[DISCUSS] proposal: APISIX support Pulsar service plugin

[wang-yeliang]

Hi, community,

My name is Yeliang Wang, and I am Apache APISIX Committer.

At present, Apache APISIX supports Kafka in real-time log processing (https://apisix.apache.org/docs/apisix/plugins/kafka-logger/ ) ,and RocketMQ has also submitted PR to support APISIX (https://github.com/apache/apisix/pull/5653)

but, in many enterprises I met, Apache Pulsar is used in both transaction and log scenarios.

As a distributed message middleware, Apache Pulsar has a very important position and a large user base in China, It also has a good cooperative relationship with APISIX community.

Therefore, I suggest that Pulsar contribute relevant plug-ins to APISIX, which can not only meet the diversified needs of users, so enrich the surrounding ecology of Pulsar.

This is my suggestion.
Developers are welcome.

Thanks.

[ericsyh]

I also take some attention on this point and I think the current challenge for Pulsar is lacking of the Lua client library like lua-resty-kafka for Kafka and lua-resty-rocketmq for RocketMQ.

Maybe another solution is to leverage the Plugin Runner in APISIX which supports Java/Go/Python and Pulsar has related client libraries for all of them.

[wang-yeliang]

Maybe I missed the information before. Who developed lua-resty-kafka <https://github.com/doujiang24/lua-resty-kafka> for Kafka? Eric Shen ***@***.***> 于2021年12月8日周三 20:53写道：

…

I also take some attention on this point and I think the current challenge for Pulsar is lacking of the Lua client library unlike lua-resty-kafka <https://github.com/doujiang24/lua-resty-kafka> for Kafka and lua-resty-rocketmq <https://github.com/yuz10/lua-resty-rocketmq> for RocketMQ. Maybe another solution is to leverage the Plugin Runner <https://apisix.apache.org/docs/java-plugin-runner/development/> in APISIX which supports Java/Go/Python and Pulsar has related client libraries for all of them. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#13158 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEXXFGOF23JPETCYZRQ5WS3UP5ILHANCNFSM5JQFXVQQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

[ericsyh]

After a brief discuss with @wang-yeliang and @jiazhai, it'll be better to develop the APISIX plugin with native Lua cause of the performance and usability than using the Plugin Runner.

So this issue will be breakdown into:

• Lua Pulsar Library: like lua-resty-kafka and lua-resty-rocketmq.
• APISIX Pulsar Plugin: like kafka-logger and rocketmq-logger.

Any other thoughts are all open to discuss and really welcome anyone wants to help on this issue.

[zambardus]

Hi @ericsyh I was also looking for a Lua-Pulsar Library.. Is it available now?

[wang-yeliang]

We are looking forward to the development of pulsar community friends Lua Pulsar Library and APISIX Pulsar Plugin. Let's enrich the surrounding ecology of Aapche Pulsar. Eric Shen ***@***.***> 于2021年12月15日周三 10:36写道：

…

After a brief discuss with @wang-yeliang <https://github.com/wang-yeliang> and @jiazhai <https://github.com/jiazhai>, it'll be better to develop the APISIX plugin with native Lua cause of the performance and usability than using the Plugin Runner <https://apisix.apache.org/docs/java-plugin-runner/development/>. So this issue will be breakdown into: - Lua Pulsar Library: like lua-resty-kafka <https://github.com/doujiang24/lua-resty-kafka> and lua-resty-rocketmq <https://github.com/yuz10/lua-resty-rocketmq>. - APISIX Pulsar Plugin: like kafka-logger <https://github.com/apache/apisix/blob/master/apisix/plugins/kafka-logger.lua> and rocketmq-logger <https://github.com/apache/apisix/blob/master/apisix/plugins/rocketmq-logger.lua> . Any other thoughts are all open to discuss and really welcome anyone wants to help on this issue. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#13158 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEXXFGKZJN34KI4HLULZ5LLUQ75K3ANCNFSM5JQFXVQQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

[github-actions[bot]]

The issue had no activity for 30 days, mark with Stale label.

[github-actions[bot]]

The issue had no activity for 30 days, mark with Stale label.