Cannot run pulsar using Docker-compose in Github Actions

[longquanzheng]

I started with this: https://pulsar.apache.org/docs/next/getting-started-docker-compose/

It works perfectly fine locally, but keep error in GitHub action :

dependency failed to start: container zookeeper has no healthcheck configured
Error: Process completed with exit code 1.

superdurable/dex#15

I have tried my best to tweak the timeout/retry/memory and even tried to remove the healthcheck, still cannot get it running.

Is it consuming too much resources so that Github actions cannot run well?

Any help is appreciated.

[Technoboy-]

Can you keep only the zk part and then try to start it? Use docker-compose -f compose.yaml logs -f to check the log.

[longquanzheng]

Hi Jiwei, thanks for the response.
The problem only exists in Github action. Running it locally is fine.

You made a good point for debugging.
I dump the docker logs in GH action and see the errors:

  2023-09-28T02:07:30,311+0000 [PurgeTask] ERROR org.apache.zookeeper.server.DatadirCleanupManager - Error occurred while purging.
  org.apache.zookeeper.server.persistence.FileTxnSnapLog$DatadirException: Unable to create data directory data/zookeeper/version-2
  	at org.apache.zookeeper.server.persistence.FileTxnSnapLog.<init>(FileTxnSnapLog.java:136) ~[org.apache.zookeeper-zookeeper-3.8.1.jar:3.8.1]
  	at org.apache.zookeeper.server.PurgeTxnLog.purge(PurgeTxnLog.java:80) ~[org.apache.zookeeper-zookeeper-3.8.1.jar:3.8.1]
  	at org.apache.zookeeper.server.DatadirCleanupManager$PurgeTask.run(DatadirCleanupManager.java:141) ~[org.apache.zookeeper-zookeeper-3.8.1.jar:3.8.1]
  	at java.util.TimerThread.mainLoop(Timer.java:566) ~[?:?]
  	at java.util.TimerThread.run(Timer.java:516) ~[?:?]

[longquanzheng]

Still got error after creating the folders manually:
https://github.com/xdblab/xdb/actions/runs/6333736402/job/17202274935?pr=19

  2023-09-28T02:15:39,401+0000 [PurgeTask] ERROR org.apache.zookeeper.server.DatadirCleanupManager - Error occurred while purging.
  org.apache.zookeeper.server.persistence.FileTxnSnapLog$DatadirException: Cannot write to data directory data/zookeeper/version-2
  	at org.apache.zookeeper.server.persistence.FileTxnSnapLog.<init>(FileTxnSnapLog.java:140) ~[org.apache.zookeeper-zookeeper-3.8.1.jar:3.8.1]
  	at org.apache.zookeeper.server.PurgeTxnLog.purge(PurgeTxnLog.java:80) ~[org.apache.zookeeper-zookeeper-3.8.1.jar:3.8.1]
  	at org.apache.zookeeper.server.DatadirCleanupManager$PurgeTask.run(DatadirCleanupManager.java:141) ~[org.apache.zookeeper-zookeeper-3.8.1.jar:3.8.1]
  	at java.util.TimerThread.mainLoop(Timer.java:566) ~[?:?]
  	at java.util.TimerThread.run(Timer.java:516) ~[?:?]

Looks like there is some permission issues

[longquanzheng]

Ohh I figured it out...I just need to remove the mount config: superdurable/dex#20

Thanks

[eolivelli]

Why can't you use pulsar standalone? It is light weight

[longquanzheng]

Ahh I didn’t know that. I will switch to standalone now. Thanks