Is it possible to run Freon for docker-compose cluster on another machine? If possible, how?

[juncevich]

I have personal computer with ozone ha docker compose cluster. I have laptop. I want to run perf testing without affecting Ozone cluster. Run Freon from laptop. How can I do that?

[kerneltime]

cc @nilotpalnandi @arunsarin85

[errose28]

Docker compose is designed to run completely in one machine for testing purposes, so it is probably not the best tool to use for this.

The biggest issue I see is going to be having the client locate the datanodes. When a client gets replica information from the OM, it will be using datanode hostnames that are relevant inside the compose network only. Even with some port forwarding and DNS hacking there will be the issue that each datanode container would need to use the same port number for data transfer, and those would need to be forwarded outside the container for external network access. This would result in a port conflict since they are all on the same host machine. Similar issues would exist for OM and SCM in HA as well.

Perhaps another solution like kubernetes would be better suited for this task, since its network virtualization could likely handle multiple processes with identical port requirements running on the same host.

[juncevich]

Thank you for your answer. I don't understand how I can run Freon outside of the Ozone cluster. I have the source code in the Ozone project, but how is it possible to convert the source code to a runnable application? I mean, how do I package Freon into an executable artefact, and which configuration files should I use to set up Freon to load separate cluster?

[juncevich]

Instead of Freon I used another perf loader in docker compose cluster.

https://github.com/unisonteam/fs-perf-loader