[Chore] Task list for serve/server changes

[gh0st-ryder]

Tracking follow up from the recently PR review:

• Fix hardcoded paths {hardcoded conf path}, {example_workflows path}
• logging package: unify with E2S loguru instead of logging
• worker.py: remove too many globals
• config.py: Env overrides for config values need to be controlled
• cpu_worker.py: Legacy infer request cleanup vestiges to be eliminated
• redis_client in main.py: Re-work to use app.state for FastAPI
• status response should invoke Python; status.sh script should call this python instead
• Eliminate the dual endpoint paths
• WorkflowRegistry should be a singleton.
• Trim docker image size and clean up dockerfile as needed