Skip to content

Core service scaling: separate RQ workers #3101

@olevski

Description

@olevski

From #3094

Dealing with the RQ workers:

  • Should we separate out the normal workers with their own ephemeral cache for background jobs and a common queue?
  • Some queues need to be local to each service (those clean up the local cache after ~30 minutes and also clean up the uploaded file cache)
  • if we decide to do the above in a follow-up, we need at least separate redis queues per core-service instance so they don't interfere with each other

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    Ready

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions