Skip to content

Implement Task Queue for Chunking #18

@EndlessReform

Description

@EndlessReform

Summary:

Set up a message queue system to hold the posts that are ready for chunking, so they can be processed asynchronously by the Triton instances.
Tasks:

Choose a message queue system (likely RabbitMQ or Redis).
Implement logic to push prepared text into the queue.

Acceptance Criteria:

A queue has been implemented and prepared text can be pushed to it.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions