Skip to content

Dequeue and Send to Triton Instances #17

@EndlessReform

Description

@EndlessReform

Summary:

Implement the logic that dequeues text from the message queue and sends it to the available Triton instances for processing.

Tasks:

Dequeue text chunks from the message queue.
Implement logic to send these text chunks to Triton instances for embedding.

Acceptance Criteria:

Dequeued text chunks are correctly sent to Triton instances and processed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions