Skip to content

✨ feat(orchestration): implement task-count-based priority scheduling#42

Merged
bglar merged 3 commits intomainfrom
feat-update-task-priorities
Apr 10, 2026
Merged

✨ feat(orchestration): implement task-count-based priority scheduling#42
bglar merged 3 commits intomainfrom
feat-update-task-priorities

Conversation

@bglar
Copy link
Copy Markdown
Contributor

@bglar bglar commented Apr 9, 2026

Summary

Implement task-count-based priority scheduling

  • Add dynamic priority assignment in inference-planner based on task count
    • Priority 4 (high): ≤5 tasks
    • Priority 5 (medium): 6-15 tasks
    • Priority 6 (low): >15 tasks
  • Update grab_new_task to use ASC ordering for priority field (1=highest, 10=lowest)
  • Ensures small inferences get faster turnaround while maintaining fairness

Related Issue (optional)

How to test this PR?

  • Tested locally in Lima
  • Tested in github actions in:

Screenshots / Logs (optional)

Checklist

  • This PR targets the main branch
  • I have added or updated relevant docs.
  • I have not included any secrets or credentials.
  • Linting and formatting checks pass.

@bglar bglar force-pushed the feat-update-task-priorities branch from 9432f07 to ff9683e Compare April 9, 2026 13:31
- Add dynamic priority assignment in inference-planner based on task count
  - Priority 4 (high): ≤5 tasks
  - Priority 5 (medium): 6-15 tasks
  - Priority 6 (low): >15 tasks
- Update grab_new_task to use ASC ordering for priority field (1=highest, 10=lowest)
- Ensures small inferences get faster turnaround while maintaining fairness

Signed-off-by: Brian Glar <bogolla4@gmail.com>
@bglar bglar force-pushed the feat-update-task-priorities branch from ff9683e to 86cbe00 Compare April 9, 2026 14:18
- Check if BASE_SHA exists before using git rev-list
- Fall back to checking HEAD commit only if base doesn't exist
- Prevents 'Invalid revision range' error after force pushes
Copy link
Copy Markdown
Contributor

@cwachira cwachira left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@bglar bglar enabled auto-merge April 10, 2026 06:41
@bglar bglar merged commit bf75af4 into main Apr 10, 2026
2 checks passed
@bglar bglar deleted the feat-update-task-priorities branch April 10, 2026 07:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants