Skip to content

Redesign similarity matching against previous jobs to ensure random job outputs#204

Open
danXyu wants to merge 5 commits intomainfrom
dxy-much-better-fix-for-ensuring-randomness-in-job-output
Open

Redesign similarity matching against previous jobs to ensure random job outputs#204
danXyu wants to merge 5 commits intomainfrom
dxy-much-better-fix-for-ensuring-randomness-in-job-output

Conversation

@danXyu
Copy link
Copy Markdown
Collaborator

@danXyu danXyu commented Oct 13, 2025

  • Delved deep into how we can generate random job outputs / ensure shceduld jobs don't always produce the exact same outputs. The reason is quite complex but basically for really simple prompts like Tell me a joke LLMs will default to the most popular jokes rather consistently.
  • Fixed this by generating randomness and tuning the LLM parameters as much as possible.
  • For scheduled jobs, the problem is actually easier to solve and the issue before was we weren't properly passing in the previously generated outputs.

@vercel
Copy link
Copy Markdown

vercel bot commented Oct 13, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
freeaixyz Ready Ready Preview Comment Nov 3, 2025 7:45pm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant