You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
chore: improvements to command line arguments (#781)
# Motivation
Makes `run_eval` command require explicit arguments
# Content
<!-- Please include a summary of the change -->
# Testing
<!-- How was the change tested? -->
# Please check the following before marking your PR as ready for review
- [ ] I have added tests for my changes
- [ ] I have updated the documentation or added new documentation as
needed
@click.option("--length", help="The number of examples to process.", type=int, default=10)
357
+
@click.option("--use-existing-preds", help="The run ID of the existing predictions to use.", type=str, default=None)
358
+
@click.option("--length", help="The number of examples to process.", type=int, default=None)
359
359
@click.option("--instance-id", help="The instance ID of the example to process.", type=str, default=None)
360
360
@click.option("--local", help="Run the evaluation locally.", is_flag=True, default=False)
361
361
@click.option("--repo", help="The repo to use.", type=str, default=None)
362
362
@click.option(
363
363
"--num-workers", help="The number of workers to use. This is the number of examples that will be processed concurrently. A large number may lead to rate limiting issues.", type=int, default=5
364
364
)
365
365
@click.option("--model", help="The model to use.", type=str, default="claude-3-7-sonnet-latest")
0 commit comments