Initial Checks
Problem Description
The scripts used to evaluate models for GDPval-AA would be very valuable as a practical usage example of Stirrup, particularly for users who want to evaluate open models on GDPeval.
Proposed Solution
See https://artificialanalysis.ai/methodology/intelligence-benchmarking#gdpval-aa
Alternatives Considered
No response
Initial Checks
Problem Description
The scripts used to evaluate models for GDPval-AA would be very valuable as a practical usage example of Stirrup, particularly for users who want to evaluate open models on GDPeval.
Proposed Solution
See https://artificialanalysis.ai/methodology/intelligence-benchmarking#gdpval-aa
Alternatives Considered
No response