Skip to content

ENH: GDPval as an example #8

Description

@RicardoDominguez

Initial Checks

  • I have searched the existing issues and this feature has not been requested

Problem Description

The scripts used to evaluate models for GDPval-AA would be very valuable as a practical usage example of Stirrup, particularly for users who want to evaluate open models on GDPeval.

Proposed Solution

See https://artificialanalysis.ai/methodology/intelligence-benchmarking#gdpval-aa

Alternatives Considered

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions