Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Compare test run UI bug for suite with no reference #114

Closed
max-arthurai opened this issue Mar 27, 2024 · 1 comment
Closed

Compare test run UI bug for suite with no reference #114

max-arthurai opened this issue Mar 27, 2024 · 1 comment

Comments

@max-arthurai
Copy link
Contributor

The QA Correctness scorer (as well as other scorers) does not require/allow reference outputs, so I didn't include them in my test suite. But it looks like the compare test table still has a column for REFERENCE OUTPUTS even when my suite lacks them, which causes an accidental shift in all the data one column to the left:

Screenshot 2024-03-27 at 11 49 43 AM
@cheungrowan cheungrowan mentioned this issue Apr 10, 2024
Merged
@cheungrowan
Copy link
Contributor

Hi @max-arthurai thanks for opening this issue. Please see #116 for a potential fix

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@max-arthurai @cheungrowan