Skip to content

Support for golden tasks
Compare
Choose a tag to compare
@thiippal thiippal released this 02 Dec 11:37
· 153 commits to main since this release
0.1.8
1b2718e
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

This release adds support for golden tasks.

A demo can be found under examples/gold_demo.py.

Essentially, golden tasks are defined in the YAML configuration under the key data/gold, which should contain key/value pairs for output columns and the columns that contain the golden answers in the TSV file.

To exemplify, if you have golden answers for the output named result, which are stored in a column with the header gold in the TSV file, the key/value pair result: gold.

Assets 2
Loading