V2.1

This release contains:

• A collection of newly added tasks
• A new hierarchy of task types and their domains
• Lots of improvements and fixes to the existing tasks.

We will continue to publish more releases as we improve the data and add more experiments.
If you're wondering whether you can still contribute to the repo, the answer is a solid YES!

What's Changed

• Further update task domains & categories; Add Utility Scripts by @ghlai9665 in #436
• Tasks 739-742: lhoestq dataset question and answer generation by @hanut1909 in #317
• Task 829-833: giga_fren, poem_sentiment and poleval2019_mt by @abhinawale12 in #325
• Tasks 877-881: kde4, schema_guided_dstc8 Datasets by @kashyap467 in #334
• Task 934 Turk Simplification by @cosmicishan in #444
• Tasks 1499-1504 by @swarooprm in #461
• Update zest tasks by @yeganehkordi in #455
• Address human feedback by @Palipoor in #447
• Tasks600-606 by @Nikhitha0911 in #285
• corrections in the evalution task file by @atharva-naik in #460
• Tasks 1443 - 1446: Synthetic data by @kurbster in #449
• Tasks 1394-1397 by @swarooprm in #416
• Tasks 1361-1364 by @swarooprm in #410
• Tasks 1437-1442 : DoQA tasks by @kuntalkumarpal in #448
• Tasks 1356-1360 by @swarooprm in #409
• Tasks906-909 DialogRE Answer Generation by @matthew-huff in #341
• Making the error message informative by @swarooprm in #466
• Tasks 1365-1369 by @swarooprm in #411
• Second PR to Address human feedback 34, 35, 44, 45, 48, 49, 52-58, 167, 201-205 by @Palipoor in #464
• Task 1498 by @sharma121amit in #456
• Task 955 Rewrite simple English wikipedia sentences in more sophisticated English by @ghlai9665 in #354
• Task 1505: root09 lexical semantic relation classification task added by @atharva-naik in #470
• Tasks910-916: Bianet and Imppres by @mirror3 in #342
• Tasks 766-769 craigslist_bargains, qed by @ritvik7 in #321
• Tasks 917-921: CoQA Dataset, code_x_glue Dataset by @ShashankDavalgi in #343
• Task 1308-1313 Amazon review by @cosmicishan in #395
• Address human feedback- tasks 301 - 332 by @Palipoor in #469
• Update categories and domains for tasks 029 - 058 by @ghlai9665 in #459
• Address human feedback Tasks 333 - 352 by @Palipoor in #471
• Tasks 1350-1355 by @swarooprm in #408
• A script to fix unicode characters in files by @Palipoor in #473
• Tasks 1506 and 1507 (get minimal text span of dob of celebrity given bio) by @atharva-naik in #472
• Tasks 1334-1339 by @swarooprm in #405
• Tasks 1370-1377 by @swarooprm in #412
• Tasks 1378-1384 by @swarooprm in #413
• Addressing Human Feedback (Crowdworker Evaluation of Tasks) by @kuntalkumarpal in #476
• Tasks 1340-1343 by @swarooprm in #406
• Tasks 1344-1349 by @swarooprm in #407
• Task 902-905: Deceptive Opinion Spam dataset, hate_speech_offensive by @meghpatel in #340
• Task 820-826: proto_qa & peixian/rtGender by @Mda233 in #323
• Tasks 970-1086: sherliic, prachathai67k and pib by @CodeHime in #360
• Tasks 960-967 by @ssingulu in #357
• Tasks 595-599: MOCHA and CUAD Datasets by @akhilkumargudipoodi in #284
• Correcting definition for Task 078 by @kurbster in #485
• Address human feedback on tasks 374 - 392 by @Palipoor in #479
• Address human feedback, tasks 397 - 400 by @Palipoor in #480
• Task 619-624 Ohsumed abd Onestop_english datasets by @papanisaicharan in #300
• Task 636-639: multi_voz_v22 dataset by @ayushkalani in #304
• Task 645 - 648: Wiki auto and winograd dataset by @khushal1996 in #306
• Tasks 676-684: OPP-115, HopeEDI, Ollie Datasets by @sskp-kaushik in #315
• Task 757-760: msr_sqa dataset by @sarnshreya in #319
• Tasks 838-842: cdt & para_pdt Datasets by @akhileshamara in #327
• Tasks 1218-1282: TED translation task for an additional 65 language directions by @davidstap in #478
• Task 1196-1217: ATOMIC by @yeganehkordi in #390
• Tasks 857-861 by @ashutosh1608 in #331
• Tasks 872-876: opus_xhosanavy, emotion by @aklagoo in #335
• Tasks 886-889: Quail, Rotten Tomatoes and Go Emotions Dataset by @saianirud in #337
• task 868-871 SQL and MSMARCO by @ujjwalaananth in #359
• Update Hierarchy for Task 059-081 by @ghlai9665 in #474
• Task 894- 901: miam, freebase_qa by @karthikmuru in #339
• Tasks 968-969 : Xcopa by @amirrezamirzaei in #358
• Tasks 922-926:Event2Mind and Coached_Conv_Pref dataset by @yashbhokare in #344
• Tasks 929-932 by @karannaik3797 in #347
• Task 956: leetcode 420 by @DZuoShi in #355
• Task 1161-1164 Coda19 by @cosmicishan in #376
• Task 1542 by @pulkitverma25 in #500
• Task 1166-1167 PennTreeBank and Brown Corpus Parts of Speech Tags by @mishra-sid in #380
• Tasks 1168-1185 : Xcopa by @amirrezamirzaei in #386
• Tasks 1283-1284: Evaluating quality and Informativeness of System Generated Reference by @Sujan242 in #393
• Tasks 1323-1330 by @abhilashreddyy in #402
• Tasks 1407-1417: DART, ajgt_twitter_ar, and youtube_caption_corrections. by @RushangKaria in #429
• Revert "Tasks 1407-1417: DART, ajgt_twitter_ar, and youtube_caption_corrections." by @aarunku5 in #512
• Task1447-1453 and Tasks 1479-1497 Drug_Extraction by @Ishani-Mondal in #450
• 576 HW (1-5) by @aarunku5 in #513
• Task 1551 + Missing Task Numbers from Issue #482 by @pulkitverma25 in #502
• task_201_resolve by @aarunku5 in #521
• Address human feedback for tasks 400 - 420 by @Palipoor in #499
• Address feedbacks for tasks 428 - 452 by @Palipoor in #506
• Update test_all by @yeganehkordi in #427
• Added task 1431-1436 by @shreeshiv in #446
• Update domains, categories, and address human feedbacks: Task 231-260 by @yeganehkordi in #484
• Update categories, domains and addressing evaluation feedbacks for tasks 200-230 by @yeganehkordi in #463
• renamed task 1511-1514 to 1582-1585 by @atharva-naik in #527
• 576 HW Tasks (part 2) by @aarunku5 in #525
• Edited filenames for PR #429 (Tasks 1407-1417: DART, ajgt_twitter_ar, and youtube_caption_corrections). by @RushangKaria in #533
• Tasks 1578-1581 by @swarooprm in #511
• Tasks 1557-1560 by @swarooprm in #507
• Tasks 1586-1589 by @swarooprm in #515
• Tasks 1590-1594 by @swarooprm in #516
• Tasks 1595-1598 by @swarooprm in #517
• Tasks 1662-1665 by @aarunku5 in #538
• Tasks 1548-1549 by @aarunku5 in #531
• Tasks 1599-1603 by @swarooprm in #518
• Tasks 1654-1657 by @aarunku5 in #536
• Tasks 1604-1611 by @swarooprm in #519
• Tasks 1676-1678 by @aarunku5 in #541
• Tasks 1703-1706 by @aarunku5 in #547
• Task 1626 - 1631 by @AnshitaSinghBais in #529
• print contributed authors by @danyaljj in #557
• address human feedback for tasks 477 - 500 by @Palipoor in #556
• Tasks 1719-1726 by @swarooprm in #550
• update categories & domains for task 082-100 by @ghlai9665 in #520
• Tasks 1685-1692 by @aarunku5 in #543
• Tasks 1711-1714 by @aarunku5 in #549
• Tasks 1645-1653 by @aarunku5 in #535
• Tasks 1666-1670 by @aarunku5 in #539
• 1637-1640 by @aarunku5 in #532
• Tasks 1658-1661 by @aarunku5 in #537
• Tasks 1612-1625 by @aarunku5 in #528
• Address human feedback tasks 477 - 500 by @Palipoor in #558
• Address human feedback on tasks 600 - 618 by @Palipoor in #561
• Fixing Issue for 1361 by @aarunku5 in #566
• Address human feedback for tasks 630 - 672 by @Palipoor in #567
• Address feedback for tasks 664 - 700 and fix a repeated misspelling across a lot of files. by @Palipoor in #568
• Tasks 261-300: update categories, domains and addressing feedbacks by @yeganehkordi in #565
• Assigning categories for Task101-121 by @ghlai9665 in #559
• update task 122-140 by @ghlai9665 in #571
• fix xcopa_cause_effect_th by @amirrezamirzaei in #564
• Tasks 500-525: Assigning categories, domains, and addressing feedbacks by @yeganehkordi in #573
• Fixed typos Tasks 570, 571 by @aarunku5 in #590
• Fixes Issue #582. by @RushangKaria in #596
• added language tags for tasks 938-954 by @tanay2001 in #586
• Update languages for tasks 927 - 1088 and address some human feedback. by @Palipoor in #595
• Fix spacing problem for task 614 by @Palipoor in #597
• update categories & domains for task 141-160 by @ghlai9665 in #585
• Fixing issue #489. Improvements to tasks 886-889 by @kurbster in #598
• Failing tests in the main branch by @yeganehkordi in #603
• Update categories and domains for tasks 400-462 by @gkaramanolakis in #475
• Tasks 525-550: Assigning categories, domains, and addressing feedbacks by @yeganehkordi in #587
• Address feedback for tasks 1100 - 1200 by @Palipoor in #605
• fix agnews by @amirrezamirzaei in #609
• Instructions fixed and human feedback addressed in mmmlu answer generation tasks (664-667, 685-737) by @pulkitverma25 in #607
• Tasks 576-600: Assigning categories, domains and addressing feedbacks by @yeganehkordi in #600
• Drop an outlier instance from task 264 by @danyaljj in #613
• Update test_all.py test for single-output tasks by @danyaljj in #614
• Downsampling by @danyaljj in #618
• More downsampling. by @danyaljj in #620
• Tasks 1226-1282: Assigning categories, domains, and addressing feedbacks by @yeganehkordi in #608
• Downsampling skewed datasets by @danyaljj in #624
• Task226 shuffle by @Maitreyapatel in #627
• print categories and domains at end of the logs. by @danyaljj in #632
• Task 1148 ( maximum_ascii_value) : Edit Task definition to include ASCII information. by @mishra-sid in #633
• Output Language Tasks 939,941,943 by @tanay2001 in #635
• task1186_nne_hrngo_classification improvement by @Sujan242 in #634
• Fixes for Issue #583 by @CodeHime in #628

New Contributors

• @hanut1909 made their first contribution in #317
• @abhinawale12 made their first contribution in #325
• @kashyap467 made their first contribution in #334
• @Nikhitha0911 made their first contribution in #285
• @matthew-huff made their first contribution in #341
• @sharma121amit made their first contribution in #456
• @mirror3 made their first contribution in #342
• @ritvik7 made their first contribution in #321
• @ShashankDavalgi made their first contribution in #343
• @meghpatel made their first contribution in #340
• @Mda233 made their first contribution in #323
• @CodeHime made their first contribution in #360
• @ssingulu made their first contribution in #357
• @akhilkumargudipoodi made their first contribution in #284
• @papanisaicharan made their first contribution in #300
• @ayushkalani made their first contribution in #304
• @khushal1996 made their first contribution in #306
• @sskp-kaushik made their first contribution in #315
• @sarnshreya made their first contribution in #319
• @akhileshamara made their first contribution in #327
• @ashutosh1608 made their first contribution in #331
• @aklagoo made their first contribution in #335
• @saianirud made their first contribution in #337
• @ujjwalaananth made their first contribution in #359
• @karthikmuru made their first contribution in #339
• @yashbhokare made their first contribution in #344
• @karannaik3797 made their first contribution in #347
• @DZuoShi made their first contribution in #355
• @pulkitverma25 made their first contribution in #500
• @abhilashreddyy made their first contribution in #402
• @RushangKaria made their first contribution in #429
• @Ishani-Mondal made their first contribution in #450
• @shreeshiv made their first contribution in #446
• @AnshitaSinghBais made their first contribution in #529

Full Changelog: v2.0...v2.1