You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I was trying to check for MMLU COT 0 shot configuration. But since there is no configuration available for that I went ahead with mmlu_flan_cot_zeroshot. But this is giving really less accuracy ranging between 28-33%. But the data published by HuggingFace is 73.0% for llama 3.18B. I tried to update the prompts still no improvements. Can anyone please help with the MMLU COT configuration.
The text was updated successfully, but these errors were encountered:
I was trying to check for MMLU COT 0 shot configuration. But since there is no configuration available for that I went ahead with mmlu_flan_cot_zeroshot. But this is giving really less accuracy ranging between 28-33%. But the data published by HuggingFace is 73.0% for llama 3.18B. I tried to update the prompts still no improvements. Can anyone please help with the MMLU COT configuration.
The text was updated successfully, but these errors were encountered: