-
Notifications
You must be signed in to change notification settings - Fork 52
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to evaluate your model? #7
Comments
Hi, @Songweiping, have you reproduced the results in paper? I evaluated it by myself, but the result is lower than the results in this paper. So, if you reproduced the results, could you share the experimence with me? Thank you so much! |
@bbjy @hoyeoplee please share any evaluation code you have written so that others can compare |
@bbjy I didn't try it myself, still waiting for official codes from authors. |
I have reproduced the result of the paper(even better) in https://github.com/waterhorse1/MELU_pytorch |
Hello, may I ask how can you print this performance indicator to the console? |
Dear authors,
Thanks for sharing the code and data. But I didn't find the code for evaluation. Could you also provide that code so that we can reproduce the results in paper quickly?
The text was updated successfully, but these errors were encountered: