Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to evaluate your model? #7

Open
Songweiping opened this issue Oct 14, 2019 · 5 comments
Open

How to evaluate your model? #7

Songweiping opened this issue Oct 14, 2019 · 5 comments

Comments

@Songweiping
Copy link

Dear authors,

Thanks for sharing the code and data. But I didn't find the code for evaluation. Could you also provide that code so that we can reproduce the results in paper quickly?

@bbjy
Copy link

bbjy commented Feb 7, 2020

Hi, @Songweiping, have you reproduced the results in paper? I evaluated it by myself, but the result is lower than the results in this paper. So, if you reproduced the results, could you share the experimence with me? Thank you so much!
Moreover, I also hope the authors can share the code for evaluation so that we can reproduce the results in paper. Thank you! @hoyeoplee

@VVinayak
Copy link

@bbjy @hoyeoplee please share any evaluation code you have written so that others can compare

@Songweiping
Copy link
Author

@bbjy I didn't try it myself, still waiting for official codes from authors.

@waterhorse1
Copy link

Hi, @Songweiping, have you reproduced the results in paper? I evaluated it by myself, but the result is lower than the results in this paper. So, if you reproduced the results, could you share the experimence with me? Thank you so much!
Moreover, I also hope the authors can share the code for evaluation so that we can reproduce the results in paper. Thank you! @hoyeoplee

I have reproduced the result of the paper(even better) in https://github.com/waterhorse1/MELU_pytorch

@non-knife
Copy link

Hi, @Songweiping, have you reproduced the results in paper? I evaluated it by myself, but the result is lower than the results in this paper. So, if you reproduced the results, could you share the experimence with me? Thank you so much!
Moreover, I also hope the authors can share the code for evaluation so that we can reproduce the results in paper. Thank you! @hoyeoplee

I have reproduced the result of the paper(even better) in https://github.com/waterhorse1/MELU_pytorch

Hello, may I ask how can you print this performance indicator to the console?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants