Skip to content

Issues: embeddings-benchmark/mteb

Merge v2.0.0: Overview issue
#1791 opened Jan 13, 2025 by KennethEnevoldsen
Open 2
Overview: Leaderboard release
#1867 opened Jan 24, 2025 by x-tabdeveloping
Open 26
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

179 Open 572 Closed
179 Open 572 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add https://huggingface.co/codesage/codesage-large-v2
#2020 opened Feb 7, 2025 by Muennighoff
Add SFR-Embedding-Code-2B_R
#2019 opened Feb 7, 2025 by Muennighoff
[v2] Refactior task specific scores v2 Issues and PRs related to `v2` branch
#2016 opened Feb 7, 2025 by Samoed v2.0.0
Validate language codes for ModelMeta Languages
#2013 opened Feb 7, 2025 by KennethEnevoldsen
CI: Seperate out tests that fail due to HTTP calls
#2012 opened Feb 7, 2025 by KennethEnevoldsen
4
Clicking model names does not open new window leaderboard issues related to the leaderboard
#2005 opened Feb 7, 2025 by Muennighoff
3
Clarify ModelMeta and what things mean
#2002 opened Feb 7, 2025 by Muennighoff
2
Rename MTEB(eng) & MTEB(eng,classic) leaderboard issues related to the leaderboard
#2001 opened Feb 6, 2025 by Muennighoff
2
Add GTR models good first issue Good for newcomers leaderboard issues related to the leaderboard new model Questions related to adding a new model to the benchmark
#2000 opened Feb 6, 2025 by Muennighoff
Add FRIDA models good first issue Good for newcomers new model Questions related to adding a new model to the benchmark
#1999 opened Feb 6, 2025 by Muennighoff
Add sentence-t5 models good first issue Good for newcomers leaderboard issues related to the leaderboard new model Questions related to adding a new model to the benchmark
#1998 opened Feb 6, 2025 by Muennighoff
2
Add SGPT models good first issue Good for newcomers new model Questions related to adding a new model to the benchmark
#1997 opened Feb 6, 2025 by Muennighoff
Add instructor models good first issue Good for newcomers new model Questions related to adding a new model to the benchmark
#1996 opened Feb 6, 2025 by Muennighoff
Leaderboard: Gradio Sidebars for better UI enhancement New feature or request leaderboard issues related to the leaderboard
#1988 opened Feb 5, 2025 by Muennighoff
2
Leaderboard: FAQ md file on transition leaderboard issues related to the leaderboard
#1987 opened Feb 5, 2025 by Muennighoff
@KennethEnevoldsen
Leaderboard: Add more explainers leaderboard issues related to the leaderboard
#1986 opened Feb 5, 2025 by Muennighoff
5
Rename MTEB(Retrieval w/Instructions) to followIR
#1982 opened Feb 5, 2025 by Muennighoff
4
SONAR results gone / Add SONAR implementation leaderboard issues related to the leaderboard
#1981 opened Feb 5, 2025 by Muennighoff
@KennethEnevoldsen
8
Leaderboard: CoIR seems broken leaderboard issues related to the leaderboard
#1980 opened Feb 5, 2025 by Muennighoff
1
Leaderboard: voyage-law gone leaderboard issues related to the leaderboard
#1979 opened Feb 5, 2025 by Muennighoff
3
Leaderboard: BRIGHT Long gone leaderboard issues related to the leaderboard
#1978 opened Feb 5, 2025 by Muennighoff
Leaderboard: Many results on BRIGHT missing leaderboard issues related to the leaderboard
#1977 opened Feb 5, 2025 by Muennighoff
Leaderboard: OpenAI results gone? leaderboard issues related to the leaderboard
#1976 opened Feb 5, 2025 by Muennighoff
[v2] MIEB classes with duplicate names v2 Issues and PRs related to `v2` branch
#1974 opened Feb 5, 2025 by Samoed
2
Reduce load time for the leaderboard enhancement New feature or request leaderboard issues related to the leaderboard
#1972 opened Feb 5, 2025 by KennethEnevoldsen
2 tasks
4
ProTip! Type g i on any issue or pull request to go back to the issue listing page.