Skip to content

Issues: embeddings-benchmark/mteb

Merge v2.0.0: Overview issue
#1791 opened Jan 13, 2025 by KennethEnevoldsen
Open 2
Overview: Leaderboard release
#1867 opened Jan 24, 2025 by x-tabdeveloping
Open 26
MAEB Overview Issue
#2072 opened Feb 16, 2025 by isaac-chung
Open 6
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

184 Open 618 Closed
184 Open 618 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Task checking on zeroshot on leaderboard bug Something isn't working
#2130 opened Feb 21, 2025 by Samoed
2
Phonetic Word Embeddings? maeb Audio extension new dataset Issues related to adding a new task or dataset
#2126 opened Feb 21, 2025 by zouharvi
1
Release MMTEB datasets on Hugging Face
#2122 opened Feb 21, 2025 by NielsRogge
5
[v2] t2t appropriateness for Classification and clustering good first issue Good for newcomers v2 Issues and PRs related to `v2` branch
#2118 opened Feb 20, 2025 by KennethEnevoldsen
3
LB customization is difficult good first issue Good for newcomers leaderboard issues related to the leaderboard
#2104 opened Feb 19, 2025 by Muennighoff
7
Order task dropdowns good first issue Good for newcomers leaderboard issues related to the leaderboard
#2103 opened Feb 19, 2025 by Muennighoff
voyage zero-shot checkmark
#2099 opened Feb 18, 2025 by Muennighoff
1
Add tasks relations enhancement New feature or request
#2094 opened Feb 18, 2025 by Samoed
2
Create audio clustering AbsTask and Evaluator maeb Audio extension
#2093 opened Feb 18, 2025 by isaac-chung
11
Integrate mmE5 good first issue Good for newcomers mieb The image extension of MTEB new model Questions related to adding a new model to the benchmark
#2079 opened Feb 16, 2025 by Samoed
1
[v2] Merge MIEB and MTEB tasks v2 Issues and PRs related to `v2` branch
#2078 opened Feb 16, 2025 by Samoed v2.0.0
6
MAEB Overview Issue maeb Audio extension
#2072 opened Feb 16, 2025 by isaac-chung
19 tasks
6
Define an encoder interface for audio maeb Audio extension
#2071 opened Feb 16, 2025 by isaac-chung
1
Create multilabel audio classification AbsTask and Evaluator maeb Audio extension
#2070 opened Feb 16, 2025 by isaac-chung
1
Create zeroshot audio classification AbsTask and Evaluator maeb Audio extension
#2069 opened Feb 16, 2025 by isaac-chung
Create audio-text retrieval AbsTask and Evaluator maeb Audio extension
#2068 opened Feb 16, 2025 by isaac-chung
Add MAEB contribution guide/README maeb Audio extension
#2067 opened Feb 16, 2025 by isaac-chung
Create audio classification AbsTask and Evaluator maeb Audio extension
#2066 opened Feb 16, 2025 by isaac-chung
1
column_width interferes with pinned_columns in gradio leaderboard issues related to the leaderboard
#2060 opened Feb 13, 2025 by shikhar1729
Add FSD50K maeb Audio extension new dataset Issues related to adding a new task or dataset
#2056 opened Feb 13, 2025 by Muennighoff
3
Add Audio Caption maeb Audio extension new dataset Issues related to adding a new task or dataset
#2055 opened Feb 13, 2025 by Muennighoff
Add AudioCaps maeb Audio extension new dataset Issues related to adding a new task or dataset
#2054 opened Feb 13, 2025 by Muennighoff
5
Add Clotho maeb Audio extension new dataset Issues related to adding a new task or dataset
#2053 opened Feb 13, 2025 by Muennighoff
Add ESC50 maeb Audio extension new dataset Issues related to adding a new task or dataset
#2052 opened Feb 13, 2025 by Muennighoff
VGGSound maeb Audio extension new dataset Issues related to adding a new task or dataset
#2051 opened Feb 13, 2025 by Muennighoff
ProTip! Exclude everything labeled bug with -label:bug.