lightonai/Reason-ModernColBERT (Score)
Reason-ModernColBERT is a late interaction model trained on the reasonir-hq dataset. It achieves extremely competitive performance on the BRIGHT benchmark aimed at evaluating reasoning-intensive retrieval performance, outperforming all existing models up to 7B (more than 45 times its size) and ev...
Overview
Benchmarks
AskUbuntuDupQuestions
Duplicate question detection from AskUbuntu
Corpus: 6,743 Queries: 360
Quality
ndcg at 10 0.6520
map at 10 0.4972
mrr at 10 0.7335
CMedQAv1-reranking
Quality
ndcg at 10 0.4245
map at 10 0.3554
mrr at 10 0.4450
CMedQAv2-reranking
Quality
ndcg at 10 0.4482
map at 10 0.3825
mrr at 10 0.4718
MMarcoReranking
Multilingual MARCO passage reranking (Chinese)
Quality
ndcg at 10 0.1861
map at 10 0.1491
mrr at 10 0.1551