vidore/colqwen2.5-v0.2
Benchmarks
Vidore3ComputerScienceRetrieval
Quality
ndcg at 10 0.7680
map at 10 0.6543
mrr at 10 0.8726
Performance L4 b1 c4
Corpus TPS 2
Corpus p50 1.9s
Query TPS 139
Query p50 527.1ms
Vidore3FinanceEnRetrieval
Quality
ndcg at 10 0.6207
map at 10 0.5008
mrr at 10 0.7416
Performance L4 b1 c4
Corpus TPS 2
Corpus p50 1.9s
Query TPS 150
Query p50 547.2ms
Vidore3HrRetrieval
Quality
ndcg at 10 0.6034
map at 10 0.4666
mrr at 10 0.7046
Performance L4 b1 c4
Corpus TPS 2
Corpus p50 2.0s
Query TPS 110
Query p50 769.7ms
Vidore3PharmaceuticalsRetrieval
Quality
ndcg at 10 0.6274
map at 10 0.5173
mrr at 10 0.7234
Performance L4 b1 c4
Corpus TPS 2
Corpus p50 1.9s
Query TPS 138
Query p50 565.3ms