naver/splade-v3
Benchmarks
CQADupstackPhysicsRetrieval
Quality
ndcg at 10 0.3639
map at 10 0.3082
mrr at 10 0.3560
Performance L4 b1 c16
Corpus TPS 20.7K
Corpus p50 73.7ms
Query TPS 3.0K
Query p50 52.9ms
CosQA
Quality
ndcg at 10 0.2045
map at 10 0.1567
mrr at 10 0.1702
Performance L4 b1 c16
Corpus TPS 9.1K
Corpus p50 62.2ms
Query TPS 1.6K
Query p50 51.3ms
FiQA2018
Quality
ndcg at 10 0.2768
map at 10 0.2113
mrr at 10 0.3451
Performance L4 b1 c16
Corpus TPS 24.5K
Corpus p50 67.6ms
Query TPS 3.3K
Query p50 51.2ms
LegalBenchConsumerContractsQA
Quality
ndcg at 10 0.7393
map at 10 0.6784
mrr at 10 0.6805
Performance L4 b1 c16
Corpus TPS 56.0K
Corpus p50 115.2ms
Query TPS 4.5K
Query p50 52.2ms
NFCorpus
Quality
ndcg at 10 0.3404
map at 10 0.1300
mrr at 10 0.5417
Performance L4 b1 c16
Corpus TPS 37.0K
Corpus p50 98.4ms
Query TPS 1.4K
Query p50 52.6ms
Performance RTX-4090 b1 c16
Corpus TPS 108.8K
Corpus p50 40.3ms
Query TPS 3.5K
Query p50 19.1ms
SCIDOCS
Quality
ndcg at 10 0.1543
map at 10 0.0878
mrr at 10 0.2686
Performance L4 b1 c16
Corpus TPS 26.2K
Corpus p50 83.4ms
Query TPS 3.0K
Query p50 53.6ms
SciFact
Quality
ndcg at 10 0.6846
map at 10 0.6371
mrr at 10 0.6524
Performance L4 b1 c16
Corpus TPS 35.8K
Corpus p50 89.7ms
Query TPS 4.5K
Query p50 52.1ms
StackOverflowQA
Quality
ndcg at 10 0.7380
map at 10 0.7057
mrr at 10 0.7057
Performance L4 b1 c16
Corpus TPS 33.0K
Corpus p50 84.0ms
Query TPS 50.8K
Query p50 91.0ms