opensearch-project/opensearch-neural-sparse-encoding-doc-v3-distill
Benchmarks
CQADupstackPhysicsRetrieval
Performance L4 b1 c16
Corpus TPS 33.5K
Corpus p50 58.4ms
Query TPS 4.1K
Query p50 41.1ms
CosQA
Performance L4 b1 c16
Corpus TPS 15.6K
Corpus p50 51.5ms
Query TPS 1.9K
Query p50 47.9ms
FiQA2018
Performance L4 b1 c16
Corpus TPS 40.5K
Corpus p50 59.2ms
Query TPS 4.6K
Query p50 39.5ms
LegalBenchConsumerContractsQA
Performance L4 b1 c16
Corpus TPS 97.4K
Corpus p50 76.3ms
Query TPS 6.3K
Query p50 40.7ms
NFCorpus
Quality
ndcg at 10 0.3399
map at 10 0.1314
mrr at 10 0.5457
Performance L4 b1 c16
Corpus TPS 71.1K
Corpus p50 65.9ms
Query TPS 1.9K
Query p50 41.1ms
SCIDOCS
Performance L4 b1 c16
Corpus TPS 47.1K
Corpus p50 59.3ms
Query TPS 4.4K
Query p50 39.9ms
SciFact
Performance L4 b1 c16
Corpus TPS 59.3K
Corpus p50 67.2ms
Query TPS 6.1K
Query p50 42.4ms
StackOverflowQA
Performance L4 b1 c16
Corpus TPS 53.1K
Corpus p50 62.1ms
Query TPS 97.0K
Query p50 46.1ms