prithivida/Splade_PP_en_v2
Primitive: /encode · Encode ·
BERT
Trained by Donkey Stereotype
Sparse
Overview
Hardware: — drives latency, throughput & cost
| Size | 110M params |
|---|---|
| Tasks | /encode |
| License | apache-2.0 |
| Languages | en |
| Latency | 55 ms |
| Throughput | 57.5K tok/s |
| Cost | $0.0039 /1M tok |
Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.
Embedding
| Output types | Sparse |
|---|---|
| Dimensions | sparse: 30,522 |
| Max sequence length | 512 |
| Inputs | text |
Benchmarks
CQADupstackPhysicsRetrieval
Duplicate question retrieval from StackExchange Physics
Corpus: 38,314 Queries: 1,039
Performance L4 b1 c16
Corpus 36.1K tok/s
Corpus p50 53.3ms
Query 3.5K tok/s
Query p50 48.4ms
CosQA
Code search with natural language queries
Corpus: 6,267 Queries: 500
Quality
map at 10 0.1365
mrr at 10 0.1527
ndcg at 10 0.1769
Performance L4 b1 c16
Corpus 15.6K tok/s
Corpus p50 54.1ms
Query 1.8K tok/s
Query p50 48.1ms
FiQA2018
Financial opinion mining and question answering
Corpus: 57,599 Queries: 648
Quality
map at 10 0.2414
mrr at 10 0.3751
ndcg at 10 0.3110
Performance L4 b1 c16
Corpus 41.4K tok/s
Corpus p50 56.1ms
Query 3.4K tok/s
Query p50 52.4ms
LegalBenchConsumerContractsQA
Question answering on consumer contracts
Corpus: 153 Queries: 396
Quality
map at 10 0.5290
mrr at 10 0.5290
ndcg at 10 0.5926
Performance L4 b1 c16
Corpus 122.4K tok/s
Corpus p50 54.9ms
Query 5.4K tok/s
Query p50 47.5ms
NFCorpus
Biomedical literature search from NutritionFacts.org
Corpus: 3,593 Queries: 323
Quality
ndcg at 10 0.3306
map at 10 0.1261
mrr at 10 0.5453
Performance L4 b1 c16
Corpus 123.4K tok/s
Corpus p50 28.4ms
Query 2.4K tok/s
Query p50 27.0ms
SCIDOCS
Citation prediction, document classification, and recommendation for scientific papers
Corpus: 25,656 Queries: 1,000
Performance L4 b1 c16
Corpus 49.8K tok/s
Corpus p50 55.8ms
Query 3.7K tok/s
Query p50 47.4ms
SciFact
Scientific claim verification using research literature
Corpus: 5,183 Queries: 300
Quality
map at 10 0.5733
mrr at 10 0.5884
ndcg at 10 0.6229
Performance L4 b1 c16
Corpus 68.5K tok/s
Corpus p50 56.9ms
Query 5.0K tok/s
Query p50 52.2ms
StackOverflowQA
Programming question answering from Stack Overflow
Corpus: 19,931 Queries: 1,994
Quality
map at 10 0.5716
mrr at 10 0.5716
ndcg at 10 0.6070
Performance L4 b1 c16
Corpus 65.1K tok/s
Corpus p50 53.6ms
Query 84.7K tok/s
Query p50 54.7ms
Compare (0)Compare →