Why did we open-source our inference engine? Read the post

← Catalog

naver/splade-v3

Open comparison →

Primitive: /encode · Encode · BERT

This checkpoint corresponds to a model that starts from SPLADE++SelfDistil (`naver/splade-cocondenser-selfdistil`), and is trained with a mix of KL-Div and MarginMSE, with 8 negatives per query sampled from SPLADE++SelfDistil. We used the original MS MARCO collection without the titles.

Sparse

Overview

Hardware: — drives latency, throughput & cost

Size110M params
Tasks /encode
Licensecc-by-nc-sa-4.0
Languagesen
Latency84 ms
Throughput29.6K tok/s
Cost$0.0075 /1M tok

Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.

Embedding

Output typesSparse
Dimensionssparse: 30,522
Max sequence length512
Inputstext

Benchmarks

CQADupstackPhysicsRetrieval

scientific retrieval en

Duplicate question retrieval from StackExchange Physics

Corpus: 38,314 Queries: 1,039
Quality
ndcg at 10 0.3763
map at 10 0.3227
mrr at 10 0.3713
Performance L4 b1 c16
Corpus 20.7K tok/s
Corpus p50 73.7ms
Query 3.0K tok/s
Query p50 52.9ms
Reference →

CosQA

technology retrieval en

Code search with natural language queries

Corpus: 6,267 Queries: 500
Quality
ndcg at 10 0.2202
map at 10 0.1649
mrr at 10 0.1734
Performance L4 b1 c16
Corpus 9.1K tok/s
Corpus p50 62.2ms
Query 1.6K tok/s
Query p50 51.3ms
Reference →

FiQA2018

finance retrieval en

Financial opinion mining and question answering

Corpus: 57,599 Queries: 648
Quality
ndcg at 10 0.3801
map at 10 0.3057
mrr at 10 0.4596
Performance L4 b1 c16
Corpus 24.5K tok/s
Corpus p50 67.6ms
Query 3.3K tok/s
Query p50 51.2ms
Reference →

LegalBenchConsumerContractsQA

legal retrieval en

Question answering on consumer contracts

Corpus: 153 Queries: 396
Quality
ndcg at 10 0.7942
map at 10 0.7440
mrr at 10 0.7466
Performance L4 b1 c16
Corpus 56.0K tok/s
Corpus p50 115.2ms
Query 4.5K tok/s
Query p50 52.2ms
Reference →

NFCorpus

medical retrieval en

Biomedical literature search from NutritionFacts.org

Corpus: 3,593 Queries: 323
Quality
ndcg at 10 0.3632
map at 10 0.1421
mrr at 10 0.5723
Performance L4 b1 c16
Corpus 37.0K tok/s
Corpus p50 98.4ms
Query 1.4K tok/s
Query p50 52.6ms
Performance RTX-4090 b1 c16
Corpus 108.8K tok/s
Corpus p50 40.3ms
Query 3.5K tok/s
Query p50 19.1ms
Reference →

SCIDOCS

scientific retrieval en

Citation prediction, document classification, and recommendation for scientific papers

Corpus: 25,656 Queries: 1,000
Quality
ndcg at 10 0.1562
map at 10 0.0911
mrr at 10 0.2740
Performance L4 b1 c16
Corpus 26.2K tok/s
Corpus p50 83.4ms
Query 3.0K tok/s
Query p50 53.6ms
Reference →

SciFact

scientific retrieval en

Scientific claim verification using research literature

Corpus: 5,183 Queries: 300
Quality
ndcg at 10 0.7169
map at 10 0.6742
mrr at 10 0.6904
Performance L4 b1 c16
Corpus 35.8K tok/s
Corpus p50 89.7ms
Query 4.5K tok/s
Query p50 52.1ms
Reference →

StackOverflowQA

technology retrieval en

Programming question answering from Stack Overflow

Corpus: 19,931 Queries: 1,994
Quality
ndcg at 10 0.6384
map at 10 0.6139
mrr at 10 0.6140
Performance L4 b1 c16
Corpus 33.0K tok/s
Corpus p50 84.0ms
Query 50.8K tok/s
Query p50 91.0ms
Reference →

Open source inference for agents

Open-source inference for the models behind your agents. Run it yourself, or let us run it for you.

Github 2.8K

Contact us

Tell us about your use case and we'll get back to you shortly.

Apply for an inference grant

Free capacity on our hosted cluster for selected projects. Tell us what you run and we reply by email.