Salesforce/SFR-Embedding-2_R
Primitive: /encode · Encode ·
Mistral
Salesforce/SFR-Embedding-2_R
Long contextDense
Overview
Hardware: — drives latency, throughput & cost
| Size | 7.1B params |
|---|---|
| Tasks | /encode |
| License | cc-by-nc-4.0 |
| Languages | en |
| Latency | 865 ms |
| Throughput | 3.0K tok/s |
| Cost | $0.075 /1M tok |
Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.
Embedding
| Output types | Dense |
|---|---|
| Dimensions | dense: 4,096 |
| Max sequence length | 32,768 |
| Inputs | text |
Benchmarks
CQADupstackPhysicsRetrieval
Duplicate question retrieval from StackExchange Physics
Corpus: 38,314 Queries: 1,039
Quality
ndcg at 10 0.5257
map at 10 0.4585
mrr at 10 0.5103
CosQA
Code search with natural language queries
Corpus: 6,267 Queries: 500
Quality
ndcg at 10 0.2965
map at 10 0.2287
mrr at 10 0.2319
FiQA2018
Financial opinion mining and question answering
Corpus: 57,599 Queries: 648
Quality
ndcg at 10 0.6204
map at 10 0.5384
mrr at 10 0.6880
LegalBenchConsumerContractsQA
Question answering on consumer contracts
Corpus: 153 Queries: 396
Quality
ndcg at 10 0.7830
map at 10 0.7269
mrr at 10 0.7269
NFCorpus
Biomedical literature search from NutritionFacts.org
Corpus: 3,593 Queries: 323
Quality
ndcg at 10 0.4142
map at 10 0.1587
mrr at 10 0.6177
Performance L4 b1 c16
Corpus 3.0K tok/s
Corpus p50 1.0s
Query 210 tok/s
Query p50 260.3ms
NanoFiQA2018Retrieval
Smaller subset of the FiQA financial QA dataset
Quality
ndcg at 10 0.6468
map at 10 0.5714
mrr at 10 0.6532
Performance L4 b1 c16
Corpus 2.9K tok/s
Corpus p50 682.5ms
Query 457 tok/s
Query p50 238.4ms
SCIDOCS
Citation prediction, document classification, and recommendation for scientific papers
Corpus: 25,656 Queries: 1,000
Quality
ndcg at 10 0.2488
map at 10 0.1515
mrr at 10 0.4078
SciFact
Scientific claim verification using research literature
Corpus: 5,183 Queries: 300
Quality
ndcg at 10 0.8564
map at 10 0.8177
mrr at 10 0.8270
StackOverflowQA
Programming question answering from Stack Overflow
Corpus: 19,931 Queries: 1,994
Quality
ndcg at 10 0.9407
map at 10 0.9289
mrr at 10 0.9289
Compare (0)Compare →