Linq-AI-Research/Linq-Embed-Mistral
Primitive: /encode · Encode ·
Mistral
Linq-AI-Research/Linq-Embed-Mistral
Long contextDense
Overview
Hardware: — drives latency, throughput & cost
| Size | 7.1B params |
|---|---|
| Tasks | /encode |
| License | cc-by-nc-4.0 |
| Languages | en |
| Latency | 818 ms |
| Throughput | 2.9K tok/s |
| Cost | $0.075 /1M tok |
Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.
Embedding
| Output types | Dense |
|---|---|
| Dimensions | dense: 4,096 |
| Max sequence length | 32,768 |
| Inputs | text |
Benchmarks
CQADupstackPhysicsRetrieval
Duplicate question retrieval from StackExchange Physics
Corpus: 38,314 Queries: 1,039
Quality
ndcg at 10 0.4989
map at 10 0.4345
mrr at 10 0.4896
CosQA
Code search with natural language queries
Corpus: 6,267 Queries: 500
Quality
ndcg at 10 0.3279
map at 10 0.2568
mrr at 10 0.2554
FiQA2018
Financial opinion mining and question answering
Corpus: 57,599 Queries: 648
Quality
ndcg at 10 0.6135
map at 10 0.5329
mrr at 10 0.6923
LegalBenchConsumerContractsQA
Question answering on consumer contracts
Corpus: 153 Queries: 396
Quality
ndcg at 10 0.7966
map at 10 0.7467
mrr at 10 0.7467
NFCorpus
Biomedical literature search from NutritionFacts.org
Corpus: 3,593 Queries: 323
Quality
ndcg at 10 0.4192
map at 10 0.1653
mrr at 10 0.6439
Performance L4 b1 c16
Corpus 3.0K tok/s
Corpus p50 968.2ms
Query 210 tok/s
Query p50 231.6ms
NanoFiQA2018Retrieval
Smaller subset of the FiQA financial QA dataset
Quality
ndcg at 10 0.6402
map at 10 0.5716
mrr at 10 0.6722
Performance L4 b1 c16
Corpus 2.9K tok/s
Corpus p50 667.7ms
Query 459 tok/s
Query p50 259.6ms
SCIDOCS
Citation prediction, document classification, and recommendation for scientific papers
Corpus: 25,656 Queries: 1,000
Quality
ndcg at 10 0.2203
map at 10 0.1315
mrr at 10 0.3650
SciFact
Scientific claim verification using research literature
Corpus: 5,183 Queries: 300
Quality
ndcg at 10 0.7853
map at 10 0.7402
mrr at 10 0.7502
StackOverflowQA
Programming question answering from Stack Overflow
Corpus: 19,931 Queries: 1,994
Quality
ndcg at 10 0.9438
map at 10 0.9332
mrr at 10 0.9332
Compare (0)Compare →