Linq-AI-Research/Linq-Embed-Mistral
Primitive: /encode · Encode ·
Mistral
Linq-AI-Research/Linq-Embed-Mistral
Long contextDense
Overview
Hardware: — drives latency, throughput & cost
| Size | 7.1B params |
|---|---|
| Tasks | /encode |
| License | cc-by-nc-4.0 |
| Languages | en |
| Latency | 818 ms |
| Throughput | 2.9K tok/s |
| Cost | $0.075 /1M tok |
Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.
Embedding
| Output types | Dense |
|---|---|
| Dimensions | dense: 4,096 |
| Max sequence length | 32,768 |
| Inputs | text |
Benchmarks
NFCorpus
Biomedical literature search from NutritionFacts.org
Corpus: 3,593 Queries: 323
Quality
ndcg at 10 0.4066
map at 10 0.1566
mrr at 10 0.6287
Performance L4 b1 c16
Corpus 3.0K tok/s
Corpus p50 968.2ms
Query 210 tok/s
Query p50 231.6ms
NanoFiQA2018Retrieval
Smaller subset of the FiQA financial QA dataset
Quality
ndcg at 10 0.6402
map at 10 0.5716
mrr at 10 0.6722
Performance L4 b1 c16
Corpus 2.9K tok/s
Corpus p50 667.7ms
Query 459 tok/s
Query p50 259.6ms
Compare (0)Compare →