intfloat/multilingual-e5-large
Primitive: /encode · Encode ·
XLM-RoBERTa
Multilingual E5 Text Embeddings: A Technical Report. Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei, arXiv 2024
View on Hugging Face → Guide: E5 family guide →
Overview
Hardware: — drives latency, throughput & cost
| Size | 560M params |
|---|---|
| Tasks | /encode |
| License | mit |
| Languages | multilingual, af, am, ar, as, az, be, bg, bn, br, bs, ca, cs, cy, da, de, el, en, eo, es, et, eu, fa, fi, fr, fy, ga, gd, gl, gu, ha, he, hi, hr, hu, hy, id, is, it, ja, jv, ka, kk, km, kn, ko, ku, ky, la, lo, lt, lv, mg, mk, ml, mn, mr, ms, my, ne, nl, no, om, or, pa, pl, ps, pt, ro, ru, sa, sd, si, sk, sl, so, sq, sr, su, sv, sw, ta, te, th, tl, tr, ug, uk, ur, uz, vi, xh, yi, zh |
| Latency | 109 ms |
| Throughput | 29.8K tok/s |
| Cost | $0.0074 /1M tok |
Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.
Embedding
| Output types | Dense |
|---|---|
| Dimensions | dense: 1,024 |
| Max sequence length | 512 |
| Inputs | text |
Benchmarks
CQADupstackPhysicsRetrieval
Duplicate question retrieval from StackExchange Physics
CosQA
Code search with natural language queries
FiQA2018
Financial opinion mining and question answering
LegalBenchConsumerContractsQA
Question answering on consumer contracts
NFCorpus
Biomedical literature search from NutritionFacts.org
NanoFiQA2018Retrieval
Smaller subset of the FiQA financial QA dataset
SCIDOCS
Citation prediction, document classification, and recommendation for scientific papers
SciFact
Scientific claim verification using research literature
StackOverflowQA
Programming question answering from Stack Overflow