nvidia/llama-nemoretriever-colembed-3b-v1
Primitive: /encode · Encode ·
llama_nemoretrievercolembed
The nvidia/llama-nemoretriever-colembed-3b-v1 is a late interaction embedding model fine-tuned for query-document retrieval. Users can input `queries`, which are text, or `documents` which are page images, to the model.
MultimodalMultilingualLong contextMulti-vector
Overview
Hardware: — drives latency, throughput & cost
| Size | 4.4B params |
|---|---|
| Tasks | /encode |
| License | other |
| Languages | multilingual |
| Latency | 6.1 s |
| Throughput | 0.7 img/s |
| Cost | — /1M tok |
Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.
Embedding
| Output types | Multi-Vec |
|---|---|
| Dimensions | multivector: 3,072 |
| Max sequence length | 8,192 |
| Inputs | text · image |
Benchmarks
Vidore3ComputerScienceRetrieval
Visual document retrieval on computer science papers and slides
default_lang-eng
Performance L4 b1 c4
Corpus 0.6 img/s
Corpus p50 6.0s
Query 381 tok/s
Query p50 182.9ms
muvera
Quality
ndcg at 10 0.5585
muvera_lang-eng_limit-256
Quality
ndcg at 10 0.7733
map at 10 0.6621
mrr at 10 0.8546
Vidore3FinanceEnRetrieval
Visual document retrieval on financial reports
default_lang-eng
Performance L4 b1 c4
Corpus 0.6 img/s
Corpus p50 6.1s
Query 502 tok/s
Query p50 152.7ms
muvera
Quality
ndcg at 10 0.2794
muvera_lang-eng_limit-256
Quality
ndcg at 10 0.5632
map at 10 0.4576
mrr at 10 0.6416
Vidore3HrRetrieval
Visual document retrieval on HR-related documents
default
Quality
ndcg at 10 0.6513
map at 10 0.5053
mrr at 10 0.7844
Performance L4 b1 c16
Corpus 0.9 img/s
Corpus p50 17.9s
Query 689 tok/s
Query p50 740.7ms
muvera
Quality
ndcg at 10 0.3291
muvera_lang-eng_limit-256
Quality
ndcg at 10 0.5003
map at 10 0.3830
mrr at 10 0.5998
Vidore3PharmaceuticalsRetrieval
Visual document retrieval on pharmaceutical documents
default_lang-eng
Performance L4 b1 c4
Corpus 0.7 img/s
Corpus p50 6.0s
Query 420 tok/s
Query p50 185.5ms
muvera
Quality
ndcg at 10 0.4697
muvera_lang-eng_limit-256
Quality
ndcg at 10 0.7338
map at 10 0.6232
mrr at 10 0.8296
VidoreTabfquadRetrieval
Visual document retrieval on French tabular QA
Quality
ndcg at 10 0.8191
Compare (0)Compare →