vidore/colpali-v1.3-hf
Primitive: /encode ยท Encode ยท
PaliGemma
> [!IMPORTANT] > This version of ColPali should be loaded with the `transformers ๐ค` release, not with `colpali-engine`. > It was converted using the `convert_colpali_weights_to_hf.py` script > from the `vidore/colpali-v1.3-merged` checkpoint.
View on Hugging Face → Fine-tuned from vidore/colpaligemma-3b-pt-448-base
Overview
Hardware: โ drives latency, throughput & cost
| Size | 3.0B params |
|---|---|
| Tasks | /encode |
| License | gemma |
| Languages | en |
| Latency | 582 ms |
| Throughput | 23.0 mpix/s |
| Cost | โ /1M tok |
Cost is approximate โ computed from list GPU prices; your actual price depends on the provider you deploy SIE with.
Embedding
| Output types | Multi-Vec |
|---|---|
| Dimensions | multivector: 128 |
| Max sequence length | 2,048 |
| Inputs | text ยท image |
Benchmarks
Vidore3ComputerScienceRetrieval
Visual document retrieval on computer science papers and slides
Vidore3FinanceEnRetrieval
Visual document retrieval on financial reports
Vidore3HrRetrieval
Visual document retrieval on HR-related documents
Vidore3PharmaceuticalsRetrieval
Visual document retrieval on pharmaceutical documents