Why did we open-source our inference engine? Read the post

← Catalog

google/siglip-so400m-patch14-224

Open comparison →

Primitive: /encode · Encode · SigLIP

SigLIP model pre-trained on WebLi at resolution 224x224. It was introduced in the paper Sigmoid Loss for Language Image Pre-Training by Zhai et al. and first released in this repository.

MultimodalDense

Overview

Hardware: — drives latency, throughput & cost

Size877M params
Tasks /encode
Licenseapache-2.0
Latency284 ms
Throughput456 tok/s
Cost$0.487 /1M tok

Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.

Embedding

Output typesDense
Dimensionsdense: 1,152
Max sequence length64
Inputstext · image

Benchmarks

Flickr30kI2TRetrieval

general retrieval en

Image-to-text retrieval: retrieve captions from images

Corpus: 31,783 Queries: 1,000
Quality
ndcg at 10 0.8383
map at 10 0.7481
mrr at 10 0.9353
Performance L4-SPOT b1 c8
Corpus 223 tok/s
Corpus p50 395.0ms
Query 11.5 img/s
Query p50 392.1ms
Performance L4 b1 c16
Corpus 689 tok/s
Corpus p50 173.8ms
Query 10.6 mpix/s
Query p50 135.9ms
Reference →

Open source inference for agents

Open-source inference for the models behind your agents. Run it yourself, or let us run it for you.

Github 2.1K

Contact us

Tell us about your use case and we'll get back to you shortly.

Apply for an inference grant

Free capacity on our hosted cluster for selected projects. Tell us what you run and we reply by email.