Why did we open-source our inference engine? Read the post

← Catalog

IDEA-Research/grounding-dino-tiny

Open comparison →

Primitive: /extract · Extract · Swin

The Grounding DINO model was proposed in Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection by Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Chunyuan Li, Jianwei Yang, Hang Su, Jun Zhu, Lei Zhang.

MultimodalBounding boxes

Overview

Hardware: — drives latency, throughput & cost

Size172M params
Tasks /extract
Licenseapache-2.0
Latency533 ms
Throughput0.9 mpix/s
Cost /1M tok

Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.

Extraction

Output kindsBounding Boxes
Inputstext · image
Max sequence length

Benchmarks

COCO

general detection en

Object detection on COCO natural images

Corpus: 5,000 Queries: 5,000
default_limit-1000
Performance A10G b1 c4
Detect 0.0 mpix/s
Detect p50 43.7s
Performance L4-SPOT b1 c4
Detect 0.9 mpix/s
Detect p50 734.4ms
Performance L4 b1 c4
Detect 0.9 mpix/s
Detect p50 330.7ms
default_limit-100
Quality
ap 0.4860
ap50 0.6553
ap75 0.5001
ar 100 0.5593
Performance RTX-4090 b1 c16
Detect 4.0 mpix/s
Detect p50 602.2ms
Reference →

Open source inference for agents

Open-source inference for the models behind your agents. Run it yourself, or let us run it for you.

Github 2.1K

Contact us

Tell us about your use case and we'll get back to you shortly.

Apply for an inference grant

Free capacity on our hosted cluster for selected projects. Tell us what you run and we reply by email.