Why did we open-source our inference engine? Read the post

← Catalog

IDEA-Research/grounding-dino-tiny

Open comparison →

Primitive: /extract · Extract · Swin

The Grounding DINO model was proposed in Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection by Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Chunyuan Li, Jianwei Yang, Hang Su, Jun Zhu, Lei Zhang.

MultimodalBounding boxes

Overview

Hardware: — drives latency, throughput & cost

Size172M params
Tasks /extract
Licenseapache-2.0
Latency331 ms
Throughput0.9 mpix/s
Cost— /1M tok

Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.

Extraction

Output kindsBounding Boxes
Inputstext · image
Max sequence length—

Benchmarks

COCO

general detection en

Object detection on COCO natural images

Corpus: 5,000 Queries: 5,000
default_limit-1000
Quality
ap 0.4315
ap50 0.5859
ap75 0.4638
ar 100 0.5291
Performance A10G b1 c4
Detect 0.0 mpix/s
Detect p50 43.7s
Performance L4-SPOT b1 c4
Detect 0.9 mpix/s
Detect p50 734.4ms
Performance L4 b1 c4
Detect 0.9 mpix/s
Detect p50 330.7ms
Performance L4 b1 c16
Detect 1.1 mpix/s
Detect p50 263.8ms
default_limit-100
Quality
ap 0.4860
ap50 0.6553
ap75 0.5001
ar 100 0.5593
Performance RTX-4090 b1 c16
Detect 4.0 mpix/s
Detect p50 602.2ms
default
Quality
ap 0.4028
ap50 0.5627
ap75 0.4361
ar 100 0.5211
Performance RTX-PRO-6000-Blackwell-Server-Edition b1 c16
Detect 2.6 mpix/s
Detect p50 113.9ms
Reference →

Open source inference for agents

Open-source inference for the models behind your agents. Run it yourself, or let us run it for you.

Contact us

Tell us about your use case and we'll get back to you shortly.

Apply for an inference grant

Free capacity on our hosted cluster for selected projects. Tell us what you run and we reply by email.