IDEA-Research/grounding-dino-base
Primitive: /extract · Extract ·
Swin
The Grounding DINO model was proposed in Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection by Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Chunyuan Li, Jianwei Yang, Hang Su, Jun Zhu, Lei Zhang.
MultimodalBounding boxes
Overview
Hardware: — drives latency, throughput & cost
| Size | 233M params |
|---|---|
| Tasks | /extract |
| License | apache-2.0 |
| Latency | 549 ms |
| Throughput | 0.8 mpix/s |
| Cost | — /1M tok |
Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.
Extraction
| Output kinds | Bounding Boxes |
|---|---|
| Inputs | text · image |
| Max sequence length | — |
Benchmarks
COCO
Object detection on COCO natural images
Corpus: 5,000 Queries: 5,000
default_limit-1000
Quality
ap 0.5194
ap50 0.7009
ap75 0.5612
ar 100 0.6158
Performance A10G b1 c4
Detect 0.0 mpix/s
Detect p50 33.0s
Performance L4-SPOT b1 c4
Detect 0.8 mpix/s
Detect p50 785.8ms
Performance L4 b1 c16
Detect 0.9 mpix/s
Detect p50 312.3ms
default_limit-100
Quality
ap 0.5809
ap50 0.7349
ap75 0.6241
ar 100 0.6503
Performance RTX-4090 b1 c16
Detect 3.4 mpix/s
Detect p50 670.9ms
default
Quality
ap 0.4860
ap50 0.6757
ap75 0.5329
ar 100 0.5860
Performance RTX-PRO-6000-Blackwell-Server-Edition b1 c16
Detect 2.6 mpix/s
Detect p50 116.7ms
Compare (0)Compare →