Why did we open-source our inference engine? Read the post

← Catalog

zai-org/GLM-OCR

Open comparison →

Primitive: /extract · Extract · GLM-OCR

👋 Join our WeChat and Discord community

MultimodalMultilingualLong contextEntities

Overview

Hardware: — drives latency, throughput & cost

Size1.3B params
Tasks /extract
Licensemit
Languageszh, en, fr, es, ru, de, ja, ko
Latency16.8 s
Throughput662 tok/s
Cost$0.336 /1M tok

Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.

Extraction

Output kindsEntities
Inputsimage
Max sequence length16,384

Benchmarks

olmOCR-Bench

general ocr en

Document text extraction accuracy across arxiv math, old scans, multi-column layouts, and tables

Corpus: 1,403 Queries: 1,403
default
Quality
accuracy 0.7380
Performance L4 b1 c4
Extract 0.4 mpix/s
Extract p50 16.8s
default_limit-50
Quality
accuracy 0.6943
Reference →

Open source inference for agents

Open-source inference for the models behind your agents. Run it yourself, or let us run it for you.

Contact us

Tell us about your use case and we'll get back to you shortly.

Apply for an inference grant

Free capacity on our hosted cluster for selected projects. Tell us what you run and we reply by email.