Why did we open-source our inference engine? Read the post

← Catalog

numind/NuNER_Zero

Open comparison →

Primitive: /extract · Extract · DeBERTa

NuNER Zero is a zero-shot Named Entity Recognition (NER) Model. (Check NuNER for the few-shot setting).

Entities

Overview

Hardware: — drives latency, throughput & cost

Size449M params
Tasks /extract
Licensemit
Languagesen
Latency107 ms
Throughput14.9K tok/s
Cost$0.015 /1M tok

Cost is approximate — computed from list GPU prices; your actual price depends on the provider you deploy SIE with.

Extraction

Output kindsEntities
Inputstext
Max sequence length384

Benchmarks

CoNLL-2003

news ner en

Named entity recognition on Reuters newswire text

Corpus: 3,453 Queries: 3,453
Quality
f1 0.6068
precision 0.5430
recall 0.6875
Performance L4 b1 c16
Extract 7.1K tok/s
Extract p50 97.0ms
Reference →

SPIA

safety ner en

Personally identifiable information (PII) span detection for redaction workflows

Corpus: 151 Queries: 151
Quality
f1 0.4632
precision 0.4727
recall 0.4540
Performance L4 b1 c16
Extract 22.6K tok/s
Extract p50 116.1ms
Reference →

Open source inference for agents

Open-source inference for the models behind your agents. Run it yourself, or let us run it for you.

Github 2.8K

Contact us

Tell us about your use case and we'll get back to you shortly.

Apply for an inference grant

Free capacity on our hosted cluster for selected projects. Tell us what you run and we reply by email.