Most AI tasks no longer need a frontier model Read launch post

OpenSearch doc‑v3‑gte

An open search model that adds learned terms to each document for the search engine you run. opensearch-project/opensearch-neural-sparse-encoding-doc-v3-gte

  • Accuracy

    8 retrieval sets, mean nDCG@10 · not measured

  • Time per request

    Not timed one request at a time

  • Serverless price

    $0.0292

    per 1M tokens

Call it

from sie_sdk import SIEClient
​
client = SIEClient(api_key="sk-sie-…")
​
query = "querywayfair comforters"
documents = [
"document 1wayfair basics® comforter set. Bedding Sets. if your mattress needs a makeover , don ’ t break the bank . refresh your···closure and a classic flange . designed for effortless upkeep , this set is machine-washable and iron- and dryer-safe .",
"document 2wayfair sleep medium weight all season polyester down alternative comforter. Comforters & Duvet Fills|Bedding Sets.···on the bed in your main room or guest room . to clean , just toss it in the washing machine for fuss-free upkeep .",
"document 3wayfair basics® reversible quilt set. Bedding Sets. give your mattress a refreshing makeover with this stylish quilt···designed for everyday life , this set can be machine washed and tumble dried in a gentle setting for fuss-free upkeep .",
"document 4wayfair basics single curtain rod. Curtain Hardware & Accessories",
"document 5wayfair basics peva shower curtain liner",
"document 6wayfair basics round single curtain rod. Curtain Hardware & Accessories",
]
​
model = "modelopensearch-project/opensearch-neural-sparse-encoding-doc-v3-gte"
q = client.encode(model, [{"text": query}], output_types=["sparse"], is_query=True)[0]["sparse"]
docs = client.encode(model, [{"text": d} for d in documents], output_types=["sparse"], is_query=False)
print(q)
print(docs)
import { SIEClient } from '@superlinked/sie-sdk';

const client = new SIEClient(undefined, { apiKey: 'sk-sie-…' });

const query = "wayfair comforters";
const documents = [
  "wayfair basics® comforter set. Bedding Sets. if your mattress needs a makeover , don ’ t break the bank . refresh your···closure and a classic flange . designed for effortless upkeep , this set is machine-washable and iron- and dryer-safe .",
  "wayfair sleep medium weight all season polyester down alternative comforter. Comforters & Duvet Fills|Bedding Sets.···on the bed in your main room or guest room . to clean , just toss it in the washing machine for fuss-free upkeep .",
  "wayfair basics® reversible quilt set. Bedding Sets. give your mattress a refreshing makeover with this stylish quilt···designed for everyday life , this set can be machine washed and tumble dried in a gentle setting for fuss-free upkeep .",
  "wayfair basics single curtain rod. Curtain Hardware & Accessories",
  "wayfair basics peva shower curtain liner",
  "wayfair basics round single curtain rod. Curtain Hardware & Accessories",
];

const model = 'opensearch-project/opensearch-neural-sparse-encoding-doc-v3-gte';
const [q] = await client.encode(model, [{ text: query }], {
  outputTypes: ['sparse'],
  isQuery: true,
});
const docs = await client.encode(
  model,
  documents.map((text) => ({ text })),
  { outputTypes: ['sparse'], isQuery: false },
);
console.log({ query: q, documents: docs });
# Encode the query with is_query, then the listings; save native sparse vectors.
curl https://api.superlinked.com/v1/encode/opensearch-project%2Fopensearch-neural-sparse-encoding-doc-v3-gte \
  -H "Authorization: Bearer sk-sie-…" \
  -H "Content-Type: application/json" \
  -d "{\"items\":[{\"text\":\"wayfair comforters\"}],\"params\":{\"output_types\":[\"sparse\"],\"options\":{\"is_query\":true}}}" \
  -H "Accept: application/json" -o query.json

curl https://api.superlinked.com/v1/encode/opensearch-project%2Fopensearch-neural-sparse-encoding-doc-v3-gte \
  -H "Authorization: Bearer sk-sie-…" \
  -H "Content-Type: application/json" \
  -d "{\"items\":[{\"text\":\"wayfair basics® comforter set. Bedding Sets. if your mattress needs a makeover , don ’ t break the bank . refresh your···closure and a classic flange . designed for effortless upkeep , this set is machine-washable and iron- and dryer-safe .\"},{\"text\":\"wayfair sleep medium weight all season polyester down alternative comforter. Comforters & Duvet Fills|Bedding Sets.···on the bed in your main room or guest room . to clean , just toss it in the washing machine for fuss-free upkeep .\"},{\"text\":\"wayfair basics® reversible quilt set. Bedding Sets. give your mattress a refreshing makeover with this stylish quilt···designed for everyday life , this set can be machine washed and tumble dried in a gentle setting for fuss-free upkeep .\"},{\"text\":\"wayfair basics single curtain rod. Curtain Hardware & Accessories\"},{\"text\":\"wayfair basics peva shower curtain liner\"},{\"text\":\"wayfair basics round single curtain rod. Curtain Hardware & Accessories\"}],\"params\":{\"output_types\":[\"sparse\"],\"options\":{\"is_query\":false}}}" \
  -H "Accept: application/json" -o listings.json
Build the "Sparse embeddings" capability into my app using the Superlinked Inference Engine (SIE).

Context
- SIE is an OpenAI-style inference API. Python SDK: `from sie_sdk import SIEClient`; TypeScript: `@superlinked/sie-sdk`.
- Base URL: https://api.superlinked.com (or my regional endpoint). Auth: Bearer key from env `SIE_API_KEY` (never hard-code it).
- Model: opensearch-project/opensearch-neural-sparse-encoding-doc-v3-gte (SIE primitive: /encode). Keep the model id configurable.

Task
- Input: a search query plus the listings to rank.
- Behaviour: return the query and listing sparse vectors, with vocabulary ids and weights
- Send two POST /v1/encode requests: one item {text: query} with params {output_types: ["sparse"], options: {is_query: true}}, then all listings in one batch with params {output_types: ["sparse"], options: {is_query: false}}. Read items[i].sparse.indices (vocabulary ids) and .values (weights). Return these native sparse vectors without adding application scoring or ranking. In Python, use SIEClient.encode(..., output_types=["sparse"], is_query=True) for the query call and is_query=False for the listings; in TypeScript, pass isQuery: true and isQuery: false respectively. Do not issue one request per listing.

Deliverables
- A typed client wrapper, an application-level function for this task, error handling for timeouts/empty input, and unit tests with a stubbed client.
- Wire it into my existing stack (ask me which framework if unclear) and add a short usage example.
Output
2126way
7011##fa
4313##ir
7216comfort
2545##ers
5 active terms · 0 added by the model

Next to the other sparse models

Next to the other sparse models
Model 8 retrieval sets, mean nDCG@10 Time per request Serverless price Size
opensearch neural sparse encoding v1 opensearch-project 0.458 Not timed Run in your cloud 133M
splade v3 naver 0.456 Not timed Run in your cloud 110M
bge m3 BAAI Not measured Not timed $0.0408 per 1M tokens 568M
Splade PP en v2 prithivida Not measured Not timed $0.0256 per 1M tokens 110M
All 12 sparse models

Measured on public datasets

Measured on public datasets
Dataset nDCG@10
LegalBenchConsumerContractsQA 0.763
StackOverflowQA 0.747
SciFact 0.724
FiQA2018 0.406
CQADupstackPhysicsRetrieval 0.406
NFCorpus 0.361
CosQA 0.224

Facts

Size
137M parameters
License
Apache-2.0
Reads
Text, up to 512 tokens
Endpoint
encode
Evaluation
Accuracy
Run on SIE against the public dataset named in each figure
8 retrieval sets
The mean over NFCorpus, FiQA2018, SciFact, SCIDOCS, CQADupstackPhysicsRetrieval, CosQA, StackOverflowQA and LegalBenchConsumerContractsQA
Prices
Serverless list prices, effective 10 Nov 2026

Run OpenSearch doc‑v3‑gte on Serverless or in your own cloud

Native Inference

Kubernetes in your own cloud, backed by our engineers.

  • Terraform modules for your cloud
  • Apache-2.0, same engine as Serverless
  • GPU workers scale to zero between jobs
  • Separate worker pools for each tenant
Agent prompt Deploy SIE to our AWS account with the superlinked/sie/aws Terraform module. Docs: superlinked.com/docs/deployment.Deploy SIE to our Google Cloud project with the superlinked/sie/google Terraform module. Docs: superlinked.com/docs/deployment.Deploy SIE to our Azure subscription with the superlinked/sie/azure Terraform module. Docs: superlinked.com/docs/deployment.Deploy SIE to our Alibaba Cloud account with the superlinked/sie/alicloud Terraform module. Docs: superlinked.com/docs/deployment.

SIE Local

The open-source server on your own machine.

  • NVIDIA
  • One container, no cluster
  • Process your data fully offline
  • Same SDK and model IDs as Serverless
docker run --gpus all -p 8080:8080 ghcr.io/superlinked/sie-server:latest-cuda12-default

Talk to us

Tell us about your use case and we'll get back to you shortly.

Apply for an inference grant

Free capacity on our hosted cluster for selected projects. Tell us what you run and we reply by email.