Qwen3 Reranker 0.6B

An open model that scores how well each passage fits a query. Qwen/Qwen3-Reranker-0.6B

Get started Run in your cloud Hugging Face

Accuracy

0.652

AskUbuntu, nDCG@10
Time per request

Not timed one request at a time
Serverless price

$0.017

per 1M tokens

Call it

from sie_sdk import SIEClient
client = SIEClient(api_key="sk-sie-…")
query = "queryWhy does my model take 30 seconds to answer the first request?"
documents = [
    "document 1Cold storage keeps old checkpoints cheap to retain.",
    "document 2Subsequent requests are fast once the model is warm.",
    "document 3The first request is slow because the model loads into GPU memory; keep one replica warm.",
]
items = [{"id": str(i), "text": d} for i, d in enumerate(documents)]
ranked = client.score("modelQwen/Qwen3-Reranker-0.6B", {"text": query}, items)
for r in ranked["scores"]:
    print(r["score"], documents[int(r["item_id"])])

import { SIEClient } from '@superlinked/sie-sdk';

const client = new SIEClient(undefined, { apiKey: 'sk-sie-…' });

const query = "Why does my model take 30 seconds to answer the first request?";
const documents = [
  "Cold storage keeps old checkpoints cheap to retain.",
  "Subsequent requests are fast once the model is warm.",
  "The first request is slow because the model loads into GPU memory; keep one replica warm.",
];
const items = documents.map((text, i) => ({ id: String(i), text }));
const ranked = await client.score('Qwen/Qwen3-Reranker-0.6B', { text: query }, items);
console.log(ranked.scores.map(({ itemId, score }) => ({ document: documents[Number(itemId)], score })));

curl https://api.superlinked.com/v1/score/Qwen%2FQwen3-Reranker-0.6B \
  -H "Authorization: Bearer sk-sie-…" \
  -H "Content-Type: application/json" \
  -d "{\"query\":{\"text\":\"Why does my model take 30 seconds to answer the first request?\"},\"items\":[{\"id\":\"0\",\"text\":\"Cold storage keeps old checkpoints cheap to retain.\"},{\"id\":\"1\",\"text\":\"Subsequent requests are fast once the model is warm.\"},{\"id\":\"2\",\"text\":\"The first request is slow because the model loads into GPU memory; keep one replica warm.\"}]}"

Build the "Rerank" capability into my app using the Superlinked Inference Engine (SIE).

Context
- SIE is an OpenAI-style inference API. Python SDK: `from sie_sdk import SIEClient`; TypeScript: `@superlinked/sie-sdk`.
- Base URL: https://api.superlinked.com (or my regional endpoint). Auth: Bearer key from env `SIE_API_KEY` (never hard-code it).
- Model: Qwen/Qwen3-Reranker-0.6B (SIE primitive: /score). Keep the model id configurable.

Task
- Input: a query string plus a list of candidate documents.
- Behaviour: reorder the candidates by true relevance to the query using the reranking model
- Call the selected SIE primitive once per request and map the response into your domain type.

Deliverables
- A typed client wrapper, an application-level function for this task, error handling for timeouts/empty input, and unit tests with a stubbed client.
- Wire it into my existing stack (ask me which framework if unclear) and add a short usage example.

Run

Next to the other rerankers

Next to the other rerankers
Model	AskUbuntu, nDCG@10	Time per request	Serverless price	Size
Qwen3 Reranker 0.6B Qwen	0.652	Not timed	$0.017 per 1M tokens	596M
Qwen3 Reranker 4B Qwen	0.697	55 ms per query	$0.0425 per 1M tokens	4.0B
mxbai rerank large v2 mixedbread-ai	0.691	Not timed	Run in your cloud	1.5B
bge reranker v2 m3 BAAI	0.676	Not timed	Run in your cloud	568M
gte reranker modernbert base Alibaba-NLP	0.670	Not timed	Run in your cloud	150M

All 22 rerankers

Measured on public datasets

Measured on public datasets
Dataset	nDCG@10
StackOverflowQA	0.934
LegalBenchConsumerContractsQA	0.832
SciFact	0.768
AskUbuntuDupQuestions	0.652
CQADupstackPhysicsRetrieval	0.495
FiQA2018	0.456
NFCorpus	0.390
CosQA	0.360
SCIDOCS	0.216
MMarcoReranking	0.086

Facts

Size: 596M parameters
License: Apache-2.0
Reads: Text, up to 32,768 tokens
Endpoint: score

Evaluation

Accuracy: Run on SIE against the public dataset named in each figure
Reranking: Reorders the top 50 from gte multilingual base
Time: SIE timed on a GPU server with the client alongside, one request at a time
Prices: Serverless list prices, effective 10 Nov 2026

Run Qwen3 Reranker 0.6B on Serverless or in your own cloud

SIE Serverless

We host the models; you call one API.

No idle GPUs, pay for what you use
Fits your stack: SDK, API, CLI, MCP
Self-host the same open-source engine
SOC 2 Type 2, US or EU data residency
Create an account to try Serverless

Get started

SIE Cluster

Kubernetes in your own cloud, backed by our engineers.

Terraform modules for your cloud
Apache-2.0, same engine as Serverless
GPU workers scale to zero between jobs
Separate worker pools for each tenant

Agent prompt Deploy SIE to our AWS account with the superlinked/sie/aws Terraform module. Docs: superlinked.com/docs/deployment.

Deploy SIE to our Google Cloud project with the superlinked/sie/google Terraform module. Docs: superlinked.com/docs/deployment.

Deploy SIE to our Azure subscription with the superlinked/sie/azure Terraform module. Docs: superlinked.com/docs/deployment.

Deploy SIE to our Alibaba Cloud account with the superlinked/sie/alicloud Terraform module. Docs: superlinked.com/docs/deployment.

Talk to us Deploy guide

SIE Local

The open-source server on your own machine.

Runs on your NVIDIA GPU
One container, no cluster
Process your data fully offline
Same SDK and model IDs as Serverless

docker run --gpus all -p 8080:8080 ghcr.io/superlinked/sie-server:latest-cuda12-default

Quickstart