Why did we open-source our inference engine? Read the post

Self-hosted inference for enterprise AI

Deploy all the models your agents need next to your data, compliant and secure by design.

security review. Approved
From
An insurer in Zurich, your customer
About
The AI agents in your product
  1. Which third parties process our data for AI features?

    None. The models run on self-hosted SIE Cluster.

  2. Where is our data processed?

    In Zurich, inside Switzerland.

  3. Can the AI features run inside our environment?

    Yes, in a private VPC or fully air‑gapped.

  4. Does a model provider see or keep our data?

    No. Nothing leaves the cluster.

Reviewed by their security team 4/4 Accepted

Third-party models stall enterprise deals in security review

Your customer Finding Reviewer note
Insurer in Switzerland FINMA

Data processed outside Switzerland

Client data has to stay in Switzerland. Your model provider's nearest region is in Frankfurt.
Defense contractor CMMC Level 2

Controlled data leaves the enclave

Controlled unclassified information can't go to a model API outside our accredited boundary.
Hospital trust in the UK NHS DSPT

Unassessed data processor

Patient data only goes to processors we have assessed, and your model provider is not one of them.
Provincial agency in Canada Nova Scotia PIIDPA

Data stored outside Canada

Personal information has to stay in Canada, and the hosted API routes through the US.

One SIE Cluster runs every model your AI platform needs

SIE Cluster One endpoint

Select a model or a task to open its page

  1. Safety and PII gate Blocks unsafe prompts and masks personal data
    On SIE Qwen3Guard 4B
  2. Semantic cache Answers a repeated question at once
  3. Intent and complexity Picks the skill, and how strong a model it needs
  4. LLM Plans and answers with an open model, calling SIE tasks as tools
  5. Verify Checks the answer before it goes out

Deploy SIE in your cloud or in your customer's

  • Terraform for four clouds Modules for AWS, GCP, Azure and Alibaba Cloud provision the cluster and its GPU node pools.
  • Helm into any cluster Install into an existing EKS, GKE, AKS or on-premises cluster.
  • Air-gapped install Mirror the images and model cache, then install with no internet egress.
  • Worker pools per tenant Dedicated workers keep one customer's load from slowing another's.
Case study

GoodData is building its AI platform on SIE

In the interview
  • Why GoodData runs its own AI platform instead of calling a model API
  • Where open models match frontier models, and where they fall short
  • How SIE serves the models behind GoodData's AI features
  • What enterprise customers ask before they turn AI features on
gooddata.ai

Get Native Inference, or self-host SIE Cluster for free

Native Inference

A platform license for SIE Cluster. Our engineers work with yours in a shared Slack channel and help answer your customers' security reviews. SIE itself stays Apache-2.0.

SIE Cluster

Easy & scalable deployment in your own cloud.

  • Terraform to your cloud in minutes
  • Apache-2.0, same engine as Serverless
  • GPU workers scale to zero between jobs
  • Per-tenant pools, no noisy neighbors
Agent prompt
Deploy SIE to our AWS account with the superlinked/sie/aws Terraform module. Docs: superlinked.com/docs/deployment. Serve Qwen/Qwen3.8-27B-FP8 using the public model configurations.Deploy SIE to our Google Cloud project with the superlinked/sie/google Terraform module. Docs: superlinked.com/docs/deployment. Serve Qwen/Qwen3.8-27B-FP8 using the public model configurations.Deploy SIE to our Azure subscription with the superlinked/sie/azure Terraform module. Docs: superlinked.com/docs/deployment. Serve Qwen/Qwen3.8-27B-FP8 using the public model configurations.Deploy SIE to our Alibaba Cloud account with the superlinked/sie/alicloud Terraform module. Docs: superlinked.com/docs/deployment. Serve Qwen/Qwen3.8-27B-FP8 using the public model configurations.
Deploy guide

SIE Local

Run the open-source server on your own NVIDIA GPU.

  • NVIDIA GPU
  • One container, no cluster
  • Qwen3.8 27B, fully offline
  • Same SDK and IDs, no code changes
docker run --gpus all -p 8080:8080 ghcr.io/superlinked/sie-server:latest-cuda13-sglang-cu130
Quickstart

Contact us

Tell us about your use case and we'll get back to you shortly.

Apply for an inference grant

Free capacity on our hosted cluster for selected projects. Tell us what you run and we reply by email.