API reference - Open Inference Docs

Base URL

https://api.openinference.xyz/v1

Authentication

Every request must include your API key in the Authorization header.

Authorization: Bearer $OPENINFERENCE_API_KEY

You can create and manage API keys from the Open Inference console.

Endpoints

Chat completions

Generate a chat response from a model given a list of messages.

Completions

Generate a text completion given a prompt.

OpenAI compatibility

The Open Inference API is compatible with the OpenAI SDK. Point base_url to https://api.openinference.xyz/v1 and use your Open Inference API key.

from openai import OpenAI

client = OpenAI(
    base_url="https://api.openinference.xyz/v1",
    api_key="your-api-key",
)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.openinference.xyz/v1",
  apiKey: process.env.OPENINFERENCE_API_KEY,
});

curl https://api.openinference.xyz/v1/chat/completions \
  -H "Authorization: Bearer $OPENINFERENCE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "openai/gpt-oss-120b", "messages": [{"role": "user", "content": "Hello"}]}'

Rate limits

Rate limits depend on your plan. Contact sales for details on dedicated capacity.

Errors

The API returns standard HTTP status codes.

Code	Description
`401`	Invalid or missing API key
`429`	Rate limit exceeded
`500`	Internal server error

Chat completions

​Base URL

​Authentication

​Endpoints

Chat completions

Completions

​OpenAI compatibility

​Rate limits

​Errors

Base URL

Authentication

Endpoints

OpenAI compatibility

Rate limits

Errors