Completions

POST /v1/completions

Creates a completion for the given prompt and model.

Request body

string

required

The model ID to use. See the models page for available models.Example: openai/gpt-oss-120b

string

required

The prompt to generate a completion for.

integer

Maximum number of tokens to generate. Defaults to the model’s maximum.

number

Sampling temperature between 0 and 2. Defaults to 1.

number

Nucleus sampling parameter. Defaults to 1.

boolean

If true, responses are sent as server-sent events. Defaults to false.

string | array

Up to 4 sequences where the model will stop generating.

Example request

curl https://api.openinference.xyz/v1/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OPENINFERENCE_API_KEY" \
  -d '{
    "model": "openai/gpt-oss-120b",
    "prompt": "The capital of France is",
    "max_tokens": 50
  }'

from openai import OpenAI

client = OpenAI(
    base_url="https://api.openinference.xyz/v1",
    api_key="your-api-key",
)

response = client.completions.create(
    model="openai/gpt-oss-120b",
    prompt="The capital of France is",
    max_tokens=50,
)
print(response.choices[0].text)

Example response

{
  "id": "cmpl-abc123",
  "object": "text_completion",
  "created": 1709000000,
  "model": "openai/gpt-oss-120b",
  "choices": [
    {
      "index": 0,
      "text": " Paris, which is also the largest city in France.",
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 7,
    "completion_tokens": 12,
    "total_tokens": 19
  }
}

Streaming

Set stream: true to receive responses as server-sent events.

curl https://api.openinference.xyz/v1/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OPENINFERENCE_API_KEY" \
  -d '{
    "model": "openai/gpt-oss-120b",
    "prompt": "Hello",
    "max_tokens": 50,
    "stream": true
  }'

Overview

Endpoints

POST /v1/completions

Request body

Example request

Example response

Streaming

​POST /v1/completions

​Request body

​Example request

​Example response

​Streaming

POST /v1/completions

Request body

Example request

Example response

Streaming