> ## Documentation Index
> Fetch the complete documentation index at: https://docs.openinference.xyz/llms.txt
> Use this file to discover all available pages before exploring further.

# Streaming

> Stream responses token by token as they are generated.

Streaming lets you display partial responses in real time instead of waiting for the full completion. Set `stream: true` in your request.

## Example

<CodeGroup>
  ```python Python theme={null}
  from openai import OpenAI

  client = OpenAI(
      base_url="https://api.openinference.xyz/v1",
      api_key="your-api-key",
  )

  stream = client.chat.completions.create(
      model="openai/gpt-oss-120b",
      messages=[
          {"role": "user", "content": "Explain quantum computing in simple terms"}
      ],
      stream=True,
  )

  for chunk in stream:
      content = chunk.choices[0].delta.content
      if content:
          print(content, end="", flush=True)
  ```

  ```javascript JavaScript theme={null}
  import OpenAI from "openai";

  const client = new OpenAI({
    baseURL: "https://api.openinference.xyz/v1",
    apiKey: process.env.OPENINFERENCE_API_KEY,
  });

  const stream = await client.chat.completions.create({
    model: "openai/gpt-oss-120b",
    messages: [
      { role: "user", content: "Explain quantum computing in simple terms" }
    ],
    stream: true,
  });

  for await (const chunk of stream) {
    const content = chunk.choices[0]?.delta?.content;
    if (content) process.stdout.write(content);
  }
  ```

  ```bash curl theme={null}
  curl https://api.openinference.xyz/v1/chat/completions \
    -H "Content-Type: application/json" \
    -H "Authorization: Bearer $OPENINFERENCE_API_KEY" \
    -d '{
      "model": "openai/gpt-oss-120b",
      "messages": [
        {"role": "user", "content": "Explain quantum computing in simple terms"}
      ],
      "stream": true
    }'
  ```
</CodeGroup>

## How it works

When streaming is enabled, the API returns a series of server-sent events (SSE). Each event contains a JSON chunk with a `delta` object holding the next piece of content.

```
data: {"id":"chatcmpl-abc123","object":"chat.completion.chunk","choices":[{"delta":{"content":"Quantum"},"index":0}]}

data: {"id":"chatcmpl-abc123","object":"chat.completion.chunk","choices":[{"delta":{"content":" computing"},"index":0}]}

...

data: [DONE]
```

The final `data: [DONE]` message signals the end of the stream. The last chunk before it includes a `usage` field with token counts.