Skip to main content
Streaming returns incremental output as SSE frames so users see responses earlier.

Supported endpoints

  • /v1/responses
  • /v1/chat/completions
  • /v1/messages

Request

Response

SDK options

  • TypeScript SDK: client.streamResponses(), client.streamChat(), and client.streamMessages()
  • Python SDK: client.stream_responses(), client.stream_chat(), and client.stream_message()
  • Vercel AI SDK: streamText(...) with @phaseo/ai-sdk-provider

Important limitation

At current gateway request-validation level, combining tools with stream: true is rejected (400 invalid_request). Use non-streaming for tool-calling loops.

Next guides

  1. SSE Event Reference
  2. Streaming in Production
Last modified on July 26, 2026