Streaming returns incremental output as SSE frames so users see responses earlier.
Supported endpoints
/v1/responses
/v1/chat/completions
/v1/messages
Request
Response
SDK options
- TypeScript SDK:
client.streamResponses(), client.streamChat(), and client.streamMessages()
- Python SDK:
client.stream_responses(), client.stream_chat(), and client.stream_message()
- Vercel AI SDK:
streamText(...) with @phaseo/ai-sdk-provider
Important limitation
At current gateway request-validation level, combining tools with stream: true is rejected (400 invalid_request). Use non-streaming for tool-calling loops.
Next guides
- SSE Event Reference
- Streaming in Production
Last modified on July 26, 2026