Skip to main content
Methods: client.CreateBatch(), client.RetrieveBatch(), client.CancelBatch(), client.GetAsyncJobWebSocketUrl(), client.GetBatchWebSocketUrl(), client.AsyncJobs.WebSocketUrl().

Example

Key parameters

  • model: Model id used to infer the upstream provider. Most callers should not pass provider.
  • prompts: Simple shorthand for one or more prompt strings.
  • items: Structured prompt shorthand with id / custom_id, prompt, messages, per-row settings, or an advanced body.
  • requests: Advanced inline provider-native batch rows.
  • input_file_id: Existing file id uploaded via /batches/files?model=... for large prebuilt JSONL inputs.
  • endpoint: Optional target endpoint for advanced rows. Phaseo chooses a model/provider default when omitted.
  • completion_window: e.g., 24h.
  • session_id: Optional Phaseo grouping id for logs, sessions, and investigate tooling.
  • webhook: Optional webhook configuration for async lifecycle notifications.
  • metadata: Optional object stored with the batch.
Use exactly one input source per batch: prompts, items, requests, or input_file_id.

Returns

BatchResponse Batch responses also surface gateway observability fields such as request_id, provider, echoed session_id / webhook, and terminal billing / pricing_lines when available. Use client.GetBatchWebSocketUrl(...) when you want to subscribe to the documented /v1/async/batch/{id}/ws lifecycle stream instead of polling only. Use client.AsyncJobs.WebSocketUrl("batch", batchId, ...) when you want the generic async-jobs resource helper. Use client.GetAsyncJobWebSocketUrl("batch", batchId, ...) when you want the same generic helper without going through the resource object.
Last modified on July 26, 2026