Open models
Updated
The open models API serves hosted open-weight models through an OpenAI-compatible Chat Completions API and an Anthropic-compatible Messages API. One workspace API key reaches them all, and credits pay for usage.
Two protocols, chat completions at /v1/chat/completions and Messages at /v1/messages, take the same workspace key. Both reach the open models on one host. Usage is paid from one credit balance, drawn as a bar.
The RightNow decision model has its own docs.
Call a hosted model
Set the base URL for your route, use a workspace API key and pass a model id.
The example calls glm-5-3; any available id from Open models works in its place. Read current capabilities, limits and prices from GET /v1/models.
GET /v1/models is the authoritative list of hosted chat models. It also reports when one is temporarily paused.
Some names in requests and replies start with runinfra, from the platform's earlier name. They stay as they are.
Which route
| Route | Path | Client base URL | Read |
|---|---|---|---|
| Chat completions | POST /v1/chat/completions | https:// | Chat completions and Responses |
| Responses | POST /v1/responses | https:// | Chat completions and Responses |
| Messages | POST /v1/messages | https://api.rightnowai.co | Messages |
Read in this order
Get a workspace key, discover an available model and send a server-side chat request.
Discover the model ids a workspace key can reach, and the limits the gateway enforces on them.
Chat completions and Responses
Chat and Responses request fields, tool loops, streamed events, usage, validation and output budgets.
Stream chat completion deltas over Server-Sent Events, and ask for the usage frame.
The error envelope, every status and code, and whether retrying can help.
Retry a call, streaming or not, without starting duplicate inference work or a second charge.
What each purchase unlocks, what each 429 means, and how to back off.
Keep a session's requests together so its prefix cache stays warm across turns and fan-out workers.
Pricing, access and help
Pricing and credits
Pay as you go and USD 5 minimum top-up.
Account and access
Sign up, keys, workspaces, deletion.
Troubleshooting
401, 402, 403, 404, 429, 503 and what to do about each.
Compatible clients
Change the base URL, the key and the model id in the client you already use.
Set up a coding agent
Copy one prompt. Your coding agent sets up the open models API for you.