Open models
Updated
Chat completions and Responses are chat-compatible. Messages follows the compatible Messages request and response protocol. Use a workspace API key; credits or an existing coding plan pay for usage on the open-models service.
| Connection | Value |
|---|---|
| API base | https://api.runinfra.ai/v1 |
| Workspace key | rp_... |
| Process variable | RUNINFRA_GATEWAY_KEY |
| Billing | The existing funding rules of your open-model account. |
Replace MODEL_ID with an available id from Open models; read current capabilities, limits and prices from GET /v1/models.
Call an open model or use the RightNow model. Each API has its own key and contract.
Using a coding agent? Your agent can set up the open-models service for you. Copy the prompt from Set up with your coding agent.
Call a hosted model
Set the base URL to https://api.runinfra.ai/v1, use a workspace API key, and pass a model id.
GET /v1/models is the authoritative list of hosted chat models. It also reports when one is temporarily paused.
The open models API quickstart
Key, base URL, first call.
Compatible clients
The chain client, the routing client, the indexing client, AI SDK, plain fetch.
Rate limits
Request, concurrency, and token limits by operation.
Coding agents
Copy one prompt. Your coding agent sets up the open-models service for you.