Loading...
RightNow Agent sends inference to the provider selected by a configured model entry. The shipped profile uses RunInfra, but the parser accepts additional OpenAI-compatible providers.
[models]
default = "runinfra"
[model_providers.runinfra]
base_url = "https://api.runinfra.ai/v1"
env_key = "RIGHTNOW_API_KEY"
supports_tool_choice_required = false
context_window = 1048576
[model.runinfra]
model = "qwen3-8-flash-next"
model_provider = "runinfra"
name = "RightNow (RunInfra)"
context_window = 1048576
auto_compact_threshold_percent = 85Set RIGHTNOW_API_KEY in the environment. The template contains only the variable name and does not store the credential value.
[model_providers.<name>]
base_url = "<OpenAI-compatible base URL>"
env_key = "<API key environment variable>"
context_window = <context window tokens>
supports_tool_choice_required = <true or false>
[model.<name>]
model = "<provider model slug>"
model_provider = "<name>"
name = "<display name>"
context_window = <context window tokens>Set the named environment variable, then select the model entry for one invocation with -m <name>. The user is responsible for the endpoint, model slug, context window, and provider capability settings.
[model_providers.cerebras]
base_url = "<Cerebras OpenAI-compatible base URL>"
env_key = "CEREBRAS_API_KEY"
[model.cerebras]
model = "<Cerebras model slug>"
model_provider = "cerebras"
name = "Cerebras"Set CEREBRAS_API_KEY and select the entry with -m cerebras. This provider is not present in the shipped template, and RightNow does not supply its endpoint or model slug.
Groq, OpenRouter, and Vercel AI Gateway can be added with the same provider and model shape. Supply and validate the appropriate base URL and model slug yourself.