Connect a model
Terere Harness works with any OpenAI- or Anthropic-compatible API. You bring the endpoint and, if it needs one, the key.
Last updated 29 September 2026
The four settings
The first window asks for these, and so does Settings, then Models, when you add another provider.
- Base URL: the address of the API, for example
https://api.openai.com/v1. - API type: OpenAI-compatible (Chat Completions) for most providers and local servers, or Anthropic-compatible (Messages) for Anthropic’s API.
- API key: the key from your provider’s dashboard. Leave it empty for a local server that doesn’t use one. The key is saved on your computer only.
- Model ID: the exact name your provider uses for the model, as shown in its model list.
Use a model that supports tool calling (also called function calling). Terere Harness works by calling tools to read files, edit code and run commands, so a model without it can chat but can’t do the work.
Settings for common providers
The model IDs are examples. Providers add and retire models often, so check the current list in your provider’s documentation.
| Provider and API type | Base URL | API key | Example model ID |
|---|---|---|---|
| OpenAIOpenAI-compatible | https://api.openai.com/v1 | Required | gpt-4.1 |
| AnthropicAnthropic-compatible | https://api.anthropic.com | Required | claude-sonnet-5-5 |
| OpenRouterOpenAI-compatible | https://openrouter.ai/api/v1 | Required | anthropic/claude-sonnet-5-5 |
| DeepSeekOpenAI-compatible | https://api.deepseek.com/v1 | Required | deepseek-chat |
| Google GeminiOpenAI-compatible | https://generativelanguage.googleapis.com/v1beta/openai | Required | gemini-2.5-pro |
| Ollama (on your computer)OpenAI-compatible | http://localhost:11434/v1 | Leave empty | llama3.1 |
| LM Studio (on your computer)OpenAI-compatible | http://localhost:1234/v1 | Leave empty | The model’s identifier in LM Studio |
Models on your computer
With Ollama, download a model first with ollama pull llama3.1, and keep Ollama running while you use Terere Harness. With LM Studio, load a model and start its local server from the Developer tab. Neither needs a key, and your prompts never leave your computer.
Change or add models later
Open Settings, then Models, to add more providers or manage the ones you have. To switch models, use the model picker in a session; the model you pick there becomes the default for new sessions.
If something doesn’t work
“Could not save the endpoint”
Check that the base URL starts with http:// or https:// and has nothing after it such as ?key=. Paste the key on its own, without quotes, spaces or a name like OPENAI_API_KEY=.
Unauthorized (401) or forbidden (403)
The key is wrong, expired, or doesn’t have access to that model. Create a new key in your provider’s dashboard and paste it again.
Not found (404)
The base URL or model ID is wrong. OpenAI-compatible URLs usually end in /v1; Anthropic’s is just https://api.anthropic.com. Copy the model ID exactly as your provider lists it.
Can’t connect to a local model
Make sure the server is running and the port matches: 11434 for Ollama, 1234 for LM Studio. Open the base URL followed by /models in a browser; it should list your models.
The model answers but doesn’t edit files or run commands
The model doesn’t support tool calling, or supports it poorly. Try a larger model, or one your provider lists as supporting tools.