LLM Providers

Post-processing runs your matching Custom Prompts rule over the transcribed text with an LLM. It is configured in Settings → Post-Processing.

Two modes

• Ollama (Local) — badged 100% Offline: "Private local LLM processing on your device".
• Your API Key — badged BYOK: you supply a key for one of the cloud providers below.

BYOK providers

Pick one under Provider:

• Groq — Ultra-fast inference
• OpenAI — GPT models
• Anthropic — Claude models
• Google Gemini — Fast & cheap
• Mistral — European, GDPR
• OpenRouter — 100+ models
• Cerebras — Ultra-fast

Model lists are fetched, never hardcoded

Speakly ships no list of model names. Paste a valid key and it asks the provider which models your account can use, then fills the dropdown from that answer. If a model you had saved disappears upstream, Speakly switches to one that still exists rather than failing with a 404.

Until a valid key is present the field shows a message instead of a dropdown:

• Add a valid API key to load available models. — no key yet
• Loading models… — the fetch is in flight
• No models found — check that your API key is valid. — the provider rejected the key

Defaults on a fresh install

• Ollama Endpoint: http://127.0.0.1:11434
• Model Name (Ollama): llama3
• OpenAI model: gpt-5.6-luna
• Groq model: openai/gpt-oss-120b

Anthropic, Google Gemini, Mistral, OpenRouter and Cerebras have no shipped default — their model is chosen from the fetched list once your key is in.

Using Ollama

1. Install Ollama from ollama.com.
2. Run ollama serve, then ollama pull llama3.
3. In Settings → Post-Processing, pick Ollama (Local).
4. Leave Ollama Endpoint at http://127.0.0.1:11434 and set Model Name to the model you pulled.
5. Click Test Connection. It reports Connected or Connection failed.