docs: document fallback patterns in default.yaml
Add comments explaining: - Auto same-model fallback via GitHub Models for Anthropic tiers - Inline per-tier fallback blocks - The full fallback order (primary → auto → inline → global chain) - local_providers map for named providers in fallback_chain - Usage examples for both patterns
This commit is contained in:
@@ -11,14 +11,57 @@ server:
|
|||||||
port: 18800
|
port: 18800
|
||||||
|
|
||||||
models:
|
models:
|
||||||
|
# ── Model tiers ────────────────────────────────────────────────────
|
||||||
|
# Each tier (default, fast, complex, local) defines a primary model.
|
||||||
|
# When an Anthropic tier fails, Flynn automatically tries the same
|
||||||
|
# model via GitHub Models before falling through to the global chain.
|
||||||
|
#
|
||||||
|
# You can override auto-fallback with an inline `fallback:` block:
|
||||||
|
#
|
||||||
|
# default:
|
||||||
|
# provider: anthropic
|
||||||
|
# model: claude-sonnet-4-20250514
|
||||||
|
# fallback: # ← inline per-tier fallback
|
||||||
|
# provider: openai
|
||||||
|
# model: gpt-4o
|
||||||
|
#
|
||||||
|
# ── Fallback order ─────────────────────────────────────────────────
|
||||||
|
# 1. Primary client for the tier
|
||||||
|
# 2. Auto same-model fallback via GitHub Models (Anthropic tiers only,
|
||||||
|
# skipped when an inline `fallback:` block is present)
|
||||||
|
# 3. Inline `fallback:` client (if configured)
|
||||||
|
# 4. Global fallback_chain (tried in order)
|
||||||
|
#
|
||||||
default:
|
default:
|
||||||
provider: anthropic
|
provider: anthropic
|
||||||
model: claude-sonnet-4-20250514
|
model: claude-sonnet-4-20250514
|
||||||
local:
|
local:
|
||||||
provider: ollama
|
provider: ollama
|
||||||
model: llama3.2:1b
|
model: llama3.2:1b
|
||||||
|
|
||||||
|
# ── Global fallback chain ──────────────────────────────────────────
|
||||||
|
# Entries can be tier names (default, fast, complex, local) or keys
|
||||||
|
# from local_providers below. Tried in order after per-tier fallbacks
|
||||||
|
# are exhausted.
|
||||||
fallback_chain: [local]
|
fallback_chain: [local]
|
||||||
|
|
||||||
|
# ── Named providers (optional) ─────────────────────────────────────
|
||||||
|
# Define additional providers that can be referenced by name in
|
||||||
|
# fallback_chain. Useful for secondary API accounts or self-hosted
|
||||||
|
# endpoints that aren't tied to a specific tier.
|
||||||
|
#
|
||||||
|
# local_providers:
|
||||||
|
# openrouter-backup:
|
||||||
|
# provider: openrouter
|
||||||
|
# model: anthropic/claude-sonnet-4
|
||||||
|
# ollama-big:
|
||||||
|
# provider: ollama
|
||||||
|
# model: llama3.1:70b
|
||||||
|
# endpoint: http://gpu-server:11434
|
||||||
|
#
|
||||||
|
# Then reference them in fallback_chain:
|
||||||
|
# fallback_chain: [openrouter-backup, ollama-big, local]
|
||||||
|
|
||||||
hooks:
|
hooks:
|
||||||
confirm:
|
confirm:
|
||||||
- shell.*
|
- shell.*
|
||||||
|
|||||||
Reference in New Issue
Block a user