Jesse-njx/dsh-polyglot

The model switch for DSH. Point DeepSeek Harness at any OpenAI-compatible endpoint — with curated presets for free and cheap DeepSeek providers and automatic fallback when a free tier rate-limits you.

What claude-code-router is to Claude Code, dsh-polyglot is to DSH — except DSH's ctx.llm is a sanctioned extension seam, so there is no request interception: the generic adapter and the router are both real LlmAdapter registrations.

• One generic adapter. A single OpenAI-compatible ctx.llm adapter parameterized by {baseUrl, apiKey, model, headers?, quirks?}. Streaming, tool calls, and usage extraction are all handled; per-provider deviations (reasoning field names, strict tool schemas, cache-folded usage) are small declarative quirks flags, never per-provider code.
• A router with fallback. On 429 / quota-exceeded / 5xx (or a missing key), the failing provider is marked cooling-down (exponential backoff, honoring Retry-After) and the request is retried on the next provider in the chain. Free tiers rate-limit constantly — automatic failover is the whole product.
• Provider presets as data. presets/*.json — community PRs add providers without touching the adapter. Each preset carries verifiedAt and free-tier notes so rot is visible.
• Usage you can see. Every attempt lands in the append-only session log as polyglot/served; /polyglot usage tallies per provider with token counts and estimated cost from preset pricing.

Quick start

Install the bundle into a profile (a DSH profile is an ordered stack of plugin-bundle patch layers):

dsh plugin --profile web add @dsh-polyglot/bundle

The bundle's patch registers the polyglot plugin with the recommended default chain — "code all day for free until something rate-limits, then degrade gracefully to cheapest-paid":

nous-portal → opencode-zen → deepseek-official (5M grant) → kilo

Configure keys through the credentials seam (the web Models page writes them), or export the env names each preset declares:

export NOUS_PORTAL_TOKEN=...      # nous-portal (bearer, manual token for v0.1)
export OPENCODE_API_KEY=...       # opencode-zen
export DEEPSEEK_API_KEY=...       # deepseek-official (new accounts: 5M free tokens, 30 days, no card)
export KILO_API_KEY=...           # kilo (paid fallback rung)

Pick the virtual provider polyglot in the model selector. A provider without a configured key is skipped automatically — the chain degrades, it never fails hard.

Day-to-day commands

Command	What it does
/model	show chains and the active one
/model <chain>	switch the active chain mid-session (logged as polyglot/chain)
/polyglot	status: active chain, entries, provider cooldowns
/polyglot usage	per-provider tally from the session log: calls, ok/failed, tokens, est. cost
/polyglot presets	free-tier posture of the active chain's presets

Configuration

Override chains and cooldown from your profile patch:

# your profile's cordis.patch.yml (or --patch overlay)
- patch:
    - id: polyglot
      config:
        chains:
          default:
            - preset: nous-portal
            - preset: opencode-zen
            - preset: deepseek-official
              model: deepseek-v4-flash
            - preset: kilo
          paid:
            - preset: deepseek-official
              model: deepseek-v4-pro
        cooldown:
          baseMs: 30000        # initial per-provider cooldown after a failure
          maxMs: 900000        # ceiling (also honors provider Retry-After)
          factor: 2            # exponential growth per consecutive failure
          jitterRatio: 0.1     # symmetric jitter around each delay

Per-entry overrides: provider (route name), model, baseUrl, apiKeyEnv, headers, quirks — the custom preset is the escape hatch for vLLM/Ollama/SGLang localhost and any other OpenAI-compatible endpoint (Qwen/GLM/Kimi official APIs included).

Quirks reference

Flag	Default	Meaning
reasoningField	'reasoning_content'	wire delta field carrying reasoning text; null disables reasoning entirely
maxTokensField	'max_tokens'	output-cap wire field (max_completion_tokens for newer hosts)
usage	'standard'	'deepseek' subtracts cache hits folded into prompt_tokens; 'none' when the host reports none
streamOptions	true	send stream_options: {include_usage: true}
strictToolSchemas	false	add strict: true to tool schemas
thinkingField	false	send thinking: {type} (DeepSeek spelling)
reasoningEffortField	true	send reasoning_effort for high/max efforts

Preset registry

All figures were re-verified 2026-08-14 against provider docs; these move weekly — every preset carries verifiedAt, and a CI job pinging each baseUrl with a 1-token request is the planned trust loop.

Preset	What you get	Cost / limits	Notes
deepseek-official	V4-Flash, V4-Pro	$0.14/$0.28 per M (Flash); 5M free tokens new accounts, 30 days, no card	Baseline; prices trending up
opencode-zen	deepseek-v4-flash-free (+ Qwen 3.6 Plus, MiniMax M3, MiMo…)	Free, no card, 200k context; rate limits undocumented	Commercial terms unclear — flagged in the preset notes
nous-portal	deepseek/deepseek-v4-flash:free	Free, OAuth-gated, hard rate ceiling that returns errors	The poster child for fallback; put it first in a chain
kilo	V4-Pro, V4-Flash, V3.1 Terminus	Pay-as-you-go at no markup over provider rates	Good paid-fallback rung
openrouter	:free DeepSeek variants + everything else	Free variants throttled; paid at listed rates	Widest catalog, one key
custom	anything OpenAI-compatible	—	vLLM/Ollama/SGLang localhost; Qwen/GLM/Kimi official endpoints
groq / together / fireworks	DeepSeek hosting	fast but pricier	Latency upgrades, not savings

How it works

profile ──> provider route "polyglot" (the router meta-adapter)
              │  chain: nous-portal → opencode-zen → deepseek-official → kilo
              ▼
        ctx.llm.stream({provider: "nous-portal", ...})
              │  adapter per real route (OpenAiCompatAdapter, one per preset)
              ▼
        POST {baseUrl}/chat/completions   (SSE, usage, tools)

The router forwards the first attempt that completes. A fallback-eligible failure that arrives before any content flowed — the free-tier ceiling case — swaps to the next provider seamlessly; a failure after content flowed cannot be unwritten and surfaces as a normal error finish. Which provider actually served each turn is durable in the session log (polyglot/served), so /polyglot usage is a pure fold over the log, not plugin-side accounting.

ToS note

Free tiers are often gated for evaluation use (OpenCode Zen's commercial terms are undocumented). Preset notes surface this at configure time — dsh-polyglot does not silently launder usage.

Development

pnpm install
pnpm typecheck    # strict TS
pnpm build        # tsc → lib/
pnpm test         # 56 tests: mock OpenAI-compat server with scripted 429/500/
                  # stream scenarios, golden wire assertions per quirk, and
                  # end-to-end cordis mounts proving fallback + session events

Roadmap

• v0.2 — per-role chains (planner → paid V4-Pro, executor/summarizer → free Flash); OAuth device flow for Nous Portal; preset auto-update check; provider benchmark/arena integration.
• Non-goals — proxying non-chat modalities; silent key laundering.