DeepSeek Harness Plugin

Chip-G0202/dsh-model-radar

Category Models & Providers Added 2026-11-11

Runs a four-task, 150-point model intelligence benchmark inside DeepSeek Harness (Qin 60, Pompeii 45, Pelican 22.5, Candy 22.5): each selected model × reasoning-effort pair executes every task in its own isolated subagent session, Qin and Pelican are graded by the selected judge model against rubrics, Pompeii and Candy programmatically, and batches keep scores, artifacts and cost. Adds a 0–1000 real-world performance score per model × effort computed from local session logs across seven dimensions (output speed, first-token latency, reasoning speed, tool cadence, tool latency, tool success rate, cache hit), with baseline deltas and controlled speed runs, plus a sidebar page with ranking, performance, history and settings views. Each batch spends real tokens of the candidate and judge models, and candidate subagents get file and bash tools inside an isolated run directory.

Install

# from a prebuilt release tarball

dsh plugin --profile web add "https://github.com/Chip-G0202/dsh-model-radar/releases/latest/download/dsh-model-radar.tgz"

# from GitHub (first run asks for allowBuilds approval — follow the hint, retry)

dsh plugin --profile web add github:Chip-G0202/dsh-model-radar

Any plugin you install runs third-party code with your own permissions — it can read your files, use your credentials, and reach the network, and tool approvals don’t sandbox it. GitHub-sourced plugins also run build scripts at install time — pnpm blocks those until you allow them, so an install can stop with ERR_PNPM_GIT_DEP_PREPARE_NOT_ALLOWED or ERR_PNPM_IGNORED_BUILDS; dsh prints the exact key to add under allowBuilds in your profile’s pnpm-workspace.yaml, and the install works on the next run. Allowing a build is a trust decision: only install sources you trust, and pin a commit (github:owner/repo#sha).

Links

More in this category

View the whole category →

Community comments

Comments are public GitHub Discussions. Loading them connects to GitHub and Giscus; a GitHub account is required to post.