DeepSeek Harness Plugin

dingchenhui0618-arch/dsh-compress-bench

Category Tools & Capabilities Added 2026-11-10

A local mirrored A/B benchmark for context compression, not another compressor. It runs one fixed read-only scenario twice with the same model and temperature — compression off, then on — and reports input tokens, turns, tool-call success, fact coverage, answer similarity and a per-line diff, with JSON, a self-contained SVG and raw warnings. 18 node --test tests, zero dependencies. The first measured run: 63,029 → 6,927 locally estimated input tokens (−89.0%), 3 → 3 turns, facts 3/3 → 3/3, answer similarity 1.00 on one sample.

Install

# from GitHub (first run asks for allowBuilds approval — follow the hint, retry)

dsh plugin --profile web add github:dingchenhui0618-arch/dsh-compress-bench

Any plugin you install runs third-party code with your own permissions — it can read your files, use your credentials, and reach the network, and tool approvals don’t sandbox it. GitHub-sourced plugins also run build scripts at install time — pnpm blocks those until you allow them, so an install can stop with ERR_PNPM_GIT_DEP_PREPARE_NOT_ALLOWED or ERR_PNPM_IGNORED_BUILDS; dsh prints the exact key to add under allowBuilds in your profile’s pnpm-workspace.yaml, and the install works on the next run. Allowing a build is a trust decision: only install sources you trust, and pin a commit (github:owner/repo#sha).

Links

More in this category

View the whole category →

Community comments

Comments are public GitHub Discussions. Loading them connects to GitHub and Giscus; a GitHub account is required to post.