A structured multi-panelist review workflow for the DeepSeek Harness: N panelists score in isolated subagents, blind to each other; a chair reconciles disagreement by anchor match then Δ-level adjudication; an independent critic audits the process. Works for design, code, paper or project review.
Install
# from GitHub (first run asks for allowBuilds approval — follow the hint, retry)
dsh plugin --profile web add github:LeslieWylie/review-workflow
Any plugin you install runs third-party code with your own permissions — it can read your files, use your credentials, and reach the network, and tool approvals don’t sandbox it. GitHub-sourced plugins also run build scripts at install time — pnpm blocks those until you allow them, so an install can stop with ERR_PNPM_GIT_DEP_PREPARE_NOT_ALLOWED or ERR_PNPM_IGNORED_BUILDS; dsh prints the exact key to add under allowBuilds in your profile’s pnpm-workspace.yaml, and the install works on the next run. Allowing a build is a trust decision: only install sources you trust, and pin a commit (github:owner/repo#sha).
README
What is this
A generic multi-panelist review workflow skill. Generalized from an internal collaboration-review process, suitable for any structured review scenario — project review, paper review, code review, design review, etc.
Core Capabilities
| Module | Content |
|---|---|
| 6-Step Process + 6 Checkpoints | Material completeness check → Bundle preparation → N-panelist parallel scoring → Aggregation → Critic review → Final decision |
| N Independent Panelists | Panelists run in isolated subagents, blind to each other, preventing bias contamination |
| Anchor Consistency Check | Two-phase disagreement resolution: anchor matching → Δ-level adjudication |
| Independent Critic Review | Isolated subagent reviews process compliance, challenges reasoning gaps |
| Re-review Support | Incremental re-review: only re-evaluate changed dimensions |
| Configurable | Review dimensions, scoring criteria, templates, panelist count all configurable |
Install
dsh plugin --profile web add "github:LeslieWylie/review-workflow"
After restart, load the skill in any session:
load review-workflow
Required Configuration
This skill requires project-level configuration (in the project's own skill or config files):
| Config | Description | Example |
|---|---|---|
| rubric | Review dimensions and scoring criteria | 5 dimensions, 5-point scale with anchor descriptions |
| bundle template | Review material bundle template | bundle.md |
| panelist prompt | Panelist prompt template | panelist-prompt.md |
| aggregation template | Aggregation report template | aggregation.md |
| critic template | Critic report template | critic-report.md |
| checklist | Material completeness checklist | proposal-checklist.md |
| panelist count | Number of panelists | 2 |
| score threshold | Pass/fail threshold per dimension | ≥3/5 |
Design Principles
- Scenario-agnostic: Only defines the review process skeleton. Specific dimensions, criteria, and templates come from the project
- Role isolation: Panelists run independently, Critic in isolated session, preventing bias
- Checkpoint enforcement: Each step has a checkpoint; cannot proceed without passing
- Auditable: All intermediate artifacts saved to disk, fully traceable
Sanitization Notice
This plugin was generalized from an internal collaboration-review process. All internal project references (specific project names, model names, internal tool paths, etc.) have been removed.
Changelog
See CHANGELOG.md.
License
MIT
Links
More in this category
Q00/ouroboros#integrations/dsh-plugin★ 6166
Config-only bundle that mounts Ouroboros through the DSH MCP client, exposing 36 interview, Seed, execution, evaluation, and evolution workflow tools in DSH.
loopx-project/loopx#dsh-loopx-plugin★ 6125
LoopX, a provider-neutral, local-first state kernel and control plane for long-horizon agents: keeps Goal, Todo, gate, evidence, quota, recovery, and handoff state above DeepSeek Harness, while the plugin bootstraps the CLI and skills, admits bounded same-session continuation, and adds a loopback GoalBar for the exact bound loop.
chuspeeism/dashi-taskboard#deepseek-harness★ 3273
Embeds the active installed Codex Taskboard runtime in the DeepSeek Harness sidebar, using its launcher runtime descriptor instead of a fixed port.
NanmiCoder/dsh-agent-teams★ 1883
AgentTeams multi-agent teams.
EthanYoQ/AI-Novel-Writer#dsh-ai-novel-writer★ 1241
Installs a dedicated AI novel-writing preset and workbench: revisioned local project assets, a compact side drawer, and native approval-gated single-file changes.
tong-io/tongflow#dsh-tongflow★ 1032
TongFlow film-crew studio for image, voice, music and video production: the agent writes per-asset TongFlow workflow files (.tongflow.json) that run through TongFlow plugins, with an embedded workflow canvas, a shot/character/take project layout and a manga-drama template; sessions starting with @tongflow open the Studio view.
Community comments
Comments are public GitHub Discussions. Loading them connects to GitHub and Giscus; a GitHub account is required to post.