A structured multi-panelist review workflow for the DeepSeek Harness: N panelists score in isolated subagents, blind to each other; a chair reconciles disagreement by anchor match then Δ-level adjudication; an independent critic audits the process. Works for design, code, paper or project review.
Install
# from GitHub (first run asks for allowBuilds approval — follow the hint, retry)
dsh plugin --profile web add github:LeslieWylie/review-workflow
Any plugin you install runs third-party code with your own permissions — it can read your files, use your credentials, and reach the network, and tool approvals don’t sandbox it. GitHub-sourced plugins also run build scripts at install time — pnpm blocks those until you allow them, so an install can stop with ERR_PNPM_GIT_DEP_PREPARE_NOT_ALLOWED or ERR_PNPM_IGNORED_BUILDS; dsh prints the exact key to add under allowBuilds in your profile’s pnpm-workspace.yaml, and the install works on the next run. Allowing a build is a trust decision: only install sources you trust, and pin a commit (github:owner/repo#sha).
README
What is this
A generic multi-panelist review workflow skill. Generalized from an internal collaboration-review process, suitable for any structured review scenario — project review, paper review, code review, design review, etc.
Core Capabilities
| Module | Content |
|---|---|
| 6-Step Process + 6 Checkpoints | Material completeness check → Bundle preparation → N-panelist parallel scoring → Aggregation → Critic review → Final decision |
| N Independent Panelists | Panelists run in isolated subagents, blind to each other, preventing bias contamination |
| Anchor Consistency Check | Two-phase disagreement resolution: anchor matching → Δ-level adjudication |
| Independent Critic Review | Isolated subagent reviews process compliance, challenges reasoning gaps |
| Re-review Support | Incremental re-review: only re-evaluate changed dimensions |
| Configurable | Review dimensions, scoring criteria, templates, panelist count all configurable |
Install
dsh plugin --profile web add "github:LeslieWylie/review-workflow"
After restart, load the skill in any session:
load review-workflow
Required Configuration
This skill requires project-level configuration (in the project's own skill or config files):
| Config | Description | Example |
|---|---|---|
| rubric | Review dimensions and scoring criteria | 5 dimensions, 5-point scale with anchor descriptions |
| bundle template | Review material bundle template | bundle.md |
| panelist prompt | Panelist prompt template | panelist-prompt.md |
| aggregation template | Aggregation report template | aggregation.md |
| critic template | Critic report template | critic-report.md |
| checklist | Material completeness checklist | proposal-checklist.md |
| panelist count | Number of panelists | 2 |
| score threshold | Pass/fail threshold per dimension | ≥3/5 |
Design Principles
- Scenario-agnostic: Only defines the review process skeleton. Specific dimensions, criteria, and templates come from the project
- Role isolation: Panelists run independently, Critic in isolated session, preventing bias
- Checkpoint enforcement: Each step has a checkpoint; cannot proceed without passing
- Auditable: All intermediate artifacts saved to disk, fully traceable
Sanitization Notice
This plugin was generalized from an internal collaboration-review process. All internal project references (specific project names, model names, internal tool paths, etc.) have been removed.
Changelog
See CHANGELOG.md.
License
MIT
Links
More in this category
loopx-project/loopx#dsh-loopx-plugin★ 6581
LoopX, a provider-neutral, local-first state kernel and control plane for long-horizon agents: keeps Goal, Todo, gate, evidence, quota, recovery, and handoff state above DeepSeek Harness, while the plugin bootstraps the CLI and skills, admits bounded same-session continuation, and adds a loopback GoalBar for the exact bound loop.
Q00/ouroboros#integrations/dsh-plugin★ 6361
Config-only bundle that mounts Ouroboros through the DSH MCP client, exposing 36 interview, Seed, execution, evaluation, and evolution workflow tools in DSH.
chuspeeism/dashi-taskboard#deepseek-harness★ 3485
Embeds the active installed Codex Taskboard runtime in the DeepSeek Harness sidebar, using its launcher runtime descriptor instead of a fixed port.
NanmiCoder/dsh-agent-teams★ 2927
AgentTeams multi-agent teams.
EthanYoQ/AI-Novel-Writer#dsh-ai-novel-writer★ 2621
Installs a dedicated AI novel-writing preset and workbench: revisioned local project assets, a compact side drawer, and native approval-gated single-file changes.
shanliuling/dsh-image-gen★ 1479
Native conversational image generation for DeepSeek Harness: ask the agent to create an image, and it handles generation and keeps the result directly in the conversation.
Community comments
Comments are public GitHub Discussions. Loading them connects to GitHub and Giscus; a GitHub account is required to post.