Workflow & Automation

review-workflow

LeslieWylie/review-workflow · ★ 3

LeslieWylieCurated

A structured multi-panelist review workflow for the DeepSeek Harness: N panelists score in isolated subagents, blind to each other; a chair reconciles disagreement by anchor match then Δ-level adjudication; an independent critic audits the process. Works for design, code, paper or project review.

License
MIT
Added
2026-08-17
Maintenance
active
Install kind
github
Manifest details
Manifest status
Declared
Manifest path
package.json#dsh
Manifest checked
2026-08-19
Lifecycle scripts
None found

Static manifest checks report declarations only; they are not compatibility or security review.

安装

dsh plugin --profile web add github:LeslieWylie/review-workflow

GitHub 源码安装:首次需按提示配置 allowBuilds 构建授权后重试

For install and environment setup, plus plugin development tutorials, see DSH community docs ↗

README

Source README · body: en · Read Chinese README

Table of contents
  1. What is this
  2. Core Capabilities
  3. Install
  4. Required Configuration
  5. Design Principles
  6. Sanitization Notice
  7. Changelog
  8. License

简体中文

What is this

A generic multi-panelist review workflow skill. Generalized from an internal collaboration-review process, suitable for any structured review scenario — project review, paper review, code review, design review, etc.

Core Capabilities

Module Content
6-Step Process + 6 Checkpoints Material completeness check → Bundle preparation → N-panelist parallel scoring → Aggregation → Critic review → Final decision
N Independent Panelists Panelists run in isolated subagents, blind to each other, preventing bias contamination
Anchor Consistency Check Two-phase disagreement resolution: anchor matching → Δ-level adjudication
Independent Critic Review Isolated subagent reviews process compliance, challenges reasoning gaps
Re-review Support Incremental re-review: only re-evaluate changed dimensions
Configurable Review dimensions, scoring criteria, templates, panelist count all configurable

Install

dsh plugin --profile web add "github:LeslieWylie/review-workflow"

After restart, load the skill in any session:

load review-workflow

Required Configuration

This skill requires project-level configuration (in the project's own skill or config files):

Config Description Example
rubric Review dimensions and scoring criteria 5 dimensions, 5-point scale with anchor descriptions
bundle template Review material bundle template bundle.md
panelist prompt Panelist prompt template panelist-prompt.md
aggregation template Aggregation report template aggregation.md
critic template Critic report template critic-report.md
checklist Material completeness checklist proposal-checklist.md
panelist count Number of panelists 2
score threshold Pass/fail threshold per dimension ≥3/5

Design Principles

  • Scenario-agnostic: Only defines the review process skeleton. Specific dimensions, criteria, and templates come from the project
  • Role isolation: Panelists run independently, Critic in isolated session, preventing bias
  • Checkpoint enforcement: Each step has a checkpoint; cannot proceed without passing
  • Auditable: All intermediate artifacts saved to disk, fully traceable

Sanitization Notice

This plugin was generalized from an internal collaboration-review process. All internal project references (specific project names, model names, internal tool paths, etc.) have been removed.

Changelog

See CHANGELOG.md.

License

MIT