DSH tools for reproducing and validating the ml-quant-trading protocol v1 CPU benchmark, then drafting an issue-ready report. Requires a local clone of initial-d/ml-quant-trading (set as the workspace or repoPath) plus Python and PyTorch; this plugin does not fetch the repository or install its dependencies.
Install
# from a prebuilt release tarball
dsh plugin --profile web add "https://github.com/initial-d/dsh-plugin-mlquant-benchmark/releases/download/v0.1.0/dsh-plugin-mlquant-benchmark-0.1.0.tgz"
# from GitHub (first run asks for allowBuilds approval — follow the hint, retry)
dsh plugin --profile web add github:initial-d/dsh-plugin-mlquant-benchmark
Any plugin you install runs third-party code with your own permissions — it can read your files, use your credentials, and reach the network, and tool approvals don’t sandbox it. GitHub-sourced plugins also run build scripts at install time — pnpm blocks those until you allow them, so an install can stop with ERR_PNPM_GIT_DEP_PREPARE_NOT_ALLOWED or ERR_PNPM_IGNORED_BUILDS; dsh prints the exact key to add under allowBuilds in your profile’s pnpm-workspace.yaml, and the install works on the next run. Allowing a build is a trust decision: only install sources you trust, and pin a commit (github:owner/repo#sha).
README
DeepSeek Harness tools for reproducing the
initial-d/ml-quant-trading
protocol v1 CPU benchmark.
The point is narrow: make a DSH agent able to run the existing benchmark, read the machine-readable artifact, validate it against the benchmark protocol, and draft an issue-ready report. This plugin does not add a trading agent, does not call market data APIs, and does not configure any model provider.
Why this exists
ml-quant-trading is a good reproducibility target for agent harnesses:
- deterministic synthetic benchmark input;
- fixed protocol v1 command, seed, panel size, repetitions, and thread counts;
- JSON artifact suitable for automated checking;
- public issue template for DeepSeek Harness benchmark reports;
- explicit boundary that benchmark throughput is not trading performance.
Challenge: can DeepSeek Harness reproduce a quant benchmark end to end, preserve the evidence bundle, and avoid turning runtime numbers into alpha claims?
Listed in
awesome-dsh-plugin
via PR #2573.
Run-To-Report Path
- Install the plugin from GitHub.
- Open an
initial-d/ml-quant-tradingcheckout in DSH. - Ask DSH to run, validate, summarize, and draft a benchmark report.
- Submit the drafted report through the dedicated issue template.
That path is intentionally small: the plugin turns DSH attention into a reproducible benchmark report, not an investment or leaderboard claim.
Tools
This package registers four DSH tools:
| Tool | Purpose |
|---|---|
mlquant_benchmark_v1_cpu |
Run the fixed protocol v1 CPU benchmark and write artifacts/benchmark-v1.json. |
mlquant_read_benchmark_json |
Read the JSON artifact and render a compact Markdown result table. |
mlquant_validate_benchmark_json |
Check protocol v1 fields, expected cases, fixed parameters, and variance warnings. |
mlquant_draft_github_issue |
Draft a DeepSeek Harness benchmark issue body from the JSON artifact. It does not post to GitHub. |
Install
Install the package in a DeepSeek Harness profile or preset environment:
dsh plugin --profile web add github:initial-d/dsh-plugin-mlquant-benchmark
The package declares a dsh.bundle manifest that inserts:
- id: mlquant-benchmark
name: dsh-plugin-mlquant-benchmark
If you use a local checkout while developing, add the same row manually:
- id: mlquant-benchmark
name: file:/path/to/dsh-plugin-mlquant-benchmark
This package is intentionally not published to npm yet. GitHub distribution is enough for the first DSH-facing benchmark reports; npm can come later if there is real usage.
Suggested DSH prompt
Read AGENTS.md, docs/benchmarking.md, and docs/reality_check.md.
Use the mlquant benchmark tools to run the protocol v1 CPU benchmark, validate
and read the JSON artifact, and draft a DeepSeek Harness benchmark report. Keep
the result as an engineering reproducibility benchmark, not a trading-performance
claim.
Public report path
Post the drafted report through the main repository's dedicated template:
https://github.com/initial-d/ml-quant-trading/issues/new?template=deepseek_harness_benchmark.yml
Seed example:
https://github.com/initial-d/ml-quant-trading/issues/61
Independent DSH runs are tracked in the plugin challenge issue:
https://github.com/initial-d/dsh-plugin-mlquant-benchmark/issues/1
Post there if the plugin failed before a valid benchmark-v1.json artifact was
created. Post successful or caveated benchmark reports through the main
repository template above.
For context and agent-facing guardrails, read the main repository's
DeepSeek Harness Recipe
and
Quant Agent Reproducibility Target.
Development
npm install
npm test
The test loads the plugin with a mock ctx.tools.register, verifies that the
four tools register, reads and validates sample artifacts, and drafts an issue
body.
Non-goals
- No investment advice.
- No backtest-performance claim.
- No hidden model provider configuration.
- No posting to GitHub from the tool.
- No private data or API keys in artifacts.
Links
More in this category
Tencent/WeKnora#dsh-weknora★ 37918
Four read-only tools over a WeKnora knowledge base: list knowledge bases, hybrid passage search, reassemble one document's chunks in order, and WeKnora's own cited RAG or ReAct-agent answer with a resumable session id.
DayuanJiang/next-ai-draw-io#dsh-plugin★ 37097
Draws draw.io diagrams in DeepSeek Harness through the next-ai-drawio MCP server: the link in the reply opens a live preview in the right sidebar, you can edit the diagram by hand, and each AI change is a version you can restore. Node.js 18+; npx downloads the MCP server on first use.
superdesigndev/treg★ 8650
Tool catalog for agents: search ~2,600 external endpoints (SEO and SERP, backlinks, social, people and company enrichment, ad libraries, scraping) by the task you want done, read each one's parameters and per-call price, then call it with the credential injected server-side. Ships the skill plus an MCP row that stays disabled until TREG_TOKEN is set.
T-Auto/dsh-ops★ 5964
Provides bash, PowerShell 7, and high-performance Rust tools for DSH on Windows to reduce token usage.
sixtysevenlf/dsh-blender-plugin★ 2216
Lets a DSH agent drive a local Blender over a direct TCP channel with 15 tools: viewport frames, custom-angle renders, Python execution, headless and job offload, transaction rollback, and a planning layer of 228 ops across 34 families.
helloHub1212/dsh-windows-mcp★ 2002
Bridges the CursorTouch/Windows-MCP desktop automation server into DSH through the official MCP client bridge, registering its screenshot, UI tree snapshot, mouse and keyboard input, clipboard, process and registry tools as mcp__windows__* tools for the model, and adds a windows_mcp_doctor diagnostic tool. Computer Use is off by default and is switched on from the plugin panel.
Community comments
Comments are public GitHub Discussions. Loading them connects to GitHub and Giscus; a GitHub account is required to post.