DeepSeek Harness Plugin

verson00/dsh-local-llm

Category Models & Providers Added 2026-11-08

Runs the local llama.cpp Qwen3.5-4B from a Settings page — Windows only, NVIDIA GPU (8 GB VRAM handles the 4B Q4) — with start, stop and restart, launch parameters, deployment paths with a presence check, provider-route and compaction-policy sync in the profile patch, a loopback request-capture proxy, and a local_worker tool that hands translation, OCR and video-frame chores to the local model by file path. Needs llama-server.exe (verified on b12069) and Qwen3.5-4B GGUF + mmproj files on disk; video frames also need ffmpeg.

Install

# from GitHub (first run asks for allowBuilds approval — follow the hint, retry)

dsh plugin --profile web add github:verson00/dsh-local-llm

Any plugin you install runs third-party code with your own permissions — it can read your files, use your credentials, and reach the network, and tool approvals don’t sandbox it. GitHub-sourced plugins also run build scripts at install time — pnpm blocks those until you allow them, so an install can stop with ERR_PNPM_GIT_DEP_PREPARE_NOT_ALLOWED or ERR_PNPM_IGNORED_BUILDS; dsh prints the exact key to add under allowBuilds in your profile’s pnpm-workspace.yaml, and the install works on the next run. Allowing a build is a trust decision: only install sources you trust, and pin a commit (github:owner/repo#sha).

Links

More in this category

View the whole category →

Community comments

Comments are public GitHub Discussions. Loading them connects to GitHub and Giscus; a GitHub account is required to post.