DeepSeek Harness Plugin

Azhe0306/dsh-connectors#desktop-connector

Stars ★ 0 Category Tools & Capabilities Added 2026-09-26

Windows desktop control connector: through 10 agent tools it captures the screen (including occluded and partially off-screen windows), lists and focuses windows, moves, clicks, drags and scrolls the mouse, and sends key chords or arbitrary Unicode text. Built on koffi FFI: no compiler, no per-call subprocess, and its own GDI screenshot plus PNG encoder.

Install

# from GitHub (first run asks for allowBuilds approval — follow the hint, retry)

dsh plugin --profile web add github:Azhe0306/dsh-connectors#path:/packages/desktop-connector

Any plugin you install runs third-party code with your own permissions — it can read your files, use your credentials, and reach the network, and tool approvals don’t sandbox it. GitHub-sourced plugins also run build scripts at install time — pnpm blocks those until you allow them, so an install can stop with ERR_PNPM_GIT_DEP_PREPARE_NOT_ALLOWED or ERR_PNPM_IGNORED_BUILDS; dsh prints the exact key to add under allowBuilds in your profile’s pnpm-workspace.yaml, and the install works on the next run. Allowing a build is a trust decision: only install sources you trust, and pin a commit (github:owner/repo#sha).

README

This plugin publishes its README in Chinese only.

让 agent 真正操控这台 Windows 电脑:看得见(截屏)也动得了(鼠标、键盘)。

  • 用 koffi 直接调 Win32(user32 / gdi32):无编译器、无每次调用的子进程。
  • 自带 GDI 截图 + PNG 编码(zlib + 手写 chunk),不需要任何图像库。
  • PrintWindow 优先:被遮挡或半出屏的窗口也能截;现代窗口画出空白时自动改用屏幕拷贝。
  • 后台进程置顶被拒的问题用 AttachThreadInput 解决。

安装

dsh plugin --profile web add github:Azhe0306/dsh-connectors#path:/packages/desktop-connector

工具:desktop_screen_info、desktop_windows_list、desktop_screen_shot、desktop_window_focus、 desktop_mouse_move、desktop_mouse_click、desktop_mouse_drag、desktop_mouse_scroll、 desktop_key_press、desktop_type_text。

Windows 专用(os: ["win32"])。desktop_key_press / desktop_type_text 可以带 window 参数: 给了就先置顶并确认成功,失败就拒绝执行——不会盲打到你没预期的窗口。

安全

这组工具会真实操作你的鼠标键盘。先 desktop_screen_shot 看清屏幕再动手;不要用它操作支付、删除确认这类高风险窗口。

MIT

Content from the project README on GitHub ↗

Links

More in this category

View the whole category →

Community comments

Comments are public GitHub Discussions. Loading them connects to GitHub and Giscus; a GitHub account is required to post.