windows-ui-automation
Automate Windows GUI interactions (mouse, keyboard, windows) using PowerShell. Use when the user needs to simulate user input on the desktop, such as moving the cursor, clicking buttons, typing text in non-web apps, or managing window states.
- License 许可
- MIT
- 最近更新
- 2026-06-10
- Stars
- ★ 3
- Forks
- 0
01 前言 Front Matter
- name
- windows-ui-automation
- description
- Automate Windows GUI interactions (mouse, keyboard, windows) using PowerShell. Use when the user needs to simulate user input on the desktop, such as moving the cursor, clicking buttons, typing text in non-web apps, or managing window states.
03 SKILL.md 正文
Windows UI Automation
Control the Windows desktop environment programmatically.
Core Capabilities
- Mouse: Move, click (left/right/double), drag.
- Keyboard: Send text, press special keys (Enter, Tab, Alt, etc.).
- Windows: Find, focus, minimize/maximize, and screenshot windows.
Usage Guide
Mouse Control
Use the provided PowerShell script mouse_control.ps1.txt:
# Move to X, Y
powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action move -X 500 -Y 500
# Click at current position
powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action click
# Right click
powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action rightclick
Keyboard Control
Use keyboard_control.ps1.txt:
# Type text
powershell -File skills/windows-ui-automation/keyboard_control.ps1.txt -Text "Hello World"
# Press Enter
powershell -File skills/windows-ui-automation/keyboard_control.ps1.txt -Key "{ENTER}"
Window Management
To focus a window by title:
$wshell = New-Object -ComObject WScript.Shell; $wshell.AppActivate("Notepad")
Best Practices
- Safety: Always move the mouse slowly or include delays between actions.
- Verification: Take a screenshot before and after complex UI actions to verify state.
- Coordinates: Remember that coordinates (0,0) are at the top-left of the primary monitor.
04 同仓库更多 Skills
youtube-content
YouTube transcripts to summaries, threads, blogs.
xurl
X/Twitter via xurl CLI: post, search, DM, media, v2 API.
touchdesigner-mcp
Control a running TouchDesigner instance via twozero MCP — create operators, set parameters, wire connections, execute Python, build real-time visuals. 36 native tools.
test-driven-development
TDD: enforce RED-GREEN-REFACTOR, tests before code.
teams-meeting-pipeline
Operate the Teams meeting summary pipeline via Hermes CLI — summarize meetings, inspect pipeline status, replay jobs, manage Microsoft Graph subscriptions.
systematic-debugging
4-phase root cause debugging: understand bugs before fixing.