ui-drive
Thin rail-router driver for a LIVE running web or Electron app — attach to it, resolve any target through three fallback rails (a11y-ref then CDP css then vision xy), point at an element with a screenshot-visible highlight, discuss it with full context, and actuate it (click/fill/hover/press/select). Also drives the ephemeral restyle loop — preview a CSS candidate as an injected style overlay, apply/accept/revert it, and harvest the accepted deltas as a PROPOSED patch — WITHOUT ever editing application source. Rides the vendored playwright at exactly 1.61.1 from the sibling ui-audit skill, so no new browser dependency. Every mutating verb logs to a bounded shadow sink (observe-only, never blocks). Use as the low-level app-driving and pointing channel under design-studio-session and design-review-loop. NOT for the design-quality verdict (use ui-audit) and NOT for element-to-source mapping or micro-commits (use design-studio-session).
- License 许可
- MIT
- 最近更新
- 2026-11-02
- Stars
- ★ 0
- Forks
- 0
01 前言 Front Matter
- name
- ui-drive
- metadata
- { "origin": "user" }
- description
- Thin rail-router driver for a LIVE running web or Electron app — attach to it, resolve any target through three fallback rails (a11y-ref then CDP css then vision xy), point at an element with a screenshot-visible highlight, discuss it with full context, and actuate it (click/fill/hover/press/select). Also drives the ephemeral restyle loop — preview a CSS candidate as an injected style overlay, apply/accept/revert it, and harvest the accepted deltas as a PROPOSED patch — WITHOUT ever editing application source. Rides the vendored playwright at exactly 1.61.1 from the sibling ui-audit skill, so no new browser dependency. Every mutating verb logs to a bounded shadow sink (observe-only, never blocks). Use as the low-level app-driving and pointing channel under design-studio-session and design-review-loop. NOT for the design-quality verdict (use ui-audit) and NOT for element-to-source mapping or micro-commits (use design-studio-session).
03 SKILL.md 正文
ui-drive Skill
A thin rail-router driver for a live app. Where ui-audit looks and scores, ui-drive
points, drives, and previews — the actuation channel an agent uses to touch a running UI.
Skill location: ~/.Codex/skills/ui-drive/ (files: SKILL.md, drive.mjs).
When to use
- Point Codex (or the owner) at a specific live element and screenshot it with a highlight box.
- Actuate a running app deterministically: click, fill, hover, press, check, select, scroll, focus.
- Drive the ephemeral restyle loop — preview a CSS candidate as an injected overlay, apply / accept / revert it, then harvest the accepted deltas as a proposed patch — with zero source edits.
- As the low-level driver invoked by
design-studio session(interactive-modify, N.2) and thedesign-review-loopgates.
Not for: the design-quality VERDICT (use ui-audit), nor element→source resolution and
micro-commits (use design-studio-session).
Zero new dependency (Correction 3: near-zero-build)
ui-drive imports the browser stack that the sibling ui-audit skill already vendors at exactly
playwright@1.61.1, resolved by absolute file URL from
../ui-audit/node_modules/playwright/index.mjs (override with UI_DRIVE_PLAYWRIGHT). No npm install in this skill. If ui-audit has not had npm install && npx playwright install chromium
run once, do that in ui-audit first — its browser binaries are shared here.
The three rails
The pinned highlight (why point works)
Verbs
Safety / shadow mode (COUNCIL C5)
Usage — programmatic (primary: one process holds the whole session)
Usage — CLI
Cross-process against a running app (Chrome started with --remote-debugging-port=9222,
or an Electron app exposing a CDP endpoint):
Relationship to the design suite
04 同仓库更多 Skills
clarify-requirements
Resolve genuine pre-execution ambiguity by scanning repo context, generating 1-6 grounded options, and asking 1-3 focused questions via AskUserQuestion. NOT for mid-task use (injection risk); NOT when the goal is already unambiguous; use to disambiguate vague prompts before any file edits.
openmm-md
Run FREE, open-source, Windows-native GPU molecular dynamics via the openmm-md MCP (OpenMM + CUDA on the local NVIDIA GPU). Use for protein / protein-ligand MD when you want a free stack or are on Windows without a Schrodinger license. Covers the full workflow (prepare, solvate, minimize, equilibrate, production, analyze, mmgbsa) AND an honest decision guide vs Schrodinger Desmond, including how to run Desmond legitimately on Linux or a cloud GPU with a real license. This is a deliberately LESSER free alternative and does NOT replace the schrodinger MCP tools. Do NOT use it to pick a free tool when a validated FEP+, WaterMap, IFD-MD, or Prime MM-GBSA result is actually required.
visual-review
Take screenshots of web pages and UI using Playwright for visual review and iteration
status
Diagnostic status report — shows metaswarm installation state, project setup, and potential issues
start
Use when starting work on any task, when the user mentions metaswarm, or when the user wants to begin tracked development work
setup
Interactive project setup — detects your project, configures metaswarm, writes project-local files