skillset-dev-testing
Design, implement, or review Skillset compiler tests, internal fixtures, deterministic projection, adapter conformance, self-hosted checks, and external adoption evidence. Use when choosing a test tier, creating fake repositories, changing test infrastructure, or proving compiler and provider-output behavior.
- License 许可
- MIT
- 最近更新
- 2026-11-01
- Stars
- ★ 1
- Forks
- 0
01 前言 Front Matter
- name
- skillset-dev-testing
- metadata
- { "version": "0.1.0", "skillset.schema": "1" }
- description
- Design, implement, or review Skillset compiler tests, internal fixtures, deterministic projection, adapter conformance, self-hosted checks, and external adoption evidence. Use when choosing a test tier, creating fake repositories, changing test infrastructure, or proving compiler and provider-output behavior.
02 资源文件 1
- 参考文档references/fixture-strategy.md1.8 KB
03 SKILL.md 正文
Skillset Testing
Choose The Evidence Level
- Read
docs/adrs/0012-fixtures-tests-dogfooding-and-evals.md,docs/adrs/0019-deterministic-projection-and-adapter-conformance.md, andfixtures/README.md. - Use an inline temp fixture for focused positive, negative, diagnostic, and lifecycle cases.
- Add
fixtures/<case>/only for a durable whole-repo case shared by tests or too large to read inline. - Use pinned external fixtures only for opt-in adoption fidelity evidence; turn discovered product gaps into ordinary focused regression tests.
- Keep compiler fixtures, self-hosted dogfooding, deterministic
skillset testdeclarations, provider runtime probes, and model-facing evals distinct.
Read references/fixture-strategy.md before adding a checked-in or Git-backed fixture, changing test sandbox behavior, or choosing a conformance lane.
Protect The Sandbox
- Build Git-backed fixtures only with
scripts/test-helpers/git-remote.tsunder a proven disposable root. - Preserve
HOME; rely on repository verification entrypoints to isolate XDG roots and Git configuration. - Never initialize, configure, or commit into an arbitrary temp path, linked worktree, shared Git directory, or the Skillset checkout.
- Never hand-edit generated fixture output to make a test pass.
- Allocate temp fixtures with
createTestFixtureRootand observe cleanup withtempEntriesLeftBy(both inscripts/test-helpers/fixture-root.ts). Never call the OStmpdir()in a test;bun run test-fixture-temp:guardfails it. - After killing a process or process group,
await expectProcessGone(pid)fromscripts/test-helpers/process.ts. A one-shotprocess.kill(pid, 0)check is flaky on Linux, andbun run process-gone:guardrejects it.
Verify Narrowly Then Broadly
- Run focused tests with
bun run test:focused -- <test-files...>. - Run
bun run conformance:determinism,bun run conformance:adapters, orbun run conformance:fastwhen the compiler projection or provider contract changes. - Keep
bun run conformance:externalopt-in and network-aware. - Rebuild and check self-hosted output after
.skillset/changes. - Run
bun run checkbefore handoff and report any skipped slow or credentialed evidence explicitly.
04 同仓库更多 Skills
use-skillset
Use the skillset compiler in a repo with skillset.yaml or a .skillset/ directory. Covers creating a workspace, adding skills, rules, agents, hooks, and plugins, building and checking Claude, Codex, and Cursor output, repairing stale or hand-edited generated files, recording changes, cutting releases, importing existing skills, and marketplaces. Use when asked to add a rule, record a change, cut a release, or fix generated output.
broken
42
reference
Keep project references organized for review.
portable-proof
Proves that generated Agent Skills are accepted by pinned external consumers.
plugin-proof
Proves immediate-child skill fidelity inside an Agent Plugins package.
sink
Kitchen-sink skill exercising shared resources and custom resource mappings.