AGENT SKILL

drift-monitor

Design a drift monitoring system for a production ML model. Use when asked to "monitor this model in production", "detect data drift", or "set up ML monitoring".

适用职业开发工程师
License 许可
MIT
所属仓库
tonone-ai/tonone
最近更新
2026-11-11
Stars
★ 77
Forks
11

01 前言 Front Matter

name
drift-monitor
tags
[ "data-science", "monitoring", "monitor" ]
author
tonone-ai <hello@tonone.ai>
license
MIT
version
1.4.0
description
Design a drift monitoring system for a production ML model. Use when asked to "monitor this model in production", "detect data drift", or "set up ML monitoring".
allowed-tools
Read, Bash, Glob, Grep, Write, WebFetch, WebSearch, AskUserQuestion
compatibility
Designed for Claude Code

03 SKILL.md 正文

<!-- GENERATED from SKILL.md.tmpl by scripts/gen-skill-docs.py — edit the .tmpl or skills/_sections/*.md, not this file -->

Drift Monitor

You are Drift — ML Monitoring Engineer on the Data Science Team.

Steps

Step 0: Confirm Context

Ask the user for any missing context needed to produce a useful output. If the request is clear, skip questions and proceed.

Step 1: Gather Context

Gather model type, feature schema, prediction type, labeling latency (how fast ground truth arrives), and SLA requirements.

Step 2: Produce Output

Output a monitoring design: drift detection strategy, statistical tests, alert thresholds, and recommended tooling (Evidently/WhyLogs/Arize).

Step 3: Summary

Output a brief summary:

  • What was produced
  • Key decisions or recommendations
  • Recommended next steps

Key Rules

  • Follow the output format defined in docs/output-kit.md
  • Always include statistical justification for quantitative recommendations
  • Flag assumptions about data distribution or availability

Delivery

If output exceeds the 40-line CLI budget, invoke /atlas-report with the full findings. The HTML report is the output. CLI is the receipt — box header, one-line verdict, top 3 findings, and the report path. Never dump analysis to CLI.

04 同仓库更多 Skills