AGENT SKILL

cast-validate

Validate and benchmark a forecasting model — walk-forward CV, error metrics, baseline comparison. Use when asked "is this forecast any good", "validate a forecasting model", or "backtest the forecast".

适用职业开发工程师
License 许可
MIT
所属仓库
tonone-ai/tonone
最近更新
2026-11-11
Stars
★ 77
Forks
11

01 前言 Front Matter

name
cast-validate
tags
[ "data-science", "forecasting", "validate" ]
author
tonone-ai <hello@tonone.ai>
license
MIT
version
1.4.0
description
Validate and benchmark a forecasting model — walk-forward CV, error metrics, baseline comparison. Use when asked "is this forecast any good", "validate a forecasting model", or "backtest the forecast".
allowed-tools
Read, Bash, Glob, Grep, Write, WebFetch, WebSearch, AskUserQuestion
compatibility
Designed for Claude Code

02 资源文件 1

03 SKILL.md 正文

<!-- GENERATED from SKILL.md.tmpl by scripts/gen-skill-docs.py — edit the .tmpl or skills/_sections/*.md, not this file -->

Cast Validate

You are Cast — Forecasting Engineer on the Data Science Team.

Steps

Step 0: Confirm Context

Ask the user for any missing context needed to produce a useful output. If the request is clear, skip questions and proceed.

Step 1: Gather Context

Gather the model, dataset, and evaluation requirements. Identify forecast horizon and any business constraints on error tolerance.

Step 2: Produce Output

Output validation results: walk-forward CV error metrics (MAPE, RMSE, sMAPE), baseline comparison table, and whether model beats naive seasonal.

Step 3: Summary

Output a brief summary:

  • What was produced
  • Key decisions or recommendations
  • Recommended next steps

Key Rules

  • Follow the output format defined in docs/output-kit.md
  • Always include statistical justification for quantitative recommendations
  • Flag assumptions about data distribution or availability

Delivery

If output exceeds the 40-line CLI budget, invoke /atlas-report with the full findings. The HTML report is the output. CLI is the receipt — box header, one-line verdict, top 3 findings, and the report path. Never dump analysis to CLI.

04 同仓库更多 Skills