castai-rate-limits
Handle CAST AI API rate limits with backoff and request queuing. Use when hitting 429 errors, optimizing API call patterns, or implementing rate-aware batch operations. Trigger with phrases like "cast ai rate limit", "cast ai 429", "cast ai throttle", "cast ai API limits".
- License 许可
- MIT
- 最近更新
- 2026-07-13
- Stars
- ★ 1
- Forks
- 0
01 前言 Front Matter
- name
- castai-rate-limits
- tags
- [ "saas", "kubernetes", "cost-optimization", "castai" ]
- author
- Jeremy Longshore <jeremy@intentsolutions.io>
- license
- MIT
- version
- 1.0.0
- description
- Handle CAST AI API rate limits with backoff and request queuing. Use when hitting 429 errors, optimizing API call patterns, or implementing rate-aware batch operations. Trigger with phrases like "cast ai rate limit", "cast ai 429", "cast ai throttle", "cast ai API limits".
- allowed-tools
- Read, Write, Edit
- compatible-with
- claude-code
03 SKILL.md 正文
CAST AI Rate Limits
Overview
The CAST AI REST API enforces rate limits per API key. The autoscaler agent communicates cluster state at 15-second intervals. For custom API integrations, implement exponential backoff and request queuing to avoid hitting limits.
Prerequisites
- CAST AI API key configured
- Understanding of the API endpoints you call
Rate Limit Behavior
| Aspect | Value |
|---|---|
| Rate limit scope | Per API key |
| Response on limit | HTTP 429 with Retry-After header |
| Agent sync interval | Every 15 seconds |
| Recommended polling | No more than once per 30 seconds |
Instructions
Step 1: Detect Rate Limits from Response Headers
async function castaiRequest(path: string): Promise<Response> {
const response = await fetch(`https://api.cast.ai${path}`, {
headers: { "X-API-Key": process.env.CASTAI_API_KEY! },
});
// Log rate limit headers for monitoring
const remaining = response.headers.get("X-RateLimit-Remaining");
const reset = response.headers.get("X-RateLimit-Reset");
if (remaining) {
console.log(`Rate limit remaining: ${remaining}, resets: ${reset}`);
}
if (response.status === 429) {
const retryAfter = parseInt(response.headers.get("Retry-After") ?? "5");
throw new RateLimitError(retryAfter);
}
return response;
}
class RateLimitError extends Error {
constructor(public retryAfterSeconds: number) {
super(`Rate limited. Retry after ${retryAfterSeconds}s`);
}
}
Step 2: Exponential Backoff with Jitter
async function withBackoff<T>(
fn: () => Promise<T>,
maxRetries = 5
): Promise<T> {
for (let attempt = 0; attempt <= maxRetries; attempt++) {
try {
return await fn();
} catch (err) {
if (attempt === maxRetries) throw err;
let delayMs: number;
if (err instanceof RateLimitError) {
delayMs = err.retryAfterSeconds * 1000;
} else {
delayMs = Math.min(1000 * Math.pow(2, attempt), 30000);
}
// Add jitter to prevent thundering herd
delayMs += Math.random() * 1000;
console.log(`Retry ${attempt + 1}/${maxRetries} in ${delayMs}ms`);
await new Promise((r) => setTimeout(r, delayMs));
}
}
throw new Error("Unreachable");
}
Step 3: Request Queue for Batch Operations
import PQueue from "p-queue";
// Limit concurrent requests and enforce interval
const castaiQueue = new PQueue({
concurrency: 3,
interval: 1000,
intervalCap: 5, // Max 5 requests per second
});
async function queuedCastAIRequest<T>(fn: () => Promise<T>): Promise<T> {
return castaiQueue.add(() => withBackoff(fn));
}
// Batch process multiple clusters
const clusterIds = ["id1", "id2", "id3", "id4", "id5"];
const savings = await Promise.all(
clusterIds.map((id) =>
queuedCastAIRequest(() =>
fetch(`https://api.cast.ai/v1/kubernetes/clusters/${id}/savings`, {
headers: { "X-API-Key": process.env.CASTAI_API_KEY! },
}).then((r) => r.json())
)
)
);
Step 4: Polling Best Practice
// Do NOT poll faster than 30 seconds for cluster state
// The agent syncs every 15s; polling faster adds no value
async function pollClusterStatus(
clusterId: string,
intervalMs = 30000
): Promise<void> {
const timer = setInterval(async () => {
try {
const status = await queuedCastAIRequest(() =>
fetch(
`https://api.cast.ai/v1/kubernetes/external-clusters/${clusterId}`,
{ headers: { "X-API-Key": process.env.CASTAI_API_KEY! } }
).then((r) => r.json())
);
console.log(`Cluster ${clusterId}: ${status.agentStatus}`);
} catch (err) {
console.error("Poll failed:", err);
}
}, intervalMs);
}
Error Handling
| Scenario | Detection | Response |
|---|---|---|
| 429 with Retry-After | Check header | Wait exact duration |
| 429 without header | Status code only | Exponential backoff from 1s |
| 5xx errors | Status >= 500 | Retry up to 3 times |
| Connection timeout | Fetch throws | Retry with longer timeout |
Resources
- CAST AI API Reference
- p-queue -- concurrent request queue
Next Steps
For security configuration, see castai-security-basics.
04 同仓库更多 Skills
zustand-store-creator
Create zustand store creator operations. Auto-activating skill for Frontend Development. Triggers on: zustand store creator, zustand store creator Part of the Frontend Development skill category. Use when working with zustand store creator functionality. Trigger with phrases like "zustand store creator", "zustand creator", "zustand".
zero-trust-config-helper
Configure with zero trust config helper operations. Auto-activating skill for Security Advanced. Triggers on: zero trust config helper, zero trust config helper Part of the Security Advanced skill category. Use when configuring systems or services. Trigger with phrases like "zero trust config helper", "zero helper", "zero".
zapier-integration-helper
Assist with zapier integration helper operations. Auto-activating skill for Business Automation. Triggers on: zapier integration helper, zapier integration helper Part of the Business Automation skill category. Use when working with APIs or building integrations. Trigger with phrases like "zapier integration helper", "zapier helper", "zapier".
yaml-config-validator
Validate yaml config validator operations. Auto-activating skill for DevOps Basics. Triggers on: yaml config validator, yaml config validator Part of the DevOps Basics skill category. Use when configuring systems or services. Trigger with phrases like "yaml config validator", "yaml validator", "yaml".
xvary-stock-research
Thesis-driven equity analysis from public SEC EDGAR and market data; /analyze, /score, /compare workflows with bundled Python tools (Claude Code, Cursor, Codex).
xss-vulnerability-scanner
Scan xss vulnerability scanner operations. Auto-activating skill for Security Fundamentals. Triggers on: xss vulnerability scanner, xss vulnerability scanner Part of the Security Fundamentals skill category. Use when working with xss vulnerability scanner functionality. Trigger with phrases like "xss vulnerability scanner", "xss scanner", "xss".