AGENT SKILL

local-runtimes

Use when choosing an optional local inference runtime for a narrow mechanical or offline job. One table routes to OmniRoute, FreeToken, Colibri, a loopback server, or the hardware probe.

License 许可
MIT
最近更新
2026-10-20
Stars
★ 31
Forks
4

01 前言 Front Matter

name
local-runtimes
license
MIT
description
Use when choosing an optional local inference runtime for a narrow mechanical or offline job. One table routes to OmniRoute, FreeToken, Colibri, a loopback server, or the hardware probe.

02 资源文件 6

03 SKILL.md 正文

Local runtimes

Cloud implementers write code directly. A local runtime is optional and only pays for narrow mechanical or offline jobs; never let it review its own diff. Pick one row, then open only that route.

Need Route Open
Which model size fits this machine hardware probe local-coding-delegate
Already READY loopback server (Ollama, LM Studio, llamacpp) loopback local-openai-compat
Standalone FreeToken process FreeToken freetoken
Frontier MoE through disk/RAM/VRAM tiers Colibri colibri
OmniRoute runner with delegate continuity OmniRoute omniroute
Local agents (OpenCode / OSS agency) agency local-agency

FreeToken and Colibri share the loopback runtime contract.

Rules:

  • A runtime is used only when its READY probe passes; otherwise stay on the cloud implementer and record local: skipped(<reason>) once.
  • One-shot jobs only: one short spec in, one digest out. No parent relay.
  • Avoided-spend metering and USD/EGP lines are required only when a local inference channel was actually used (process owner).
  • Descriptions, paths and host exposure live in the catalog.

04 同仓库更多 Skills