[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7F16VSX2F4SHTZ30RJTDBRM":3,"skill-same:01M7F16VSX2F4SHTZ30RJTDBRM":63},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":28,"commitSha":29,"skillDirectory":30,"forksCount":31,"repositoryHtmlUrl":32,"repositoryHomepageUrl":6,"ownerHtmlUrl":33,"ownerBlogUrl":6,"ownerDescription":34,"updatedAt":35,"install":36,"resources":48},"01M7F16VSX2F4SHTZ30RJTDBRM","model-deployment",null,"Guides LazyLLM model modules, online providers, local serving, fine-tuning, multimodal examples, and backend-aware deployment diagnostics.","lza6\u002FArmor-piercing-system-prompts","lza6","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F128880206?v=4","01M7EB3K7WPX5T28EJ2NVHE6EG","Chinese-tingfeng","01M7EB3K97E1KQ16QWKJMFNGX8",11,"Apache-2.0","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F05-技能与代理开发\u002Flazy-llm\u002Fsub-skills\u002Fmodel-deployment\u002FSKILL.md",[],[],"2026-11-16 10:05:34",false,"---\nname: model-deployment\ndescription: \"Guides LazyLLM model modules, online providers, local serving,\n  fine-tuning, multimodal examples, and backend-aware deployment diagnostics.\"\ndisable-model-invocation: true\nmetadata:\n  disco-role: operating\nlicense: Apache 2.0\n---\n\n# LazyLLM Model Deployment\n\nUse this sub-skill for LazyLLM tasks about `TrainableModule`, `OnlineModule`, `OnlineChatModule`, `ServerModule`, `ActionModule`, model type mapping, model deployment, fine-tuning, distillation, local serving, provider calls, streaming tool calls, or multimodal examples.\n\n## Start here when\n\n- The user asks how to wrap a local model or online provider in LazyLLM.\n- The task mentions `lazyllm deploy`, vLLM, LMDeploy, LightLLM, Infinity, LLaMA-Factory, model caches, CUDA, or serving ports.\n- A provider\u002Fchat module fails due to model type, API key, timeout, message inspection, streaming tool calls, or provider response format.\n- The user wants to adapt chatbot, online chatbot, multimodal, painting, TTS, STT, OCR, fine-tuning, or distillation examples.\n\n## Files to read\n\n- [model-workflows.md](references\u002Fmodel-workflows.md) for class selection, online\u002Flocal\u002Fmultimodal recipes, and safe provider-free checks.\n- [backend-matrix.md](references\u002Fbackend-matrix.md) for optional dependency and backend classification.\n- [troubleshooting.md](references\u002Ftroubleshooting.md) for provider, CUDA, model path, and serving failures.\n- [scripts\u002Fmodel_surface_smoke.py](scripts\u002Fmodel_surface_smoke.py) for a no-network check of model type inference and online chat message utilities.\n\n## Safe workflow\n\n1. **Classify the module type.**\n   - `OnlineModule` \u002F `OnlineChatModule`: provider or endpoint backed.\n   - `TrainableModule`: local model\u002Ffine-tune\u002Fdeploy abstraction.\n   - `ServerModule`: wraps functions\u002Fmodules\u002Fservices and may start\u002Fbind servers.\n   - `ActionModule`: wraps deterministic actions in a LazyLLM module chain.\n2. **Classify backend requirements.** Do not run a model call until provider credentials or local model\u002FGPU\u002Fbackend are confirmed.\n3. **Perform no-network checks first.**\n   ```bash\n   python scripts\u002Fmodel_surface_smoke.py\n   python ..\u002F..\u002Fscripts\u002Finspect_lazyllm_surface.py --include-optional\n   ```\n4. **Route composed apps to their owner.** If model modules are only nodes inside a `pipeline`, read [flow-orchestration](..\u002Fflow-orchestration\u002FSKILL.md). If they serve RAG or agents, read the RAG or agent sub-skill too.\n5. **Record optional verification clearly.** Online\u002FGPU\u002Fmodel-download tests are optional unless the user explicitly asks to execute them and supplies resources.\n\n## Verified signatures to remember\n\n- `TrainableModule(base_model='', target_path='', *, stream=False, return_trace=False, trust_remote_code=True, type=None, source=None, use_model_map=True)`\n- `OnlineModule(model=None, source=None, *, type=None, url=None, **kwargs)`\n- `OnlineChatModule(model=None, source=None, url=None, stream=True, return_trace=False, skip_auth=False, type=None, api_key=None, static_params=None, id=None, name=None, group_id=None, dynamic_auth=False, timeout=180, **kwargs)`\n- `ServerModule(m=None, pre=None, post=None, stream=False, return_trace=False, port=None, pythonpath=None, launcher=None, url=None, num_replicas=1, security_key=None)`\n- `ActionModule(*action, return_trace=False)`\n\n## Model type and streaming facts\n\nLazyLLM has provider model-name mapping helpers that classify names into categories including `llm`, `vlm`, `stt`, `tts`, `embed`, `sd`, `text2video`, and `cross_modal_embed`. Tests also verify online chat helper behavior that removes prior tool traces and merges streamed tool-call chunks by index.\n\nUse these pure helpers to debug provider message formatting without calling the provider.\n\n## Backend boundaries\n\n- **Safe CPU checks:** signature inspection, model type mapping, chat history sanitization, stream chunk merge utility.\n- **Provider-required:** online chat\u002Fcompletion, online multimodal, web-search-backed flows, writer pipeline with cloud LLM.\n- **GPU\u002Flocal backend:** vLLM\u002FLMDeploy\u002FLightLLM, local TrainableModule inference, fine-tuning, distillation, painting, speech, OCR.\n- **External service:** deployed server endpoints, k8s\u002Fslurm\u002FSCO launcher tests.\n\n## Handoff outputs\n\nWhen you finish a model-deployment task, leave:\n\n- chosen LazyLLM module class and constructor parameters,\n- exact optional extra\u002Fbackend\u002Fprovider requirements,\n- safe smoke result or reason it was not executable,\n- explicit status of credentials, model path\u002Fcache, GPU, server port, and budget,\n- routes to flow\u002FRAG\u002Fagent\u002Fwriter sub-skills for composed apps.\n","# LazyLLM Model Deployment\n\nUse this sub-skill for LazyLLM tasks about `TrainableModule`, `OnlineModule`, `OnlineChatModule`, `ServerModule`, `ActionModule`, model type mapping, model deployment, fine-tuning, distillation, local serving, provider calls, streaming tool calls, or multimodal examples.\n\n## Start here when\n\n- The user asks how to wrap a local model or online provider in LazyLLM.\n- The task mentions `lazyllm deploy`, vLLM, LMDeploy, LightLLM, Infinity, LLaMA-Factory, model caches, CUDA, or serving ports.\n- A provider\u002Fchat module fails due to model type, API key, timeout, message inspection, streaming tool calls, or provider response format.\n- The user wants to adapt chatbot, online chatbot, multimodal, painting, TTS, STT, OCR, fine-tuning, or distillation examples.\n\n## Files to read\n\n- [model-workflows.md](references\u002Fmodel-workflows.md) for class selection, online\u002Flocal\u002Fmultimodal recipes, and safe provider-free checks.\n- [backend-matrix.md](references\u002Fbackend-matrix.md) for optional dependency and backend classification.\n- [troubleshooting.md](references\u002Ftroubleshooting.md) for provider, CUDA, model path, and serving failures.\n- [scripts\u002Fmodel_surface_smoke.py](scripts\u002Fmodel_surface_smoke.py) for a no-network check of model type inference and online chat message utilities.\n\n## Safe workflow\n\n1. **Classify the module type.**\n   - `OnlineModule` \u002F `OnlineChatModule`: provider or endpoint backed.\n   - `TrainableModule`: local model\u002Ffine-tune\u002Fdeploy abstraction.\n   - `ServerModule`: wraps functions\u002Fmodules\u002Fservices and may start\u002Fbind servers.\n   - `ActionModule`: wraps deterministic actions in a LazyLLM module chain.\n2. **Classify backend requirements.** Do not run a model call until provider credentials or local model\u002FGPU\u002Fbackend are confirmed.\n3. **Perform no-network checks first.**\n   ```bash\n   python scripts\u002Fmodel_surface_smoke.py\n   python ..\u002F..\u002Fscripts\u002Finspect_lazyllm_surface.py --include-optional\n   ```\n4. **Route composed apps to their owner.** If model modules are only nodes inside a `pipeline`, read [flow-orchestration](..\u002Fflow-orchestration\u002FSKILL.md). If they serve RAG or agents, read the RAG or agent sub-skill too.\n5. **Record optional verification clearly.** Online\u002FGPU\u002Fmodel-download tests are optional unless the user explicitly asks to execute them and supplies resources.\n\n## Verified signatures to remember\n\n- `TrainableModule(base_model='', target_path='', *, stream=False, return_trace=False, trust_remote_code=True, type=None, source=None, use_model_map=True)`\n- `OnlineModule(model=None, source=None, *, type=None, url=None, **kwargs)`\n- `OnlineChatModule(model=None, source=None, url=None, stream=True, return_trace=False, skip_auth=False, type=None, api_key=None, static_params=None, id=None, name=None, group_id=None, dynamic_auth=False, timeout=180, **kwargs)`\n- `ServerModule(m=None, pre=None, post=None, stream=False, return_trace=False, port=None, pythonpath=None, launcher=None, url=None, num_replicas=1, security_key=None)`\n- `ActionModule(*action, return_trace=False)`\n\n## Model type and streaming facts\n\nLazyLLM has provider model-name mapping helpers that classify names into categories including `llm`, `vlm`, `stt`, `tts`, `embed`, `sd`, `text2video`, and `cross_modal_embed`. Tests also verify online chat helper behavior that removes prior tool traces and merges streamed tool-call chunks by index.\n\nUse these pure helpers to debug provider message formatting without calling the provider.\n\n## Backend boundaries\n\n- **Safe CPU checks:** signature inspection, model type mapping, chat history sanitization, stream chunk merge utility.\n- **Provider-required:** online chat\u002Fcompletion, online multimodal, web-search-backed flows, writer pipeline with cloud LLM.\n- **GPU\u002Flocal backend:** vLLM\u002FLMDeploy\u002FLightLLM, local TrainableModule inference, fine-tuning, distillation, painting, speech, OCR.\n- **External service:** deployed server endpoints, k8s\u002Fslurm\u002FSCO launcher tests.\n\n## Handoff outputs\n\nWhen you finish a model-deployment task, leave:\n\n- chosen LazyLLM module class and constructor parameters,\n- exact optional extra\u002Fbackend\u002Fprovider requirements,\n- safe smoke result or reason it was not executable,\n- explicit status of credentials, model path\u002Fcache, GPU, server port, and budget,\n- routes to flow\u002FRAG\u002Fagent\u002Fwriter sub-skills for composed apps.\n",{"name":5,"license":24,"metadata":25,"description":7,"disable-model-invocation":27},"Apache 2.0",{"disco-role":26},"operating",true,"main","d69096e239f2a89aabc2cd078c47664a9d3b1e11","05-技能与代理开发\u002Flazy-llm\u002Fsub-skills\u002Fmodel-deployment",3,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts","https:\u002F\u002Fgithub.com\u002Flza6","个人vx：Tf00798\r\n个人✈：@TFGY999","2026-10-08 14:29:22",{"source":8,"skillName":5,"commands":37,"prompt":47,"zipAvailable":27},[38,41,44],{"tool":39,"command":40},"npx","npx skills add lza6\u002FArmor-piercing-system-prompts --skill model-deployment",{"tool":42,"command":43},"bunx","bunx skills add lza6\u002FArmor-piercing-system-prompts --skill model-deployment",{"tool":45,"command":46},"pnpm","pnpm dlx skills add lza6\u002FArmor-piercing-system-prompts --skill model-deployment","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F05-技能与代理开发\u002Flazy-llm\u002Fsub-skills\u002Fmodel-deployment\u002FSKILL.md",[49,55,59],{"path":50,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":53,"sourceHtmlUrl":54},"references\u002Fbackend-matrix.md","REFERENCE","参考文档",2738,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F05-技能与代理开发\u002Flazy-llm\u002Fsub-skills\u002Fmodel-deployment\u002Freferences\u002Fbackend-matrix.md",{"path":56,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":57,"sourceHtmlUrl":58},"references\u002Fmodel-workflows.md",3775,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F05-技能与代理开发\u002Flazy-llm\u002Fsub-skills\u002Fmodel-deployment\u002Freferences\u002Fmodel-workflows.md",{"path":60,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":61,"sourceHtmlUrl":62},"references\u002Ftroubleshooting.md",2489,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F05-技能与代理开发\u002Flazy-llm\u002Fsub-skills\u002Fmodel-deployment\u002Freferences\u002Ftroubleshooting.md",[64,72,77,84,91,98],{"skillNo":65,"name":66,"nameZh":6,"description":67,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":69,"categories":70,"keywords":71,"publishedAt":19},"01M7FFG485KY83TD6HSC4YPCMC","obsidian-clipper-template-creator","Guide for creating templates for the Obsidian Web Clipper. Use when you want to create a new clipping template, understand available variables, or format clipped content.","MIT","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobsidian-clipper-template-creator\u002FSKILL.md",[],[],{"skillNo":73,"name":66,"nameZh":6,"description":67,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":74,"categories":75,"keywords":76,"publishedAt":19},"01M7FFG0T6AZ0STEJPSB3CX84K","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobsidian-clipper-template-creator-antigravity-awesome-skills-main\u002FSKILL.md",[],[],{"skillNo":78,"name":79,"nameZh":6,"description":80,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":81,"categories":82,"keywords":83,"publishedAt":19},"01M7FFFY0QEM14SKWPDYGMXM2P","python-api","Programmatic Object-Detection-Metrics API guidance for BoundingBox, BoundingBoxes, Evaluator, enums, coordinate conversion, AP\u002FmAP semantics, and source-style import diagnostics.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobject-detection-metrics\u002Fsub-skills\u002Fpython-api\u002FSKILL.md",[],[],{"skillNo":85,"name":86,"nameZh":6,"description":87,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":88,"categories":89,"keywords":90,"publishedAt":19},"01M7FFFVZQZ2GJ0C0TGP7JHD20","file-evaluation","Folder-based PASCAL VOC AP\u002FmAP evaluation from ground-truth and detection text files.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobject-detection-metrics\u002Fsub-skills\u002Ffile-evaluation\u002FSKILL.md",[],[],{"skillNo":92,"name":93,"nameZh":6,"description":94,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":95,"categories":96,"keywords":97,"publishedAt":19},"01M7FFFSFNYSE77SJ6PE1CK2DA","object-detection-metrics","Guides legacy Object-Detection-Metrics PASCAL VOC AP\u002FmAP evaluation from detection text folders and direct Python API classes.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobject-detection-metrics\u002FSKILL.md",[],[],{"skillNo":99,"name":100,"nameZh":6,"description":101,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":102,"categories":103,"keywords":104,"publishedAt":19},"01M7FFFP0GCK1RVXBCPQ8APBMT","nx-workspace-patterns","Configure and optimize Nx monorepo workspaces. Use when setting up Nx, configuring project boundaries, optimizing build caching, or implementing affected commands.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fnx-workspace-patterns\u002FSKILL.md",[],[]]