[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7F16YSW29DFWEN2E58JW2YQ":3,"skill-same:01M7F16YSW29DFWEN2E58JW2YQ":63},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":28,"commitSha":29,"skillDirectory":30,"forksCount":31,"repositoryHtmlUrl":32,"repositoryHomepageUrl":6,"ownerHtmlUrl":33,"ownerBlogUrl":6,"ownerDescription":34,"updatedAt":35,"install":36,"resources":48},"01M7F16YSW29DFWEN2E58JW2YQ","rag-document-processing",null,"Guides LazyLLM RAG, document ingestion, readers, transforms, retrievers, rerankers, stores, BM25, and parser-service workflows.","lza6\u002FArmor-piercing-system-prompts","lza6","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F128880206?v=4","01M7EB3K7WPX5T28EJ2NVHE6EG","Chinese-tingfeng","01M7EB3K97E1KQ16QWKJMFNGX8",11,"Apache-2.0","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F05-技能与代理开发\u002Flazy-llm\u002Fsub-skills\u002Frag-document-processing\u002FSKILL.md",[],[],"2026-11-16 10:05:34",false,"---\nname: rag-document-processing\ndescription: \"Guides LazyLLM RAG, document ingestion, readers, transforms,\n  retrievers, rerankers, stores, BM25, and parser-service workflows.\"\ndisable-model-invocation: true\nmetadata:\n  disco-role: operating\nlicense: Apache 2.0\n---\n\n# LazyLLM RAG and Document Processing\n\nUse this sub-skill for LazyLLM tasks involving `Document`, `DocNode`, document readers, transforms, node groups, retrievers, rerankers, BM25, stores\u002Findexes, document service metadata, parser service, Milvus\u002FOpenSearch, or RAG examples.\n\n## Start here when\n\n- The task mentions `lazyllm.tools.rag`, `Document`, `Retriever`, `Reranker`, `DocNode`, node groups, chunking, embedding, reranking, or BM25.\n- An import error says to run `lazyllm install rag`.\n- The user wants a local RAG app, parser-service architecture, URL\u002Ffile retriever, map store, Milvus\u002FOpenSearch index, or RAG with online\u002Flocal model modules.\n- You need to separate local text retrieval from optional embedding\u002Fvector database\u002Fmodel backends.\n\n## Files to read\n\n- [rag-workflows.md](references\u002Frag-workflows.md) for local RAG recipes, object relationships, and backend escalation.\n- [data-and-service-formats.md](references\u002Fdata-and-service-formats.md) for document\u002Fnode\u002Fservice request shapes and parser-service boundaries.\n- [troubleshooting.md](references\u002Ftroubleshooting.md) for missing dependencies, parser service, vector DB, and retrieval issues.\n- [scripts\u002Frag_bm25_smoke.py](scripts\u002Frag_bm25_smoke.py) for a no-network BM25 retrieval check.\n\n## Safe RAG workflow\n\n1. **Install\u002Fcheck the RAG extra** when importing RAG objects:\n   ```bash\n   lazyllm install rag\n   python ..\u002F..\u002Fscripts\u002Fcheck_lazyllm_env.py --require-rag\n   ```\n2. **Start local and text-only.** Use `DocNode` and BM25 or local readers before adding embeddings, rerankers, vector DBs, or model modules.\n3. **Decide ownership of model nodes.** Model modules used for embeddings\u002Freranking\u002Fchat belong to [model-deployment](..\u002Fmodel-deployment\u002FSKILL.md) for backend checks.\n4. **Decide service boundaries.** Parser service, document service, Milvus\u002FOpenSearch\u002FRedis, object storage, and external URLs require service credentials or local fixtures.\n5. **Run local smoke.**\n   ```bash\n   python scripts\u002Frag_bm25_smoke.py\n   ```\n\n## Key public surfaces\n\n- `Document(*args, **kw)` is the main RAG container and index manager.\n- `Retriever(doc, group_name, similarity=None, similarity_cut_off=-inf, index='default', topk=6, embed_keys=None, target=None, output_format=None, join=False, weight=None, priority=None, **kwargs)` pulls contexts from a document\u002Findex.\n- `Reranker(name='ModuleReranker', *args, **kwargs)` reranks retrieved contexts and may depend on a model\u002Fbackend.\n- `DocNode` represents text chunks with metadata and relationships.\n- BM25 supports local English\u002FChinese retrieval with no embedding server.\n\n## Backend posture\n\n- **Required for local guidance:** base LazyLLM plus `rag` extra.\n- **Safe CPU candidates:** BM25, document\u002Fnode transforms, reader utilities, retriever logic, local doc-service manager with SQLite\u002Fmocked parser client.\n- **Optional external services:** Milvus, OpenSearch\u002FElasticsearch, Redis\u002FRedisVL, parser service workers, object storage, remote URLs.\n- **Optional model\u002FGPU:** embedding models, rerankers, local LLM answer generation, multimodal OCR\u002Faudio ingestion.\n\n## Handoff checklist\n\nWhen you complete a RAG task, report:\n\n- document source type and data format,\n- node\u002Fchunking\u002Fgrouping plan,\n- retrieval method and index\u002Fstore backend,\n- model\u002Fembedding\u002Freranker backend status,\n- local smoke command or reason it is optional\u002Fskipped,\n- clear separation between local artifacts and external services.\n","# LazyLLM RAG and Document Processing\n\nUse this sub-skill for LazyLLM tasks involving `Document`, `DocNode`, document readers, transforms, node groups, retrievers, rerankers, BM25, stores\u002Findexes, document service metadata, parser service, Milvus\u002FOpenSearch, or RAG examples.\n\n## Start here when\n\n- The task mentions `lazyllm.tools.rag`, `Document`, `Retriever`, `Reranker`, `DocNode`, node groups, chunking, embedding, reranking, or BM25.\n- An import error says to run `lazyllm install rag`.\n- The user wants a local RAG app, parser-service architecture, URL\u002Ffile retriever, map store, Milvus\u002FOpenSearch index, or RAG with online\u002Flocal model modules.\n- You need to separate local text retrieval from optional embedding\u002Fvector database\u002Fmodel backends.\n\n## Files to read\n\n- [rag-workflows.md](references\u002Frag-workflows.md) for local RAG recipes, object relationships, and backend escalation.\n- [data-and-service-formats.md](references\u002Fdata-and-service-formats.md) for document\u002Fnode\u002Fservice request shapes and parser-service boundaries.\n- [troubleshooting.md](references\u002Ftroubleshooting.md) for missing dependencies, parser service, vector DB, and retrieval issues.\n- [scripts\u002Frag_bm25_smoke.py](scripts\u002Frag_bm25_smoke.py) for a no-network BM25 retrieval check.\n\n## Safe RAG workflow\n\n1. **Install\u002Fcheck the RAG extra** when importing RAG objects:\n   ```bash\n   lazyllm install rag\n   python ..\u002F..\u002Fscripts\u002Fcheck_lazyllm_env.py --require-rag\n   ```\n2. **Start local and text-only.** Use `DocNode` and BM25 or local readers before adding embeddings, rerankers, vector DBs, or model modules.\n3. **Decide ownership of model nodes.** Model modules used for embeddings\u002Freranking\u002Fchat belong to [model-deployment](..\u002Fmodel-deployment\u002FSKILL.md) for backend checks.\n4. **Decide service boundaries.** Parser service, document service, Milvus\u002FOpenSearch\u002FRedis, object storage, and external URLs require service credentials or local fixtures.\n5. **Run local smoke.**\n   ```bash\n   python scripts\u002Frag_bm25_smoke.py\n   ```\n\n## Key public surfaces\n\n- `Document(*args, **kw)` is the main RAG container and index manager.\n- `Retriever(doc, group_name, similarity=None, similarity_cut_off=-inf, index='default', topk=6, embed_keys=None, target=None, output_format=None, join=False, weight=None, priority=None, **kwargs)` pulls contexts from a document\u002Findex.\n- `Reranker(name='ModuleReranker', *args, **kwargs)` reranks retrieved contexts and may depend on a model\u002Fbackend.\n- `DocNode` represents text chunks with metadata and relationships.\n- BM25 supports local English\u002FChinese retrieval with no embedding server.\n\n## Backend posture\n\n- **Required for local guidance:** base LazyLLM plus `rag` extra.\n- **Safe CPU candidates:** BM25, document\u002Fnode transforms, reader utilities, retriever logic, local doc-service manager with SQLite\u002Fmocked parser client.\n- **Optional external services:** Milvus, OpenSearch\u002FElasticsearch, Redis\u002FRedisVL, parser service workers, object storage, remote URLs.\n- **Optional model\u002FGPU:** embedding models, rerankers, local LLM answer generation, multimodal OCR\u002Faudio ingestion.\n\n## Handoff checklist\n\nWhen you complete a RAG task, report:\n\n- document source type and data format,\n- node\u002Fchunking\u002Fgrouping plan,\n- retrieval method and index\u002Fstore backend,\n- model\u002Fembedding\u002Freranker backend status,\n- local smoke command or reason it is optional\u002Fskipped,\n- clear separation between local artifacts and external services.\n",{"name":5,"license":24,"metadata":25,"description":7,"disable-model-invocation":27},"Apache 2.0",{"disco-role":26},"operating",true,"main","d69096e239f2a89aabc2cd078c47664a9d3b1e11","05-技能与代理开发\u002Flazy-llm\u002Fsub-skills\u002Frag-document-processing",3,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts","https:\u002F\u002Fgithub.com\u002Flza6","个人vx：Tf00798\r\n个人✈：@TFGY999","2026-10-08 14:29:22",{"source":8,"skillName":5,"commands":37,"prompt":47,"zipAvailable":27},[38,41,44],{"tool":39,"command":40},"npx","npx skills add lza6\u002FArmor-piercing-system-prompts --skill rag-document-processing",{"tool":42,"command":43},"bunx","bunx skills add lza6\u002FArmor-piercing-system-prompts --skill rag-document-processing",{"tool":45,"command":46},"pnpm","pnpm dlx skills add lza6\u002FArmor-piercing-system-prompts --skill rag-document-processing","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F05-技能与代理开发\u002Flazy-llm\u002Fsub-skills\u002Frag-document-processing\u002FSKILL.md",[49,55,59],{"path":50,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":53,"sourceHtmlUrl":54},"references\u002Fdata-and-service-formats.md","REFERENCE","参考文档",2613,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F05-技能与代理开发\u002Flazy-llm\u002Fsub-skills\u002Frag-document-processing\u002Freferences\u002Fdata-and-service-formats.md",{"path":56,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":57,"sourceHtmlUrl":58},"references\u002Frag-workflows.md",3215,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F05-技能与代理开发\u002Flazy-llm\u002Fsub-skills\u002Frag-document-processing\u002Freferences\u002Frag-workflows.md",{"path":60,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":61,"sourceHtmlUrl":62},"references\u002Ftroubleshooting.md",2329,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F05-技能与代理开发\u002Flazy-llm\u002Fsub-skills\u002Frag-document-processing\u002Freferences\u002Ftroubleshooting.md",[64,72,77,84,91,98],{"skillNo":65,"name":66,"nameZh":6,"description":67,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":69,"categories":70,"keywords":71,"publishedAt":19},"01M7FFG485KY83TD6HSC4YPCMC","obsidian-clipper-template-creator","Guide for creating templates for the Obsidian Web Clipper. Use when you want to create a new clipping template, understand available variables, or format clipped content.","MIT","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobsidian-clipper-template-creator\u002FSKILL.md",[],[],{"skillNo":73,"name":66,"nameZh":6,"description":67,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":74,"categories":75,"keywords":76,"publishedAt":19},"01M7FFG0T6AZ0STEJPSB3CX84K","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobsidian-clipper-template-creator-antigravity-awesome-skills-main\u002FSKILL.md",[],[],{"skillNo":78,"name":79,"nameZh":6,"description":80,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":81,"categories":82,"keywords":83,"publishedAt":19},"01M7FFFY0QEM14SKWPDYGMXM2P","python-api","Programmatic Object-Detection-Metrics API guidance for BoundingBox, BoundingBoxes, Evaluator, enums, coordinate conversion, AP\u002FmAP semantics, and source-style import diagnostics.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobject-detection-metrics\u002Fsub-skills\u002Fpython-api\u002FSKILL.md",[],[],{"skillNo":85,"name":86,"nameZh":6,"description":87,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":88,"categories":89,"keywords":90,"publishedAt":19},"01M7FFFVZQZ2GJ0C0TGP7JHD20","file-evaluation","Folder-based PASCAL VOC AP\u002FmAP evaluation from ground-truth and detection text files.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobject-detection-metrics\u002Fsub-skills\u002Ffile-evaluation\u002FSKILL.md",[],[],{"skillNo":92,"name":93,"nameZh":6,"description":94,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":95,"categories":96,"keywords":97,"publishedAt":19},"01M7FFFSFNYSE77SJ6PE1CK2DA","object-detection-metrics","Guides legacy Object-Detection-Metrics PASCAL VOC AP\u002FmAP evaluation from detection text folders and direct Python API classes.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobject-detection-metrics\u002FSKILL.md",[],[],{"skillNo":99,"name":100,"nameZh":6,"description":101,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":102,"categories":103,"keywords":104,"publishedAt":19},"01M7FFFP0GCK1RVXBCPQ8APBMT","nx-workspace-patterns","Configure and optimize Nx monorepo workspaces. Use when setting up Nx, configuring project boundaries, optimizing build caching, or implementing affected commands.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fnx-workspace-patterns\u002FSKILL.md",[],[]]