[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6JEBAVMTCN4SRJMEM64W2Q1":3,"skill-same:01M6JEBAVMTCN4SRJMEM64W2Q1":54},{"skillNo":4,"name":5,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":6,"repositoryNo":11,"starsCount":12,"licenseSpdxId":13,"licenseFileUrl":6,"sourceHtmlUrl":14,"categories":15,"keywords":24,"publishedAt":28,"linkOnly":29,"markdownContent":30,"markdownBody":30,"frontMatter":31,"refName":32,"commitSha":33,"skillDirectory":34,"forksCount":35,"repositoryHtmlUrl":36,"repositoryHomepageUrl":37,"ownerHtmlUrl":38,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":39,"install":40,"resources":53},"01M6JEBAVMTCN4SRJMEM64W2Q1","knowledge-pipeline",null,"S3YED\u002Fappie-kit","S3YED","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F62743867?v=4","01M6JBKBRRVP6KMS0VWZ27T3R6","01M6JBKBX0KG30284PW1DBYJT1",14,"MIT","https:\u002F\u002Fgithub.com\u002FS3YED\u002Fappie-kit\u002Fblob\u002Fmaster\u002Fskills\u002Fknowledge\u002Fknowledge-pipeline\u002FSKILL.md",[16,21],{"categoryNo":17,"categoryName":18,"taxonomyType":19,"taxonomyTypeDesc":20},"01JBSEEDCAT000000000000021","资料检索与研究","SCENARIO","使用场景",{"categoryNo":22,"categoryName":23,"taxonomyType":19,"taxonomyTypeDesc":20},"01JBSEEDCAT000000000000023","Skill与智能体开发",[25,26,27],"pipeline","knowledge","knowledge pipeline","2026-11-10 10:12:30",false,"# knowledge-pipeline Skill\n\n## Purpose\n\nOperate the local-first Weblyfe knowledge pipeline: ingest documents and Google Drive \u002F Notion content, embed locally, search by meaning, and surface it as a 3D graph in Mission Control. Built 2026-06-03. Codifies the patterns so future sessions and fleet agents do not re-derive them.\n\n## Where it lives\n\n`~\u002Fclawd\u002Fprojects\u002Fknowledge-pipeline\u002F`. Store at `.data\u002Fknowledge.db` (SQLite, gitignored). Drive cache `.data\u002Fdrive-cache\u002F`, Notion cache `.data\u002Fnotion-cache\u002F`.\n\n## Core principle (from the adversarial review)\n\nLocal-first is REAL: SQLite + local embeddings are canonical. Pinecone is a deferred optional sync target, never the critical path. No client data is embedded until per-tenant isolation is hard. `tenant` is fail-closed (NOT NULL, scoped search never returns another tenant or UNASSIGNED).\n\n## Quick reference\n\n| Task | Command |\n|------|---------|\n| Ingest a local folder | `python3 ingest.py \u003Cdir> --tenant weblyfe-internal` |\n| Search | `python3 query.py \"your question\" --tenant weblyfe-internal -k 5` |\n| Sync a Google Drive folder | `python3 sync_drive.py \u003CdriveFolderId>` then ingest `.data\u002Fdrive-cache\u002F\u003Cid>` |\n| Export Notion (streaming) | `NOTION_API_KEY=... python3 -u sync_notion.py` then ingest `.data\u002Fnotion-cache --tenant notion` |\n\n## Stack\n\n- Embeddings: local Ollama `bge-m3` (1024-dim). `ollama pull bge-m3`. Helper `kp\u002Fembed.py` hits `localhost:11434\u002Fapi\u002Fembed`. Nothing leaves the machine.\n- Store: SQLite + brute-force numpy cosine (`kp\u002Fstore.py`). Corpus is small (tens of thousands of chunks) so this is fast and avoids fragile native installs on Python 3.14. sqlite-vec \u002F Chroma is the upgrade path.\n- Parse: PyMuPDF (fitz, preinstalled) for PDF, plain read for md\u002Ftxt (`kp\u002Fparse.py`). `iter_files` skips node_modules\u002F.git\u002F.next\u002Fetc.\n- Incremental: files are skipped by md5 on re-run.\n\n## Gotchas\n\n- Python 3.14 (`\u002Fopt\u002Fhomebrew\u002Fbin\u002Fpython3`) has a broken pyexpat for native builds; chromadb\u002Fsentence-transformers installs are fragile. Stick to ollama + SQLite + numpy.\n- Notion `\u002Fv1\u002Fsearch` returns thousands of page objects for a large workspace. Stream (write per page) instead of collecting all first, or it appears to hang.\n- Notion rate limit is ~3 req\u002Fs; keep a 0.34s pause per request.\n- nohup buffers stdout; use `python3 -u` for live progress.\n\n## Mission Control integration\n\nThe 3D graph lives at MC `Memory > Graph` (reagraph WebGL, already installed). `src\u002Fapp\u002Fapi\u002Fmemory\u002Fgraph\u002Froute.ts` surfaces the pipeline DB as a `knowledge` cluster (GROUP BY path, cap 350 nodes). The Graph tab was gated `!isLocal`; unlocked in local mode in `memory-browser-panel.tsx`. Override the DB path with env `KNOWLEDGE_DB_PATH`.\n\n## Next phases (not built)\n\nPer-tenant namespaces then client folders; FastAPI read-only for MC; audio (faster-whisper) + OCR ingest; entity\u002Frelation knowledge graph behind a flag; Pinecone remote sync; clustering\u002Fanalysis; Obsidian export; voice \"ask the KB\".",{},"master","8ec37df6d71fb664ea19d32c079e7d3ff931a8e0","skills\u002Fknowledge\u002Fknowledge-pipeline",3,"https:\u002F\u002Fgithub.com\u002FS3YED\u002Fappie-kit","https:\u002F\u002Fweblyfe.ai","https:\u002F\u002Fgithub.com\u002FS3YED","2026-08-27 01:54:02",{"source":7,"skillName":5,"commands":41,"prompt":51,"zipAvailable":52},[42,45,48],{"tool":43,"command":44},"npx","npx skills add S3YED\u002Fappie-kit --skill knowledge-pipeline",{"tool":46,"command":47},"bunx","bunx skills add S3YED\u002Fappie-kit --skill knowledge-pipeline",{"tool":49,"command":50},"pnpm","pnpm dlx skills add S3YED\u002Fappie-kit --skill knowledge-pipeline","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FS3YED\u002Fappie-kit\u002Fblob\u002Fmaster\u002Fskills\u002Fknowledge\u002Fknowledge-pipeline\u002FSKILL.md",true,[],[55,87,122,148,179,204],{"skillNo":56,"name":57,"nameZh":6,"description":58,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":6,"repositoryNo":11,"starsCount":12,"licenseSpdxId":13,"licenseFileUrl":6,"sourceHtmlUrl":59,"categories":60,"keywords":68,"publishedAt":28},"01M6JFD4M6N4DSGC7TXEJ5R3J2","ai-music","AI music generation and audio tools: HeartMuLa lyrics-to-music generation, songwriting craft (+ Suno prompts), and audio spectrogram\u002Ffeature visualization.","https:\u002F\u002Fgithub.com\u002FS3YED\u002Fappie-kit\u002Fblob\u002Fmaster\u002Fskills\u002Fwethlete\u002Fai-music\u002FSKILL.md",[61,64,67],{"categoryNo":62,"categoryName":63,"taxonomyType":19,"taxonomyTypeDesc":20},"01JBSEEDCAT000000000000013","分析与可视化",{"categoryNo":65,"categoryName":66,"taxonomyType":19,"taxonomyTypeDesc":20},"01JBSEEDCAT000000000000016","图像与多媒体",{"categoryNo":22,"categoryName":23,"taxonomyType":19,"taxonomyTypeDesc":20},[69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86],"music","ai music","humanizer","visualization","Tools","Audio","hermes","hermes agent","songwriting","suno","lyrics","prompts","heartmula","craft","generation","feature","ai music generation","music generation",{"skillNo":88,"name":89,"nameZh":6,"description":90,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":6,"repositoryNo":11,"starsCount":12,"licenseSpdxId":13,"licenseFileUrl":6,"sourceHtmlUrl":91,"categories":92,"keywords":101,"publishedAt":28},"01M6JFCZE4XNFQFMNZDHKHT5V5","agentic-webdesign-design-system-ingestion","Use v0 Design Systems 2.0, Bolt Design System Agents, or Lovable to generate production UI from a client's real design system components — not generic Tailwind. Use when building a client website where brand consistency matters.","https:\u002F\u002Fgithub.com\u002FS3YED\u002Fappie-kit\u002Fblob\u002Fmaster\u002Fskills\u002Fweb-design\u002Fagentic-webdesign-design-system-ingestion\u002FSKILL.md",[93,96],{"categoryNo":94,"categoryName":95,"taxonomyType":19,"taxonomyTypeDesc":20},"01JBSEEDCAT000000000000015","视觉设计",{"categoryNo":97,"categoryName":98,"taxonomyType":99,"taxonomyTypeDesc":100},"01JBSEEDCAT000000000000032","设计师","PROFESSION","适用职业",[102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121],"design","agentic","design system","system","ingestion","webdesign","agentic webdesign design system ingestion","components","generate","design systems","website","ui","Tailwind","bolt","lovable","v0","design-system","wed","design system components","appie",{"skillNo":123,"name":124,"nameZh":6,"description":125,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":6,"repositoryNo":11,"starsCount":12,"licenseSpdxId":13,"licenseFileUrl":6,"sourceHtmlUrl":126,"categories":127,"keywords":130,"publishedAt":28},"01M6JFCVPX3913CFAS6QQJ33ZB","agentic-webdesign-agent-elements","Use 21st.dev Agent Elements — 25 shadcn\u002Fui components purpose-built for AI agent UIs. Tool cards (Bash, Edit, Search, Plan, Subagent, MCP), chat, input, streaming. Open source, shadcn-registry install, no runtime lock-in.","https:\u002F\u002Fgithub.com\u002FS3YED\u002Fappie-kit\u002Fblob\u002Fmaster\u002Fskills\u002Fweb-design\u002Fagentic-webdesign-agent-elements\u002FSKILL.md",[128,129],{"categoryNo":22,"categoryName":23,"taxonomyType":19,"taxonomyTypeDesc":20},{"categoryNo":97,"categoryName":98,"taxonomyType":99,"taxonomyTypeDesc":100},[103,131,107,132,133,134,109,135,136,137,138,139,140,141,142,143,144,145,146,147],"elements","agentic webdesign agent elements","MCP","ai agent","registry","search","streaming","open source","open","Bash","plan","subagent","edit","install","input","lock","source",{"skillNo":149,"name":150,"nameZh":6,"description":151,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":6,"repositoryNo":11,"starsCount":12,"licenseSpdxId":13,"licenseFileUrl":6,"sourceHtmlUrl":152,"categories":153,"keywords":158,"publishedAt":28},"01M6JFCQC7H65M9QJ6TRE71BS1","vercel-deployment","Deploy static sites and frontends to Vercel — handles both CLI and REST API paths, including the CLI token sanitization workaround.","https:\u002F\u002Fgithub.com\u002FS3YED\u002Fappie-kit\u002Fblob\u002Fmaster\u002Fskills\u002Fsoftware-development\u002Fvercel-deployment\u002FSKILL.md",[154,157],{"categoryNo":155,"categoryName":156,"taxonomyType":19,"taxonomyTypeDesc":20},"01JBSEEDCAT000000000000011","运维与部署",{"categoryNo":22,"categoryName":23,"taxonomyType":19,"taxonomyTypeDesc":20},[159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178],"deployment","vercel deployment","vercel","macos","cli","linux","windows","deploy","vercel deploy","REST","api","site","deploy to vercel","token","rest api","host","sites","paths","sanitization","static site",{"skillNo":180,"name":181,"nameZh":6,"description":182,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":6,"repositoryNo":11,"starsCount":12,"licenseSpdxId":13,"licenseFileUrl":6,"sourceHtmlUrl":183,"categories":184,"keywords":186,"publishedAt":28},"01M6JFCM4SMTXBM5A01BK2YQG1","software-quality-workflows","Umbrella workflow for TDD, debugging, code simplification, spikes, pre-commit review, and debugger-assisted investigation.","https:\u002F\u002Fgithub.com\u002FS3YED\u002Fappie-kit\u002Fblob\u002Fmaster\u002Fskills\u002Fsoftware-development\u002Fsoftware-quality-workflows\u002FSKILL.md",[185],{"categoryNo":22,"categoryName":23,"taxonomyType":19,"taxonomyTypeDesc":20},[187,188,189,190,191,192,193,194,195,196,197,198,199,200,201,202,203],"workflows","quality","software","software quality workflows","review","tdd","workflow","commit","debugging","code","debugger","pre-commit","investigation","code simplification","user","simplification","for",{"skillNo":205,"name":206,"nameZh":6,"description":207,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":6,"repositoryNo":11,"starsCount":12,"licenseSpdxId":13,"licenseFileUrl":6,"sourceHtmlUrl":208,"categories":209,"keywords":217,"publishedAt":28},"01M6JFCGD0M6CEATY01W7YN6DB","react-component-refactoring","Safely refactor large React components into smaller, maintainable pieces using proven patterns","https:\u002F\u002Fgithub.com\u002FS3YED\u002Fappie-kit\u002Fblob\u002Fmaster\u002Fskills\u002Fsoftware-development\u002Freact-component-refactoring\u002FSKILL.md",[210,213,216],{"categoryNo":211,"categoryName":212,"taxonomyType":19,"taxonomyTypeDesc":20},"01JBSEEDCAT000000000000007","代码审查",{"categoryNo":214,"categoryName":215,"taxonomyType":19,"taxonomyTypeDesc":20},"01JBSEEDCAT000000000000009","前端开发",{"categoryNo":22,"categoryName":23,"taxonomyType":19,"taxonomyTypeDesc":20},[218,219,220,221,222,223,224,225,162,226,227,109,228,165,229,196,230,231,232,233],"react","component","refactoring","component refactoring","react component","react component refactoring","frontend","writing","safe","typescript","react components","modular","refactor","simplify","patterns","test-driven-development"]