[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M737KXNW7GMTMR8G2Y3ERMCD":3,"skill-same:01M737KXNW7GMTMR8G2Y3ERMCD":47},{"skillNo":4,"name":5,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":15,"categories":16,"keywords":17,"publishedAt":18,"linkOnly":19,"markdownContent":20,"markdownBody":21,"frontMatter":22,"refName":23,"commitSha":24,"skillDirectory":25,"forksCount":26,"repositoryHtmlUrl":27,"repositoryHomepageUrl":28,"ownerHtmlUrl":29,"ownerBlogUrl":30,"ownerDescription":31,"updatedAt":32,"install":33,"resources":46},"01M737KXNW7GMTMR8G2Y3ERMCD","stream-pipeline-patterns",null,"Horonomos-laps\u002FYana-AI","Horonomos-laps","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F355299122?v=4","01M76B3QPXE88ET2SQPDPVATZT"," Horonomos-laps","01M72ZQRJPCYPSSWT4D00VJR2A",13,"Apache-2.0","https:\u002F\u002Fgithub.com\u002FHoronomos-laps\u002FYana-AI\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fstream-pipeline-patterns\u002FSKILL.md",[],[],"2026-11-11 15:11:14",false,"---\nname: stream-pipeline-patterns\ndescription: Node.js stream pipeline management with automatic cleanup. pump\u002Fpipeline error propagation, transform stream chains, backpressure handling, and preventing stream leaks when one stage errors. Sources: mafintosh\u002Fpump, Node.js stream.pipeline.\norigin: yana-ai — synthesized from mafintosh\u002Fpump (MIT), Node.js stream.pipeline docs\nlicense: Apache-2.0\nversion: 1.0.0\ncompatibility: yana-ai >= 1.3.48\n---\n\n# \u002Fstream-pipeline-patterns\n\n## When to Use\n\n- Chaining compress → encrypt → write streams with proper error cleanup\n- Processing large log files or archives without loading into memory\n- Ensuring all streams in a pipeline are destroyed if any one errors\n- Replacing manual `.pipe()` chains that leak on errors\n\n## Do NOT use for\n\n- One-shot small data (\u003C 10MB) — just use `fs.readFileSync` \u002F `Buffer`\n- Async iterables (use `for await...of` with stream iteration instead)\n\n---\n\n## pump (auto-cleanup on error)\n\n```javascript\nimport pump  from 'pump'\nimport { createReadStream, createWriteStream } from 'fs'\nimport { createGzip } from 'zlib'\n\n\u002F\u002F If any stream errors, ALL streams are destroyed and callback fires\npump(\n  createReadStream('\u002Ftmp\u002Fagent.log'),\n  createGzip(),\n  createWriteStream('\u002Ftmp\u002Fagent.log.gz'),\n  (err) => {\n    if (err) console.error('[pump] pipeline error:', err.message)\n    else      console.log('[pump] done')\n  }\n)\n```\n\n---\n\n## stream.pipeline (built-in Node.js ≥ 10)\n\n```javascript\nimport { pipeline } from 'stream\u002Fpromises'\nimport { createReadStream, createWriteStream } from 'fs'\nimport { createBrotliCompress } from 'zlib'\n\n\u002F\u002F Awaitable pipeline — throws on error, cleans up all streams\nasync function compressLog(input: string, output: string): Promise\u003Cvoid> {\n  await pipeline(\n    createReadStream(input),\n    createBrotliCompress(),\n    createWriteStream(output)\n  )\n}\n```\n\n---\n\n## Transform stream chain\n\n```javascript\nimport { Transform } from 'stream'\nimport { pipeline }  from 'stream\u002Fpromises'\n\nconst lineCounter = new Transform({\n  transform(chunk, _enc, cb) {\n    const lines = chunk.toString().split('\\n').length - 1\n    this.lineCount = (this.lineCount ?? 0) + lines\n    cb(null, chunk)\n  },\n})\n\nconst jsonFilter = new Transform({\n  transform(chunk, _enc, cb) {\n    const filtered = chunk.toString()\n      .split('\\n')\n      .filter(line => { try { JSON.parse(line); return true } catch { return false } })\n      .join('\\n')\n    cb(null, filtered)\n  },\n})\n\nawait pipeline(\n  createReadStream('\u002Ftmp\u002Faudit.log'),\n  jsonFilter,\n  lineCounter,\n  createWriteStream('\u002Ftmp\u002Faudit-clean.log')\n)\n```\n\n---\n\n## Backpressure: respect highWaterMark\n\n```javascript\nconst readable = createReadStream('\u002Ftmp\u002Fhuge.log', {\n  highWaterMark: 64 * 1024,  \u002F\u002F 64KB chunks\n})\n\n\u002F\u002F pipeline handles backpressure automatically\n\u002F\u002F manual .pipe() requires checking write.write() return value\n```\n\n---\n\n## Anti-Fake-Pass Checklist\n\n```\n❌ Manual .pipe() without error handlers → source stream not destroyed on dest error\n❌ pump callback-style — must handle null err case, not just error case\n❌ stream.pipeline (non-promise) vs stream\u002Fpromises — different import paths\n❌ Transform pushes data after calling cb(err) → double-emit crash\n❌ highWaterMark too large → buffers entire file in memory despite streaming intent\n❌ pipeline with async generator → must use Node.js 16+ for full support\n```\n","# \u002Fstream-pipeline-patterns\n\n## When to Use\n\n- Chaining compress → encrypt → write streams with proper error cleanup\n- Processing large log files or archives without loading into memory\n- Ensuring all streams in a pipeline are destroyed if any one errors\n- Replacing manual `.pipe()` chains that leak on errors\n\n## Do NOT use for\n\n- One-shot small data (\u003C 10MB) — just use `fs.readFileSync` \u002F `Buffer`\n- Async iterables (use `for await...of` with stream iteration instead)\n\n---\n\n## pump (auto-cleanup on error)\n\n```javascript\nimport pump  from 'pump'\nimport { createReadStream, createWriteStream } from 'fs'\nimport { createGzip } from 'zlib'\n\n\u002F\u002F If any stream errors, ALL streams are destroyed and callback fires\npump(\n  createReadStream('\u002Ftmp\u002Fagent.log'),\n  createGzip(),\n  createWriteStream('\u002Ftmp\u002Fagent.log.gz'),\n  (err) => {\n    if (err) console.error('[pump] pipeline error:', err.message)\n    else      console.log('[pump] done')\n  }\n)\n```\n\n---\n\n## stream.pipeline (built-in Node.js ≥ 10)\n\n```javascript\nimport { pipeline } from 'stream\u002Fpromises'\nimport { createReadStream, createWriteStream } from 'fs'\nimport { createBrotliCompress } from 'zlib'\n\n\u002F\u002F Awaitable pipeline — throws on error, cleans up all streams\nasync function compressLog(input: string, output: string): Promise\u003Cvoid> {\n  await pipeline(\n    createReadStream(input),\n    createBrotliCompress(),\n    createWriteStream(output)\n  )\n}\n```\n\n---\n\n## Transform stream chain\n\n```javascript\nimport { Transform } from 'stream'\nimport { pipeline }  from 'stream\u002Fpromises'\n\nconst lineCounter = new Transform({\n  transform(chunk, _enc, cb) {\n    const lines = chunk.toString().split('\\n').length - 1\n    this.lineCount = (this.lineCount ?? 0) + lines\n    cb(null, chunk)\n  },\n})\n\nconst jsonFilter = new Transform({\n  transform(chunk, _enc, cb) {\n    const filtered = chunk.toString()\n      .split('\\n')\n      .filter(line => { try { JSON.parse(line); return true } catch { return false } })\n      .join('\\n')\n    cb(null, filtered)\n  },\n})\n\nawait pipeline(\n  createReadStream('\u002Ftmp\u002Faudit.log'),\n  jsonFilter,\n  lineCounter,\n  createWriteStream('\u002Ftmp\u002Faudit-clean.log')\n)\n```\n\n---\n\n## Backpressure: respect highWaterMark\n\n```javascript\nconst readable = createReadStream('\u002Ftmp\u002Fhuge.log', {\n  highWaterMark: 64 * 1024,  \u002F\u002F 64KB chunks\n})\n\n\u002F\u002F pipeline handles backpressure automatically\n\u002F\u002F manual .pipe() requires checking write.write() return value\n```\n\n---\n\n## Anti-Fake-Pass Checklist\n\n```\n❌ Manual .pipe() without error handlers → source stream not destroyed on dest error\n❌ pump callback-style — must handle null err case, not just error case\n❌ stream.pipeline (non-promise) vs stream\u002Fpromises — different import paths\n❌ Transform pushes data after calling cb(err) → double-emit crash\n❌ highWaterMark too large → buffers entire file in memory despite streaming intent\n❌ pipeline with async generator → must use Node.js 16+ for full support\n```\n",{},"main","481dcd7dd2e288b9d627a2bd017db70e64e6c6fa",".claude\u002Fskills\u002Fstream-pipeline-patterns",2,"https:\u002F\u002Fgithub.com\u002FHoronomos-laps\u002FYana-AI","https:\u002F\u002Fyana.vutam.link\u002F","https:\u002F\u002Fgithub.com\u002FHoronomos-laps","https:\u002F\u002Fyana.vutam.link","An open-source governed runtime & execution environment for multi-agent AI systems.","2026-11-14 13:24:09",{"source":7,"skillName":5,"commands":34,"prompt":44,"zipAvailable":45},[35,38,41],{"tool":36,"command":37},"npx","npx skills add Horonomos-laps\u002FYana-AI --skill stream-pipeline-patterns",{"tool":39,"command":40},"bunx","bunx skills add Horonomos-laps\u002FYana-AI --skill stream-pipeline-patterns",{"tool":42,"command":43},"pnpm","pnpm dlx skills add Horonomos-laps\u002FYana-AI --skill stream-pipeline-patterns","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FHoronomos-laps\u002FYana-AI\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fstream-pipeline-patterns\u002FSKILL.md",true,[],[48,56,63,71,79,87],{"skillNo":49,"name":50,"nameZh":6,"description":51,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":52,"licenseFileUrl":6,"sourceHtmlUrl":53,"categories":54,"keywords":55,"publishedAt":18},"01M735GKET5YVYKAY62W2P5YXB","openai--sentry--sentry","Use when the user asks to inspect Sentry issues or events, summarize recent production errors, or pull basic Sentry health data via the Sentry API; perform read-only queries with the bundled script and require `SENTRY_AUTH_TOKEN`.","MIT","https:\u002F\u002Fgithub.com\u002FHoronomos-laps\u002FYana-AI\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fopenai--sentry--sentry\u002FSKILL.md",[],[],{"skillNo":57,"name":58,"nameZh":6,"description":59,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":60,"categories":61,"keywords":62,"publishedAt":18},"01M73DCAP83T17HY7SMGK7MGFE","ito-basket-compare","Compare Itô prediction-market baskets against a user's knowledge base, portfolio notes, financial context, watchlist, or research thesis. Use for read-only basket comparison and gap analysis without investment advice or live trading.","https:\u002F\u002Fgithub.com\u002FHoronomos-laps\u002FYana-AI\u002Fblob\u002Fmain\u002Fcore\u002Fskills\u002Fito-basket-compare\u002FSKILL.md",[],[],{"skillNo":64,"name":65,"nameZh":6,"description":66,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":67,"sourceHtmlUrl":68,"categories":69,"keywords":70,"publishedAt":18},"01M734CYEMZFDR3KH6SW0JP8TD","implementing-network-traffic-baselining","Build network traffic baselines from NetFlow\u002FIPFIX data using Python pandas for statistical analysis, z-score anomaly detection, and hourly\u002Fdaily traffic pattern profiling","https:\u002F\u002Fgithub.com\u002Fyanacuti1121\u002FYana-AI\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fimplementing-network-traffic-baselining\u002FLICENSE","https:\u002F\u002Fgithub.com\u002FHoronomos-laps\u002FYana-AI\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fimplementing-network-traffic-baselining\u002FSKILL.md",[],[],{"skillNo":72,"name":73,"nameZh":6,"description":74,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":75,"sourceHtmlUrl":76,"categories":77,"keywords":78,"publishedAt":18},"01M73ASZ6NJRJM44Z2P84NGQ3Q","detecting-evasion-techniques-in-endpoint-logs","Detects defense evasion techniques used by adversaries in endpoint logs including log tampering, timestomping, process injection, and security tool disabling. Use when investigating suspicious endpoint behavior, building detection rules for evasion tactics, or conducting threat hunting for stealthy adversary activity. Activates for requests involving evasion detection, defense evasion analysis, log tampering detection, or MITRE ATT&CK TA0005.","https:\u002F\u002Fgithub.com\u002Fyanacuti1121\u002FYana-AI\u002Fblob\u002Fmain\u002Fcore\u002Fskills\u002Fdetecting-evasion-techniques-in-endpoint-logs\u002FLICENSE","https:\u002F\u002Fgithub.com\u002FHoronomos-laps\u002FYana-AI\u002Fblob\u002Fmain\u002Fcore\u002Fskills\u002Fdetecting-evasion-techniques-in-endpoint-logs\u002FSKILL.md",[],[],{"skillNo":80,"name":81,"nameZh":6,"description":82,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":83,"sourceHtmlUrl":84,"categories":85,"keywords":86,"publishedAt":18},"01M734AFNXD06Z78QRK0VKGT7Q","implementing-microsegmentation-with-guardicore","Implementing microsegmentation using Akamai Guardicore Segmentation to map application dependencies, create granular network policies, visualize east-west traffic flows, and enforce least-privilege communication between workloads across data centers and cloud.","https:\u002F\u002Fgithub.com\u002Fyanacuti1121\u002FYana-AI\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fimplementing-microsegmentation-with-guardicore\u002FLICENSE","https:\u002F\u002Fgithub.com\u002FHoronomos-laps\u002FYana-AI\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fimplementing-microsegmentation-with-guardicore\u002FSKILL.md",[],[],{"skillNo":88,"name":89,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":90,"categories":91,"keywords":92,"publishedAt":18},"01M736TK27QMCXK0DVCH25SJN5","ramdisk-tmpfs-patterns","https:\u002F\u002Fgithub.com\u002FHoronomos-laps\u002FYana-AI\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Framdisk-tmpfs-patterns\u002FSKILL.md",[],[]]