[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7C1XPM4SMF7C61WK0PBECQ3":3,"skill-same:01M7C1XPM4SMF7C61WK0PBECQ3":98},{"skillNo":4,"name":5,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":15,"categories":16,"keywords":17,"publishedAt":18,"linkOnly":19,"markdownContent":20,"markdownBody":20,"frontMatter":21,"refName":22,"commitSha":23,"skillDirectory":24,"forksCount":25,"repositoryHtmlUrl":26,"repositoryHomepageUrl":6,"ownerHtmlUrl":27,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":28,"install":29,"resources":42},"01M7C1XPM4SMF7C61WK0PBECQ3","senior-data-engineer",null,"linyouxue\u002Fskill-repair-benchmark","linyouxue","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F216151464?v=4","01M7BJEVCXKD74KH6FG9CBVSQB","林宥学","01M7BJEVE02NP217V93BKZFC0J",0,"Apache-2.0","https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"# Flink Repo Aligned Streaming Job Implementation\n\n## Purpose\nImplement or modify a Flink (typically Java) streaming\u002Fbatch job inside an existing repository so it matches the repository entrypoints, IO utilities, and the verifier\u002Ftest harness contract, while avoiding brittle assumptions about ordering, filesystem semantics, and event completeness.\n\n## When to Use\nUse when a task requires producing verifier-checked artifacts from a Flink job in a provided codebase (Maven\u002FGradle), especially when inputs\u002Foutputs are defined by repo scripts\u002Ftests and when mistakes often come from writing outputs to the wrong place, using custom IO\u002Fconnectors, or assuming event-time ordering and terminal events.\n\n## Procedure\n- Step 1: Discover the contract before coding.\n- Locate how the job is run and verified: read README, run scripts, CI config, and tests; inspect build files for main class\u002Fentrypoints.\n- Extract and write down (a) the expected entrypoint and arguments, (b) required output path(s) and filename patterns, and (c) any output format\u002Fschema expectations found.\n- If output path(s) are not explicitly stated, search for them in tests\u002Fverifier code; if still unknown, do not invent a new path. Keep it as unknown and prioritize finding the harness logic.\n- Step 2: Ground input schema and semantics with a small sample.\n- Identify the authoritative schema source (repo docs, model classes, parsing utilities). Prefer reusing existing parsers and POJOs over re-deriving indices.\n- Run a small parse\u002Finspect on a tiny input subset (or use an existing repo tool) to confirm:\n- Column-to-field mapping and types (timestamps, ids, event_type enums).\n- Whether timestamps are out-of-order in file order (check at least a few hundred rows).\n- Whether terminal events needed by your logic (for example FINISH\u002FKILL) actually appear in the provided subset; if not, design emission logic that does not require them.\n- Decision point: If ordering is not guaranteed, choose bounded-out-of-orderness watermarks or processing-time timers; do not use monotonic watermarks unless you observed monotonicity in the sample and the task explicitly guarantees it.\n- Step 3: Implement using repo-aligned IO and Flink safe primitives.\n- Prefer existing repo IO utilities\u002Fsources\u002Fsinks and Flink supported connectors (FileSource\u002FFileSink, TextOutputFormat equivalents) that work with parallelism and distributed filesystems.\n- Implement core logic with explicit checkpoints:\n- Keying: key by the entity the contract implies (for example job_id) and document the key choice in code comments.\n- State\u002Ftimers: use keyed state plus event-time or processing-time timers to close inactivity gaps; ensure you handle out-of-order events (late events policy) in a contract-aligned way.\n- Emission: do not gate all outputs on optional events unless the contract proves they are always present; if ambiguous, implement a fallback close condition (for example inactivity timer) that still produces required aggregates.\n- Avoid adding custom low-level IO (custom gzip readers, local FileOutputStream sinks) unless the repo contract explicitly requires it and you can prove verifier visibility.\n- Step 4: Verify against the observable contract before finalizing.\n- Build and run using the repo documented command (not an invented one). If a test target exists, run it.\n- Output grounding check (exact paths):\n- List the exact required output path(s) discovered in Step 1 and confirm non-empty output artifacts exist there (for example part files).\n- If writing fails, diagnose mounts\u002Fpermissions and align with the harness write route; do not silently switch to a different directory.\n- Schema check:\n- Reload the produced outputs and assert required columns\u002Ftypes\u002Fline format match what tests expect (delimiter, header\u002Fno header, ordering constraints if stated).\n- Only then claim completion.\n\n## Constraints \u002F Pitfalls\n- Do not assume event-time monotonicity or in-order arrival. Using monotonic watermarks without evidence is forbidden; default to bounded out-of-orderness or processing-time logic when ordering is unclear.\n- Do not introduce custom sources\u002Fsinks or write to arbitrary local paths. Use repo-provided IO or Flink-supported file sinks and verify artifacts exist at the exact verifier-checked output path(s) before finishing.",{},"main","cdcb6d230f3b15c3c33f8a2bdd16439f43602cbe","evaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer",1,"https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark","https:\u002F\u002Fgithub.com\u002Flinyouxue","2026-11-14 20:28:35",{"source":7,"skillName":5,"commands":30,"prompt":40,"zipAvailable":41},[31,34,37],{"tool":32,"command":33},"npx","npx skills add linyouxue\u002Fskill-repair-benchmark --skill senior-data-engineer",{"tool":35,"command":36},"bunx","bunx skills add linyouxue\u002Fskill-repair-benchmark --skill senior-data-engineer",{"tool":38,"command":39},"pnpm","pnpm dlx skills add linyouxue\u002Fskill-repair-benchmark --skill senior-data-engineer","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002FSKILL.md",true,[43,48,51,54,60,64,68,72,78,82,86,90,94],{"path":44,"resourceType":45,"resourceTypeDesc":46,"sizeBytes":13,"sourceHtmlUrl":47},"assets\u002F.gitkeep","ASSET","资产文件","https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002Fassets\u002F.gitkeep",{"path":49,"resourceType":45,"resourceTypeDesc":46,"sizeBytes":13,"sourceHtmlUrl":50},"assets\u002Fdata-quality-checklist.md","https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002Fassets\u002Fdata-quality-checklist.md",{"path":52,"resourceType":45,"resourceTypeDesc":46,"sizeBytes":13,"sourceHtmlUrl":53},"assets\u002Fpipeline-design-template.md","https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002Fassets\u002Fpipeline-design-template.md",{"path":55,"resourceType":56,"resourceTypeDesc":57,"sizeBytes":58,"sourceHtmlUrl":59},"HOW_TO_USE.md","REFERENCE","参考文档",2500,"https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002FHOW_TO_USE.md",{"path":61,"resourceType":56,"resourceTypeDesc":57,"sizeBytes":62,"sourceHtmlUrl":63},"references\u002Fframeworks.md",42313,"https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002Freferences\u002Fframeworks.md",{"path":65,"resourceType":56,"resourceTypeDesc":57,"sizeBytes":66,"sourceHtmlUrl":67},"references\u002Ftemplates.md",67136,"https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002Freferences\u002Ftemplates.md",{"path":69,"resourceType":56,"resourceTypeDesc":57,"sizeBytes":70,"sourceHtmlUrl":71},"references\u002Ftools.md",39140,"https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002Freferences\u002Ftools.md",{"path":73,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":76,"sourceHtmlUrl":77},"scripts\u002Fdata_quality_validator.py","SCRIPT","脚本",3489,"https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002Fscripts\u002Fdata_quality_validator.py",{"path":79,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":80,"sourceHtmlUrl":81},"scripts\u002Fetl_performance_optimizer.py",3504,"https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002Fscripts\u002Fetl_performance_optimizer.py",{"path":83,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":84,"sourceHtmlUrl":85},"scripts\u002Fkafka_config_generator.py",41177,"https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002Fscripts\u002Fkafka_config_generator.py",{"path":87,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":88,"sourceHtmlUrl":89},"scripts\u002Fpipeline_orchestrator.py",3487,"https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002Fscripts\u002Fpipeline_orchestrator.py",{"path":91,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":92,"sourceHtmlUrl":93},"scripts\u002Fstream_processor.py",60553,"https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002Fscripts\u002Fstream_processor.py",{"path":95,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":96,"sourceHtmlUrl":97},"scripts\u002Fstreaming_quality_validator.py",40005,"https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fevaluation\u002Fresults\u002FSkillrevise\u002Ftasks\u002Fflink-query\u002Frepaired_run\u002Finputs\u002Fskills\u002Fsenior-data-engineer\u002Fscripts\u002Fstreaming_quality_validator.py",[99,106,113,120,125,130],{"skillNo":100,"name":101,"nameZh":6,"description":102,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":103,"categories":104,"keywords":105,"publishedAt":18},"01M7E1HGVRY73NBJ022CJG13X6","video-frame-extraction","Extract frames from video files and save them as images using OpenCV","https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fjpg-ocr-stat\u002Fresult\u002Fskilltta-claude4.7\u002Fgroup_03\u002Frun_03\u002Finputs\u002Fskills\u002Fvideo-frame-extraction\u002FSKILL.md",[],[],{"skillNo":107,"name":108,"nameZh":6,"description":109,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":110,"categories":111,"keywords":112,"publishedAt":18},"01M7E1HAG5R7CJ9C8NYJS771MB","openai-vision","Analyze images and multi-frame sequences using OpenAI GPT vision models","https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fjpg-ocr-stat\u002Fresult\u002Fskilltta-claude4.7\u002Fgroup_03\u002Frun_03\u002Finputs\u002Fskills\u002Fopenai-vision\u002FSKILL.md",[],[],{"skillNo":114,"name":115,"nameZh":6,"description":116,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":117,"categories":118,"keywords":119,"publishedAt":18},"01M7E1H7DADKB6QBWKC2KQ63SZ","image-ocr","Extract text content from images using Tesseract OCR via Python, including structured field extraction from receipts and forms","https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fjpg-ocr-stat\u002Fresult\u002Fskilltta-claude4.7\u002Fgroup_03\u002Frun_03\u002Finputs\u002Fskills\u002Fimage-ocr\u002FSKILL.md",[],[],{"skillNo":121,"name":101,"nameZh":6,"description":102,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":122,"categories":123,"keywords":124,"publishedAt":18},"01M7E1H0WBNT43TENGQY7AVZHD","https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fjpg-ocr-stat\u002Fresult\u002Fskilltta-claude4.7\u002Fgroup_03\u002Frun_02\u002Finputs\u002Fskills\u002Fvideo-frame-extraction\u002FSKILL.md",[],[],{"skillNo":126,"name":108,"nameZh":6,"description":109,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":127,"categories":128,"keywords":129,"publishedAt":18},"01M7E1GTC7D4N4Q2EF03875J9E","https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fjpg-ocr-stat\u002Fresult\u002Fskilltta-claude4.7\u002Fgroup_03\u002Frun_02\u002Finputs\u002Fskills\u002Fopenai-vision\u002FSKILL.md",[],[],{"skillNo":131,"name":115,"nameZh":6,"description":116,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":132,"categories":133,"keywords":134,"publishedAt":18},"01M7E1GQ92CWFMGH53KSSE4WER","https:\u002F\u002Fgithub.com\u002Flinyouxue\u002Fskill-repair-benchmark\u002Fblob\u002Fmain\u002Fjpg-ocr-stat\u002Fresult\u002Fskilltta-claude4.7\u002Fgroup_03\u002Frun_02\u002Finputs\u002Fskills\u002Fimage-ocr\u002FSKILL.md",[],[]]