[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M792ZQDM61KA7JCFKEDZ7FPG":3,"skill-same:01M792ZQDM61KA7JCFKEDZ7FPG":56},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":15,"categories":16,"keywords":17,"publishedAt":18,"linkOnly":19,"markdownContent":20,"markdownBody":21,"frontMatter":22,"refName":26,"commitSha":27,"skillDirectory":28,"forksCount":29,"repositoryHtmlUrl":30,"repositoryHomepageUrl":6,"ownerHtmlUrl":31,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":32,"install":33,"resources":45},"01M792ZQDM61KA7JCFKEDZ7FPG","indexing",null,"Guide Kalshi and Polymarket market, trade, block, and legacy backfill workflows.","VectorSpaceLab\u002FAREX-Skill","VectorSpaceLab","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F180637102?v=4","01M7538C5WPSJGWF7KHR4EFZ9F","01M7538C6R2GFP53NPXTCZNBRT",351,"MIT","https:\u002F\u002Fgithub.com\u002FVectorSpaceLab\u002FAREX-Skill\u002Fblob\u002Fmain\u002Fskills\u002Frepositories\u002Frepo-skills\u002Fprediction-market-analysis\u002Fsub-skills\u002Findexing\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: indexing\ndescription: \"Guide Kalshi and Polymarket market, trade, block, and legacy\n  backfill workflows.\"\nmetadata:\n  disco-role: operating\ndisable-model-invocation: true\nlicense: MIT\n---\n\n# indexing\n\nUse this sub-skill for data-collection workflows that write Parquet chunks and resume from cursor files.\nIt covers both API-based and blockchain-based collectors.\n\n## Use this route when\n\n- The user wants to backfill markets, trades, blocks, or legacy FPMM data.\n- The user wants to resume a partially completed run.\n- The user wants to understand the shape of a cursor file or chunked Parquet output.\n- The user wants to add a new indexer subclass.\n\n## Scope\n\n### Included\n\n- Kalshi market and trade backfills.\n- Polymarket market, trade, block, and legacy FPMM backfills.\n- Cursor files, chunk naming, deduplication, and resume behavior.\n- `KalshiClient`, `PolymarketClient`, `PolygonClient`, and `Indexer.load()`.\n\n### Excluded\n\n- Analysis and chart output workflows, which belong to `sub-skills\u002Fanalysis\u002F`.\n- Dataset packaging and host-tool installation, which belong to `sub-skills\u002Fdata-ops\u002F`.\n\n## Read first\n\n- `..\u002F..\u002Freferences\u002Findexing-catalog.md` for the full indexer list.\n- `..\u002F..\u002Freferences\u002Fapi-reference.md` for the client and base-class APIs.\n- `..\u002F..\u002Freferences\u002Fdata-layout.md` for chunk paths, cursor files, and helper files.\n- `..\u002F..\u002Freferences\u002Ftroubleshooting.md` for cross-cutting failures.\n\n## Core workflow\n\n1. Identify the indexer name and required inputs.\n2. Confirm the cursor file and output directory state.\n3. Provide any required env vars, especially `POLYGON_RPC` for blockchain-backed collectors.\n4. Run the indexer through `uv run main.py index` or directly from the Python class.\n5. Verify that the expected Parquet chunks and cursor files were updated.\n\n## Indexer families\n\n### Kalshi\n\n- `kalshi_markets` backfills market snapshots into chunked Parquet files.\n- `kalshi_trades` fetches trades for markets discovered from the market parquet tree and skips already-processed tickers.\n\nImportant details:\n\n- Markets use `ParquetStorage` for chunking and deduplication.\n- Trades run concurrently and dedupe by `trade_id`.\n- `kalshi_trades` only considers markets above the built-in volume threshold.\n\n### Polymarket markets and trades\n\n- `polymarket_markets` paginates the Gamma API with an offset cursor.\n- `polymarket_trades` backfills CTF and NegRisk `OrderFilled` logs by block range.\n\nImportant details:\n\n- The trade indexer stores progress after each completed block chunk.\n- The trade indexer writes chunked Parquet files under `data\u002Fpolymarket\u002Ftrades\u002F`.\n- The market indexer writes an offset cursor and chunked market files.\n\n### Polymarket blocks\n\n- `polymarket_blocks` builds a block-to-timestamp lookup.\n- It samples every 100 blocks and interpolates the values to fill each bucket.\n- The output feeds analyses that need approximate timestamps for trade blocks.\n\n### Polymarket legacy FPMM trades\n\n- `polymarket_fpmm_trades` decodes `FPMMBuy` and `FPMMSell` logs from the Polygon chain.\n- It filters to USDC-collateralized markets.\n- It is the most RPC-intensive collector in the repo.\n\n## Adding or fixing an indexer\n\n- Subclass `Indexer`.\n- Set `name` and `description` in `__init__`.\n- Keep the fetch\u002Fresume\u002Fsave loop explicit so interruption points are easy to reason about.\n- Write Parquet chunks with predictable names.\n- Save or update a cursor file only after the relevant unit of work is safely completed.\n- Prefer small helper methods for decoding logs, chunking ranges, or deduplicating existing rows.\n\n## Common failure patterns\n\n- Missing `POLYGON_RPC` for chain-backed collectors.\n- Invalid cursor files that point to the wrong offset or block.\n- Duplicate rows when the collector is rerun without deduplication.\n- Chunk files that are partially written because a run was interrupted.\n- Slow or failing RPC queries when the block range is too large.\n\n## Helpful helper\n\n- `..\u002F..\u002Fscripts\u002Fcatalog.py --indexers` lists the indexer names without opening the interactive menu when run through the repo environment.\n","# indexing\n\nUse this sub-skill for data-collection workflows that write Parquet chunks and resume from cursor files.\nIt covers both API-based and blockchain-based collectors.\n\n## Use this route when\n\n- The user wants to backfill markets, trades, blocks, or legacy FPMM data.\n- The user wants to resume a partially completed run.\n- The user wants to understand the shape of a cursor file or chunked Parquet output.\n- The user wants to add a new indexer subclass.\n\n## Scope\n\n### Included\n\n- Kalshi market and trade backfills.\n- Polymarket market, trade, block, and legacy FPMM backfills.\n- Cursor files, chunk naming, deduplication, and resume behavior.\n- `KalshiClient`, `PolymarketClient`, `PolygonClient`, and `Indexer.load()`.\n\n### Excluded\n\n- Analysis and chart output workflows, which belong to `sub-skills\u002Fanalysis\u002F`.\n- Dataset packaging and host-tool installation, which belong to `sub-skills\u002Fdata-ops\u002F`.\n\n## Read first\n\n- `..\u002F..\u002Freferences\u002Findexing-catalog.md` for the full indexer list.\n- `..\u002F..\u002Freferences\u002Fapi-reference.md` for the client and base-class APIs.\n- `..\u002F..\u002Freferences\u002Fdata-layout.md` for chunk paths, cursor files, and helper files.\n- `..\u002F..\u002Freferences\u002Ftroubleshooting.md` for cross-cutting failures.\n\n## Core workflow\n\n1. Identify the indexer name and required inputs.\n2. Confirm the cursor file and output directory state.\n3. Provide any required env vars, especially `POLYGON_RPC` for blockchain-backed collectors.\n4. Run the indexer through `uv run main.py index` or directly from the Python class.\n5. Verify that the expected Parquet chunks and cursor files were updated.\n\n## Indexer families\n\n### Kalshi\n\n- `kalshi_markets` backfills market snapshots into chunked Parquet files.\n- `kalshi_trades` fetches trades for markets discovered from the market parquet tree and skips already-processed tickers.\n\nImportant details:\n\n- Markets use `ParquetStorage` for chunking and deduplication.\n- Trades run concurrently and dedupe by `trade_id`.\n- `kalshi_trades` only considers markets above the built-in volume threshold.\n\n### Polymarket markets and trades\n\n- `polymarket_markets` paginates the Gamma API with an offset cursor.\n- `polymarket_trades` backfills CTF and NegRisk `OrderFilled` logs by block range.\n\nImportant details:\n\n- The trade indexer stores progress after each completed block chunk.\n- The trade indexer writes chunked Parquet files under `data\u002Fpolymarket\u002Ftrades\u002F`.\n- The market indexer writes an offset cursor and chunked market files.\n\n### Polymarket blocks\n\n- `polymarket_blocks` builds a block-to-timestamp lookup.\n- It samples every 100 blocks and interpolates the values to fill each bucket.\n- The output feeds analyses that need approximate timestamps for trade blocks.\n\n### Polymarket legacy FPMM trades\n\n- `polymarket_fpmm_trades` decodes `FPMMBuy` and `FPMMSell` logs from the Polygon chain.\n- It filters to USDC-collateralized markets.\n- It is the most RPC-intensive collector in the repo.\n\n## Adding or fixing an indexer\n\n- Subclass `Indexer`.\n- Set `name` and `description` in `__init__`.\n- Keep the fetch\u002Fresume\u002Fsave loop explicit so interruption points are easy to reason about.\n- Write Parquet chunks with predictable names.\n- Save or update a cursor file only after the relevant unit of work is safely completed.\n- Prefer small helper methods for decoding logs, chunking ranges, or deduplicating existing rows.\n\n## Common failure patterns\n\n- Missing `POLYGON_RPC` for chain-backed collectors.\n- Invalid cursor files that point to the wrong offset or block.\n- Duplicate rows when the collector is rerun without deduplication.\n- Chunk files that are partially written because a run was interrupted.\n- Slow or failing RPC queries when the block range is too large.\n\n## Helpful helper\n\n- `..\u002F..\u002Fscripts\u002Fcatalog.py --indexers` lists the indexer names without opening the interactive menu when run through the repo environment.\n",{"name":5,"license":14,"metadata":23,"description":7,"disable-model-invocation":25},{"disco-role":24},"operating",true,"main","ac3fe1afa80fb9a09775ecfb2b6cc3ba850a2db6","skills\u002Frepositories\u002Frepo-skills\u002Fprediction-market-analysis\u002Fsub-skills\u002Findexing",27,"https:\u002F\u002Fgithub.com\u002FVectorSpaceLab\u002FAREX-Skill","https:\u002F\u002Fgithub.com\u002FVectorSpaceLab","2026-09-03 10:25:21",{"source":8,"skillName":5,"commands":34,"prompt":44,"zipAvailable":25},[35,38,41],{"tool":36,"command":37},"npx","npx skills add VectorSpaceLab\u002FAREX-Skill --skill indexing",{"tool":39,"command":40},"bunx","bunx skills add VectorSpaceLab\u002FAREX-Skill --skill indexing",{"tool":42,"command":43},"pnpm","pnpm dlx skills add VectorSpaceLab\u002FAREX-Skill --skill indexing","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FVectorSpaceLab\u002FAREX-Skill\u002Fblob\u002Fmain\u002Fskills\u002Frepositories\u002Frepo-skills\u002Fprediction-market-analysis\u002Fsub-skills\u002Findexing\u002FSKILL.md",[46,52],{"path":47,"resourceType":48,"resourceTypeDesc":49,"sizeBytes":50,"sourceHtmlUrl":51},"references\u002Ftroubleshooting.md","REFERENCE","参考文档",1800,"https:\u002F\u002Fgithub.com\u002FVectorSpaceLab\u002FAREX-Skill\u002Fblob\u002Fmain\u002Fskills\u002Frepositories\u002Frepo-skills\u002Fprediction-market-analysis\u002Fsub-skills\u002Findexing\u002Freferences\u002Ftroubleshooting.md",{"path":53,"resourceType":48,"resourceTypeDesc":49,"sizeBytes":54,"sourceHtmlUrl":55},"references\u002Fworkflows.md",1470,"https:\u002F\u002Fgithub.com\u002FVectorSpaceLab\u002FAREX-Skill\u002Fblob\u002Fmain\u002Fskills\u002Frepositories\u002Frepo-skills\u002Fprediction-market-analysis\u002Fsub-skills\u002Findexing\u002Freferences\u002Fworkflows.md",[57,65,72,79,86,93],{"skillNo":58,"name":59,"nameZh":6,"description":60,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":61,"licenseFileUrl":6,"sourceHtmlUrl":62,"categories":63,"keywords":64,"publishedAt":18},"01M799NYSH1R3RVAHSM2D88Y84","passnet-triton-opt","Make a single PassNet Triton kernel fast AND numerically faithful: performance model (when a replacement can win at all), block\u002Fgrid\u002Fwarp tuning, autotune policy, launch overhead, and per-op numeric recipes to pass the dtype baseline tolerances. Use when a pass matches and is correct but speedup below expected, or when correctness fails by small numeric margins.","Apache-2.0","https:\u002F\u002Fgithub.com\u002FVectorSpaceLab\u002FAREX-Skill\u002Fblob\u002Fmain\u002Fskills\u002Ftask-oriented\u002FPassNet\u002Fskills\u002Fpassnet-triton-opt\u002FSKILL.md",[],[],{"skillNo":66,"name":67,"nameZh":6,"description":68,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":61,"licenseFileUrl":6,"sourceHtmlUrl":69,"categories":70,"keywords":71,"publishedAt":18},"01M799NS5APEC0N1FZ7XZVW6BN","passnet-solve","END-TO-END playbook for solving one PassNet sample: analyze the computation graphs, decide the optimization strategy (what to fuse, what to replace, what to leave alone), drive the iteration loop, and maximize the sample score. This is the ENTRY skill — invoke it first for any PassNet optimization task; it tells you when to use passnet-pattern-fusion, passnet-triton-opt and passnet-feedback.","https:\u002F\u002Fgithub.com\u002FVectorSpaceLab\u002FAREX-Skill\u002Fblob\u002Fmain\u002Fskills\u002Ftask-oriented\u002FPassNet\u002Fskills\u002Fpassnet-solve\u002FSKILL.md",[],[],{"skillNo":73,"name":74,"nameZh":6,"description":75,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":61,"licenseFileUrl":6,"sourceHtmlUrl":76,"categories":77,"keywords":78,"publishedAt":18},"01M799NNY9BKSM21V5R7QVTBJX","passnet-skill","PassNet GPU kernel optimization via compiler passes. Design and implement Triton-based optimization passes, create pass files under .\u002Fpass_dir\u002F, self-evaluate with pass_evaluator, and iterate to maximize GPU speedup.","https:\u002F\u002Fgithub.com\u002FVectorSpaceLab\u002FAREX-Skill\u002Fblob\u002Fmain\u002Fskills\u002Ftask-oriented\u002FPassNet\u002Fskills\u002Fpassnet-skill\u002FSKILL.md",[],[],{"skillNo":80,"name":81,"nameZh":6,"description":82,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":61,"licenseFileUrl":6,"sourceHtmlUrl":83,"categories":84,"keywords":85,"publishedAt":18},"01M799NHH6NP7Z1RK77KGXAN6S","passnet-pattern-fusion","Author PassNet pass files: write patterns that actually MATCH the FX graph, pick fusion regions (which ops to absorb into one Triton kernel), and structure multi-pass submissions with the mandatory shared-dispatch architecture. Use when creating or fixing pattern()\u002Freplacement_args()\u002Freplacement_func() files, when a pass \"failed to match\", or when deciding how to fuse multiple kernels\u002Fops.","https:\u002F\u002Fgithub.com\u002FVectorSpaceLab\u002FAREX-Skill\u002Fblob\u002Fmain\u002Fskills\u002Ftask-oriented\u002FPassNet\u002Fskills\u002Fpassnet-pattern-fusion\u002FSKILL.md",[],[],{"skillNo":87,"name":88,"nameZh":6,"description":89,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":61,"licenseFileUrl":6,"sourceHtmlUrl":90,"categories":91,"keywords":92,"publishedAt":18},"01M799ND2J4WNC2PGAZ0A06NDF","passnet-orchestrate","Round\u002Fbatch planning and decision support for PassNet graph optimization. Use for multi-sample triage, worker allocation, eval-budget policy, and post-eval keep\u002Frevert decisions. For solving one concrete sample end to end, use passnet-solve as the entry skill; consult this skill only when you need broader planning or a specific decision gate.","https:\u002F\u002Fgithub.com\u002FVectorSpaceLab\u002FAREX-Skill\u002Fblob\u002Fmain\u002Fskills\u002Ftask-oriented\u002FPassNet\u002Fskills\u002Fpassnet-orchestrate\u002FSKILL.md",[],[],{"skillNo":94,"name":95,"nameZh":6,"description":96,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":61,"licenseFileUrl":6,"sourceHtmlUrl":97,"categories":98,"keywords":99,"publishedAt":18},"01M799N8SBTMY02ZDG2AZF5ZWE","passnet-feedback","Fast, deterministic feedback for PassNet work: pre-flight pattern\u002Fmatch verification WITHOUT burning a GPU evaluation, per-node bottleneck analysis of a sample's graphs, and eval-log parsing into per-variant status + estimated score + failure classification. Use BEFORE every GPU evaluation (check_pattern), at the START of a sample (analyze_graph), and AFTER every evaluation (parse_eval_log).","https:\u002F\u002Fgithub.com\u002FVectorSpaceLab\u002FAREX-Skill\u002Fblob\u002Fmain\u002Fskills\u002Ftask-oriented\u002FPassNet\u002Fskills\u002Fpassnet-feedback\u002FSKILL.md",[],[]]