[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6EEAFB6R3DAQPAA689NYNDC":3,"skill-same:01M6EEAFB6R3DAQPAA689NYNDC":45},{"skillNo":4,"name":5,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":15,"categories":16,"keywords":17,"publishedAt":18,"linkOnly":19,"markdownContent":20,"markdownBody":20,"frontMatter":21,"refName":22,"commitSha":23,"skillDirectory":24,"forksCount":25,"repositoryHtmlUrl":26,"repositoryHomepageUrl":27,"ownerHtmlUrl":28,"ownerBlogUrl":6,"ownerDescription":29,"updatedAt":30,"install":31,"resources":44},"01M6EEAFB6R3DAQPAA689NYNDC","airbyte",null,"ComeOnOliver\u002Fskillshub","ComeOnOliver","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F43215937?v=4","01M6E5JNFECJAAVFE0W7SMWWD2","Haoran Shu","01M6E5JNNDQS7AJZDYFQ8TPZCK",67,"MIT","https:\u002F\u002Fgithub.com\u002FComeOnOliver\u002Fskillshub\u002Fblob\u002Fmain\u002Fskills\u002FTerminalSkills\u002Fskills\u002Fairbyte\u002FSKILL.md",[],[5],"2026-11-10 10:12:30",false,"# Airbyte — Open-Source Data Integration Platform\n\nYou are an expert in Airbyte, the open-source data integration platform with 300+ pre-built connectors. You help developers sync data from SaaS tools, databases, and APIs into data warehouses and lakes — handling incremental syncs, CDC (Change Data Capture), schema evolution, and error recovery for production data pipelines.\n\n## Core Capabilities\n\n### Self-Hosted Setup\n\n```bash\n# Docker Compose (recommended for small-medium)\ngit clone https:\u002F\u002Fgithub.com\u002Fairbytehq\u002Fairbyte.git\ncd airbyte && .\u002Frun-ab-platform.sh\n# UI at http:\u002F\u002Flocalhost:8000\n\n# Kubernetes (production)\nhelm repo add airbyte https:\u002F\u002Fairbytehq.github.io\u002Fhelm-charts\nhelm install airbyte airbyte\u002Fairbyte -n airbyte --create-namespace\n\n# Cloud: https:\u002F\u002Fcloud.airbyte.com (managed)\n```\n\n### Configuration via API\n\n```python\n# Create connections programmatically via Airbyte API\nimport requests\n\nAIRBYTE_API = \"http:\u002F\u002Flocalhost:8000\u002Fapi\u002Fv1\"\n\n# Create a Stripe source\nsource = requests.post(f\"{AIRBYTE_API}\u002Fsources\u002Fcreate\", json={\n    \"workspaceId\": workspace_id,\n    \"name\": \"Stripe Production\",\n    \"sourceDefinitionId\": \"e094cb9a-26de-4645-8761-65c0c425d1de\",  # Stripe\n    \"connectionConfiguration\": {\n        \"account_id\": \"acct_xxx\",\n        \"client_secret\": os.environ[\"STRIPE_SECRET_KEY\"],\n        \"start_date\": \"2025-01-01T00:00:00Z\",\n    },\n}).json()\n\n# Create a BigQuery destination\ndestination = requests.post(f\"{AIRBYTE_API}\u002Fdestinations\u002Fcreate\", json={\n    \"workspaceId\": workspace_id,\n    \"name\": \"BigQuery Warehouse\",\n    \"destinationDefinitionId\": \"22f6c74f-5699-40ff-833c-4a879ea40133\",\n    \"connectionConfiguration\": {\n        \"project_id\": \"my-project\",\n        \"dataset_id\": \"raw_stripe\",\n        \"credentials_json\": os.environ[\"GCP_CREDENTIALS\"],\n        \"loading_method\": {\"method\": \"GCS Staging\", \"gcs_bucket_name\": \"airbyte-staging\"},\n    },\n}).json()\n\n# Create connection (source → destination)\nconnection = requests.post(f\"{AIRBYTE_API}\u002Fconnections\u002Fcreate\", json={\n    \"sourceId\": source[\"sourceId\"],\n    \"destinationId\": destination[\"destinationId\"],\n    \"syncCatalog\": {\n        \"streams\": [\n            {\n                \"stream\": {\"name\": \"subscriptions\", \"namespace\": \"stripe\"},\n                \"config\": {\n                    \"syncMode\": \"incremental\",\n                    \"destinationSyncMode\": \"append_dedup\",\n                    \"cursorField\": [\"created\"],\n                    \"primaryKey\": [[\"id\"]],\n                },\n            },\n        ],\n    },\n    \"schedule\": {\"scheduleType\": \"cron\", \"cronExpression\": \"0 *\u002F2 * * * ?\"},\n    \"namespaceFormat\": \"raw_${SOURCE_NAMESPACE}\",\n}).json()\n```\n\n### Custom Connectors (CDK)\n\n```python\n# Build a custom source connector with Airbyte CDK\nfrom airbyte_cdk.sources import AbstractSource\nfrom airbyte_cdk.sources.streams import Stream\nfrom airbyte_cdk.sources.streams.http import HttpStream\n\nclass InternalAPIStream(HttpStream):\n    url_base = \"https:\u002F\u002Fapi.internal.company.com\u002Fv1\u002F\"\n    primary_key = \"id\"\n    cursor_field = \"updated_at\"\n\n    def path(self, **kwargs) -> str:\n        return \"events\"\n\n    def parse_response(self, response, **kwargs):\n        for record in response.json()[\"data\"]:\n            yield record\n\nclass Source(AbstractSource):\n    def check_connection(self, logger, config):\n        # Verify API credentials work\n        return True, None\n\n    def streams(self, config):\n        return [InternalAPIStream(authenticator=self.get_auth(config))]\n```\n\n## Installation\n\n```bash\n# Docker Compose\ncurl -o docker-compose.yaml https:\u002F\u002Fraw.githubusercontent.com\u002Fairbytehq\u002Fairbyte\u002Fmaster\u002Fdocker-compose.yaml\ndocker compose up -d\n\n# Python CDK for custom connectors\npip install airbyte-cdk\n```\n\n## Best Practices\n\n1. **Incremental syncs** — Use incremental mode for large tables; full refresh only for small reference tables\n2. **CDC for databases** — Use Change Data Capture (logical replication) for real-time PostgreSQL\u002FMySQL syncs\n3. **Staging area** — Configure GCS\u002FS3 staging for BigQuery\u002FSnowflake destinations; direct insert is slow for large volumes\n4. **Schema evolution** — Airbyte handles new columns automatically; configure `auto_propagation` in connection settings\n5. **Alerting** — Set up webhook notifications for sync failures; integrate with Slack\u002FPagerDuty\n6. **Namespace per source** — Use `raw_${SOURCE}` namespace pattern; keeps raw data organized before dbt transforms\n7. **Self-host for cost** — Airbyte Cloud charges per row synced; self-hosting is free for unlimited data\n8. **Custom connectors** — Use CDK for internal APIs; publish to Airbyte's connector marketplace for community use\n",{},"main","def8531e65114c0fca8fb8551c1871ee0eed705c","skills\u002FTerminalSkills\u002Fskills\u002Fairbyte",24,"https:\u002F\u002Fgithub.com\u002FComeOnOliver\u002Fskillshub","https:\u002F\u002Fskillshub.wtf","https:\u002F\u002Fgithub.com\u002FComeOnOliver","AI & Blockchain Engineer\r\n","2026-06-24 22:07:19",{"source":7,"skillName":5,"commands":32,"prompt":42,"zipAvailable":43},[33,36,39],{"tool":34,"command":35},"npx","npx skills add ComeOnOliver\u002Fskillshub --skill airbyte",{"tool":37,"command":38},"bunx","bunx skills add ComeOnOliver\u002Fskillshub --skill airbyte",{"tool":40,"command":41},"pnpm","pnpm dlx skills add ComeOnOliver\u002Fskillshub --skill airbyte","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FComeOnOliver\u002Fskillshub\u002Fblob\u002Fmain\u002Fskills\u002FTerminalSkills\u002Fskills\u002Fairbyte\u002FSKILL.md",true,[],[46,60,70,79,85,92],{"skillNo":47,"name":48,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":49,"categories":50,"keywords":56,"publishedAt":18},"01M6FKJN13GMG4KY57J3QD8GY5","model-hierarchy-skill","https:\u002F\u002Fgithub.com\u002FComeOnOliver\u002Fskillshub\u002Fblob\u002Fmain\u002Fskills\u002Fzscole\u002Fmodel-hierarchy-skill\u002Fmodel-hierarchy-skill\u002FSKILL.md",[51],{"categoryNo":52,"categoryName":53,"taxonomyType":54,"taxonomyTypeDesc":55},"01JBSEEDCAT000000000000023","Skill与智能体开发","SCENARIO","使用场景",[57,58,59],"model","model hierarchy","model hierarchy skill",{"skillNo":61,"name":62,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":63,"categories":64,"keywords":66,"publishedAt":18},"01M6FKJJJ6GCAMR4PPPRD12M5X","zoom-mcp","https:\u002F\u002Fgithub.com\u002FComeOnOliver\u002Fskillshub\u002Fblob\u002Fmain\u002Fskills\u002Fzoom\u002Fskills\u002Fzoom-mcp\u002FSKILL.md",[65],{"categoryNo":52,"categoryName":53,"taxonomyType":54,"taxonomyTypeDesc":55},[67,68,69],"MCP","zoom","zoom mcp",{"skillNo":71,"name":72,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":73,"categories":74,"keywords":75,"publishedAt":18},"01M6FKJE3KYT3KPEZMEEHYKA6K","zoom-apps-sdk","https:\u002F\u002Fgithub.com\u002FComeOnOliver\u002Fskillshub\u002Fblob\u002Fmain\u002Fskills\u002Fzoom\u002Fskills\u002Fzoom-apps-sdk\u002FSKILL.md",[],[76,77,78,68],"sdk","zoom apps sdk","apps",{"skillNo":80,"name":81,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":82,"categories":83,"keywords":84,"publishedAt":18},"01M6FKJ9EDH9Q5VWDF8HAJRSP0","windows","https:\u002F\u002Fgithub.com\u002FComeOnOliver\u002Fskillshub\u002Fblob\u002Fmain\u002Fskills\u002Fzoom\u002Fskills\u002Fwindows\u002FSKILL.md",[],[81],{"skillNo":86,"name":87,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":88,"categories":89,"keywords":91,"publishedAt":18},"01M6FKJ666BEEFC3AE9GJ72Q93","whiteboard","https:\u002F\u002Fgithub.com\u002FComeOnOliver\u002Fskillshub\u002Fblob\u002Fmain\u002Fskills\u002Fzoom\u002Fskills\u002Fwhiteboard\u002FSKILL.md",[90],{"categoryNo":52,"categoryName":53,"taxonomyType":54,"taxonomyTypeDesc":55},[87],{"skillNo":93,"name":94,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":7,"ownerLogin":8,"ownerAvatarUrl":9,"ownerAccountNo":10,"ownerDisplayName":11,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":95,"categories":96,"keywords":97,"publishedAt":18},"01M6FKJ21WFCDGTJQ2Q91T9DVW","websockets","https:\u002F\u002Fgithub.com\u002FComeOnOliver\u002Fskillshub\u002Fblob\u002Fmain\u002Fskills\u002Fzoom\u002Fskills\u002Fwebsockets\u002FSKILL.md",[],[94]]