[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M754TTW5PQCGNSVD1K8H9BJ4":3,"skill-same:01M754TTW5PQCGNSVD1K8H9BJ4":55},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":29,"commitSha":30,"skillDirectory":5,"forksCount":14,"repositoryHtmlUrl":31,"repositoryHomepageUrl":6,"ownerHtmlUrl":32,"ownerBlogUrl":33,"ownerDescription":6,"updatedAt":34,"install":35,"resources":48},"01M754TTW5PQCGNSVD1K8H9BJ4","openevidence-observability",null,"Set up comprehensive observability for OpenEvidence integrations with metrics, traces, and alerts.\nUse when implementing monitoring for clinical AI operations, setting up dashboards,\nor configuring alerting for healthcare application health.\nTrigger with phrases like \"openevidence monitoring\", \"openevidence metrics\",\n\"openevidence observability\", \"monitor openevidence\", \"openevidence alerts\".","SamuelChien\u002Fmega-skills-collection","SamuelChien","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F4652114?v=4","01M74KK34WVHA0P5ZYSJRDDFMG","Samuel Chien","01M74KK35FQN1N9VZ9EPTH3P2S",0,"MIT","https:\u002F\u002Fgithub.com\u002FSamuelChien\u002Fmega-skills-collection\u002Fblob\u002Fmain\u002Fopenevidence-observability\u002FSKILL.md",[],[],"2026-11-12 13:55:43",false,"---\nname: openevidence-observability\ndescription: |\n  Set up comprehensive observability for OpenEvidence integrations with metrics, traces, and alerts.\n  Use when implementing monitoring for clinical AI operations, setting up dashboards,\n  or configuring alerting for healthcare application health.\n  Trigger with phrases like \"openevidence monitoring\", \"openevidence metrics\",\n  \"openevidence observability\", \"monitor openevidence\", \"openevidence alerts\".\nallowed-tools: Read, Write, Edit\nversion: 1.0.0\nlicense: MIT\nauthor: Jeremy Longshore \u003Cjeremy@intentsolutions.io>\ncompatible-with: claude-code, codex, openclaw\n---\n# OpenEvidence Observability\n\n## Table of Contents\n- [Overview](#overview)\n- [Prerequisites](#prerequisites)\n- [Instructions](#instructions)\n- [Output](#output)\n- [Error Handling](#error-handling)\n- [Examples](#examples)\n- [Resources](#resources)\n\n## Overview\nSet up comprehensive observability for OpenEvidence clinical AI integrations with Prometheus metrics, OpenTelemetry tracing, structured logging with PHI redaction, and Grafana dashboards.\n\n## Prerequisites\n- Prometheus or compatible metrics backend\n- OpenTelemetry SDK installed\n- Grafana or similar dashboarding tool\n- AlertManager or PagerDuty configured\n\n## Key Metrics\n\n| Metric | Type | Alert Threshold |\n|--------|------|-----------------|\n| `openevidence_requests_total` | Counter | N\u002FA |\n| `openevidence_request_duration_seconds` | Histogram | P95 > 15s |\n| `openevidence_errors_total` | Counter | > 5% error rate |\n| `openevidence_cache_hits_total` | Counter | \u003C 50% hit rate |\n| `openevidence_rate_limit_remaining` | Gauge | \u003C 10% headroom |\n| `openevidence_deepconsult_active` | Gauge | > 50 concurrent |\n\n## Instructions\n\n### Step 1: Set Up Prometheus Metrics\nRegister counters (requests, errors, cache hits\u002Fmisses), histograms (request duration, DeepConsult duration), gauges (rate limit remaining), and summaries (confidence scores) with appropriate labels.\n\n### Step 2: Instrument Client Wrapper\nWrap OpenEvidence client with metrics collection, cache hit\u002Fmiss tracking, rate limit monitoring from response headers, and confidence score recording.\n\n### Step 3: Configure Distributed Tracing\nInitialize OpenTelemetry with Google Cloud Trace exporter, HTTP and Express instrumentations, and service metadata.\n\n### Step 4: Set Up Structured Logging\nUse pino with PHI redaction (patient.*, patientId, mrn, *.ssn) and OpenEvidence-specific child logger for clinical queries and DeepConsult events.\n\n### Step 5: Define Alert Rules\nCreate Prometheus alerts for: high error rate (>5% warning, >20% critical), high P95 latency (>15s), low cache hit rate (\u003C50%), rate limit warning (\u003C10 remaining), service down.\n\n### Step 6: Build Grafana Dashboard\nCreate panels for request rate, error rate gauge, latency heatmap, cache hit rate timeseries, rate limit gauge, and confidence score distribution.\n\n## Output\n- Prometheus metrics collection with `\u002Fmetrics` endpoint\n- Instrumented client wrapper with tracing\n- Distributed tracing (OpenTelemetry + Cloud Trace)\n- Structured logging with PHI redaction\n- Alert rules for critical conditions\n- Grafana dashboard JSON\n\n## Error Handling\n| Issue | Detection | Resolution |\n|-------|-----------|------------|\n| Metrics endpoint down | Prometheus scrape failure | Check `\u002Fmetrics` route registration |\n| Missing traces | No spans in Cloud Trace | Verify OpenTelemetry SDK initialization |\n| PHI in logs | Audit review | Add patterns to pino redact config |\n| Alert fatigue | Too many alerts | Adjust thresholds, add `for` durations |\n\n## Examples\n\n### Metrics Endpoint\n```typescript\nrouter.get('\u002Fmetrics', async (req, res) => {\n  res.set('Content-Type', registry.contentType);\n  res.send(await registry.metrics());\n});\n```\n\nSee [detailed implementation](${CLAUDE_SKILL_DIR}\u002Freferences\u002Fimplementation.md) for advanced patterns.\n\n## Resources\n- [Prometheus Best Practices](https:\u002F\u002Fprometheus.io\u002Fdocs\u002Fpractices\u002Fnaming\u002F)\n- [OpenTelemetry Documentation](https:\u002F\u002Fopentelemetry.io\u002Fdocs\u002F)\n- [Grafana Dashboards](https:\u002F\u002Fgrafana.com\u002Fdocs\u002Fgrafana\u002Flatest\u002Fdashboards\u002F)","# OpenEvidence Observability\n\n## Table of Contents\n- [Overview](#overview)\n- [Prerequisites](#prerequisites)\n- [Instructions](#instructions)\n- [Output](#output)\n- [Error Handling](#error-handling)\n- [Examples](#examples)\n- [Resources](#resources)\n\n## Overview\nSet up comprehensive observability for OpenEvidence clinical AI integrations with Prometheus metrics, OpenTelemetry tracing, structured logging with PHI redaction, and Grafana dashboards.\n\n## Prerequisites\n- Prometheus or compatible metrics backend\n- OpenTelemetry SDK installed\n- Grafana or similar dashboarding tool\n- AlertManager or PagerDuty configured\n\n## Key Metrics\n\n| Metric | Type | Alert Threshold |\n|--------|------|-----------------|\n| `openevidence_requests_total` | Counter | N\u002FA |\n| `openevidence_request_duration_seconds` | Histogram | P95 > 15s |\n| `openevidence_errors_total` | Counter | > 5% error rate |\n| `openevidence_cache_hits_total` | Counter | \u003C 50% hit rate |\n| `openevidence_rate_limit_remaining` | Gauge | \u003C 10% headroom |\n| `openevidence_deepconsult_active` | Gauge | > 50 concurrent |\n\n## Instructions\n\n### Step 1: Set Up Prometheus Metrics\nRegister counters (requests, errors, cache hits\u002Fmisses), histograms (request duration, DeepConsult duration), gauges (rate limit remaining), and summaries (confidence scores) with appropriate labels.\n\n### Step 2: Instrument Client Wrapper\nWrap OpenEvidence client with metrics collection, cache hit\u002Fmiss tracking, rate limit monitoring from response headers, and confidence score recording.\n\n### Step 3: Configure Distributed Tracing\nInitialize OpenTelemetry with Google Cloud Trace exporter, HTTP and Express instrumentations, and service metadata.\n\n### Step 4: Set Up Structured Logging\nUse pino with PHI redaction (patient.*, patientId, mrn, *.ssn) and OpenEvidence-specific child logger for clinical queries and DeepConsult events.\n\n### Step 5: Define Alert Rules\nCreate Prometheus alerts for: high error rate (>5% warning, >20% critical), high P95 latency (>15s), low cache hit rate (\u003C50%), rate limit warning (\u003C10 remaining), service down.\n\n### Step 6: Build Grafana Dashboard\nCreate panels for request rate, error rate gauge, latency heatmap, cache hit rate timeseries, rate limit gauge, and confidence score distribution.\n\n## Output\n- Prometheus metrics collection with `\u002Fmetrics` endpoint\n- Instrumented client wrapper with tracing\n- Distributed tracing (OpenTelemetry + Cloud Trace)\n- Structured logging with PHI redaction\n- Alert rules for critical conditions\n- Grafana dashboard JSON\n\n## Error Handling\n| Issue | Detection | Resolution |\n|-------|-----------|------------|\n| Metrics endpoint down | Prometheus scrape failure | Check `\u002Fmetrics` route registration |\n| Missing traces | No spans in Cloud Trace | Verify OpenTelemetry SDK initialization |\n| PHI in logs | Audit review | Add patterns to pino redact config |\n| Alert fatigue | Too many alerts | Adjust thresholds, add `for` durations |\n\n## Examples\n\n### Metrics Endpoint\n```typescript\nrouter.get('\u002Fmetrics', async (req, res) => {\n  res.set('Content-Type', registry.contentType);\n  res.send(await registry.metrics());\n});\n```\n\nSee [detailed implementation](${CLAUDE_SKILL_DIR}\u002Freferences\u002Fimplementation.md) for advanced patterns.\n\n## Resources\n- [Prometheus Best Practices](https:\u002F\u002Fprometheus.io\u002Fdocs\u002Fpractices\u002Fnaming\u002F)\n- [OpenTelemetry Documentation](https:\u002F\u002Fopentelemetry.io\u002Fdocs\u002F)\n- [Grafana Dashboards](https:\u002F\u002Fgrafana.com\u002Fdocs\u002Fgrafana\u002Flatest\u002Fdashboards\u002F)",{"name":5,"author":24,"license":15,"version":25,"description":26,"allowed-tools":27,"compatible-with":28},"Jeremy Longshore \u003Cjeremy@intentsolutions.io>","1.0.0","Set up comprehensive observability for OpenEvidence integrations with metrics, traces, and alerts.\nUse when implementing monitoring for clinical AI operations, setting up dashboards,\nor configuring alerting for healthcare application health.\nTrigger with phrases like \"openevidence monitoring\", \"openevidence metrics\",\n\"openevidence observability\", \"monitor openevidence\", \"openevidence alerts\".\n","Read, Write, Edit","claude-code, codex, openclaw","main","c2b1fdccc779e99ac814e55fb69ca8d71215dd0f","https:\u002F\u002Fgithub.com\u002FSamuelChien\u002Fmega-skills-collection","https:\u002F\u002Fgithub.com\u002FSamuelChien","http:\u002F\u002Fsamuelchien.com\u002F","2026-05-26 08:27:14",{"source":8,"skillName":5,"commands":36,"prompt":46,"zipAvailable":47},[37,40,43],{"tool":38,"command":39},"npx","npx skills add SamuelChien\u002Fmega-skills-collection --skill openevidence-observability",{"tool":41,"command":42},"bunx","bunx skills add SamuelChien\u002Fmega-skills-collection --skill openevidence-observability",{"tool":44,"command":45},"pnpm","pnpm dlx skills add SamuelChien\u002Fmega-skills-collection --skill openevidence-observability","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FSamuelChien\u002Fmega-skills-collection\u002Fblob\u002Fmain\u002Fopenevidence-observability\u002FSKILL.md",true,[49],{"path":50,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":53,"sourceHtmlUrl":54},"references\u002Fimplementation.md","REFERENCE","参考文档",1844,"https:\u002F\u002Fgithub.com\u002FSamuelChien\u002Fmega-skills-collection\u002Fblob\u002Fmain\u002Fopenevidence-observability\u002Freferences\u002Fimplementation.md",[56,63,70,77,84,92],{"skillNo":57,"name":58,"nameZh":6,"description":59,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":60,"categories":61,"keywords":62,"publishedAt":19},"01M76R4WZQZAXGGXMQCA0FZ716","zustand-store-ts","Create Zustand stores with TypeScript, subscribeWithSelector middleware, and proper state\u002Faction separation. Use when building React state management, creating global stores, or implementing reactive state patterns with Zustand.","https:\u002F\u002Fgithub.com\u002FSamuelChien\u002Fmega-skills-collection\u002Fblob\u002Fmain\u002Fzustand-store-ts\u002FSKILL.md",[],[],{"skillNo":64,"name":65,"nameZh":6,"description":66,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":67,"categories":68,"keywords":69,"publishedAt":19},"01M76R4T9KENDH7FENGZQHBW4G","zustand-store-creator","Zustand Store Creator - Auto-activating skill for Frontend Development.\nTriggers on: zustand store creator, zustand store creator\nPart of the Frontend Development skill category.","https:\u002F\u002Fgithub.com\u002FSamuelChien\u002Fmega-skills-collection\u002Fblob\u002Fmain\u002Fzustand-store-creator\u002FSKILL.md",[],[],{"skillNo":71,"name":72,"nameZh":6,"description":73,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":74,"categories":75,"keywords":76,"publishedAt":19},"01M76R3YWN84B7SANJ52X799ZE","zero-trust-config-helper","Zero Trust Config Helper - Auto-activating skill for Security Advanced.\nTriggers on: zero trust config helper, zero trust config helper\nPart of the Security Advanced skill category.","https:\u002F\u002Fgithub.com\u002FSamuelChien\u002Fmega-skills-collection\u002Fblob\u002Fmain\u002Fzero-trust-config-helper\u002FSKILL.md",[],[],{"skillNo":78,"name":79,"nameZh":6,"description":80,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":81,"categories":82,"keywords":83,"publishedAt":19},"01M76R3HNSV2AEYSKHM915GJ58","zapier-integration-helper","Zapier Integration Helper - Auto-activating skill for Business Automation.\nTriggers on: zapier integration helper, zapier integration helper\nPart of the Business Automation skill category.","https:\u002F\u002Fgithub.com\u002FSamuelChien\u002Fmega-skills-collection\u002Fblob\u002Fmain\u002Fzapier-integration-helper\u002FSKILL.md",[],[],{"skillNo":85,"name":86,"nameZh":6,"description":87,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":88,"licenseFileUrl":6,"sourceHtmlUrl":89,"categories":90,"keywords":91,"publishedAt":19},"01M76R3DJSKAT4FA7DV4BF3GCE","zai-cli","Execute z.AI CLI providing vision, search, reader, and GitHub exploration via CLI and MCP.\nUse when user needs image\u002Fvideo analysis, OCR, UI-to-code conversion, error diagnosis,\nreal-time web search, web page to markdown extraction, or GitHub code exploration.\nTrigger with phrases like \"analyze this image\", \"search the web for\", \"read this page\",\n\"explore this repo\", or \"use zai\". Requires Z_AI_API_KEY.","Apache-2.0","https:\u002F\u002Fgithub.com\u002FSamuelChien\u002Fmega-skills-collection\u002Fblob\u002Fmain\u002Fzai-cli\u002FSKILL.md",[],[],{"skillNo":93,"name":94,"nameZh":6,"description":95,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":96,"categories":97,"keywords":98,"publishedAt":19},"01M76R2KAM699XE9AJVAWE4H2E","yt-research","Research competitor YouTube channels, niches, and trending topics for your content strategy.\nUse this skill whenever the user says \"research channels\", \"analyze competitors\", \"find trending topics\",\n\"niche analysis\", \"competitive research\", \"what are other creators doing\", \"scrape YouTube channels\",\nor wants to understand the competitive landscape for a specific tool or topic area. Use when working with yt research. Trigger with 'yt', 'research'.","https:\u002F\u002Fgithub.com\u002FSamuelChien\u002Fmega-skills-collection\u002Fblob\u002Fmain\u002Fyt-research\u002FSKILL.md",[],[]]