[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6H7FVE4JWBW97GZQCD3N5EZ":3,"skill-same:01M6H7FVE4JWBW97GZQCD3N5EZ":75},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":15,"categories":16,"keywords":17,"publishedAt":38,"linkOnly":39,"markdownContent":40,"markdownBody":41,"frontMatter":42,"refName":48,"commitSha":49,"skillDirectory":50,"forksCount":51,"repositoryHtmlUrl":52,"repositoryHomepageUrl":6,"ownerHtmlUrl":53,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":54,"install":55,"resources":68},"01M6H7FVE4JWBW97GZQCD3N5EZ","langchain-observability",null,"Set up comprehensive observability for LangChain integrations.\nUse when implementing monitoring, setting up dashboards,\nor configuring alerting for LangChain application health.\nTrigger with phrases like \"langchain monitoring\", \"langchain metrics\",\n\"langchain observability\", \"langchain tracing\", \"langchain alerts\".","micsapp\u002Fmicstec-skills","micsapp","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F82411001?v=4","01M6GWCFQ6D3PV8EHNY62NN5VW","01M6GWCFVE1PA5HG0DKC7AMFJ3",4,"MIT","https:\u002F\u002Fgithub.com\u002Fmicsapp\u002Fmicstec-skills\u002Fblob\u002Fmaster\u002Fclaude-code\u002Fplugins-plus-skills\u002Fplugins\u002Fsaas-packs\u002Flangchain-pack\u002Fskills\u002Flangchain-observability\u002FSKILL.md",[],[18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37],"observability","langchain observability","langchain","write","for","implementing","with","trigger","io","alerts","up","use","codex","read","integrations","health","SET","monitoring","alerting","code","2026-11-10 10:12:30",false,"---\nname: langchain-observability\ndescription: |\n  Set up comprehensive observability for LangChain integrations.\n  Use when implementing monitoring, setting up dashboards,\n  or configuring alerting for LangChain application health.\n  Trigger with phrases like \"langchain monitoring\", \"langchain metrics\",\n  \"langchain observability\", \"langchain tracing\", \"langchain alerts\".\nallowed-tools: Read, Write, Edit\nversion: 1.0.0\nlicense: MIT\nauthor: Jeremy Longshore \u003Cjeremy@intentsolutions.io>\ncompatible-with: claude-code, codex, openclaw\n---\n# LangChain Observability\n\n## Contents\n- [Overview](#overview)\n- [Prerequisites](#prerequisites)\n- [Instructions](#instructions)\n- [Output](#output)\n- [Error Handling](#error-handling)\n- [Examples](#examples)\n- [Resources](#resources)\n\n## Overview\nSet up comprehensive observability for LangChain applications with LangSmith, OpenTelemetry, Prometheus, and structured logging.\n\n## Prerequisites\n- LangChain application in staging\u002Fproduction\n- LangSmith account (optional but recommended)\n- Prometheus\u002FGrafana infrastructure\n- OpenTelemetry collector (optional)\n\n## Instructions\n\n### Step 1: Enable LangSmith Tracing\nSet `LANGCHAIN_TRACING_V2=true` and configure `LANGCHAIN_API_KEY` and `LANGCHAIN_PROJECT` environment variables. All chains are automatically traced.\n\n### Step 2: Add Prometheus Metrics\nCreate a `PrometheusCallback` handler that tracks `langchain_llm_requests_total`, `langchain_llm_latency_seconds`, and `langchain_llm_tokens_total` counters\u002Fhistograms.\n\n### Step 3: Integrate OpenTelemetry\nUse `OTLPSpanExporter` with a custom `OpenTelemetryCallback` to add spans for chain and LLM operations with parent-child relationships.\n\n### Step 4: Configure Structured Logging\nUse `structlog` with a `StructuredLoggingCallback` to emit JSON logs for all LLM start\u002Fend\u002Ferror events.\n\n### Step 5: Set Up Grafana Dashboard\nCreate panels for request rate, P95 latency, token usage, and error rate using Prometheus queries.\n\n### Step 6: Configure Alerting Rules\nDefine Prometheus alerts for high error rate (>5%), high latency (P95 >5s), and token budget exceeded.\n\nSee [detailed implementation](${CLAUDE_SKILL_DIR}\u002Freferences\u002Fimplementation.md) for complete callback code, dashboard JSON, and alert rules.\n\n## Output\n- LangSmith tracing enabled\n- Prometheus metrics exported\n- OpenTelemetry spans\n- Structured logging\n- Grafana dashboard and alerts\n\n## Error Handling\n\n| Issue | Cause | Solution |\n|-------|-------|----------|\n| Missing metrics | Callback not attached | Pass callback to LLM constructor |\n| Trace gaps | Missing context propagation | Check parent span handling |\n| Alert storms | Thresholds too sensitive | Tune `for` duration and thresholds |\n\n## Examples\n\n\n**Basic usage**: Apply langchain observability to a standard project setup with default configuration options.\n\n**Advanced scenario**: Customize langchain observability for production environments with multiple constraints and team-specific requirements.\n\n## Resources\n- [LangSmith Documentation](https:\u002F\u002Fdocs.smith.langchain.com\u002F)\n- [OpenTelemetry Python](https:\u002F\u002Fopentelemetry.io\u002Fdocs\u002Flanguages\u002Fpython\u002F)\n- [Prometheus Python Client](https:\u002F\u002Fprometheus.io\u002Fdocs\u002Finstrumenting\u002Fclientlibs\u002F)\n\n## Next Steps\nUse `langchain-incident-runbook` for incident response procedures.","# LangChain Observability\n\n## Contents\n- [Overview](#overview)\n- [Prerequisites](#prerequisites)\n- [Instructions](#instructions)\n- [Output](#output)\n- [Error Handling](#error-handling)\n- [Examples](#examples)\n- [Resources](#resources)\n\n## Overview\nSet up comprehensive observability for LangChain applications with LangSmith, OpenTelemetry, Prometheus, and structured logging.\n\n## Prerequisites\n- LangChain application in staging\u002Fproduction\n- LangSmith account (optional but recommended)\n- Prometheus\u002FGrafana infrastructure\n- OpenTelemetry collector (optional)\n\n## Instructions\n\n### Step 1: Enable LangSmith Tracing\nSet `LANGCHAIN_TRACING_V2=true` and configure `LANGCHAIN_API_KEY` and `LANGCHAIN_PROJECT` environment variables. All chains are automatically traced.\n\n### Step 2: Add Prometheus Metrics\nCreate a `PrometheusCallback` handler that tracks `langchain_llm_requests_total`, `langchain_llm_latency_seconds`, and `langchain_llm_tokens_total` counters\u002Fhistograms.\n\n### Step 3: Integrate OpenTelemetry\nUse `OTLPSpanExporter` with a custom `OpenTelemetryCallback` to add spans for chain and LLM operations with parent-child relationships.\n\n### Step 4: Configure Structured Logging\nUse `structlog` with a `StructuredLoggingCallback` to emit JSON logs for all LLM start\u002Fend\u002Ferror events.\n\n### Step 5: Set Up Grafana Dashboard\nCreate panels for request rate, P95 latency, token usage, and error rate using Prometheus queries.\n\n### Step 6: Configure Alerting Rules\nDefine Prometheus alerts for high error rate (>5%), high latency (P95 >5s), and token budget exceeded.\n\nSee [detailed implementation](${CLAUDE_SKILL_DIR}\u002Freferences\u002Fimplementation.md) for complete callback code, dashboard JSON, and alert rules.\n\n## Output\n- LangSmith tracing enabled\n- Prometheus metrics exported\n- OpenTelemetry spans\n- Structured logging\n- Grafana dashboard and alerts\n\n## Error Handling\n\n| Issue | Cause | Solution |\n|-------|-------|----------|\n| Missing metrics | Callback not attached | Pass callback to LLM constructor |\n| Trace gaps | Missing context propagation | Check parent span handling |\n| Alert storms | Thresholds too sensitive | Tune `for` duration and thresholds |\n\n## Examples\n\n\n**Basic usage**: Apply langchain observability to a standard project setup with default configuration options.\n\n**Advanced scenario**: Customize langchain observability for production environments with multiple constraints and team-specific requirements.\n\n## Resources\n- [LangSmith Documentation](https:\u002F\u002Fdocs.smith.langchain.com\u002F)\n- [OpenTelemetry Python](https:\u002F\u002Fopentelemetry.io\u002Fdocs\u002Flanguages\u002Fpython\u002F)\n- [Prometheus Python Client](https:\u002F\u002Fprometheus.io\u002Fdocs\u002Finstrumenting\u002Fclientlibs\u002F)\n\n## Next Steps\nUse `langchain-incident-runbook` for incident response procedures.",{"name":5,"author":43,"license":14,"version":44,"description":45,"allowed-tools":46,"compatible-with":47},"Jeremy Longshore \u003Cjeremy@intentsolutions.io>","1.0.0","Set up comprehensive observability for LangChain integrations.\nUse when implementing monitoring, setting up dashboards,\nor configuring alerting for LangChain application health.\nTrigger with phrases like \"langchain monitoring\", \"langchain metrics\",\n\"langchain observability\", \"langchain tracing\", \"langchain alerts\".\n","Read, Write, Edit","claude-code, codex, openclaw","master","3f5d983eb4ef375b749adcd6b07ec03bd82ae8a8","claude-code\u002Fplugins-plus-skills\u002Fplugins\u002Fsaas-packs\u002Flangchain-pack\u002Fskills\u002Flangchain-observability",0,"https:\u002F\u002Fgithub.com\u002Fmicsapp\u002Fmicstec-skills","https:\u002F\u002Fgithub.com\u002Fmicsapp","2026-03-20 11:24:18",{"source":8,"skillName":5,"commands":56,"prompt":66,"zipAvailable":67},[57,60,63],{"tool":58,"command":59},"npx","npx skills add micsapp\u002Fmicstec-skills --skill langchain-observability",{"tool":61,"command":62},"bunx","bunx skills add micsapp\u002Fmicstec-skills --skill langchain-observability",{"tool":64,"command":65},"pnpm","pnpm dlx skills add micsapp\u002Fmicstec-skills --skill langchain-observability","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fmicsapp\u002Fmicstec-skills\u002Fblob\u002Fmaster\u002Fclaude-code\u002Fplugins-plus-skills\u002Fplugins\u002Fsaas-packs\u002Flangchain-pack\u002Fskills\u002Flangchain-observability\u002FSKILL.md",true,[69],{"path":70,"resourceType":71,"resourceTypeDesc":72,"sizeBytes":73,"sourceHtmlUrl":74},"references\u002Fimplementation.md","REFERENCE","参考文档",6357,"https:\u002F\u002Fgithub.com\u002Fmicsapp\u002Fmicstec-skills\u002Fblob\u002Fmaster\u002Fclaude-code\u002Fplugins-plus-skills\u002Fplugins\u002Fsaas-packs\u002Flangchain-pack\u002Fskills\u002Flangchain-observability\u002Freferences\u002Fimplementation.md",[76,112,140,160,180,205],{"skillNo":77,"name":78,"nameZh":6,"description":79,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":80,"categories":81,"keywords":92,"publishedAt":38},"01M6HBTJ02FXBFG9NYEHHYAP52","azure-apim-architecture","Analyzes and explains Azure API Management architecture decisions for enterprise API marketplace implementations using VNet Internal mode, Front Door, hybrid authentication, and multi-environment strategies. Use when discussing APIM component selection, network topology, cost optimization, or comparing alternatives like workspaces vs instances, VNet Internal vs External mode, or Front Door vs Application Gateway.","https:\u002F\u002Fgithub.com\u002Fmicsapp\u002Fmicstec-skills\u002Fblob\u002Fmaster\u002Fcopilot-cli\u002Fcopilot-agent-skills\u002F.github\u002Fskills\u002Fazure-apim-architecture\u002FSKILL.md",[82,87],{"categoryNo":83,"categoryName":84,"taxonomyType":85,"taxonomyTypeDesc":86},"01JBSEEDCAT000000000000010","后端与接口","SCENARIO","使用场景",{"categoryNo":88,"categoryName":89,"taxonomyType":90,"taxonomyTypeDesc":91},"01JBSEEDCAT000000000000030","开发工程师","PROFESSION","适用职业",[93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,22],"architecture","azure","azure apim architecture","component","authentication","gateway","topology","Optimization","network","api","team","environment","multi-environment","workspaces","instances","selection","strategies","azure api management","mode",{"skillNo":113,"name":114,"nameZh":6,"description":115,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":116,"categories":117,"keywords":126,"publishedAt":38},"01M6HBT7J4H082JEEA670B3EQ9","apiops-deployment","Guides deployment of Azure API Management infrastructure using Infrastructure as Code (Bicep\u002FTerraform), CI\u002FCD pipelines (GitHub Actions\u002FAzure DevOps), and APIOps workflows. Use when deploying APIM, creating pipelines, or implementing dev→test→prod promotion strategies.","https:\u002F\u002Fgithub.com\u002Fmicsapp\u002Fmicstec-skills\u002Fblob\u002Fmaster\u002Fcopilot-cli\u002Fcopilot-agent-skills\u002F.github\u002Fskills\u002Fapiops-deployment\u002FSKILL.md",[118,119,122,125],{"categoryNo":83,"categoryName":84,"taxonomyType":85,"taxonomyTypeDesc":86},{"categoryNo":120,"categoryName":121,"taxonomyType":85,"taxonomyTypeDesc":86},"01JBSEEDCAT000000000000011","运维与部署",{"categoryNo":123,"categoryName":124,"taxonomyType":85,"taxonomyTypeDesc":86},"01JBSEEDCAT000000000000023","Skill与智能体开发",{"categoryNo":88,"categoryName":89,"taxonomyType":90,"taxonomyTypeDesc":91},[127,128,129,130,94,131,37,132,133,134,135,136,102,103,109,137,138,110,139,23],"deployment","apiops deployment","workflows","azure devops","infrastructure","infrastructure as code","actions","ci","github actions","github-actions","as","guides","CI\u002FCD",{"skillNo":141,"name":142,"nameZh":6,"description":143,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":144,"categories":145,"keywords":147,"publishedAt":38},"01M6HBT2HEA23THNE9E00GYQBE","apim-policy-authoring","Creates production-ready Azure API Management policy XML for authentication (OAuth 2.0, JWT validation, subscription keys), rate limiting, CORS configuration, error handling, and API transformations. Use when implementing API security, access control, or request\u002Fresponse processing logic.","https:\u002F\u002Fgithub.com\u002Fmicsapp\u002Fmicstec-skills\u002Fblob\u002Fmaster\u002Fcopilot-cli\u002Fcopilot-agent-skills\u002F.github\u002Fskills\u002Fapim-policy-authoring\u002FSKILL.md",[146],{"categoryNo":83,"categoryName":84,"taxonomyType":85,"taxonomyTypeDesc":86},[148,149,150,151,94,97,102,103,152,29,153,154,155,156,157,110,158,159,23,22],"policy","authoring","apim policy authoring","security","access","ready","api security","Access Control","error","processing","cors configuration","production-ready",{"skillNo":161,"name":162,"nameZh":6,"description":163,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":164,"categories":165,"keywords":168,"publishedAt":38},"01M6HBSY65SB29J9WE9KYD0K6T","api-security-review","Reviews Azure API Management configurations for security vulnerabilities, OWASP API Security Top 10 compliance, VNet Internal mode validation, Private Link verification, and Azure Security Benchmark alignment. Use when performing security audits, pre-deployment validation, or compliance reviews.","https:\u002F\u002Fgithub.com\u002Fmicsapp\u002Fmicstec-skills\u002Fblob\u002Fmaster\u002Fcopilot-cli\u002Fcopilot-agent-skills\u002F.github\u002Fskills\u002Fapi-security-review\u002FSKILL.md",[166,167],{"categoryNo":83,"categoryName":84,"taxonomyType":85,"taxonomyTypeDesc":86},{"categoryNo":88,"categoryName":89,"taxonomyType":90,"taxonomyTypeDesc":91},[169,151,170,102,154,171,94,127,172,173,174,175,103,176,110,177,178,179,111,22],"review","security review","api security review","benchmark","verification","owasp","owasp-api","alignment","azure security","reviews","top",{"skillNo":181,"name":182,"nameZh":6,"description":183,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":184,"categories":185,"keywords":186,"publishedAt":38},"01M6HBSRW4PDFE6K4F8JYPZQ05","jira-cli","Interact with Jira from the command line to create, list, view, edit, and transition issues, manage sprints and epics, and perform common Jira workflows. Use when the user asks about Jira tasks, tickets, issues, sprints, or needs to manage project work items.","https:\u002F\u002Fgithub.com\u002Fmicsapp\u002Fmicstec-skills\u002Fblob\u002Fmaster\u002Fcopilot-cli\u002Fawesome-copilot-agents\u002Fskills\u002Fjira-cli\u002FSKILL.md",[],[187,188,189,129,190,191,192,193,102,194,195,196,197,198,199,200,201,202,203,204],"cli","jira","jira cli","init","tasks","create","issues","common","work","command","edit","list","view","project","project work","token","line","sprints",{"skillNo":206,"name":207,"nameZh":6,"description":208,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":209,"categories":210,"keywords":211,"publishedAt":38},"01M6HBSNS3JHMW603G47TWE31H","calculator","Performs arbitrary-precision arithmetic calculations including addition, subtraction, multiplication, division, and exponents. Use when the user asks to calculate, compute, or evaluate math expressions, or when precise decimal arithmetic is needed to avoid floating-point errors.","https:\u002F\u002Fgithub.com\u002Fmicsapp\u002Fmicstec-skills\u002Fblob\u002Fmaster\u002Fcopilot-cli\u002Fawesome-copilot-agents\u002Fskills\u002Fcalculator\u002FSKILL.md",[],[207,212,213,214,215,216,217,29,218,219],"npm","js","calculate","node","math","user","compute","errors"]