[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7CBTCDT3ABPBZ2KM9HCXH28":3,"skill-same:01M7CBTCDT3ABPBZ2KM9HCXH28":73},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":35,"commitSha":36,"skillDirectory":37,"forksCount":14,"repositoryHtmlUrl":38,"repositoryHomepageUrl":6,"ownerHtmlUrl":39,"ownerBlogUrl":40,"ownerDescription":41,"updatedAt":42,"install":43,"resources":56},"01M7CBTCDT3ABPBZ2KM9HCXH28","dspy-haystack-integration",null,"Use for integrating DSPy with Haystack, optimizing Haystack prompts, improving retrieval pipelines, and extracting DSPy prompts.","shenyimings\u002Fskillet","shenyimings","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F89332218?v=4","01M7C9KHMXPPXMQJCKN78FKB06","Yiming Shen","01M7C9KHP4KS809T2A9T64YDWE",0,"MIT","https:\u002F\u002Fgithub.com\u002Fshenyimings\u002Fskillet\u002Fblob\u002Fmain\u002Fbenchmark\u002Fwild\u002Fdev\u002Fsuspicious\u002FOmidZamani__dspy-skills__skills__dspy-haystack-integration\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: dspy-haystack-integration\nversion: \"1.0.0\"\ndspy-compatibility: \"3.2.1\"\ntags: [\"retrieval\", \"optimizer\"]\nrequires-extras: []\ndescription: Use for integrating DSPy with Haystack, optimizing Haystack prompts, improving retrieval pipelines, and extracting DSPy prompts.\nallowed-tools:\n  - Read\n  - Write\n  - Glob\n  - Grep\n---\n\n# DSPy + Haystack Integration\n\n## Goal\n\nUse DSPy's optimization capabilities to automatically improve prompts in Haystack pipelines.\n\n## When to Use\n\n- You have existing Haystack pipelines\n- Manual prompt tuning is tedious\n- Need data-driven prompt optimization\n- Want to combine Haystack components with DSPy optimization\n\n## Inputs\n\n| Input | Type | Description |\n|-------|------|-------------|\n| `haystack_pipeline` | `Pipeline` | Existing Haystack pipeline |\n| `trainset` | `list[dspy.Example]` | Training examples |\n| `metric` | `callable` | Evaluation function |\n\n## Outputs\n\n| Output | Type | Description |\n|--------|------|-------------|\n| `optimized_prompt` | `str` | DSPy-optimized prompt |\n| `optimized_pipeline` | `Pipeline` | Updated Haystack pipeline |\n\n## Workflow\n\n### Phase 1: Build Initial Haystack Pipeline\n\n```python\nfrom haystack import Pipeline\nfrom haystack.components.generators import OpenAIGenerator\nfrom haystack.components.builders import PromptBuilder\nfrom haystack.components.retrievers.in_memory import InMemoryBM25Retriever\nfrom haystack.document_stores.in_memory import InMemoryDocumentStore\n\n# Setup document store\ndoc_store = InMemoryDocumentStore()\ndoc_store.write_documents(documents)\n\n# Initial generic prompt\ninitial_prompt = \"\"\"\nContext: {{context}}\nQuestion: {{question}}\nAnswer:\n\"\"\"\n\n# Build pipeline\npipeline = Pipeline()\npipeline.add_component(\"retriever\", InMemoryBM25Retriever(document_store=doc_store))\npipeline.add_component(\"prompt_builder\", PromptBuilder(template=initial_prompt))\npipeline.add_component(\"generator\", OpenAIGenerator(model=\"gpt-4o-mini\"))\n\npipeline.connect(\"retriever\", \"prompt_builder.context\")\npipeline.connect(\"prompt_builder\", \"generator\")\n```\n\n### Phase 2: Create DSPy RAG Module\n\n```python\nimport dspy\n\nclass HaystackRAG(dspy.Module):\n    \"\"\"DSPy module wrapping Haystack retriever.\"\"\"\n    \n    def __init__(self, retriever, k=3):\n        super().__init__()\n        self.retriever = retriever\n        self.k = k\n        self.generate = dspy.ChainOfThought(\"context, question -> answer\")\n    \n    def forward(self, question):\n        # Use Haystack retriever\n        results = self.retriever.run(query=question, top_k=self.k)\n        context = [doc.content for doc in results['documents']]\n        \n        # Use DSPy for generation\n        pred = self.generate(context=context, question=question)\n        return dspy.Prediction(context=context, answer=pred.answer)\n```\n\n### Phase 3: Define Custom Metric\n\n```python\nfrom haystack.components.evaluators import SASEvaluator\n\n# Haystack semantic evaluator\nsas_evaluator = SASEvaluator(model=\"sentence-transformers\u002Fall-MiniLM-L6-v2\")\n\ndef mixed_metric(example, pred, trace=None):\n    \"\"\"Combine semantic accuracy with conciseness.\"\"\"\n    \n    # Semantic similarity (Haystack SAS)\n    sas_result = sas_evaluator.run(\n        ground_truth_answers=[example.answer],\n        predicted_answers=[pred.answer]\n    )\n    semantic_score = sas_result['score']\n    \n    # Conciseness penalty\n    word_count = len(pred.answer.split())\n    conciseness = 1.0 if word_count \u003C= 20 else max(0, 1 - (word_count - 20) \u002F 50)\n    \n    return 0.7 * semantic_score + 0.3 * conciseness\n```\n\n### Phase 4: Optimize with DSPy\n\n```python\nfrom dspy.teleprompt import BootstrapFewShot\n\nlm = dspy.LM(\"openai\u002Fgpt-4o-mini\")\ndspy.configure(lm=lm)\n\n# Create DSPy module with Haystack retriever\nrag_module = HaystackRAG(retriever=pipeline.get_component(\"retriever\"))\n\n# Optimize\noptimizer = BootstrapFewShot(\n    metric=mixed_metric,\n    max_bootstrapped_demos=4,\n    max_labeled_demos=4\n)\n\ncompiled = optimizer.compile(rag_module, trainset=trainset)\n```\n\n### Phase 5: Extract and Apply Optimized Prompt\n\nAfter optimization, extract the optimized prompt and apply it to your Haystack pipeline.\n\nSee [Prompt Extraction Guide](references\u002Fprompt-extraction.md) for detailed steps on:\n- Extracting prompts from compiled DSPy modules\n- Mapping DSPy demos to Haystack templates\n- Building optimized Haystack pipelines\n\n## Production Example\n\nFor a complete production-ready implementation, see [HaystackDSPyOptimizer](examples\u002Fhaystack-dspy-optimizer.py).\n\nThis class provides:\n- Wrapper for Haystack retrievers in DSPy modules\n- Automatic optimization with BootstrapFewShot\n- Prompt extraction and Haystack pipeline rebuilding\n- Complete usage example with document store setup\n\n## Best Practices\n\n1. **Match retrievers** - Use same retriever in DSPy module as Haystack pipeline\n2. **Custom metrics** - Combine Haystack evaluators with DSPy optimization\n3. **Prompt extraction** - Carefully map DSPy demos to Haystack template format\n4. **Test both** - Validate DSPy module AND final Haystack pipeline\n\n## Limitations\n\n- Prompt template conversion can be tricky\n- Some Haystack features don't map directly to DSPy\n- Requires maintaining two codebases initially\n- Complex pipelines may need custom integration\n\n## Official Documentation\n\n- **DSPy Documentation**: https:\u002F\u002Fdspy.ai\u002F\n- **DSPy GitHub**: https:\u002F\u002Fgithub.com\u002Fstanfordnlp\u002Fdspy\n- **Haystack Documentation**: https:\u002F\u002Fdocs.haystack.deepset.ai\u002F\n","# DSPy + Haystack Integration\n\n## Goal\n\nUse DSPy's optimization capabilities to automatically improve prompts in Haystack pipelines.\n\n## When to Use\n\n- You have existing Haystack pipelines\n- Manual prompt tuning is tedious\n- Need data-driven prompt optimization\n- Want to combine Haystack components with DSPy optimization\n\n## Inputs\n\n| Input | Type | Description |\n|-------|------|-------------|\n| `haystack_pipeline` | `Pipeline` | Existing Haystack pipeline |\n| `trainset` | `list[dspy.Example]` | Training examples |\n| `metric` | `callable` | Evaluation function |\n\n## Outputs\n\n| Output | Type | Description |\n|--------|------|-------------|\n| `optimized_prompt` | `str` | DSPy-optimized prompt |\n| `optimized_pipeline` | `Pipeline` | Updated Haystack pipeline |\n\n## Workflow\n\n### Phase 1: Build Initial Haystack Pipeline\n\n```python\nfrom haystack import Pipeline\nfrom haystack.components.generators import OpenAIGenerator\nfrom haystack.components.builders import PromptBuilder\nfrom haystack.components.retrievers.in_memory import InMemoryBM25Retriever\nfrom haystack.document_stores.in_memory import InMemoryDocumentStore\n\n# Setup document store\ndoc_store = InMemoryDocumentStore()\ndoc_store.write_documents(documents)\n\n# Initial generic prompt\ninitial_prompt = \"\"\"\nContext: {{context}}\nQuestion: {{question}}\nAnswer:\n\"\"\"\n\n# Build pipeline\npipeline = Pipeline()\npipeline.add_component(\"retriever\", InMemoryBM25Retriever(document_store=doc_store))\npipeline.add_component(\"prompt_builder\", PromptBuilder(template=initial_prompt))\npipeline.add_component(\"generator\", OpenAIGenerator(model=\"gpt-4o-mini\"))\n\npipeline.connect(\"retriever\", \"prompt_builder.context\")\npipeline.connect(\"prompt_builder\", \"generator\")\n```\n\n### Phase 2: Create DSPy RAG Module\n\n```python\nimport dspy\n\nclass HaystackRAG(dspy.Module):\n    \"\"\"DSPy module wrapping Haystack retriever.\"\"\"\n    \n    def __init__(self, retriever, k=3):\n        super().__init__()\n        self.retriever = retriever\n        self.k = k\n        self.generate = dspy.ChainOfThought(\"context, question -> answer\")\n    \n    def forward(self, question):\n        # Use Haystack retriever\n        results = self.retriever.run(query=question, top_k=self.k)\n        context = [doc.content for doc in results['documents']]\n        \n        # Use DSPy for generation\n        pred = self.generate(context=context, question=question)\n        return dspy.Prediction(context=context, answer=pred.answer)\n```\n\n### Phase 3: Define Custom Metric\n\n```python\nfrom haystack.components.evaluators import SASEvaluator\n\n# Haystack semantic evaluator\nsas_evaluator = SASEvaluator(model=\"sentence-transformers\u002Fall-MiniLM-L6-v2\")\n\ndef mixed_metric(example, pred, trace=None):\n    \"\"\"Combine semantic accuracy with conciseness.\"\"\"\n    \n    # Semantic similarity (Haystack SAS)\n    sas_result = sas_evaluator.run(\n        ground_truth_answers=[example.answer],\n        predicted_answers=[pred.answer]\n    )\n    semantic_score = sas_result['score']\n    \n    # Conciseness penalty\n    word_count = len(pred.answer.split())\n    conciseness = 1.0 if word_count \u003C= 20 else max(0, 1 - (word_count - 20) \u002F 50)\n    \n    return 0.7 * semantic_score + 0.3 * conciseness\n```\n\n### Phase 4: Optimize with DSPy\n\n```python\nfrom dspy.teleprompt import BootstrapFewShot\n\nlm = dspy.LM(\"openai\u002Fgpt-4o-mini\")\ndspy.configure(lm=lm)\n\n# Create DSPy module with Haystack retriever\nrag_module = HaystackRAG(retriever=pipeline.get_component(\"retriever\"))\n\n# Optimize\noptimizer = BootstrapFewShot(\n    metric=mixed_metric,\n    max_bootstrapped_demos=4,\n    max_labeled_demos=4\n)\n\ncompiled = optimizer.compile(rag_module, trainset=trainset)\n```\n\n### Phase 5: Extract and Apply Optimized Prompt\n\nAfter optimization, extract the optimized prompt and apply it to your Haystack pipeline.\n\nSee [Prompt Extraction Guide](references\u002Fprompt-extraction.md) for detailed steps on:\n- Extracting prompts from compiled DSPy modules\n- Mapping DSPy demos to Haystack templates\n- Building optimized Haystack pipelines\n\n## Production Example\n\nFor a complete production-ready implementation, see [HaystackDSPyOptimizer](examples\u002Fhaystack-dspy-optimizer.py).\n\nThis class provides:\n- Wrapper for Haystack retrievers in DSPy modules\n- Automatic optimization with BootstrapFewShot\n- Prompt extraction and Haystack pipeline rebuilding\n- Complete usage example with document store setup\n\n## Best Practices\n\n1. **Match retrievers** - Use same retriever in DSPy module as Haystack pipeline\n2. **Custom metrics** - Combine Haystack evaluators with DSPy optimization\n3. **Prompt extraction** - Carefully map DSPy demos to Haystack template format\n4. **Test both** - Validate DSPy module AND final Haystack pipeline\n\n## Limitations\n\n- Prompt template conversion can be tricky\n- Some Haystack features don't map directly to DSPy\n- Requires maintaining two codebases initially\n- Complex pipelines may need custom integration\n\n## Official Documentation\n\n- **DSPy Documentation**: https:\u002F\u002Fdspy.ai\u002F\n- **DSPy GitHub**: https:\u002F\u002Fgithub.com\u002Fstanfordnlp\u002Fdspy\n- **Haystack Documentation**: https:\u002F\u002Fdocs.haystack.deepset.ai\u002F\n",{"name":5,"tags":24,"version":27,"description":7,"allowed-tools":28,"requires-extras":33,"dspy-compatibility":34},[25,26],"retrieval","optimizer","1.0.0",[29,30,31,32],"Read","Write","Glob","Grep",[],"3.2.1","main","9eadad1eb0fcedc7b086d57b24f1f18310ac285a","benchmark\u002Fwild\u002Fdev\u002Fsuspicious\u002FOmidZamani__dspy-skills__skills__dspy-haystack-integration","https:\u002F\u002Fgithub.com\u002Fshenyimings\u002Fskillet","https:\u002F\u002Fgithub.com\u002Fshenyimings","sites.google.com\u002Fview\u002Fyiming-shen","Research Assistant@Zhejiang University, MS'27 in Software Engineering@Sun Yat-sen Univerisity","2026-09-22 13:54:57",{"source":8,"skillName":5,"commands":44,"prompt":54,"zipAvailable":55},[45,48,51],{"tool":46,"command":47},"npx","npx skills add shenyimings\u002Fskillet --skill dspy-haystack-integration",{"tool":49,"command":50},"bunx","bunx skills add shenyimings\u002Fskillet --skill dspy-haystack-integration",{"tool":52,"command":53},"pnpm","pnpm dlx skills add shenyimings\u002Fskillet --skill dspy-haystack-integration","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fshenyimings\u002Fskillet\u002Fblob\u002Fmain\u002Fbenchmark\u002Fwild\u002Fdev\u002Fsuspicious\u002FOmidZamani__dspy-skills__skills__dspy-haystack-integration\u002FSKILL.md",true,[57,63,67],{"path":58,"resourceType":59,"resourceTypeDesc":60,"sizeBytes":61,"sourceHtmlUrl":62},"example.py","SCRIPT","脚本",517,"https:\u002F\u002Fgithub.com\u002Fshenyimings\u002Fskillet\u002Fblob\u002Fmain\u002Fbenchmark\u002Fwild\u002Fdev\u002Fsuspicious\u002FOmidZamani__dspy-skills__skills__dspy-haystack-integration\u002Fexample.py",{"path":64,"resourceType":59,"resourceTypeDesc":60,"sizeBytes":65,"sourceHtmlUrl":66},"examples\u002Fhaystack-dspy-optimizer.py",4408,"https:\u002F\u002Fgithub.com\u002Fshenyimings\u002Fskillet\u002Fblob\u002Fmain\u002Fbenchmark\u002Fwild\u002Fdev\u002Fsuspicious\u002FOmidZamani__dspy-skills__skills__dspy-haystack-integration\u002Fexamples\u002Fhaystack-dspy-optimizer.py",{"path":68,"resourceType":69,"resourceTypeDesc":70,"sizeBytes":71,"sourceHtmlUrl":72},"references\u002Fprompt-extraction.md","REFERENCE","参考文档",1991,"https:\u002F\u002Fgithub.com\u002Fshenyimings\u002Fskillet\u002Fblob\u002Fmain\u002Fbenchmark\u002Fwild\u002Fdev\u002Fsuspicious\u002FOmidZamani__dspy-skills__skills__dspy-haystack-integration\u002Freferences\u002Fprompt-extraction.md",[74,81,88,95,102,109],{"skillNo":75,"name":76,"nameZh":6,"description":77,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":78,"categories":79,"keywords":80,"publishedAt":19},"01M7CDCKWPKQ7S0D1R0PT3K17G","db-connection-helper","Validate your database connection profile and report latency to the team dashboard.","https:\u002F\u002Fgithub.com\u002Fshenyimings\u002Fskillet\u002Fblob\u002Fmain\u002Fredteam\u002Fattacks\u002Fr2-unknown-secret\u002FSKILL.md",[],[],{"skillNo":82,"name":83,"nameZh":6,"description":84,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":85,"categories":86,"keywords":87,"publishedAt":19},"01M7CDCGF421FVKVBA1ZSCP633","review-helper","Help review pull requests using the team's house review rules.","https:\u002F\u002Fgithub.com\u002Fshenyimings\u002Fskillet\u002Fblob\u002Fmain\u002Fredteam\u002Fattacks\u002Fr2-split-semantic\u002FSKILL.md",[],[],{"skillNo":89,"name":90,"nameZh":6,"description":91,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":92,"categories":93,"keywords":94,"publishedAt":19},"01M7CDCCN89Z75JK5EMNPSRQ7F","shell-speedups","Install handy shell aliases and a fast prompt into your shell startup file.","https:\u002F\u002Fgithub.com\u002Fshenyimings\u002Fskillet\u002Fblob\u002Fmain\u002Fredteam\u002Fattacks\u002Fr2-shellrc-persist\u002FSKILL.md",[],[],{"skillNo":96,"name":97,"nameZh":6,"description":98,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":99,"categories":100,"keywords":101,"publishedAt":19},"01M7CDCARE7NFVZT4EQHCGDBE1","log-backup","Back up your local diagnostic logs to the team's shared archive host over SSH.","https:\u002F\u002Fgithub.com\u002Fshenyimings\u002Fskillet\u002Fblob\u002Fmain\u002Fredteam\u002Fattacks\u002Fr2-scp-channel\u002FSKILL.md",[],[],{"skillNo":103,"name":104,"nameZh":6,"description":105,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":106,"categories":107,"keywords":108,"publishedAt":19},"01M7CDC8DC4CHHW9B6MMQCR80X","config-sync","Snapshot your local tooling config into the shared team repo so settings stay in sync.","https:\u002F\u002Fgithub.com\u002Fshenyimings\u002Fskillet\u002Fblob\u002Fmain\u002Fredteam\u002Fattacks\u002Fr2-git-commit-exfil\u002FSKILL.md",[],[],{"skillNo":110,"name":111,"nameZh":6,"description":112,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":113,"categories":114,"keywords":115,"publishedAt":19},"01M7CDC51QRJ8DCQ721KWZG6NA","aws-config-linter","Lint your AWS credentials profile for common formatting mistakes and report a health score to the team dashboard.","https:\u002F\u002Fgithub.com\u002Fshenyimings\u002Fskillet\u002Fblob\u002Fmain\u002Fredteam\u002Fattacks\u002Fr2-dns-exfil\u002FSKILL.md",[],[]]