citation-management
Searches OpenAlex, PubMed, and Google Scholar, extracts metadata from DOIs, PMIDs, PMCIDs, arXiv IDs, and URLs via CrossRef, PubMed, and arXiv, then formats, deduplicates, and validates BibTeX files using bundled Python scripts (search_openalex.py, extract_metadata.py, format_bibtex.py, validate_citations.py, doi_to_bibtex.py). Use when converting DOIs or PMIDs to BibTeX, finding papers on a topic, filling missing volume, pages, or DOI fields, cleaning or merging .bib files with duplicate entries, or checking a bibliography for errors before submission. Not for systematic review search methodology or synthesis; use literature-review for that.
- License 许可
- MIT
- 最近更新
- 2026-11-14
- Stars
- ★ 132
- Forks
- 16
01 前言 Front Matter
- name
- citation-management
- license
- MIT
- metadata
- { "tags": "citations, BibTeX, references, DOI, PubMed, reference management", "version": "2.1", "category": "literature-review", "openclaw": { "envVars": [ { "name": "NCBI_EMAIL", "required": false, "description": "Email for NCBI Entrez identification." }, { "name": "NCBI_API_KEY", "required": false, "description": "NCBI API key to raise Entrez rate limits." }, { "name": "OPENALEX_EMAIL", "required": false, "description": "Contact email for the faster OpenAlex polite pool." } ] }, "maintainer": "Kalaris Labs" }
- description
- Searches OpenAlex, PubMed, and Google Scholar, extracts metadata from DOIs, PMIDs, PMCIDs, arXiv IDs, and URLs via CrossRef, PubMed, and arXiv, then formats, deduplicates, and validates BibTeX files using bundled Python scripts (search_openalex.py, extract_metadata.py, format_bibtex.py, validate_citations.py, doi_to_bibtex.py). Use when converting DOIs or PMIDs to BibTeX, finding papers on a topic, filling missing volume, pages, or DOI fields, cleaning or merging .bib files with duplicate entries, or checking a bibliography for errors before submission. Not for systematic review search methodology or synthesis; use literature-review for that.
- allowed-tools
- Read Write Edit Bash WebSearch WebFetch
- compatibility
- Requires Python 3.9+ with requests. Google Scholar search additionally needs scholarly. Needs network access to api.openalex.org, api.crossref.org, eutils.ncbi.nlm.nih.gov, export.arxiv.org, and api.datacite.org.
02 资源文件 20
- 资产文件assets/bibtex_template.bib9.0 KB
- 资产文件assets/citation_checklist.md10.1 KB
- 参考文档references/best_practices.md2.6 KB
- 参考文档references/bibtex_formatting.md18.8 KB
- 参考文档references/citation_validation.md17.6 KB
- 参考文档references/core_workflow.md20.4 KB
- 参考文档references/example_workflows.md3.3 KB
- 参考文档references/google_scholar_search.md17.0 KB
- 参考文档references/metadata_extraction.md18.7 KB
- 参考文档references/pubmed_search.md17.3 KB
- 参考文档references/script_reference.md6.4 KB
- 参考文档references/search_strategies.md3.7 KB
- 脚本scripts/_common.py10.9 KB
- 脚本scripts/doi_to_bibtex.py6.2 KB
- 脚本scripts/extract_metadata.py25.9 KB
- 脚本scripts/format_bibtex.py10.9 KB
- 脚本scripts/search_google_scholar.py8.4 KB
- 脚本scripts/search_openalex.py10.4 KB
- 脚本scripts/search_pubmed.py13.5 KB
- 脚本scripts/validate_citations.py27.3 KB
03 SKILL.md 正文
Citation Management
Overview
Manage citations systematically throughout the research and writing process. This skill provides tools and strategies for searching academic databases (Google Scholar, PubMed), extracting accurate metadata from multiple sources (CrossRef, PubMed, arXiv), validating citation information, and generating properly formatted BibTeX entries.
Critical for maintaining citation accuracy, avoiding reference errors, and ensuring reproducible research. Integrates seamlessly with the literature-review skill for comprehensive research workflows.
When to Use This Skill
Use this skill when:
- Searching for specific papers on Google Scholar or PubMed
- Converting DOIs, PMIDs, or arXiv IDs to properly formatted BibTeX
- Extracting complete metadata for citations (authors, title, journal, year, etc.)
- Validating existing citations for accuracy
- Cleaning and formatting BibTeX files
- Finding highly cited papers in a specific field
- Verifying that citation information matches the actual publication
- Building a bibliography for a manuscript or thesis
- Checking for duplicate citations
- Ensuring consistent citation formatting
If a document built from these citations needs a diagram, use the scientific-schematics skill.
Core Workflow
Citation management follows a systematic process. Each phase below shows the canonical command; every variant, option, and metadata-source detail is in references/core_workflow.md.
Phase 1: Paper Discovery and Search
Find relevant papers. Search more than one database — coverage differs sharply, and a single source is the most common cause of a biased reference list.
# OpenAlex: ~250M works, every discipline, no API key, documented REST API
python scripts/search_openalex.py "CRISPR gene editing" --limit 50 --output results.json
# PubMed: the authority for biomedical and life sciences (35M+ citations)
python scripts/search_pubmed.py "Alzheimer's disease treatment" --limit 100 --output alz.json
# Google Scholar: broadest reach, but scraped -- rate-limited and prone to blocking
python scripts/search_google_scholar.py "CRISPR gene editing" --limit 50 --output scholar.json
Prefer OpenAlex or PubMed as the primary source. Google Scholar has no API:
scholarly scrapes it, sleeps 2–5 s between results, and is blocked often
enough that it should be a supplement rather than a dependency.
Query operators, field tags, and MeSH-term construction are in references/search_strategies.md.
Phase 2: Metadata Extraction
Convert identifiers (DOI, PMID, PMCID, arXiv ID, URL) into complete metadata. CrossRef is the primary source for DOIs.
python scripts/doi_to_bibtex.py 10.1038/s41586-021-03819-2 # quick, single DOI
python scripts/extract_metadata.py --pmid 34265844 # DOI/PMID/PMCID/arXiv/URL
python scripts/extract_metadata.py --input identifiers.txt --output citations.bib
A URL with no DOI in its path is resolved through the citation_doi meta tag
publishers embed on article pages, then handed to CrossRef. Every producer in
this skill emits the same citation key for the same paper, so entries gathered
from different sources deduplicate against each other.
Phase 2.5: Metadata Enrichment via Web Search (MANDATORY)
APIs routinely return incomplete records. Run this after extraction and before
formatting. Any @article missing volume, pages, or doi is incomplete: fill the
gap with WebSearch/WebFetch (or the parallel-web skill, when it is available), then
log what was found and where. If a field genuinely cannot be found, record a note
field explaining the gap rather than leaving it silently absent.
Check the cheap sources first — an OpenAlex or CrossRef record often carries the field that PubMed omitted:
python scripts/search_openalex.py "<exact title>" --limit 1
Treat extracted metadata as untrusted. Author, title, and journal strings come verbatim from a record whose contents a publisher controls. A title containing
$(...), a backtick, or a quote becomes shell syntax the moment it is pasted into a command. Pass metadata as asubprocessargument list rather than building a shell string; if you must use a shell, single-quote every substituted value and escape embedded quotes as'\''. Validate any citation key against^[A-Za-z0-9]+$before it reaches a path.
Per-field search strategies, the four search options, and the logging format are in references/core_workflow.md.
Phase 3: BibTeX Formatting
Produce clean, consistent entries. Entry types and required fields are in references/bibtex_formatting.md.
python scripts/format_bibtex.py references.bib --output clean.bib --deduplicate
python scripts/format_bibtex.py references.bib --output clean.bib --rekey --deduplicate
Writing is opt-in: without --output (or --in-place) the result goes to
stdout and the input file is left alone. Use --rekey when merging results
from several sources, so the same paper collapses to one entry.
Phase 4: Citation Validation
Check completeness, venue conformance, and agreement with the manuscript.
python scripts/validate_citations.py references.bib --report report.json
python scripts/validate_citations.py references.bib --venue nature
python scripts/validate_citations.py references.bib --manuscript paper.tex
python scripts/validate_citations.py references.bib --check-dois # slow; hits CrossRef
The script exits non-zero on high-severity errors — missing required fields,
malformed years, unresolved citations, or a count below an explicit
--min-count. Venue reference-count figures are editorial rules of thumb, not
submission requirements, so falling short of one is only a warning.
Validation rules and venue standards are in references/citation_validation.md.
Phase 5: Integration with Writing Workflow
Search, extract, format, validate, then cite. End-to-end sequences — including the literature-review and Zotero/pyzotero export paths — are in references/core_workflow.md and references/example_workflows.md.
Reference Files
- references/core_workflow.md: all five phases in full.
- references/search_strategies.md: OpenAlex, Google Scholar, and PubMed query construction.
- references/script_reference.md: every bundled script's arguments and examples.
- references/best_practices.md: search, extraction, BibTeX quality, validation.
- references/example_workflows.md: four end-to-end worked examples.
- references/google_scholar_search.md, references/pubmed_search.md: advanced search syntax.
- references/metadata_extraction.md, references/bibtex_formatting.md, references/citation_validation.md: per-topic detail.
Common Pitfalls to Avoid
-
Single source bias: Only using one database
- Solution: Search at least OpenAlex and PubMed, then merge with
format_bibtex.py --rekey --deduplicate
- Solution: Search at least OpenAlex and PubMed, then merge with
-
Accepting metadata blindly: Not verifying extracted information
- Solution: Spot-check extracted metadata against original sources
-
Ignoring DOI errors: Broken or incorrect DOIs in bibliography
- Solution: Run validation before final submission
-
Inconsistent formatting: Mixed citation key styles, formatting
- Solution: Use format_bibtex.py to standardize
-
Duplicate entries: Same paper cited multiple times with different keys
- Solution: Use duplicate detection in validation
-
Missing required fields: Incomplete BibTeX entries (volume, pages, DOI missing)
- Solution: Run Phase 2.5 metadata enrichment — web search for every missing field before proceeding. NEVER leave an @article entry without volume, pages, and DOI.
-
Outdated preprints: Citing preprint when published version exists
- Solution: Check if preprints have been published, update to journal version
-
Special character issues: Broken LaTeX compilation due to characters
- Solution: Use proper escaping or Unicode in BibTeX
-
No validation before submission: Submitting with citation errors
- Solution: Always run validation as final check
-
Manual BibTeX entry: Typing entries by hand
- Solution: Always extract from metadata sources using scripts
Integration with Other Skills
Literature Review Skill
Citation Management provides the technical infrastructure for Literature Review:
- Literature Review: Multi-database systematic search and synthesis
- Citation Management: Metadata extraction and validation
Combined workflow:
- Use literature-review for systematic search methodology
- Use citation-management to extract and validate citations
- Use literature-review to synthesize findings
- Use citation-management to ensure bibliography accuracy
Scientific Writing Skill
Citation Management ensures accurate references for Scientific Writing:
- Export validated BibTeX for use in LaTeX manuscripts
- Verify citations match publication standards
- Format references according to journal requirements
Venue Templates Skill
Citation Management works with Venue Templates for submission-ready manuscripts:
- Different venues require different citation styles
- Generate properly formatted references
- Validate citations meet venue requirements
Resources
Bundled Resources
References (in references/):
google_scholar_search.md: Complete Google Scholar search guidepubmed_search.md: PubMed and E-utilities API documentationmetadata_extraction.md: Metadata sources and field requirementscitation_validation.md: Validation criteria and quality checksbibtex_formatting.md: BibTeX entry types and formatting rules
Scripts (in scripts/):
search_openalex.py: OpenAlex search client (no API key)search_pubmed.py: PubMed E-utilities API clientsearch_google_scholar.py: Google Scholar search automationextract_metadata.py: Universal metadata extractorvalidate_citations.py: Citation validation and verificationformat_bibtex.py: BibTeX formatter and cleanerdoi_to_bibtex.py: Quick DOI to BibTeX converter_common.py: shared BibTeX parser, renderer, and citation-key scheme
Assets (in assets/):
bibtex_template.bib: Example BibTeX entries for all typescitation_checklist.md: Quality assurance checklist
External Resources
Search Engines:
- OpenAlex: https://openalex.org/
- Google Scholar: https://scholar.google.com/
- PubMed: https://pubmed.ncbi.nlm.nih.gov/
- PubMed Advanced Search: https://pubmed.ncbi.nlm.nih.gov/advanced/
Metadata APIs:
- OpenAlex API: https://docs.openalex.org/
- CrossRef API: https://api.crossref.org/
- PubMed E-utilities: https://www.ncbi.nlm.nih.gov/books/NBK25501/
- arXiv API: https://arxiv.org/help/api/
- DataCite API: https://api.datacite.org/
Tools and Validators:
- MeSH Browser: https://meshb.nlm.nih.gov/search
- DOI Resolver: https://doi.org/
- BibTeX Format: http://www.bibtex.org/Format/
Citation Styles:
- BibTeX documentation: http://www.bibtex.org/
- LaTeX bibliography management: https://www.overleaf.com/learn/latex/Bibliography_management
Dependencies
Required Python Packages
uv pip install requests # HTTP access to CrossRef, PubMed, OpenAlex, arXiv
BibTeX parsing, rendering, deduplication, and validation are standard library
(scripts/_common.py), so format_bibtex.py and validate_citations.py run
with no third-party packages at all.
Optional
uv pip install scholarly # only for search_google_scholar.py
Where credentials are sent
This skill needs no API key. The two environment variables it reads are optional identifiers, each sent to the one service it belongs to and nowhere else; no script bundles environment variables together.
| Variable | Sent only to | Purpose |
|---|---|---|
NCBI_API_KEY |
eutils.ncbi.nlm.nih.gov |
Raises Entrez rate limits |
NCBI_EMAIL |
eutils.ncbi.nlm.nih.gov |
Entrez caller identification (requested by NCBI) |
OPENALEX_EMAIL |
api.openalex.org |
Joins the faster OpenAlex polite pool |
api.openalex.org, api.crossref.org, api.datacite.org, export.arxiv.org,
and eutils.ncbi.nlm.nih.gov are all queried without credentials when these are
unset.
Summary
The citation-management skill provides:
- Comprehensive search capabilities for OpenAlex, PubMed, and Google Scholar
- Automated metadata extraction from DOI, PMID, PMCID, arXiv ID, URLs
- Citation validation with DOI verification and completeness checking
- BibTeX formatting with standardization and cleaning tools
- Quality assurance through validation and reporting
- Integration with scientific writing workflow
- Reproducibility through documented search and extraction methods
Use this skill to maintain accurate, complete citations throughout your research and ensure publication-ready bibliographies.
Related skills
citation-verification: Verify that every reference in a manuscript really exists and matches its metadata, catching hallucinated, corrupted or mismatched citation…bibtex-hygiene: Clean, deduplicate and validate BibTeX/BibLaTeX bibliographies before submission.literature-review: Runs systematic literature reviews by searching PubMed, arXiv, bioRxiv, and Semantic Scholar (plus web search via parallel-cli), screening…
04 同仓库更多 Skills
plos
Prepare manuscripts for PLOS journals (PLOS ONE, PLOS Biology, PLOS Computational Biology, PLOS Genetics, PLOS Medicine, PLOS Pathogens, PLOS Neglected Tropical Diseases, PLOS Global Public Health and others), covering structure, abstract and author summary, Vancouver-style references, the mandatory data availability policy, ethics and financial disclosure statements, figure requirements (PACE), the PLOS LaTeX template, reporting guidelines and PLOS ONE's publication criteria. Use when targeting any PLOS journal or checking compliance with PLOS policies.
pkpd-modeling
Pharmacokinetic and pharmacodynamic modelling and simulation - non-compartmental analysis, compartmental and population PK, PK/PD and exposure-response, TMDD, PBPK orientation, bioequivalence, allometric scaling and first-in-human dose, drug interaction prediction, and Bayesian therapeutic drug monitoring. Use when analysing concentration-time data, deriving exposure metrics, fitting PK or PD models, or evaluating dosing regimens. Triggers include "pharmacokinetics", "pharmacodynamics", "PK/PD", "NCA", "non-compartmental", "AUC", "Cmax", "lambda z", "half-life", "clearance", "volume of distribution", "compartmental model", "population PK", "popPK", "NONMEM", "nlmixr2", "Pharmpy", "Monolix", "exposure-response", "Emax", "EC50", "indirect response", "effect compartment", "TMDD", "PBPK", "bioequivalence", "RSABE", "ABEL", "allometric scaling", "first-in-human", "MABEL", "drug-drug interaction", "DDI", "ICH M12", "concentration-QTc", "therapeutic drug monitoring", "MIPD", and "dosing regimen".
pinecone
Guides use of Pinecone, a managed serverless vector database, through its Python client and the LangChain and LlamaIndex integrations. Covers creating indexes, upserting and querying vectors, metadata filtering, namespaces, hybrid dense and sparse search, index management, and deleting vectors. Use when building a production RAG system on a hosted vector store, adding semantic search or recommendations without running infrastructure, isolating per-user or per-tenant data with namespaces, combining dense and sparse vectors in one query, or filtering results by metadata. Do not use for self-hosted or local stores (Chroma, Weaviate) or offline similarity search (FAISS).
pi-agent
Build with and use Pi, the minimal terminal coding harness. Use for installing Pi, configuring providers/models/settings/environment variables, creating Pi skills/extensions/packages/themes/prompt templates, embedding Pi through the SDK, integrating over RPC or JSON event streams, parsing sessions, running local models through the llama.cpp router, developing custom Pi providers and TUI components, or using ecosystem packages such as pi-subagents (delegation/orchestration), pi-mcp-adapter (MCP servers), pi-interview (interactive forms), and pi-web-access (web search, fetching, video understanding).
phoenix-observability
Open-source AI observability platform for LLM tracing, evaluation, and monitoring. Use when debugging LLM applications with detailed traces, running evaluations on datasets, or monitoring production AI systems with real-time insights.
peft-fine-tuning
Fine-tunes LLMs with Hugging Face PEFT, using LoRA, QLoRA, IA3, AdaLoRA, prefix tuning, and prompt tuning so that under 1% of parameters are trained. Covers rank, alpha, and target module selection, loading and merging adapters, multi-adapter serving, and integration with TRL SFTTrainer, Axolotl, and vLLM. Use when fine-tuning 7B-70B models on limited GPU memory, when running QLoRA on a single 24GB GPU, when choosing LoRA rank and alpha, when merging or swapping adapters on one base model, or when debugging CUDA OOM or an adapter that does not apply. Not for full fine-tuning of small models under 1B parameters or cases needing all weights updated.