AGENT SKILL

multiqc-qc-reports

Aggregates QC from 150+ bioinformatics tools into one interactive HTML report. Scans FastQC, samtools, STAR, HISAT2, Trim Galore, featureCounts, Kallisto, Salmon, Picard, GATK logs; merges per-sample stats with plots. For NGS pipeline-wide QC. Use FastQC directly for single-sample; MultiQC for multi-sample reporting.

License 许可
GPL-3.0
所属仓库
bg-szy/TOP-SKILLS
最近更新
2026-11-12
Stars
★ 6
Forks
0

01 前言 Front Matter

name
multiqc-qc-reports
license
GPL-3.0
description
Aggregates QC from 150+ bioinformatics tools into one interactive HTML report. Scans FastQC, samtools, STAR, HISAT2, Trim Galore, featureCounts, Kallisto, Salmon, Picard, GATK logs; merges per-sample stats with plots. For NGS pipeline-wide QC. Use FastQC directly for single-sample; MultiQC for multi-sample reporting.

03 SKILL.md 正文

MultiQC — Multi-Sample QC Report Aggregator

Overview

MultiQC automatically searches directories for QC log files from 150+ bioinformatics tools and aggregates statistics across all samples into a single interactive HTML report. It parses outputs from FastQC, samtools flagstat, STAR, HISAT2, Trim Galore, Salmon, Kallisto, featureCounts, Picard, GATK, and many more — eliminating the need to manually review per-sample QC files. Reports include interactive bar plots, scatter plots, heatmaps, and tables with configurable warnings and pass/fail thresholds.

When to Use

  • Reviewing QC metrics across 10+ samples at once after FastQC, alignment, or quantification
  • Final QC checkpoint before differential expression or variant analysis
  • Sharing QC summaries with collaborators or including in publications
  • Identifying batch effects, outlier samples, or failed sequencing runs
  • Combining QC from multi-step pipelines (trimming → alignment → quantification) into one view
  • Use FastQC directly instead for initial single-sample QC exploration
  • For custom QC metrics not from standard tools, use Python/R directly; MultiQC parses tool outputs only

Prerequisites

  • Python packages: multiqc
  • Input requirements: Output files from bioinformatics tools (FastQC .zip, samtools .flagstat, STAR Log.final.out, etc.) — MultiQC finds them automatically
  • Environment: Python 3.8+

Check before installing: The tool may already be available in the current environment (e.g., inside a pixi / conda env). Run command -v multiqc first and skip the install commands below if it returns a path. When running inside a pixi project, invoke the tool via pixi run multiqc rather than bare multiqc.

pip install multiqc

# Verify
multiqc --version
# MultiQC v1.25.0

# With conda (recommended for bioinformatics)
conda install -c bioconda multiqc

Pre-flight Interview

Settle these with the user before writing any analysis code.

decisions:
  - id: D1
    param: searchScope
    kind: required
    source: data
    ask: "Which directories should be scanned, and are there old or partial runs in them that must be excluded?"
    default: "the pipeline output root, with no exclusions"

  - id: D2
    param: sampleNameCleaning
    kind: required
    source: data
    ask: "Do the discovered sample names collapse correctly, or do suffixes from different tools split one sample into several rows?"
    default: "built-in extension stripping; verify the resulting sample list"

  - id: D3
    param: moduleFilter
    kind: optional
    source: user
    ask: "Report on every tool found, or only some?"
    default: "all modules detected"

  - id: D4
    param: exportData
    kind: optional_conditional
    source: upstream
    ask: "Should the parsed metrics be written as flat tables for a later programmatic QC gate?"
    default: "HTML report only"

MultiQC aggregates rather than analyses, so most of its parameters are presentation. The two that are not are D1 and D2: a stale directory in scope silently adds samples that were never part of this run, and wrong name cleaning reports one sample as several. Both produce a clean-looking report.

Workflow

Step 1: Generate Tool-Specific QC Files

MultiQC aggregates existing output — first run your QC tools.

# FastQC on all FASTQ files
mkdir -p qc/fastqc
fastqc data/*.fastq.gz -o qc/fastqc/ -t 8

# samtools flagstat on all BAM files
for bam in results/*.bam; do
    samtools flagstat $bam > qc/$(basename $bam .bam).flagstat
done
echo "QC files generated: $(ls qc/ | wc -l)"

Step 2: Run MultiQC on a Directory

MultiQC recursively scans for recognized QC files.

# Basic run: scan current directory recursively
multiqc .

# Specify output directory and report name
multiqc . -o reports/ -n project_qc_report

# Scan specific subdirectories only
multiqc qc/fastqc/ results/star/ logs/trimming/ -o reports/

# Output: reports/project_qc_report.html
echo "Report: reports/project_qc_report.html"

Step 3: Configure Report Behavior

Use multiqc_config.yaml to set custom thresholds, sample naming, and module order.

# multiqc_config.yaml — place in working directory
title: "RNA-seq QC Report — Project X"
subtitle: "Analysis date: 2026-02"
intro_text: "Quality control summary for all 48 samples."

# Sample name cleaning: remove path prefixes and suffixes
fn_clean_exts:
  - ".fastq.gz"
  - "_R1"
  - ".sorted"

# Thresholds for pass/warn/fail coloring
general_stats_addcols:
  FastQC:
    pct_duplication:
      max: 40
      warn: 30

# Module run order
module_order:
  - fastqc
  - trimgalore
  - star
  - featurecounts
  - samtools
# Run with config file
multiqc . --config multiqc_config.yaml -o reports/

Step 4: Use MultiQC Modules and Filters

Control which tools and samples are included.

# Run only specific modules
multiqc . --module fastqc --module samtools

# Exclude specific modules
multiqc . --exclude fastqc

# Include only files matching a pattern
multiqc . --filename "*.flagstat" --filename "*_fastqc.zip"

# Ignore specific directories or files
multiqc . --ignore "tmp/" --ignore "*.bam"

# Add sample name regex substitution
multiqc . --replace-names "sample_" ""

Step 5: Export Data for Downstream Analysis

Extract machine-readable statistics from the MultiQC report.

# Export data tables (CSV, JSON, YAML, TSV)
multiqc . -o reports/ --data-format json
# Generates: reports/multiqc_data/multiqc_data.json

# Export flat CSV tables per tool
multiqc . -o reports/ --export
ls reports/multiqc_data/
# multiqc_fastqc.txt, multiqc_samtools_stats.txt, ...

# Extract general stats as pandas DataFrame
python3 - << 'EOF'
import json
import pandas as pd
with open("reports/multiqc_data/multiqc_general_stats.json") as f:
    data = json.load(f)
df = pd.DataFrame(data).T
print(df.head())
print(f"Shape: {df.shape}")
EOF

Step 6: Automate in Pipeline Scripts

Integrate MultiQC as the final step of any QC pipeline.

#!/bin/bash
# Complete RNA-seq QC pipeline → MultiQC summary
SAMPLES=(ctrl_rep1 ctrl_rep2 treat_rep1 treat_rep2)
OUTDIR="pipeline_output"
mkdir -p $OUTDIR/{fastqc,star,featurecounts,flagstat}

for sample in "${SAMPLES[@]}"; do
    # FastQC
    fastqc data/${sample}.fastq.gz -o $OUTDIR/fastqc/ -t 4
    # STAR alignment
    STAR --runThreadN 8 --genomeDir refs/star_index \
         --readFilesIn data/${sample}.fastq.gz \
         --outSAMtype BAM SortedByCoordinate \
         --outFileNamePrefix $OUTDIR/star/${sample}/
    # samtools flagstat
    samtools flagstat $OUTDIR/star/${sample}/Aligned.sortedByCoord.out.bam \
        > $OUTDIR/flagstat/${sample}.flagstat
done

# Final MultiQC report
multiqc $OUTDIR/ -o $OUTDIR/qc_report/ -n "full_pipeline_qc"
echo "Report ready: $OUTDIR/qc_report/full_pipeline_qc.html"

Key Parameters

Parameter Default Range/Options Effect
-o, --outdir . directory path Output directory for report and data
-n, --filename multiqc_report any string Report filename (without extension)
-m, --module all tool name Run only specified module(s)
--ignore — glob pattern Ignore matching files or directories
--export False flag Export flat tab-delimited data files
--data-format tsv tsv, json, yaml Format for exported data files
--config auto-detected YAML file path Custom config file with thresholds and naming
--replace-names — regex, replacement Clean sample names in report
--fn_clean_exts (built-in) list in config File extensions to strip from sample names
--profile-runtime False flag Show per-module runtime profiling

Common Recipes

Recipe: Add MultiQC to a Snakemake Pipeline

# In Snakefile: collect all QC outputs, then run MultiQC
rule multiqc:
    input:
        expand("qc/fastqc/{sample}_fastqc.zip", sample=SAMPLES),
        expand("qc/flagstat/{sample}.flagstat", sample=SAMPLES)
    output:
        html="reports/multiqc_report.html",
        data=directory("reports/multiqc_data")
    shell:
        "multiqc qc/ -o reports/ -n multiqc_report"

Recipe: Parse MultiQC Output in Python

import json
import pandas as pd

# Load general stats from JSON export
with open("reports/multiqc_data/multiqc_general_stats.json") as f:
    stats = json.load(f)

df = pd.DataFrame(stats).T
print(f"Samples: {len(df)}")
print(f"Metrics: {list(df.columns[:5])}")

# Flag samples with low mapping rate
if "STAR_mqc-generalstats-star-uniquely_mapped_percent" in df.columns:
    low_mapping = df[df["STAR_mqc-generalstats-star-uniquely_mapped_percent"] < 70]
    print(f"Samples with <70% mapping: {list(low_mapping.index)}")

Recipe: Compare QC Before and After Trimming

# Run FastQC on raw and trimmed reads, then combine in one report
mkdir -p qc/{raw,trimmed}

fastqc data/*.fastq.gz -o qc/raw/ -t 8
trim_galore data/*.fastq.gz --paired -o trimmed/
fastqc trimmed/*_trimmed.fastq.gz -o qc/trimmed/ -t 8

multiqc qc/raw/ qc/trimmed/ \
    -o reports/ -n raw_vs_trimmed \
    --dirs --dirs-depth 1  # use directory names in sample labels

Expected Outputs

Output Format Description
multiqc_report.html HTML Interactive report with all plots and tables
multiqc_data/multiqc_general_stats.txt TSV Per-sample summary statistics (all tools)
multiqc_data/multiqc_*.txt TSV Per-tool detailed statistics tables
multiqc_data/multiqc_data.json JSON Full data (if --data-format json)
multiqc_data/multiqc_sources.txt TSV Mapping of source files to samples

Troubleshooting

Problem Cause Solution
Empty report (no modules found) QC files not in scanned directories Specify directories explicitly: multiqc qc/ logs/ results/
Wrong sample names in report File extensions or paths not cleaned Add fn_clean_exts to config or use --replace-names
Module missing from report Log file format changed in tool version Update MultiQC: pip install --upgrade multiqc; check GitHub issues
Duplicate sample names Multiple files map to same sample name Use --sample-names or fix fn_clean_exts in config
Report very slow to open Too many samples (>500) in one report Split by project or condition; use --flat for simpler rendering
FastQC data not parsed FastQC ZIP not in expected location Run MultiQC from root of project; ensure *_fastqc.zip files exist
ModuleNotFoundError Missing optional module dependencies pip install multiqc[all] for all extras

References

04 同仓库更多 Skills

bg-szy
bg-szy/TOP-SKILLS

branding

When the user wants to define, audit, or apply brand strategy—purpose, values, positioning, storytelling, voice, narrative (not only visuals). Also use when the user mentions "brand strategy", "brand story", "brand storytelling" or "brand voice". For typography, colors, design tokens, and frontend visuals, use brand-visual-generator.

★ 6
bg-szy
bg-szy/TOP-SKILLS

brand-visual-generator

When the user wants to define, audit, or apply visual identity (typography, colors, spacing, design tokens, frontend aesthetics). Also use when the user mentions "brand style guide", "visual identity", "design system" or "typography". For brand story, positioning, and voice, use branding.

★ 6
bg-szy
bg-szy/TOP-SKILLS

mcp-builder

Guide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK).

★ 6
bg-szy
bg-szy/TOP-SKILLS

frontend-design

Guidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults.

★ 6
bg-szy
bg-szy/TOP-SKILLS

claude-api

Reference for the Claude API / Anthropic SDK — model ids, pricing, params, streaming, tool use, MCP, agents, caching, token counting, model migration. TRIGGER — read BEFORE opening the target file; don't skip because it "looks like a one-liner" — whenever: the prompt names Claude/Anthropic in any form (Claude, Anthropic, Fable, Opus, Sonnet, Haiku, `anthropic`, `@anthropic-ai`, `claude-*`, `us.anthropic.*`, `[1m]`); the user asks about an LLM (pricing/model choice/limits/caching) — never answer from memory; OR the task is LLM-shaped with provider unstated (agent/MCP/tool-definition/multi-agent/RAG/LLM-judge/computer-use; generate/summarize/extract/classify/rewrite/converse over NL; debugging refusals/cutoffs/streaming/tool-calls/tokens). SKIP only when another provider is being worked on (overrides all triggers): OpenAI/GPT/Gemini/Llama/Mistral/Cohere/Ollama named in the query; OR `grep -rE 'openai|langchain_openai|google.generativeai|genai|mistralai|cohere|ollama'` over the project hits (run this grep FIRST if no provider named — don't Read the file).

★ 6
bg-szy
bg-szy/TOP-SKILLS

inbox-guardian-for-gmail

Review a personal Gmail inbox with local, owner-approved spam rules. Use for audit-first quarantine, Trash, repeated-evidence sender learning, and header review. Do not use for automatic unsubscribe requests or unreviewed mailbox actions.

★ 6