[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7CVDHYF2GRE6PVKM5FYSDEV":3,"skill-same:01M7CVDHYF2GRE6PVKM5FYSDEV":59},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":26,"commitSha":27,"skillDirectory":28,"forksCount":29,"repositoryHtmlUrl":30,"repositoryHomepageUrl":6,"ownerHtmlUrl":31,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":32,"install":33,"resources":46},"01M7CVDHYF2GRE6PVKM5FYSDEV","bio-proteomics-data-import",null,"Loads mass-spectrometry data into Python\u002FR and strips the search engine's bookkeeping before any number is trusted -- removes decoys (REV__\u002FReverse), contaminants (CON__\u002FPotential contaminant), Only-identified-by-site groups, and resolves semicolon razor\u002Fleading protein-ID ambiguity in MaxQuant proteinGroups.txt, DIA-NN report.parquet, and mzML\u002FmzXML. Distinguishes Intensity (raw) vs LFQ intensity (MaxLFQ) vs iBAQ, treats a MaxQuant zero as missing (NaN, not log2(-inf)), and diagnoses the missingness contract (intensity-dependent in both DDA and DIA; DIA has fewer missing values). Use when starting an analysis from raw spectra or a search engine output. Downstream normalization and stats are differential-abundance; reporter-ion\u002FMaxLFQ quant is quantification; protein grouping is protein-inference.","mrsonord2240\u002Fopenscience-specialists","mrsonord2240","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F76487430?v=4","01M7CTEM40S43GSJZ9A3YCCXZK","Samuel Nord","01M7CTEM4K69JD1GBYNHVJ9ZP4",2,"Apache-2.0","https:\u002F\u002Fgithub.com\u002Fmrsonord2240\u002Fopenscience-specialists\u002Fblob\u002Fmain\u002Fspecialists\u002Fmass-spec-proteomics-analyst\u002Fversions\u002F1.0.1\u002Fpackage\u002Fskills\u002Fbio-proteomics-data-import\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: bio-proteomics-data-import\ndescription: Loads mass-spectrometry data into Python\u002FR and strips the search engine's bookkeeping before any number is trusted -- removes decoys (REV__\u002FReverse), contaminants (CON__\u002FPotential contaminant), Only-identified-by-site groups, and resolves semicolon razor\u002Fleading protein-ID ambiguity in MaxQuant proteinGroups.txt, DIA-NN report.parquet, and mzML\u002FmzXML. Distinguishes Intensity (raw) vs LFQ intensity (MaxLFQ) vs iBAQ, treats a MaxQuant zero as missing (NaN, not log2(-inf)), and diagnoses the missingness contract (intensity-dependent in both DDA and DIA; DIA has fewer missing values). Use when starting an analysis from raw spectra or a search engine output. Downstream normalization and stats are differential-abundance; reporter-ion\u002FMaxLFQ quant is quantification; protein grouping is protein-inference.\ntool_type: mixed\nprimary_tool: pyOpenMS\n---\n\n## Version Compatibility\n\nReference examples tested with: pyOpenMS 3.5.0, pandas 3.0.5, numpy 2.5.3 (Python blocks, 2026-09-15); MSnbase 2.28+\n\nBefore using code patterns, verify installed versions match. If versions differ:\n- Python: `pip show \u003Cpackage>` then `help(module.function)` to check signatures\n- R: `packageVersion('\u003Cpkg>')` then `?function_name` to verify parameters\n\nIf code throws ImportError, AttributeError, or TypeError, introspect the installed\npackage and adapt the example to match the actual API rather than retrying.\n\n# Mass Spectrometry Data Import -- Inheriting the Acquisition Contract and Stripping the Bookkeeping\n\n**\"Load my mass spec data into Python\"** -> Parse spectra or a search-engine table AND immediately enforce two contracts -- which quant column carries real biology, and which rows are search-engine bookkeeping that must be deleted -- because the same proteinGroups.txt yields different conclusions depending on the column read and the rows kept.\n- Python: `pyopenms.MzMLFile().load(path, exp)` for raw spectra; `pandas.read_csv(sep='\\t')` for MaxQuant; `pandas.read_parquet` for DIA-NN\n- R: `Spectra::Spectra()` \u002F `QFeatures::readQFeatures()` for raw and quantified data (MSnbase still works but is in maintenance mode)\n\nScope: this skill owns reading spectra\u002Fsearch outputs into memory, deleting decoy\u002Fcontaminant\u002Fsite-only rows, picking the correct quant column, and characterizing missingness. Format conversion (RAW -> mzML) -> peptide-identification. MaxLFQ\u002FTMT reporter quant computation -> quantification. Protein-group parsimony -> protein-inference. Normalization and imputation -> differential-abundance and expression-matrix\u002Fnormalization. OUT OF SCOPE: statistical testing, batch correction, and the actual imputation step (this skill only diagnoses the missingness so the right imputer is chosen later).\n\n## The Single Most Important Modern Insight -- Import Is Where Two Contracts Are Read and Enforced\n\n1. **A \"data import\" is never just file parsing -- it is the moment the acquisition mode's quantitative contract and its missingness structure are inherited.** DDA selects the top-N most intense precursors per cycle, and which precursors get picked is partly stochastic and abundance-biased, so the same low-abundance peptide is sampled in run A and missed in run B; this manufactures structured, left-censored MNAR missingness. DIA fragments every precursor in every window every cycle, so it has fewer missing values, but those it has are still mostly intensity-dependent (concentrated in low-abundance proteins), not MCAR (Hediyeh-zadeh 2023). The catastrophic error this prevents: imputing a matrix with a mean\u002FKNN method that assumes MCAR, which biases low-abundance proteins upward and manufactures false hits. The mode is born at acquisition and inherited at import, but the imputer is chosen from the missingness diagnosis made here, not from the acquisition mode alone.\n\n2. **The search engine's bookkeeping must be stripped before any number is trusted.** A proteinGroups.txt carries decoy rows (`Reverse == '+'`, `REV__` prefix in the ID) from the target-decoy FDR machinery, contaminant rows (`Potential contaminant == '+'`, `CON__` prefix), and Only-identified-by-site rows (the protein has no unmodified-peptide evidence, only a modified site). Keeping any of these leaks non-biological signal into the intensity matrix and inflates IDs. The catastrophic error: reporting differential abundance on a matrix where decoy or keratin rows survived.\n\n3. **The same proteinGroups.txt yields different biology from different columns, and a zero is not a measurement.** `Intensity` is raw summed precursor signal (not normalized, not comparable across samples for ratios). `LFQ intensity` is MaxLFQ-normalized and is the column for between-sample comparison. `iBAQ` is intensity divided by the number of observable tryptic peptides -- a within-sample molar proxy, not a between-sample quant. MaxQuant writes 0 for \"not quantified\", so log2(0) = -inf; replace 0 -> NaN before any transform. The catastrophic error: log2-transforming raw `Intensity` (or iBAQ) and reading the ratios as biology.\n\n## Tool Taxonomy\n\n| Tool \u002F method | Citation | Mechanism \u002F role | When |\n|---|---|---|---|\n| pyOpenMS `MzMLFile().load` | Rost 2014 | Loads mzML\u002FmzXML into an MSExperiment in memory; iterate spectra by MS level | Programmatic access to raw peaks, precursor m\u002Fz, isolation windows |\n| pandas `read_csv`\u002F`read_parquet` | -- | Tabular ingest of MaxQuant TSV and DIA-NN parquet | All search-engine output tables |\n| DIA-NN report | Demichev 2020 | Long-format precursor table; `report.parquet` is the default (1.9+) and the only default (2.0) | DIA quant; pivot on `PG.MaxLFQ` after q-filtering |\n| MaxQuant `txt\u002F` outputs | Cox 2014 (MaxLFQ) | `proteinGroups.txt` (group level), `evidence.txt` (per-PSM) | DDA label-free \u002F TMT search results |\n| Spectra + QFeatures (R) | -- | Current Bioconductor raw + quantified-feature containers; `readQFeatures`, `aggregateFeatures` | R pipelines; preferred over MSnbase going forward |\n| MSnbase `readMSData` (R) | -- | On-disk raw reading; maintenance mode (route OUT to Spectra\u002FQFeatures) | Legacy R code only |\n| ThermoRawFileParser \u002F msconvert | Hulstaert 2020 \u002F Chambers 2012 | RAW -> mzML conversion (route OUT) | File conversion is peptide-identification |\n\n## Decision Tree by Scenario\n\n| Scenario | Recommended | Why |\n|---|---|---|\n| MaxQuant DDA label-free, between-sample comparison | Read `LFQ intensity` columns from proteinGroups.txt | MaxLFQ-normalized; the only MaxQuant column valid for cross-sample ratios |\n| MaxQuant, absolute\u002Fmolar abundance within one sample | Read `iBAQ` columns | iBAQ is a within-sample molar proxy; do not use across samples |\n| Need raw uncorrected signal for a custom normalization | Read `Intensity` columns, normalize yourself | `Intensity` is raw summed precursor area, not comparable as-is |\n| DIA-NN output (1.9 or 2.0) | `pd.read_parquet('report.parquet')`, filter run-level and `Global.PG.Q.Value` q-values, pivot `PG.MaxLFQ`, 0 -> NaN, log2 | 2.0 dropped the TSV default; without the global protein q-value filter, groups that pass only within single runs leak into the cross-run matrix |\n| Raw spectra, need peaks\u002Fprecursor\u002Fisolation window | pyOpenMS `MzMLFile().load` | Programmatic peak and isolation-window access for QC and co-isolation reasoning |\n| R-based pipeline, quantified features | QFeatures `readQFeatures` + `aggregateFeatures` | Current Bioconductor; MSnbase is maintenance-only |\n| Data came from DDA, planning imputation | Diagnose missingness as MNAR -> route to left-censored imputation | DDA top-N sampling makes missingness abundance-dependent |\n| Data came from DIA, planning imputation | Run the same diagnostic; a negative abundance-missingness correlation means left-censored handling, as for DDA | DIA has fewer missing values, but they are still mostly intensity-dependent (Hediyeh-zadeh 2023) |\n\nDefault when uncertain: read `LFQ intensity` (MaxQuant) or `PG.MaxLFQ` after q-filtering (DIA-NN), strip Reverse\u002Fcontaminant\u002Fsite-only rows, set 0 -> NaN, then diagnose missingness before choosing an imputer.\n\n## Loading mzML\u002FmzXML with pyOpenMS\n\n**Goal:** Parse raw spectra into memory for QC, peak access, and isolation-window reasoning.\n\n**Approach:** Load into an MSExperiment (filled in place), iterate by MS level; `get_peaks()` returns a tuple of (mz, intensity) numpy arrays, and `getPrecursors()` returns a list that is empty for all-ion (AIF\u002FMSE\u002FbbCID) MS2 scans. An isolation width of 0 means the offsets were not written, not a 0-Th window.\n\n```python\nfrom pyopenms import MSExperiment, MzMLFile\n\nexp = MSExperiment()\nMzMLFile().load('sample.mzML', exp)  # fills exp in place; returns None\n\nfor spectrum in exp:\n    if spectrum.getMSLevel() == 1:\n        mz, intensity = spectrum.get_peaks()  # tuple of two numpy arrays\n    elif spectrum.getMSLevel() == 2:\n        precs = spectrum.getPrecursors()  # a list; empty for all-ion (AIF\u002FMSE) MS2 scans\n        if not precs:\n            continue  # record as no-precursor MS2 instead of indexing [0]\n        precursor = precs[0]\n        precursor_mz = precursor.getMZ()\n        window = precursor.getIsolationWindowLowerOffset() + precursor.getIsolationWindowUpperOffset()\n        if window == 0:\n            print(f'{spectrum.getNativeID()}: isolation offsets not written (width unknown, not 0 Th)')\n```\n\n## Loading and Cleaning MaxQuant proteinGroups.txt\n\n**Goal:** Get a trustworthy log2 intensity matrix with bookkeeping rows removed and missing values represented as NaN.\n\n**Approach:** Strip Reverse\u002Fcontaminant\u002Fsite-only rows, resolve the semicolon protein-ID list to a leading ID, pick `LFQ intensity` columns, set 0 -> NaN, then log2-transform.\n\n```python\nimport pandas as pd\nimport numpy as np\n\npg = pd.read_csv('proteinGroups.txt', sep='\\t', low_memory=False)  # mixed-type cols\n\n# Flag columns hold '+' or empty string; all three are proteinGroups-only bookkeeping\nmask = (pg.get('Reverse', '') != '+') & (pg.get('Potential contaminant', '') != '+') & (pg.get('Only identified by site', '') != '+')\npg = pg[mask].copy()\n\n# Protein IDs \u002F Majority protein IDs \u002F Gene names are SEMICOLON lists; take the first (leading\u002Frazor) entry\npg['leading_protein'] = pg['Protein IDs'].str.split(';').str[0]\npg['leading_gene'] = pg['Gene names'].where(pg['Gene names'].notna(), '').str.split(';').str[0]\n\nlfq_cols = [c for c in pg.columns if c.startswith('LFQ intensity ')]  # MaxLFQ-normalized, between-sample comparable\nif not lfq_cols:\n    raise ValueError('No LFQ intensity columns: LFQ was not enabled in MaxQuant; use Intensity and normalize explicitly')\nmatrix = pg[['leading_protein', 'leading_gene'] + lfq_cols].copy()\nmatrix[lfq_cols] = matrix[lfq_cols].replace(0, np.nan)  # MaxQuant writes 0 for missing; log2(0) = -inf\nmatrix[lfq_cols] = np.log2(matrix[lfq_cols])\nmatrix = matrix[matrix[lfq_cols].notna().any(axis=1)]  # groups with no valid LFQ value carry no quant\n```\n\n## Loading DIA-NN report.parquet\n\n**Goal:** Reshape the long DIA-NN report into a confident protein-by-run matrix.\n\n**Approach:** Read the parquet (default since 1.9, only default in 2.0), filter run-level precursor and protein-group q-values AND the experiment-wide `Global.PG.Q.Value` to 1% FDR BEFORE pivoting on `PG.MaxLFQ` (with library-based MBR on 1.9.x use `Lib.PG.Q.Value`), then set 0 -> NaN and log2.\n\n```python\nimport numpy as np\nimport pandas as pd\n\nreport = pd.read_parquet('report.parquet')  # report.tsv dropped as default in DIA-NN 2.0\nreport = report[(report['Q.Value'] \u003C= 0.01) & (report['PG.Q.Value'] \u003C= 0.01)\n                & (report['Global.PG.Q.Value'] \u003C= 0.01)]  # run-level AND experiment-wide 1% FDR before quant\n\nmatrix = report.pivot_table(index='Protein.Group', columns='Run', values='PG.MaxLFQ', aggfunc='first')\nmatrix = np.log2(matrix.replace(0, np.nan))  # PG.MaxLFQ can be 0 too; log2(0) = -inf\n```\n\n## Diagnosing the Missingness Contract\n\n**Goal:** Quantify the missing-value pattern so the legitimate imputation class can be chosen downstream.\n\n**Approach:** Count NaN per protein and per sample on a log2 matrix with NaN for missing (zeros left in, or a linear scale, hide the signature). A negative correlation between missingness and mean abundance is the MNAR (left-censored) signature; expect it in DDA and, with fewer missing values, in DIA too.\n\n```python\nimport numpy as np\n\ndef assess_missingness(matrix, sample_cols):\n    miss_per_protein = matrix[sample_cols].isna().sum(axis=1)\n    miss_per_sample = matrix[sample_cols].isna().sum(axis=0)\n    total_pct = 100 * matrix[sample_cols].isna().sum().sum() \u002F matrix[sample_cols].size\n    mean_abund = matrix[sample_cols].mean(axis=1)  # negative corr with missingness => MNAR \u002F left-censored\n    mnar_corr = mean_abund.corr(miss_per_protein)\n    return {'per_protein': miss_per_protein, 'per_sample': miss_per_sample, 'total_pct': total_pct, 'abundance_missing_corr': mnar_corr}\n```\n\n## Per-Method Failure Modes\n\n### MaxQuant wrong quant column\n\n**Trigger:** Reading `Intensity` (raw) or `iBAQ` when between-sample ratios are intended.\n**Mechanism:** `Intensity` is un-normalized summed precursor signal; `iBAQ` is a within-sample molar proxy. Neither is comparable across samples the way `LFQ intensity` is.\n**Symptom:** Ratios track total loaded protein \u002F sample depth rather than biology; fold changes shift when one sample's loading changes.\n**Fix:** Use `LFQ intensity` for cross-sample comparison; if computing custom normalization use `Intensity` and normalize explicitly (expression-matrix\u002Fnormalization).\n\n### Zero treated as a measurement\n\n**Trigger:** `np.log2` applied directly to a MaxQuant matrix still containing 0.\n**Mechanism:** MaxQuant encodes \"not quantified\" as 0; log2(0) = -inf, which then propagates into means and tests.\n**Symptom:** -inf values, NaN means, proteins silently dropped or skewed.\n**Fix:** `replace(0, np.nan)` before any transform; then diagnose missingness.\n\n### Bookkeeping rows survive\n\n**Trigger:** Loading proteinGroups.txt without filtering Reverse \u002F Potential contaminant \u002F Only identified by site.\n**Mechanism:** Decoys exist only for FDR estimation; contaminants are keratin\u002Ftrypsin\u002FBSA, not the sample; site-only groups have no unmodified-peptide quant evidence. `Only identified by site` exists only in proteinGroups.txt.\n**Symptom:** Inflated protein counts; a \"hit\" that is a decoy or keratin.\n**Fix:** Filter all three flag columns; cross-check with `REV__`\u002F`CON__` ID prefixes when joining to peptide tables. Caveat: do not delete CON__ rows blindly if a contaminant (e.g. keratin) is the protein of interest.\n\n### Razor \u002F leading protein-ID ambiguity ignored\n\n**Trigger:** Treating `Protein IDs` or `Gene names` as an atomic single value.\n**Mechanism:** These are semicolon-delimited lists; the first entry is the leading (razor) protein for the group, and `Gene names` can be blank while protein IDs are present.\n**Symptom:** Merges fail, NaN gene labels, ambiguous identity downstream.\n**Fix:** Split on `;` and take the first entry; guard `Gene names` with `.notna()`. Group parsimony details -> protein-inference.\n\n### Stale DIA-NN parsing\n\n**Trigger:** Reading `report.tsv` on DIA-NN 2.0, or pivoting before q-filtering.\n**Mechanism:** 2.0 defaults to (and only defaults to) `report.parquet`; pivoting unfiltered rows includes precursors above 1% FDR.\n**Symptom:** FileNotFoundError on report.tsv; or low-confidence quant inflating the matrix.\n**Fix:** `pd.read_parquet('report.parquet')`; filter `Q.Value \u003C= 0.01 & PG.Q.Value \u003C= 0.01 & Global.PG.Q.Value \u003C= 0.01` before pivoting `PG.MaxLFQ`.\n\n### MNAR imputed as MCAR\n\n**Trigger:** Mean\u002Fmedian\u002FKNN imputation on a DDA or DIA matrix whose diagnostic shows abundance-dependent missingness.\n**Mechanism:** DDA missingness is abundance-dependent (left-censored); MCAR imputers fill missing low values with the central tendency, biasing them upward.\n**Symptom:** Low-abundance proteins gain false high values; spurious differential hits.\n**Fix:** Diagnose the abundance-missingness correlation here and choose the imputer from it, not from the acquisition mode: a negative correlation routes to left-censored imputation (downshifted-Gaussian \u002F QRILC \u002F MinProb) or a censoring-aware model in differential-abundance. DIA's fewer missing values limit the damage but do not make them MCAR.\n\n## Quantitative Thresholds\n\n| Threshold | Source | Rationale |\n|---|---|---|\n| DIA-NN import filter `Q.Value \u003C= 0.01` AND `PG.Q.Value \u003C= 0.01` AND `Global.PG.Q.Value \u003C= 0.01` | Demichev 2020; DIA-NN documentation | Run-level precursor\u002Fprotein and experiment-wide protein-group 1% FDR enforced before any quant value enters a cross-run matrix |\n| Peptide\u002Fprotein FDR 1% (q \u003C= 0.01) | Target-decoy convention | Standard ID confidence at both peptide and protein levels |\n| MaxQuant zero -> NaN | MaxQuant output convention | 0 encodes \"not quantified\"; log2(0) = -inf corrupts every transform |\n| Min peptides per protein for quant >= 2 | Community quant practice | Single-peptide (\"one-hit-wonder\") proteins are ID\u002Fquant-unreliable; not applied by the import code above -- apply it (e.g. `Razor + unique peptides >= 2`) as a documented study choice |\n| Valid-value filter >= 50-70% per group | Modeling choice (document per study) | Caps imputation burden; the exact cutoff is a study decision, not a universal constant |\n| Take FIRST semicolon entry as leading protein\u002Fgene | MaxQuant proteinGroups convention | The leading\u002Frazor protein is the group identifier; trailing entries are shared-peptide members |\n\n## Common Errors\n\n| Error \u002F symptom | Cause | Solution |\n|---|---|---|\n| `-inf` values after log2 | Zeros not converted to NaN (MaxQuant LFQ or DIA-NN PG.MaxLFQ) | `df.replace(0, np.nan)` before `np.log2` |\n| `IndexError: list index out of range` at `getPrecursors()[0]` | All-ion (AIF\u002FMSE) MS2 scan without a precursor | Check `if not spectrum.getPrecursors()` before indexing |\n| `FileNotFoundError: report.tsv` (DIA-NN 2.0) | TSV no longer the default output | `pd.read_parquet('report.parquet')` |\n| `KeyError: 'Only identified by site'` | That column exists ONLY in proteinGroups.txt | Use `df.get('Only identified by site', '')` or guard the column lookup |\n| Mixed-type \u002F DtypeWarning on MaxQuant load | Wide TSV with mixed column types | `pd.read_csv(..., low_memory=False)` |\n| NaN gene labels break a merge | `Gene names` is a semicolon list, sometimes blank | `.where(notna(), '').str.split(';').str[0]` |\n| Ratios track loading not biology | Read `Intensity` (raw) instead of `LFQ intensity` | Use `LFQ intensity` for between-sample comparison |\n| `get_peaks()` unpacking error | Expecting a 2D array | It returns a tuple `(mz, intensity)` of two numpy arrays |\n\n## References\n\n- Cox J, Hein MY, Luber CA, Paron I, Nagaraj N, Mann M. 2014. Accurate proteome-wide label-free quantification by delayed normalization and maximal peptide ratio extraction, termed MaxLFQ. *Mol Cell Proteomics* 13(9):2513-2526.\n- Demichev V, Messner CB, Vernardis SI, Lilley KS, Ralser M. 2020. DIA-NN: neural networks and interference correction enable deep proteome coverage in high throughput. *Nat Methods* 17(1):41-44.\n- Rost HL, Schmitt U, Aebersold R, Malmstrom L. 2014. pyOpenMS: a Python-based interface to the OpenMS mass-spectrometry algorithm library. *Proteomics* 14(1):74-77.\n- Hediyeh-zadeh S, Webb AI, Davis MJ. 2023. MsImpute: estimation of missing peptide intensity data in label-free quantitative mass spectrometry. *Mol Cell Proteomics* 22(8):100558.\n- Chambers MC, Maclean B, Burke R, et al. 2012. A cross-platform toolkit for mass spectrometry and proteomics. *Nat Biotechnol* 30(10):918-920.\n- Hulstaert N, Shofstahl J, Sachsenberg T, et al. 2020. ThermoRawFileParser: modular, scalable, and cross-platform RAW file conversion. *J Proteome Res* 19(1):537-542.\n\n## Related Skills\n\n- peptide-identification - search raw spectra and convert vendor RAW to mzML\n- quantification - compute MaxLFQ and TMT reporter-ion quantities from imported data\n- protein-inference - resolve protein-group parsimony and razor assignment\n- differential-abundance - normalize, impute (per the missingness diagnosis), and test\n- proteomics-qc - assess run-level identification and quant quality\n- dia-analysis - run DIA-NN to produce the report this skill imports\n- expression-matrix\u002Fnormalization - general intensity-matrix normalization patterns\n- workflows\u002Fproteomics-pipeline - end-to-end pipeline that begins with this import step\n","## Version Compatibility\n\nReference examples tested with: pyOpenMS 3.5.0, pandas 3.0.5, numpy 2.5.3 (Python blocks, 2026-09-15); MSnbase 2.28+\n\nBefore using code patterns, verify installed versions match. If versions differ:\n- Python: `pip show \u003Cpackage>` then `help(module.function)` to check signatures\n- R: `packageVersion('\u003Cpkg>')` then `?function_name` to verify parameters\n\nIf code throws ImportError, AttributeError, or TypeError, introspect the installed\npackage and adapt the example to match the actual API rather than retrying.\n\n# Mass Spectrometry Data Import -- Inheriting the Acquisition Contract and Stripping the Bookkeeping\n\n**\"Load my mass spec data into Python\"** -> Parse spectra or a search-engine table AND immediately enforce two contracts -- which quant column carries real biology, and which rows are search-engine bookkeeping that must be deleted -- because the same proteinGroups.txt yields different conclusions depending on the column read and the rows kept.\n- Python: `pyopenms.MzMLFile().load(path, exp)` for raw spectra; `pandas.read_csv(sep='\\t')` for MaxQuant; `pandas.read_parquet` for DIA-NN\n- R: `Spectra::Spectra()` \u002F `QFeatures::readQFeatures()` for raw and quantified data (MSnbase still works but is in maintenance mode)\n\nScope: this skill owns reading spectra\u002Fsearch outputs into memory, deleting decoy\u002Fcontaminant\u002Fsite-only rows, picking the correct quant column, and characterizing missingness. Format conversion (RAW -> mzML) -> peptide-identification. MaxLFQ\u002FTMT reporter quant computation -> quantification. Protein-group parsimony -> protein-inference. Normalization and imputation -> differential-abundance and expression-matrix\u002Fnormalization. OUT OF SCOPE: statistical testing, batch correction, and the actual imputation step (this skill only diagnoses the missingness so the right imputer is chosen later).\n\n## The Single Most Important Modern Insight -- Import Is Where Two Contracts Are Read and Enforced\n\n1. **A \"data import\" is never just file parsing -- it is the moment the acquisition mode's quantitative contract and its missingness structure are inherited.** DDA selects the top-N most intense precursors per cycle, and which precursors get picked is partly stochastic and abundance-biased, so the same low-abundance peptide is sampled in run A and missed in run B; this manufactures structured, left-censored MNAR missingness. DIA fragments every precursor in every window every cycle, so it has fewer missing values, but those it has are still mostly intensity-dependent (concentrated in low-abundance proteins), not MCAR (Hediyeh-zadeh 2023). The catastrophic error this prevents: imputing a matrix with a mean\u002FKNN method that assumes MCAR, which biases low-abundance proteins upward and manufactures false hits. The mode is born at acquisition and inherited at import, but the imputer is chosen from the missingness diagnosis made here, not from the acquisition mode alone.\n\n2. **The search engine's bookkeeping must be stripped before any number is trusted.** A proteinGroups.txt carries decoy rows (`Reverse == '+'`, `REV__` prefix in the ID) from the target-decoy FDR machinery, contaminant rows (`Potential contaminant == '+'`, `CON__` prefix), and Only-identified-by-site rows (the protein has no unmodified-peptide evidence, only a modified site). Keeping any of these leaks non-biological signal into the intensity matrix and inflates IDs. The catastrophic error: reporting differential abundance on a matrix where decoy or keratin rows survived.\n\n3. **The same proteinGroups.txt yields different biology from different columns, and a zero is not a measurement.** `Intensity` is raw summed precursor signal (not normalized, not comparable across samples for ratios). `LFQ intensity` is MaxLFQ-normalized and is the column for between-sample comparison. `iBAQ` is intensity divided by the number of observable tryptic peptides -- a within-sample molar proxy, not a between-sample quant. MaxQuant writes 0 for \"not quantified\", so log2(0) = -inf; replace 0 -> NaN before any transform. The catastrophic error: log2-transforming raw `Intensity` (or iBAQ) and reading the ratios as biology.\n\n## Tool Taxonomy\n\n| Tool \u002F method | Citation | Mechanism \u002F role | When |\n|---|---|---|---|\n| pyOpenMS `MzMLFile().load` | Rost 2014 | Loads mzML\u002FmzXML into an MSExperiment in memory; iterate spectra by MS level | Programmatic access to raw peaks, precursor m\u002Fz, isolation windows |\n| pandas `read_csv`\u002F`read_parquet` | -- | Tabular ingest of MaxQuant TSV and DIA-NN parquet | All search-engine output tables |\n| DIA-NN report | Demichev 2020 | Long-format precursor table; `report.parquet` is the default (1.9+) and the only default (2.0) | DIA quant; pivot on `PG.MaxLFQ` after q-filtering |\n| MaxQuant `txt\u002F` outputs | Cox 2014 (MaxLFQ) | `proteinGroups.txt` (group level), `evidence.txt` (per-PSM) | DDA label-free \u002F TMT search results |\n| Spectra + QFeatures (R) | -- | Current Bioconductor raw + quantified-feature containers; `readQFeatures`, `aggregateFeatures` | R pipelines; preferred over MSnbase going forward |\n| MSnbase `readMSData` (R) | -- | On-disk raw reading; maintenance mode (route OUT to Spectra\u002FQFeatures) | Legacy R code only |\n| ThermoRawFileParser \u002F msconvert | Hulstaert 2020 \u002F Chambers 2012 | RAW -> mzML conversion (route OUT) | File conversion is peptide-identification |\n\n## Decision Tree by Scenario\n\n| Scenario | Recommended | Why |\n|---|---|---|\n| MaxQuant DDA label-free, between-sample comparison | Read `LFQ intensity` columns from proteinGroups.txt | MaxLFQ-normalized; the only MaxQuant column valid for cross-sample ratios |\n| MaxQuant, absolute\u002Fmolar abundance within one sample | Read `iBAQ` columns | iBAQ is a within-sample molar proxy; do not use across samples |\n| Need raw uncorrected signal for a custom normalization | Read `Intensity` columns, normalize yourself | `Intensity` is raw summed precursor area, not comparable as-is |\n| DIA-NN output (1.9 or 2.0) | `pd.read_parquet('report.parquet')`, filter run-level and `Global.PG.Q.Value` q-values, pivot `PG.MaxLFQ`, 0 -> NaN, log2 | 2.0 dropped the TSV default; without the global protein q-value filter, groups that pass only within single runs leak into the cross-run matrix |\n| Raw spectra, need peaks\u002Fprecursor\u002Fisolation window | pyOpenMS `MzMLFile().load` | Programmatic peak and isolation-window access for QC and co-isolation reasoning |\n| R-based pipeline, quantified features | QFeatures `readQFeatures` + `aggregateFeatures` | Current Bioconductor; MSnbase is maintenance-only |\n| Data came from DDA, planning imputation | Diagnose missingness as MNAR -> route to left-censored imputation | DDA top-N sampling makes missingness abundance-dependent |\n| Data came from DIA, planning imputation | Run the same diagnostic; a negative abundance-missingness correlation means left-censored handling, as for DDA | DIA has fewer missing values, but they are still mostly intensity-dependent (Hediyeh-zadeh 2023) |\n\nDefault when uncertain: read `LFQ intensity` (MaxQuant) or `PG.MaxLFQ` after q-filtering (DIA-NN), strip Reverse\u002Fcontaminant\u002Fsite-only rows, set 0 -> NaN, then diagnose missingness before choosing an imputer.\n\n## Loading mzML\u002FmzXML with pyOpenMS\n\n**Goal:** Parse raw spectra into memory for QC, peak access, and isolation-window reasoning.\n\n**Approach:** Load into an MSExperiment (filled in place), iterate by MS level; `get_peaks()` returns a tuple of (mz, intensity) numpy arrays, and `getPrecursors()` returns a list that is empty for all-ion (AIF\u002FMSE\u002FbbCID) MS2 scans. An isolation width of 0 means the offsets were not written, not a 0-Th window.\n\n```python\nfrom pyopenms import MSExperiment, MzMLFile\n\nexp = MSExperiment()\nMzMLFile().load('sample.mzML', exp)  # fills exp in place; returns None\n\nfor spectrum in exp:\n    if spectrum.getMSLevel() == 1:\n        mz, intensity = spectrum.get_peaks()  # tuple of two numpy arrays\n    elif spectrum.getMSLevel() == 2:\n        precs = spectrum.getPrecursors()  # a list; empty for all-ion (AIF\u002FMSE) MS2 scans\n        if not precs:\n            continue  # record as no-precursor MS2 instead of indexing [0]\n        precursor = precs[0]\n        precursor_mz = precursor.getMZ()\n        window = precursor.getIsolationWindowLowerOffset() + precursor.getIsolationWindowUpperOffset()\n        if window == 0:\n            print(f'{spectrum.getNativeID()}: isolation offsets not written (width unknown, not 0 Th)')\n```\n\n## Loading and Cleaning MaxQuant proteinGroups.txt\n\n**Goal:** Get a trustworthy log2 intensity matrix with bookkeeping rows removed and missing values represented as NaN.\n\n**Approach:** Strip Reverse\u002Fcontaminant\u002Fsite-only rows, resolve the semicolon protein-ID list to a leading ID, pick `LFQ intensity` columns, set 0 -> NaN, then log2-transform.\n\n```python\nimport pandas as pd\nimport numpy as np\n\npg = pd.read_csv('proteinGroups.txt', sep='\\t', low_memory=False)  # mixed-type cols\n\n# Flag columns hold '+' or empty string; all three are proteinGroups-only bookkeeping\nmask = (pg.get('Reverse', '') != '+') & (pg.get('Potential contaminant', '') != '+') & (pg.get('Only identified by site', '') != '+')\npg = pg[mask].copy()\n\n# Protein IDs \u002F Majority protein IDs \u002F Gene names are SEMICOLON lists; take the first (leading\u002Frazor) entry\npg['leading_protein'] = pg['Protein IDs'].str.split(';').str[0]\npg['leading_gene'] = pg['Gene names'].where(pg['Gene names'].notna(), '').str.split(';').str[0]\n\nlfq_cols = [c for c in pg.columns if c.startswith('LFQ intensity ')]  # MaxLFQ-normalized, between-sample comparable\nif not lfq_cols:\n    raise ValueError('No LFQ intensity columns: LFQ was not enabled in MaxQuant; use Intensity and normalize explicitly')\nmatrix = pg[['leading_protein', 'leading_gene'] + lfq_cols].copy()\nmatrix[lfq_cols] = matrix[lfq_cols].replace(0, np.nan)  # MaxQuant writes 0 for missing; log2(0) = -inf\nmatrix[lfq_cols] = np.log2(matrix[lfq_cols])\nmatrix = matrix[matrix[lfq_cols].notna().any(axis=1)]  # groups with no valid LFQ value carry no quant\n```\n\n## Loading DIA-NN report.parquet\n\n**Goal:** Reshape the long DIA-NN report into a confident protein-by-run matrix.\n\n**Approach:** Read the parquet (default since 1.9, only default in 2.0), filter run-level precursor and protein-group q-values AND the experiment-wide `Global.PG.Q.Value` to 1% FDR BEFORE pivoting on `PG.MaxLFQ` (with library-based MBR on 1.9.x use `Lib.PG.Q.Value`), then set 0 -> NaN and log2.\n\n```python\nimport numpy as np\nimport pandas as pd\n\nreport = pd.read_parquet('report.parquet')  # report.tsv dropped as default in DIA-NN 2.0\nreport = report[(report['Q.Value'] \u003C= 0.01) & (report['PG.Q.Value'] \u003C= 0.01)\n                & (report['Global.PG.Q.Value'] \u003C= 0.01)]  # run-level AND experiment-wide 1% FDR before quant\n\nmatrix = report.pivot_table(index='Protein.Group', columns='Run', values='PG.MaxLFQ', aggfunc='first')\nmatrix = np.log2(matrix.replace(0, np.nan))  # PG.MaxLFQ can be 0 too; log2(0) = -inf\n```\n\n## Diagnosing the Missingness Contract\n\n**Goal:** Quantify the missing-value pattern so the legitimate imputation class can be chosen downstream.\n\n**Approach:** Count NaN per protein and per sample on a log2 matrix with NaN for missing (zeros left in, or a linear scale, hide the signature). A negative correlation between missingness and mean abundance is the MNAR (left-censored) signature; expect it in DDA and, with fewer missing values, in DIA too.\n\n```python\nimport numpy as np\n\ndef assess_missingness(matrix, sample_cols):\n    miss_per_protein = matrix[sample_cols].isna().sum(axis=1)\n    miss_per_sample = matrix[sample_cols].isna().sum(axis=0)\n    total_pct = 100 * matrix[sample_cols].isna().sum().sum() \u002F matrix[sample_cols].size\n    mean_abund = matrix[sample_cols].mean(axis=1)  # negative corr with missingness => MNAR \u002F left-censored\n    mnar_corr = mean_abund.corr(miss_per_protein)\n    return {'per_protein': miss_per_protein, 'per_sample': miss_per_sample, 'total_pct': total_pct, 'abundance_missing_corr': mnar_corr}\n```\n\n## Per-Method Failure Modes\n\n### MaxQuant wrong quant column\n\n**Trigger:** Reading `Intensity` (raw) or `iBAQ` when between-sample ratios are intended.\n**Mechanism:** `Intensity` is un-normalized summed precursor signal; `iBAQ` is a within-sample molar proxy. Neither is comparable across samples the way `LFQ intensity` is.\n**Symptom:** Ratios track total loaded protein \u002F sample depth rather than biology; fold changes shift when one sample's loading changes.\n**Fix:** Use `LFQ intensity` for cross-sample comparison; if computing custom normalization use `Intensity` and normalize explicitly (expression-matrix\u002Fnormalization).\n\n### Zero treated as a measurement\n\n**Trigger:** `np.log2` applied directly to a MaxQuant matrix still containing 0.\n**Mechanism:** MaxQuant encodes \"not quantified\" as 0; log2(0) = -inf, which then propagates into means and tests.\n**Symptom:** -inf values, NaN means, proteins silently dropped or skewed.\n**Fix:** `replace(0, np.nan)` before any transform; then diagnose missingness.\n\n### Bookkeeping rows survive\n\n**Trigger:** Loading proteinGroups.txt without filtering Reverse \u002F Potential contaminant \u002F Only identified by site.\n**Mechanism:** Decoys exist only for FDR estimation; contaminants are keratin\u002Ftrypsin\u002FBSA, not the sample; site-only groups have no unmodified-peptide quant evidence. `Only identified by site` exists only in proteinGroups.txt.\n**Symptom:** Inflated protein counts; a \"hit\" that is a decoy or keratin.\n**Fix:** Filter all three flag columns; cross-check with `REV__`\u002F`CON__` ID prefixes when joining to peptide tables. Caveat: do not delete CON__ rows blindly if a contaminant (e.g. keratin) is the protein of interest.\n\n### Razor \u002F leading protein-ID ambiguity ignored\n\n**Trigger:** Treating `Protein IDs` or `Gene names` as an atomic single value.\n**Mechanism:** These are semicolon-delimited lists; the first entry is the leading (razor) protein for the group, and `Gene names` can be blank while protein IDs are present.\n**Symptom:** Merges fail, NaN gene labels, ambiguous identity downstream.\n**Fix:** Split on `;` and take the first entry; guard `Gene names` with `.notna()`. Group parsimony details -> protein-inference.\n\n### Stale DIA-NN parsing\n\n**Trigger:** Reading `report.tsv` on DIA-NN 2.0, or pivoting before q-filtering.\n**Mechanism:** 2.0 defaults to (and only defaults to) `report.parquet`; pivoting unfiltered rows includes precursors above 1% FDR.\n**Symptom:** FileNotFoundError on report.tsv; or low-confidence quant inflating the matrix.\n**Fix:** `pd.read_parquet('report.parquet')`; filter `Q.Value \u003C= 0.01 & PG.Q.Value \u003C= 0.01 & Global.PG.Q.Value \u003C= 0.01` before pivoting `PG.MaxLFQ`.\n\n### MNAR imputed as MCAR\n\n**Trigger:** Mean\u002Fmedian\u002FKNN imputation on a DDA or DIA matrix whose diagnostic shows abundance-dependent missingness.\n**Mechanism:** DDA missingness is abundance-dependent (left-censored); MCAR imputers fill missing low values with the central tendency, biasing them upward.\n**Symptom:** Low-abundance proteins gain false high values; spurious differential hits.\n**Fix:** Diagnose the abundance-missingness correlation here and choose the imputer from it, not from the acquisition mode: a negative correlation routes to left-censored imputation (downshifted-Gaussian \u002F QRILC \u002F MinProb) or a censoring-aware model in differential-abundance. DIA's fewer missing values limit the damage but do not make them MCAR.\n\n## Quantitative Thresholds\n\n| Threshold | Source | Rationale |\n|---|---|---|\n| DIA-NN import filter `Q.Value \u003C= 0.01` AND `PG.Q.Value \u003C= 0.01` AND `Global.PG.Q.Value \u003C= 0.01` | Demichev 2020; DIA-NN documentation | Run-level precursor\u002Fprotein and experiment-wide protein-group 1% FDR enforced before any quant value enters a cross-run matrix |\n| Peptide\u002Fprotein FDR 1% (q \u003C= 0.01) | Target-decoy convention | Standard ID confidence at both peptide and protein levels |\n| MaxQuant zero -> NaN | MaxQuant output convention | 0 encodes \"not quantified\"; log2(0) = -inf corrupts every transform |\n| Min peptides per protein for quant >= 2 | Community quant practice | Single-peptide (\"one-hit-wonder\") proteins are ID\u002Fquant-unreliable; not applied by the import code above -- apply it (e.g. `Razor + unique peptides >= 2`) as a documented study choice |\n| Valid-value filter >= 50-70% per group | Modeling choice (document per study) | Caps imputation burden; the exact cutoff is a study decision, not a universal constant |\n| Take FIRST semicolon entry as leading protein\u002Fgene | MaxQuant proteinGroups convention | The leading\u002Frazor protein is the group identifier; trailing entries are shared-peptide members |\n\n## Common Errors\n\n| Error \u002F symptom | Cause | Solution |\n|---|---|---|\n| `-inf` values after log2 | Zeros not converted to NaN (MaxQuant LFQ or DIA-NN PG.MaxLFQ) | `df.replace(0, np.nan)` before `np.log2` |\n| `IndexError: list index out of range` at `getPrecursors()[0]` | All-ion (AIF\u002FMSE) MS2 scan without a precursor | Check `if not spectrum.getPrecursors()` before indexing |\n| `FileNotFoundError: report.tsv` (DIA-NN 2.0) | TSV no longer the default output | `pd.read_parquet('report.parquet')` |\n| `KeyError: 'Only identified by site'` | That column exists ONLY in proteinGroups.txt | Use `df.get('Only identified by site', '')` or guard the column lookup |\n| Mixed-type \u002F DtypeWarning on MaxQuant load | Wide TSV with mixed column types | `pd.read_csv(..., low_memory=False)` |\n| NaN gene labels break a merge | `Gene names` is a semicolon list, sometimes blank | `.where(notna(), '').str.split(';').str[0]` |\n| Ratios track loading not biology | Read `Intensity` (raw) instead of `LFQ intensity` | Use `LFQ intensity` for between-sample comparison |\n| `get_peaks()` unpacking error | Expecting a 2D array | It returns a tuple `(mz, intensity)` of two numpy arrays |\n\n## References\n\n- Cox J, Hein MY, Luber CA, Paron I, Nagaraj N, Mann M. 2014. Accurate proteome-wide label-free quantification by delayed normalization and maximal peptide ratio extraction, termed MaxLFQ. *Mol Cell Proteomics* 13(9):2513-2526.\n- Demichev V, Messner CB, Vernardis SI, Lilley KS, Ralser M. 2020. DIA-NN: neural networks and interference correction enable deep proteome coverage in high throughput. *Nat Methods* 17(1):41-44.\n- Rost HL, Schmitt U, Aebersold R, Malmstrom L. 2014. pyOpenMS: a Python-based interface to the OpenMS mass-spectrometry algorithm library. *Proteomics* 14(1):74-77.\n- Hediyeh-zadeh S, Webb AI, Davis MJ. 2023. MsImpute: estimation of missing peptide intensity data in label-free quantitative mass spectrometry. *Mol Cell Proteomics* 22(8):100558.\n- Chambers MC, Maclean B, Burke R, et al. 2012. A cross-platform toolkit for mass spectrometry and proteomics. *Nat Biotechnol* 30(10):918-920.\n- Hulstaert N, Shofstahl J, Sachsenberg T, et al. 2020. ThermoRawFileParser: modular, scalable, and cross-platform RAW file conversion. *J Proteome Res* 19(1):537-542.\n\n## Related Skills\n\n- peptide-identification - search raw spectra and convert vendor RAW to mzML\n- quantification - compute MaxLFQ and TMT reporter-ion quantities from imported data\n- protein-inference - resolve protein-group parsimony and razor assignment\n- differential-abundance - normalize, impute (per the missingness diagnosis), and test\n- proteomics-qc - assess run-level identification and quant quality\n- dia-analysis - run DIA-NN to produce the report this skill imports\n- expression-matrix\u002Fnormalization - general intensity-matrix normalization patterns\n- workflows\u002Fproteomics-pipeline - end-to-end pipeline that begins with this import step\n",{"name":5,"tool_type":24,"description":7,"primary_tool":25},"mixed","pyOpenMS","main","e0956dc9606356ab78468936b502e55a365282e2","specialists\u002Fmass-spec-proteomics-analyst\u002Fversions\u002F1.0.1\u002Fpackage\u002Fskills\u002Fbio-proteomics-data-import",0,"https:\u002F\u002Fgithub.com\u002Fmrsonord2240\u002Fopenscience-specialists","https:\u002F\u002Fgithub.com\u002Fmrsonord2240","2026-10-12 03:19:04",{"source":8,"skillName":5,"commands":34,"prompt":44,"zipAvailable":45},[35,38,41],{"tool":36,"command":37},"npx","npx skills add mrsonord2240\u002Fopenscience-specialists --skill bio-proteomics-data-import",{"tool":39,"command":40},"bunx","bunx skills add mrsonord2240\u002Fopenscience-specialists --skill bio-proteomics-data-import",{"tool":42,"command":43},"pnpm","pnpm dlx skills add mrsonord2240\u002Fopenscience-specialists --skill bio-proteomics-data-import","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fmrsonord2240\u002Fopenscience-specialists\u002Fblob\u002Fmain\u002Fspecialists\u002Fmass-spec-proteomics-analyst\u002Fversions\u002F1.0.1\u002Fpackage\u002Fskills\u002Fbio-proteomics-data-import\u002FSKILL.md",true,[47,53],{"path":48,"resourceType":49,"resourceTypeDesc":50,"sizeBytes":51,"sourceHtmlUrl":52},"examples\u002Fload_maxquant.py","SCRIPT","脚本",4068,"https:\u002F\u002Fgithub.com\u002Fmrsonord2240\u002Fopenscience-specialists\u002Fblob\u002Fmain\u002Fspecialists\u002Fmass-spec-proteomics-analyst\u002Fversions\u002F1.0.1\u002Fpackage\u002Fskills\u002Fbio-proteomics-data-import\u002Fexamples\u002Fload_maxquant.py",{"path":54,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":57,"sourceHtmlUrl":58},"usage-guide.md","REFERENCE","参考文档",5069,"https:\u002F\u002Fgithub.com\u002Fmrsonord2240\u002Fopenscience-specialists\u002Fblob\u002Fmain\u002Fspecialists\u002Fmass-spec-proteomics-analyst\u002Fversions\u002F1.0.1\u002Fpackage\u002Fskills\u002Fbio-proteomics-data-import\u002Fusage-guide.md",[60,67,74,81,88,95],{"skillNo":61,"name":62,"nameZh":6,"description":63,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":64,"categories":65,"keywords":66,"publishedAt":19},"01M7CW36A6QAGWFE2C008M1XPG","bio-workflows-metabolomics-pipeline","Orchestrates the untargeted LC-MS metabolomics pipeline end-to-end (xcms 4.x feature extraction, QC\u002Fdrift\u002Fnormalization, confidence-stratified annotation, permutation-validated statistics, background-aware pathway mapping), naming what each stage decides and where it silently fails. Use when running a full LC-MS metabolomics study from raw mzML to enriched pathways and needing the honest handoffs between stages. Each stage defers to its component skill for parameters and traps; for stable-isotope flux (a separate branch, not this untargeted flow) see metabolomics\u002Fisotope-tracing.","https:\u002F\u002Fgithub.com\u002Fmrsonord2240\u002Fopenscience-specialists\u002Fblob\u002Fmain\u002Fspecialists\u002Funtargeted-metabolomics-analyst\u002Fversions\u002F1.0.0\u002Fpackage\u002Fskills\u002Fbio-workflows-metabolomics-pipeline\u002FSKILL.md",[],[],{"skillNo":68,"name":69,"nameZh":6,"description":70,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":71,"categories":72,"keywords":73,"publishedAt":19},"01M7CW2Y18623NA2S1Y30FRQW1","bio-metabolomics-xcms-preprocessing","Programmatic untargeted LC-MS feature extraction in R with the modern xcms 4.x MsExperiment\u002FXcmsExperiment API, taking raw mzML to a feature table via CentWave peak detection, retention-time alignment, peak-density correspondence, gap-filling, CAMERA redundancy collapse, and built-in QC feature filtering. Use when converting centroided LC-MS runs into a features-by-samples matrix and deciding centWave\u002Fgrouping\u002Falignment parameters. For drift correction and QC\u002FCV filtering execution see metabolomics\u002Fnormalization-qc; for metabolite identification see metabolomics\u002Fmetabolite-annotation; for the MS-DIAL GUI alternative with MS2Dec deconvolution see metabolomics\u002Fmsdial-preprocessing; for downstream statistics see metabolomics\u002Fstatistical-analysis.","https:\u002F\u002Fgithub.com\u002Fmrsonord2240\u002Fopenscience-specialists\u002Fblob\u002Fmain\u002Fspecialists\u002Funtargeted-metabolomics-analyst\u002Fversions\u002F1.0.0\u002Fpackage\u002Fskills\u002Fbio-metabolomics-xcms-preprocessing\u002FSKILL.md",[],[],{"skillNo":75,"name":76,"nameZh":6,"description":77,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":78,"categories":79,"keywords":80,"publishedAt":19},"01M7CW2M364HVWPNQEKE2WP4PP","bio-metabolomics-statistical-analysis","Decision-grade statistical analysis for metabolomics intensity tables. Covers transformation and scaling (Pareto vs unit-variance as a hidden hypothesis), unsupervised structure (PCA\u002FHCA for QC), permutation-validated PLS-DA\u002FOPLS-DA (R2 vs Q2, double CV, VIP as heuristic), univariate testing (Welch\u002FMann-Whitney\u002FANOVA\u002FLMM with covariate adjustment), and dependence-aware multiple testing. Use when testing which metabolites differ, building or validating a discriminant model, choosing a scaling, or correcting many correlated tests. For sample-wise normalization\u002Fdrift correction see metabolomics\u002Fnormalization-qc; for ML classifiers and selection-inside-CV leakage see machine-learning\u002Fbiomarker-discovery and machine-learning\u002Fmodel-validation; for pathway interpretation see metabolomics\u002Fpathway-mapping; for design\u002Fpower\u002Fmultiplicity regime see experimental-design\u002Fmultiple-testing.","https:\u002F\u002Fgithub.com\u002Fmrsonord2240\u002Fopenscience-specialists\u002Fblob\u002Fmain\u002Fspecialists\u002Funtargeted-metabolomics-analyst\u002Fversions\u002F1.0.0\u002Fpackage\u002Fskills\u002Fbio-metabolomics-statistical-analysis\u002FSKILL.md",[],[],{"skillNo":82,"name":83,"nameZh":6,"description":84,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":85,"categories":86,"keywords":87,"publishedAt":19},"01M7CW2BCBF851WYE03Z8XPEDQ","bio-metabolomics-pathway-mapping","Maps metabolomics results to biological pathways via over-representation (ORA), metabolite-set enrichment (MSEA\u002FQEA), mummichog\u002FPSEA on raw m\u002Fz peaks, and network-diffusion enrichment (FELLA), with correct background-set construction and honest interpretive ceilings. Use when interpreting differential metabolites or an untargeted LC-MS feature table in pathway context, choosing ORA vs MSEA vs mummichog vs topology, or setting the reference\u002Fbackground set. For annotation confidence levels feeding ORA see metabolomics\u002Fmetabolite-annotation; for gene-set concepts see pathway-analysis\u002Fgo-enrichment and pathway-analysis\u002Fgsea; for joint gene+metabolite pathways see multi-omics-integration\u002Fmofa-integration.","https:\u002F\u002Fgithub.com\u002Fmrsonord2240\u002Fopenscience-specialists\u002Fblob\u002Fmain\u002Fspecialists\u002Funtargeted-metabolomics-analyst\u002Fversions\u002F1.0.0\u002Fpackage\u002Fskills\u002Fbio-metabolomics-pathway-mapping\u002FSKILL.md",[],[],{"skillNo":89,"name":90,"nameZh":6,"description":91,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":92,"categories":93,"keywords":94,"publishedAt":19},"01M7CW21NSZMCPMF7D9CHJM718","bio-metabolomics-normalization-qc","Designs QC, corrects signal drift, removes batch effects, filters features, normalizes samples, and imputes missing values for untargeted LC-MS\u002FGC-MS metabolomics, framing each step as a measurement model that can create or erase biological signal. Use when processing a peak\u002Ffeature table before statistical analysis, choosing a drift-correction or sample-normalization method, deciding QC RSD vs D-ratio filtering, or handling left-censored missing values. The feature table is produced by metabolomics\u002Fxcms-preprocessing or metabolomics\u002Fmsdial-preprocessing; transformation\u002Fscaling for modeling defers to metabolomics\u002Fstatistical-analysis; cross-study design issues link to experimental-design\u002Fbatch-design.","https:\u002F\u002Fgithub.com\u002Fmrsonord2240\u002Fopenscience-specialists\u002Fblob\u002Fmain\u002Fspecialists\u002Funtargeted-metabolomics-analyst\u002Fversions\u002F1.0.0\u002Fpackage\u002Fskills\u002Fbio-metabolomics-normalization-qc\u002FSKILL.md",[],[],{"skillNo":96,"name":97,"nameZh":6,"description":98,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":99,"categories":100,"keywords":101,"publishedAt":19},"01M7CW1SWVM0NYHVE6Q7MA3G7R","bio-metabolomics-msdial-preprocessing","Runs the MS-DIAL preprocessing workflow (peak picking, MS2Dec spectral deconvolution, alignment, gap-filling) and imports the alignment-result table into R or Python with honest filtering. Use when preprocessing LC-MS DDA\u002FDIA (SWATH) or GC-MS raw data with MS-DIAL, deciding MS-DIAL vs XCMS, configuring the MSDIALCUI console run, or parsing an MS-DIAL export into a clean feature matrix. For programmatic R peak detection and the feature-table-as-artifact framing see metabolomics\u002Fxcms-preprocessing; for lipid annotation mode see metabolomics\u002Flipidomics; for MSI-level confidence honesty see metabolomics\u002Fmetabolite-annotation; for drift correction and QC see metabolomics\u002Fnormalization-qc.","https:\u002F\u002Fgithub.com\u002Fmrsonord2240\u002Fopenscience-specialists\u002Fblob\u002Fmain\u002Fspecialists\u002Funtargeted-metabolomics-analyst\u002Fversions\u002F1.0.0\u002Fpackage\u002Fskills\u002Fbio-metabolomics-msdial-preprocessing\u002FSKILL.md",[],[]]