[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7ASWPVHX209NPFVTSN4MK8X":3,"skill-same:01M7ASWPVHX209NPFVTSN4MK8X":93},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":29,"commitSha":30,"skillDirectory":31,"forksCount":14,"repositoryHtmlUrl":32,"repositoryHomepageUrl":6,"ownerHtmlUrl":33,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":34,"install":35,"resources":48},"01M7ASWPVHX209NPFVTSN4MK8X","pytdc",null,"Use Therapeutics Data Commons through the PyTDC Python package for registry discovery, approved dataset access, task-aware splits, evaluator metrics, benchmark groups, and bounded molecular-oracle workflows.","nikhilesh-s\u002Fclaude-toolkit","nikhilesh-s","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F123913414?v=4","01M7ARX6NXB6DFY1CCP91599KE","Nikhilesh Suravarjjala","01M7ARX6PFTQKR6ME1K2S4AZ9K",0,"MIT","https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fpytdc\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: pytdc\ndescription: Use Therapeutics Data Commons through the PyTDC Python package for registry discovery, approved dataset access, task-aware splits, evaluator metrics, benchmark groups, and bounded molecular-oracle workflows.\nlicense: MIT\nallowed-tools: Read Write Edit Bash\ncompatibility: Requires uv, CPython 3.11, PyTDC 1.1.15, and setuptools 80.9.0 for its legacy pkg_resources runtime import. Dataset, benchmark, checkpoint, and remote-oracle operations require network\u002Fstorage review and explicit user approval.\nmetadata:\n  version: \"1.1\"\n  skill-author: K-Dense Inc.\n---\n\n# PyTDC (Therapeutics Data Commons)\n\nUse the official `PyTDC` distribution (`import tdc`) to discover therapeutic ML\ntasks, load approved datasets, apply task-appropriate splits, evaluate predictions,\nand work with curated benchmark groups. Prefer package metadata over copied dataset\nlists, and plan network\u002Fstorage effects before constructing any loader.\n\n## Verified snapshot\n\n- Research date: **2026-07-23**\n- PyPI stable: **PyTDC 1.1.15**, released 2025-03-31\n- Package\u002Fsource repository: `mims-harvard\u002FTDC`\n- Code license: MIT\n- PyPI supplies only a source distribution and declares no `Requires-Python`\n- The dependency graph makes **CPython 3.11** the reproducible target used here:\n  `cellxgene-census==1.15.0` excludes Python 3.12, and PyTDC's constrained\n  RDKit release has no CPython 3.13 wheel\n- PyTDC imports deprecated `pkg_resources` at runtime. Setuptools 82 removed that\n  module; pin the verified compatibility release **setuptools 80.9.0**.\n- `tdc.readthedocs.io` still identifies itself as TDC 0.4.1; use it as API\n  cross-reference, not as release-version evidence\n- Upstream publishes no GitHub tags\u002Freleases or maintained changelog. Treat\n  undocumented migration claims as uncertainty and verify against the installed\n  1.1.15 source\u002Fmetadata.\n\nSee [references\u002Fsources.md](references\u002Fsources.md) for dated evidence and known\ndocumentation conflicts.\n\n## Installation\n\nUse an isolated CPython 3.11 environment and pin the reviewed snapshot:\n\n```bash\nuv venv --python 3.11 .venv-pytdc\nuv pip install --dry-run --python .venv-pytdc\u002Fbin\u002Fpython \\\n  \"setuptools==80.9.0\" \"PyTDC==1.1.15\"\nuv pip install --python .venv-pytdc\u002Fbin\u002Fpython \\\n  \"setuptools==80.9.0\" \"PyTDC==1.1.15\"\n```\n\nThe tested macOS ARM64 resolution installed 123 packages, including large\nscientific\u002FML dependencies, so the environment itself can transfer and occupy\nhundreds of megabytes before any dataset is downloaded. Review the dry run and\navailable disk first. The direct pins identify the reviewed API snapshot; generate\na platform-specific `uv.lock` in the user's project when every transitive version\nmust also be frozen.\n\nFor an ephemeral command:\n\n```bash\nuv run --python 3.11 \\\n  --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fdiscover_metadata.py --kind tasks\n```\n\nTo check for a newer release, inspect the PyPI release history at\n\u003Chttps:\u002F\u002Fpypi.org\u002Fproject\u002Fpytdc\u002F>. Before changing the pin, compare its source\ndistribution, dependencies, official repository, task registries, and smoke tests;\ndo not silently substitute the separate `pytdc-nextml` package.\n\n## Non-negotiable data and network policy\n\n1. **Discover first.** Reading `tdc.metadata` or using\n   `scripts\u002Fdiscover_metadata.py` does not instantiate a loader or download data.\n2. **Plan second.** Record the exact task\u002Fdataset, official task page, license,\n   expected size, cache directory, split, metric, and reproducibility seed.\n3. **Ask the user before downloading.** Loader constructors fetch missing data.\n   Some datasets and benchmark-group archives are large; model-backed oracles can\n   fetch checkpoints; remote\u002Fdocking oracles can transmit molecular structures.\n4. **Execute only after approval.** In bundled CLIs, `--execute` acknowledges\n   execution and `--download` is additionally required for MolGen corpora or\n   supported oracle checkpoints.\n5. **Keep outputs bounded.** Emit counts, schema, and small previews rather than\n   full datasets, sequences, prediction arrays, or molecule corpora.\n\n### Cache and cost behavior\n\n- Ordinary loaders default to `path=\".\u002Fdata\"` and save files beneath that path.\n  The bundled scripts instead default to explicit `.pytdc-*` directories.\n- Core downloads use Harvard Dataverse file endpoints when a local filename is\n  absent. Newer resource classes may use other upstream services.\n- `admet_group(path=...)` and other benchmark-group constructors download and\n  extract the group archive when `\u003Cpath>\u002F\u003Cgroup>` is absent.\n- Download-backed `Oracle(...)` construction uses `.\u002Foracle` internally. The\n  bundled oracle CLI changes into a safe runtime directory before approved calls.\n- PyTDC 1.1.15 does not provide a universal cache quota, eviction policy, or\n  dataset-wide checksum manifest. Use `scripts\u002Fcache_audit.py` and manage disk\n  retention explicitly.\n- Network transfer, local storage, decompression, parsing, feature generation,\n  docking, and external service calls can all incur time or monetary cost.\n\nThe PyTDC **code** is MIT. Dataset\u002Ftask licenses are heterogeneous: official task\npages include per-dataset terms ranging from Creative Commons licenses to\nnon-commercial restrictions or “Not Specified.” Verify the exact dataset's page and\noriginal source terms before download, redistribution, publication, or commercial\nuse. Cite both TDC and the original dataset.\n\n## Start with metadata-only discovery\n\nFrom this skill directory:\n\n```bash\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fdiscover_metadata.py --kind datasets --task ADME --limit 50\n\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fdiscover_metadata.py --kind benchmarks --limit 50\n\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fdiscover_metadata.py --kind evaluators --limit 100\n```\n\nThe package API is also metadata-only:\n\n```python\nfrom tdc.utils import retrieve_dataset_names, retrieve_benchmark_names\n\nadme_names = retrieve_dataset_names(\"ADME\")\nadmet_benchmarks = retrieve_benchmark_names(\"admet_group\")\n```\n\nUse exact returned names. PyTDC performs fuzzy matching internally, but explicit\nmatching avoids silently selecting the wrong dataset\u002Foracle.\n\n## Dataset workflow\n\nPlan a split without downloading:\n\n```bash\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fload_and_split_data.py \\\n  --task ADME --dataset Caco2_Wang --method scaffold \\\n  --seed 42 --data-dir .pytdc-data\n```\n\nAfter the user approves the dataset, license, transfer, and storage:\n\n```bash\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fload_and_split_data.py \\\n  --task ADME --dataset Caco2_Wang --method scaffold \\\n  --seed 42 --data-dir .pytdc-data --execute\n```\n\nVerified public import patterns include:\n\n```python\nfrom tdc.single_pred import ADME, Tox\nfrom tdc.multi_pred import DDI, DTI\nfrom tdc.generation import MolGen, Reaction, RetroSyn\n```\n\nConstructors perform data access, so do not run them before approval:\n\n```python\ndata = ADME(name=\"Caco2_Wang\", path=\".pytdc-data\")\nframe = data.get_data(format=\"df\")\nsplit = data.get_split(\n    method=\"scaffold\",\n    seed=42,\n    frac=[0.7, 0.1, 0.2],\n)\n# split keys are: train, valid, test\n```\n\nRead [references\u002Fdatasets.md](references\u002Fdatasets.md) before choosing a task or\ndataset.\n\n## Split selection without overclaiming leakage control\n\n- `random`: default for loaders; default seed 42 and fractions 0.7\u002F0.1\u002F0.2.\n- `scaffold`: documented generic support for molecule-based ADME, Tox, and HTS.\n  PyTDC groups RDKit Bemis–Murcko scaffold strings (chirality disabled), but that\n  does **not** prove absence of analog, duplicate, label, temporal, or provenance\n  leakage.\n- `cold_split`: multi-instance API. Pass exact dataframe columns, for example\n  `method=\"cold_split\", column_name=[\"Drug\", \"Target\"]`. Multi-column splitting can\n  discard cross-partition rows and need not preserve requested row fractions.\n- `combination`: built-in DrugSyn combination split.\n- `time`: pair-loader API requiring `time_column`; the verified built-in case is\n  `BindingDB_Patent` with its `Year` column. The API spelling is `time`, not\n  `temporal`.\n\nDo not use undocumented `cold_drug_target`, `temporal`, or `stratified=True`\nexamples. For every split, record PyTDC version, parameters, row counts, and exact\nentity overlap audits. PyTDC 1.1.15's random splitter uses the supplied seed for\ntest sampling but a fixed `random_state=1` for validation sampling; do not describe\nall partitions as independently varying with the seed.\n\nDetailed semantics and caveats are in\n[references\u002Futilities.md](references\u002Futilities.md).\n\n## Evaluators\n\nUse exact names from the installed evaluator registry:\n\n```python\nfrom tdc import Evaluator\n\nmae = Evaluator(name=\"MAE\")(y_true, y_pred)\nauroc = Evaluator(name=\"ROC-AUC\")(y_true_binary, predicted_scores)\npcc = Evaluator(name=\"PCC\")(y_true, y_pred)\n```\n\n`PCC` is the registered Pearson-correlation name; `Pearson` is not. Multi-class\nregistry names are `micro-f1`, `macro-f1`, and `kappa`. Thresholded binary metrics\ndefault to 0.5. Metric direction and input shape are metric-specific; use the\nofficial task\u002Fbenchmark metric rather than choosing from task type alone.\n\n## Benchmark groups\n\nUse specialized classes. Top-level `from tdc import BenchmarkGroup` is retained\nonly as a deprecated compatibility path in 1.1.15.\n\n```python\nfrom tdc.benchmark_group import admet_group\n\n# Run only after approval: construction may download the group archive.\ngroup = admet_group(path=\".pytdc-benchmarks\")\nbenchmark = group.get(\"Caco2_Wang\")\ntrain_val = benchmark[\"train_val\"]\ntest = benchmark[\"test\"]\ntrain, valid = group.get_train_valid_split(\n    seed=1,\n    benchmark=benchmark[\"name\"],\n    split_type=\"default\",\n)\n```\n\nFor one run, `group.evaluate({name: test_predictions})` returns metric results.\nFor leaderboard aggregation, pass a **list of at least five prediction\ndictionaries** to `group.evaluate_many(...)`. Do not index `group.get(...)` by\nseed, and do not derive dummy predictions from test labels.\n\nUse `scripts\u002Fbenchmark_evaluation.py` to validate a bounded JSON prediction plan\nbefore any group download. See [references\u002Futilities.md](references\u002Futilities.md)\nfor the exact JSON shape and API behavior.\n\n## Molecular generation and oracles\n\nPyTDC supplies molecule corpora, evaluators, and oracles; it does not train or\nprovide a generic molecule generator in the core workflow. Discover current names:\n\n```bash\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fdiscover_metadata.py --kind oracles --limit 100\n```\n\nPlan bounded local QED scoring:\n\n```bash\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fmolecular_generation.py score --oracle QED --smiles CCO\n```\n\nAdd `--execute` only after review. LogP and SA call the downloadable `fpscores`\nartifact in 1.1.15; they and DRD2\u002FGSK3B\u002FJNK3\u002FCYP3A4_Veith also require\n`--download`. The helper intentionally refuses remote services, docking,\ndistribution, and composite oracles. It preserves input order and never assumes\nscore direction.\n\nRead [references\u002Foracles.md](references\u002Foracles.md) before any oracle call.\n\n## Bundled resources\n\n### Scripts\n\n- `scripts\u002Fdiscover_metadata.py` — download-free package registry discovery\n- `scripts\u002Fload_and_split_data.py` — task-aware split plan\u002Fexplicit execution\n- `scripts\u002Fbenchmark_evaluation.py` — prediction validation and explicit evaluation\n- `scripts\u002Fmolecular_generation.py` — bounded local\u002Fcheckpoint scoring and MolGen plan\n- `scripts\u002Fcache_audit.py` — read-only bounded cache manifest\n\nEvery CLI uses lazy optional imports, safe relative output\u002Fcache paths, JSON\nsummaries, bounded output, and no implicit dataset\u002Fmodel download.\n\n### References\n\n- [references\u002Fdatasets.md](references\u002Fdatasets.md) — task discovery, data access,\n  cache behavior, and licensing\n- [references\u002Futilities.md](references\u002Futilities.md) — splits, evaluators, and\n  benchmark-group APIs\n- [references\u002Foracles.md](references\u002Foracles.md) — oracle categories, side effects,\n  and safe execution\n- [references\u002Fsources.md](references\u002Fsources.md) — dated authoritative sources and\n  unresolved upstream gaps\n","# PyTDC (Therapeutics Data Commons)\n\nUse the official `PyTDC` distribution (`import tdc`) to discover therapeutic ML\ntasks, load approved datasets, apply task-appropriate splits, evaluate predictions,\nand work with curated benchmark groups. Prefer package metadata over copied dataset\nlists, and plan network\u002Fstorage effects before constructing any loader.\n\n## Verified snapshot\n\n- Research date: **2026-07-23**\n- PyPI stable: **PyTDC 1.1.15**, released 2025-03-31\n- Package\u002Fsource repository: `mims-harvard\u002FTDC`\n- Code license: MIT\n- PyPI supplies only a source distribution and declares no `Requires-Python`\n- The dependency graph makes **CPython 3.11** the reproducible target used here:\n  `cellxgene-census==1.15.0` excludes Python 3.12, and PyTDC's constrained\n  RDKit release has no CPython 3.13 wheel\n- PyTDC imports deprecated `pkg_resources` at runtime. Setuptools 82 removed that\n  module; pin the verified compatibility release **setuptools 80.9.0**.\n- `tdc.readthedocs.io` still identifies itself as TDC 0.4.1; use it as API\n  cross-reference, not as release-version evidence\n- Upstream publishes no GitHub tags\u002Freleases or maintained changelog. Treat\n  undocumented migration claims as uncertainty and verify against the installed\n  1.1.15 source\u002Fmetadata.\n\nSee [references\u002Fsources.md](references\u002Fsources.md) for dated evidence and known\ndocumentation conflicts.\n\n## Installation\n\nUse an isolated CPython 3.11 environment and pin the reviewed snapshot:\n\n```bash\nuv venv --python 3.11 .venv-pytdc\nuv pip install --dry-run --python .venv-pytdc\u002Fbin\u002Fpython \\\n  \"setuptools==80.9.0\" \"PyTDC==1.1.15\"\nuv pip install --python .venv-pytdc\u002Fbin\u002Fpython \\\n  \"setuptools==80.9.0\" \"PyTDC==1.1.15\"\n```\n\nThe tested macOS ARM64 resolution installed 123 packages, including large\nscientific\u002FML dependencies, so the environment itself can transfer and occupy\nhundreds of megabytes before any dataset is downloaded. Review the dry run and\navailable disk first. The direct pins identify the reviewed API snapshot; generate\na platform-specific `uv.lock` in the user's project when every transitive version\nmust also be frozen.\n\nFor an ephemeral command:\n\n```bash\nuv run --python 3.11 \\\n  --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fdiscover_metadata.py --kind tasks\n```\n\nTo check for a newer release, inspect the PyPI release history at\n\u003Chttps:\u002F\u002Fpypi.org\u002Fproject\u002Fpytdc\u002F>. Before changing the pin, compare its source\ndistribution, dependencies, official repository, task registries, and smoke tests;\ndo not silently substitute the separate `pytdc-nextml` package.\n\n## Non-negotiable data and network policy\n\n1. **Discover first.** Reading `tdc.metadata` or using\n   `scripts\u002Fdiscover_metadata.py` does not instantiate a loader or download data.\n2. **Plan second.** Record the exact task\u002Fdataset, official task page, license,\n   expected size, cache directory, split, metric, and reproducibility seed.\n3. **Ask the user before downloading.** Loader constructors fetch missing data.\n   Some datasets and benchmark-group archives are large; model-backed oracles can\n   fetch checkpoints; remote\u002Fdocking oracles can transmit molecular structures.\n4. **Execute only after approval.** In bundled CLIs, `--execute` acknowledges\n   execution and `--download` is additionally required for MolGen corpora or\n   supported oracle checkpoints.\n5. **Keep outputs bounded.** Emit counts, schema, and small previews rather than\n   full datasets, sequences, prediction arrays, or molecule corpora.\n\n### Cache and cost behavior\n\n- Ordinary loaders default to `path=\".\u002Fdata\"` and save files beneath that path.\n  The bundled scripts instead default to explicit `.pytdc-*` directories.\n- Core downloads use Harvard Dataverse file endpoints when a local filename is\n  absent. Newer resource classes may use other upstream services.\n- `admet_group(path=...)` and other benchmark-group constructors download and\n  extract the group archive when `\u003Cpath>\u002F\u003Cgroup>` is absent.\n- Download-backed `Oracle(...)` construction uses `.\u002Foracle` internally. The\n  bundled oracle CLI changes into a safe runtime directory before approved calls.\n- PyTDC 1.1.15 does not provide a universal cache quota, eviction policy, or\n  dataset-wide checksum manifest. Use `scripts\u002Fcache_audit.py` and manage disk\n  retention explicitly.\n- Network transfer, local storage, decompression, parsing, feature generation,\n  docking, and external service calls can all incur time or monetary cost.\n\nThe PyTDC **code** is MIT. Dataset\u002Ftask licenses are heterogeneous: official task\npages include per-dataset terms ranging from Creative Commons licenses to\nnon-commercial restrictions or “Not Specified.” Verify the exact dataset's page and\noriginal source terms before download, redistribution, publication, or commercial\nuse. Cite both TDC and the original dataset.\n\n## Start with metadata-only discovery\n\nFrom this skill directory:\n\n```bash\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fdiscover_metadata.py --kind datasets --task ADME --limit 50\n\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fdiscover_metadata.py --kind benchmarks --limit 50\n\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fdiscover_metadata.py --kind evaluators --limit 100\n```\n\nThe package API is also metadata-only:\n\n```python\nfrom tdc.utils import retrieve_dataset_names, retrieve_benchmark_names\n\nadme_names = retrieve_dataset_names(\"ADME\")\nadmet_benchmarks = retrieve_benchmark_names(\"admet_group\")\n```\n\nUse exact returned names. PyTDC performs fuzzy matching internally, but explicit\nmatching avoids silently selecting the wrong dataset\u002Foracle.\n\n## Dataset workflow\n\nPlan a split without downloading:\n\n```bash\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fload_and_split_data.py \\\n  --task ADME --dataset Caco2_Wang --method scaffold \\\n  --seed 42 --data-dir .pytdc-data\n```\n\nAfter the user approves the dataset, license, transfer, and storage:\n\n```bash\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fload_and_split_data.py \\\n  --task ADME --dataset Caco2_Wang --method scaffold \\\n  --seed 42 --data-dir .pytdc-data --execute\n```\n\nVerified public import patterns include:\n\n```python\nfrom tdc.single_pred import ADME, Tox\nfrom tdc.multi_pred import DDI, DTI\nfrom tdc.generation import MolGen, Reaction, RetroSyn\n```\n\nConstructors perform data access, so do not run them before approval:\n\n```python\ndata = ADME(name=\"Caco2_Wang\", path=\".pytdc-data\")\nframe = data.get_data(format=\"df\")\nsplit = data.get_split(\n    method=\"scaffold\",\n    seed=42,\n    frac=[0.7, 0.1, 0.2],\n)\n# split keys are: train, valid, test\n```\n\nRead [references\u002Fdatasets.md](references\u002Fdatasets.md) before choosing a task or\ndataset.\n\n## Split selection without overclaiming leakage control\n\n- `random`: default for loaders; default seed 42 and fractions 0.7\u002F0.1\u002F0.2.\n- `scaffold`: documented generic support for molecule-based ADME, Tox, and HTS.\n  PyTDC groups RDKit Bemis–Murcko scaffold strings (chirality disabled), but that\n  does **not** prove absence of analog, duplicate, label, temporal, or provenance\n  leakage.\n- `cold_split`: multi-instance API. Pass exact dataframe columns, for example\n  `method=\"cold_split\", column_name=[\"Drug\", \"Target\"]`. Multi-column splitting can\n  discard cross-partition rows and need not preserve requested row fractions.\n- `combination`: built-in DrugSyn combination split.\n- `time`: pair-loader API requiring `time_column`; the verified built-in case is\n  `BindingDB_Patent` with its `Year` column. The API spelling is `time`, not\n  `temporal`.\n\nDo not use undocumented `cold_drug_target`, `temporal`, or `stratified=True`\nexamples. For every split, record PyTDC version, parameters, row counts, and exact\nentity overlap audits. PyTDC 1.1.15's random splitter uses the supplied seed for\ntest sampling but a fixed `random_state=1` for validation sampling; do not describe\nall partitions as independently varying with the seed.\n\nDetailed semantics and caveats are in\n[references\u002Futilities.md](references\u002Futilities.md).\n\n## Evaluators\n\nUse exact names from the installed evaluator registry:\n\n```python\nfrom tdc import Evaluator\n\nmae = Evaluator(name=\"MAE\")(y_true, y_pred)\nauroc = Evaluator(name=\"ROC-AUC\")(y_true_binary, predicted_scores)\npcc = Evaluator(name=\"PCC\")(y_true, y_pred)\n```\n\n`PCC` is the registered Pearson-correlation name; `Pearson` is not. Multi-class\nregistry names are `micro-f1`, `macro-f1`, and `kappa`. Thresholded binary metrics\ndefault to 0.5. Metric direction and input shape are metric-specific; use the\nofficial task\u002Fbenchmark metric rather than choosing from task type alone.\n\n## Benchmark groups\n\nUse specialized classes. Top-level `from tdc import BenchmarkGroup` is retained\nonly as a deprecated compatibility path in 1.1.15.\n\n```python\nfrom tdc.benchmark_group import admet_group\n\n# Run only after approval: construction may download the group archive.\ngroup = admet_group(path=\".pytdc-benchmarks\")\nbenchmark = group.get(\"Caco2_Wang\")\ntrain_val = benchmark[\"train_val\"]\ntest = benchmark[\"test\"]\ntrain, valid = group.get_train_valid_split(\n    seed=1,\n    benchmark=benchmark[\"name\"],\n    split_type=\"default\",\n)\n```\n\nFor one run, `group.evaluate({name: test_predictions})` returns metric results.\nFor leaderboard aggregation, pass a **list of at least five prediction\ndictionaries** to `group.evaluate_many(...)`. Do not index `group.get(...)` by\nseed, and do not derive dummy predictions from test labels.\n\nUse `scripts\u002Fbenchmark_evaluation.py` to validate a bounded JSON prediction plan\nbefore any group download. See [references\u002Futilities.md](references\u002Futilities.md)\nfor the exact JSON shape and API behavior.\n\n## Molecular generation and oracles\n\nPyTDC supplies molecule corpora, evaluators, and oracles; it does not train or\nprovide a generic molecule generator in the core workflow. Discover current names:\n\n```bash\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fdiscover_metadata.py --kind oracles --limit 100\n```\n\nPlan bounded local QED scoring:\n\n```bash\nuv run --python 3.11 --with \"setuptools==80.9.0\" --with \"PyTDC==1.1.15\" \\\n  python scripts\u002Fmolecular_generation.py score --oracle QED --smiles CCO\n```\n\nAdd `--execute` only after review. LogP and SA call the downloadable `fpscores`\nartifact in 1.1.15; they and DRD2\u002FGSK3B\u002FJNK3\u002FCYP3A4_Veith also require\n`--download`. The helper intentionally refuses remote services, docking,\ndistribution, and composite oracles. It preserves input order and never assumes\nscore direction.\n\nRead [references\u002Foracles.md](references\u002Foracles.md) before any oracle call.\n\n## Bundled resources\n\n### Scripts\n\n- `scripts\u002Fdiscover_metadata.py` — download-free package registry discovery\n- `scripts\u002Fload_and_split_data.py` — task-aware split plan\u002Fexplicit execution\n- `scripts\u002Fbenchmark_evaluation.py` — prediction validation and explicit evaluation\n- `scripts\u002Fmolecular_generation.py` — bounded local\u002Fcheckpoint scoring and MolGen plan\n- `scripts\u002Fcache_audit.py` — read-only bounded cache manifest\n\nEvery CLI uses lazy optional imports, safe relative output\u002Fcache paths, JSON\nsummaries, bounded output, and no implicit dataset\u002Fmodel download.\n\n### References\n\n- [references\u002Fdatasets.md](references\u002Fdatasets.md) — task discovery, data access,\n  cache behavior, and licensing\n- [references\u002Futilities.md](references\u002Futilities.md) — splits, evaluators, and\n  benchmark-group APIs\n- [references\u002Foracles.md](references\u002Foracles.md) — oracle categories, side effects,\n  and safe execution\n- [references\u002Fsources.md](references\u002Fsources.md) — dated authoritative sources and\n  unresolved upstream gaps\n",{"name":5,"license":15,"metadata":24,"description":7,"allowed-tools":27,"compatibility":28},{"version":25,"skill-author":26},"1.1","K-Dense Inc.","Read Write Edit Bash","Requires uv, CPython 3.11, PyTDC 1.1.15, and setuptools 80.9.0 for its legacy pkg_resources runtime import. Dataset, benchmark, checkpoint, and remote-oracle operations require network\u002Fstorage review and explicit user approval.","nik-claude-toolkit","4feaa2876384b593d9e30d9190bc56985eeeeb8e","skills\u002Fpytdc","https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit","https:\u002F\u002Fgithub.com\u002Fnikhilesh-s","2026-10-22 14:30:58",{"source":8,"skillName":5,"commands":36,"prompt":46,"zipAvailable":47},[37,40,43],{"tool":38,"command":39},"npx","npx skills add nikhilesh-s\u002Fclaude-toolkit --skill pytdc",{"tool":41,"command":42},"bunx","bunx skills add nikhilesh-s\u002Fclaude-toolkit --skill pytdc",{"tool":44,"command":45},"pnpm","pnpm dlx skills add nikhilesh-s\u002Fclaude-toolkit --skill pytdc","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fpytdc\u002FSKILL.md",true,[49,55,59,63,67,73,77,81,85,89],{"path":50,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":53,"sourceHtmlUrl":54},"references\u002Fdatasets.md","REFERENCE","参考文档",7991,"https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fpytdc\u002Freferences\u002Fdatasets.md",{"path":56,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":57,"sourceHtmlUrl":58},"references\u002Foracles.md",9564,"https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fpytdc\u002Freferences\u002Foracles.md",{"path":60,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":61,"sourceHtmlUrl":62},"references\u002Fsources.md",10184,"https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fpytdc\u002Freferences\u002Fsources.md",{"path":64,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":65,"sourceHtmlUrl":66},"references\u002Futilities.md",11877,"https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fpytdc\u002Freferences\u002Futilities.md",{"path":68,"resourceType":69,"resourceTypeDesc":70,"sizeBytes":71,"sourceHtmlUrl":72},"scripts\u002F_common.py","SCRIPT","脚本",7346,"https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fpytdc\u002Fscripts\u002F_common.py",{"path":74,"resourceType":69,"resourceTypeDesc":70,"sizeBytes":75,"sourceHtmlUrl":76},"scripts\u002Fbenchmark_evaluation.py",12498,"https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fpytdc\u002Fscripts\u002Fbenchmark_evaluation.py",{"path":78,"resourceType":69,"resourceTypeDesc":70,"sizeBytes":79,"sourceHtmlUrl":80},"scripts\u002Fcache_audit.py",4574,"https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fpytdc\u002Fscripts\u002Fcache_audit.py",{"path":82,"resourceType":69,"resourceTypeDesc":70,"sizeBytes":83,"sourceHtmlUrl":84},"scripts\u002Fdiscover_metadata.py",5066,"https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fpytdc\u002Fscripts\u002Fdiscover_metadata.py",{"path":86,"resourceType":69,"resourceTypeDesc":70,"sizeBytes":87,"sourceHtmlUrl":88},"scripts\u002Fload_and_split_data.py",12594,"https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fpytdc\u002Fscripts\u002Fload_and_split_data.py",{"path":90,"resourceType":69,"resourceTypeDesc":70,"sizeBytes":91,"sourceHtmlUrl":92},"scripts\u002Fmolecular_generation.py",13619,"https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fpytdc\u002Fscripts\u002Fmolecular_generation.py",[94,101,109,116,123,130],{"skillNo":95,"name":96,"nameZh":6,"description":97,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":98,"categories":99,"keywords":100,"publishedAt":19},"01M7AT8339CZMCRMRZP6G1R329","zarr-python","Chunked N-D arrays for cloud storage (Zarr-Python 3). Compressed arrays, parallel I\u002FO, S3\u002FGCS via fsspec, NumPy\u002FDask\u002FXarray compatible, for large-scale scientific computing pipelines.","https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fzarr-python\u002FSKILL.md",[],[],{"skillNo":102,"name":103,"nameZh":6,"description":104,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":105,"sourceHtmlUrl":106,"categories":107,"keywords":108,"publishedAt":19},"01M7AT77E7JPH96ETQBNDVVYDM","video-use","Edit any video by conversation. Transcribe, cut, color grade, generate overlay animations, burn subtitles — for talking heads, montages, tutorials, travel, interviews. No presets, no menus. Ask questions, confirm the plan, execute, iterate, persist. Production-correctness rules are hard; everything else is artistic freedom.","https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fvideo-use\u002FLICENSE","https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fvideo-use\u002FSKILL.md",[],[],{"skillNo":110,"name":111,"nameZh":6,"description":112,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":113,"categories":114,"keywords":115,"publishedAt":19},"01M7AT6YVX000D73Q40SBPZYKP","venue-templates","Prepare journal manuscripts, conference papers, research posters, and grant documents using venue-specific formatting guidance and bundled LaTeX scaffolds. Use when selecting an official template, checking current page or anonymity rules, adapting academic writing to a venue, or inspecting a submission PDF.","https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fvenue-templates\u002FSKILL.md",[],[],{"skillNo":117,"name":118,"nameZh":6,"description":119,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":120,"categories":121,"keywords":122,"publishedAt":19},"01M7AT6SGGBENKX1G6V8V9G2MJ","vaex","Use this skill for processing and analyzing large tabular datasets (billions of rows) that exceed available RAM. Vaex excels at out-of-core DataFrame operations, lazy evaluation, fast aggregations, efficient visualization of big data, and machine learning on large datasets. Apply when users need to work with large CSV\u002FHDF5\u002FArrow\u002FParquet files, perform fast statistics on massive datasets, create visualizations of big data, or build ML pipelines that do not fit in memory.","https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fvaex\u002FSKILL.md",[],[],{"skillNo":124,"name":125,"nameZh":6,"description":126,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":127,"categories":128,"keywords":129,"publishedAt":19},"01M7AT6HHDJ54MR4HDPFHJYR7G","usfiscaldata","Query the U.S. Treasury Fiscal Data REST API for federal financial data. No API key required. Use for national debt (Debt to the Penny), Daily Treasury Statements, Monthly Treasury Statements, Treasury securities auctions, interest rates, foreign exchange rates, savings bonds, or U.S. government revenue and spending statistics.","https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Fusfiscaldata\u002FSKILL.md",[],[],{"skillNo":131,"name":132,"nameZh":6,"description":133,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":134,"categories":135,"keywords":136,"publishedAt":19},"01M7AT662JFE4THBVAZBB3ANJD","uncertainty-and-units","Track physical units and propagate measurement uncertainty in scientific calculations using pint and uncertainties. Use for unit conversion and dimensional checking, GUM uncertainty budgets, Type A and Type B evaluation, coverage factors and expanded uncertainty, Monte Carlo propagation, significant-figure and plus-minus reporting, error propagation through curve fits, CODATA constants, auditing Python code for stripped units or broken uncertainty propagation, and order-of-magnitude plausibility checks using dimensionless groups (Reynolds, Peclet, Damkohler, Knudsen, Biot, Womersley), characteristic scales such as diffusion time or Debye length, and observed magnitude ranges. Trigger on \"is this number physically reasonable\", \"sanity check these units\", \"what regime is this flow in\", or a result that looks off by orders of magnitude.","https:\u002F\u002Fgithub.com\u002Fnikhilesh-s\u002Fclaude-toolkit\u002Fblob\u002Fnik-claude-toolkit\u002Fskills\u002Funcertainty-and-units\u002FSKILL.md",[],[]]