fg-data-profiling
Guides fg-data-profiling data profiling, report generation, configuration, CLI, comparison, privacy, and optional Spark/notebook integration workflows.
- License 许可
- MIT
- 最近更新
- 2026-10-08
- Stars
- ★ 11
- Forks
- 3
01 前言 Front Matter
- name
- fg-data-profiling
- license
- MIT
- metadata
- { "disco-role": "operating" }
- description
- Guides fg-data-profiling data profiling, report generation, configuration, CLI, comparison, privacy, and optional Spark/notebook integration workflows.
- disable-model-invocation
- true
02 资源文件 5
- 参考文档references/development-and-maintenance.md3.3 KB
- 参考文档references/package-overview.md4.0 KB
- 参考文档references/repo-provenance.md2.8 KB
- 参考文档references/repo-routing-metadata.json347 B
- 参考文档references/troubleshooting.md4.1 KB
03 SKILL.md 正文
fg-data-profiling
Use this repo skill when a task involves the fg-data-profiling Python package
or its public import data_profiling: exploratory data analysis reports,
data-quality profiling, HTML/JSON export, command-line report generation,
comparison reports, sensitive-data-safe reports, configuration, or optional
Spark/notebook integrations.
Do not use this skill as proof that the original repository checkout is present. All runnable helpers and operational references needed by future agents are bundled in this skill tree.
Install and import check
For normal package usage, install the public distribution and import the current module name:
python -m pip install -U fg-data-profiling
python - <<'PY'
import data_profiling
from data_profiling import ProfileReport, compare
print(data_profiling.__version__)
print(ProfileReport)
print(compare)
PY
The repository also exposes a deprecated compatibility import named
ydata_profiling and a legacy CLI name pandas_profiling; prefer the
data_profiling import and data_profiling CLI for new work.
Run scripts/check_environment.py when you need a safe package/import/CLI diagnostic before deciding which sub-skill to read. Read references/repo-provenance.md before refreshing this skill or comparing it with a new checkout.
Route by task
- Read sub-skills/profiling-workflows/SKILL.md
for core pandas
ProfileReportusage,df.profile_report(), HTML/JSON/notebook output calls, time-series mode, type schemas, supported file shapes, and a tiny report-generation smoke helper. - Read sub-skills/cli-and-automation/SKILL.md
for
data_profiling/pandas_profilingcommand-line usage, supported input extensions, parser flags, default output naming, and automation in DAGs or IDE tasks. - Read sub-skills/configuration-and-output/SKILL.md
for
Settings, YAML config files,PROFILE_environment variables, minimal/explorative section controls, HTML assets/themes, cache invalidation, and serialization. - Read sub-skills/comparison-and-quality/SKILL.md for comparing profile reports, sensitive-data redaction, custom samples, dataset metadata, data dictionaries, type schema, quality output access, and Great Expectations caveats.
- Read sub-skills/integrations-and-backends/SKILL.md for optional Spark, notebook widgets, Bytewax/streaming snapshots, interactive app embedding, other DataFrame libraries, PyCharm integration, optional dependencies, and backend readiness checks.
Shared references
- references/package-overview.md summarizes package identity, primary APIs, extras, migration naming, and capability boundaries shared across sub-skills.
- references/troubleshooting.md covers cross-cutting install/import, optional dependency, data, rendering, and stale version issues.
- references/development-and-maintenance.md is for maintainers editing or testing a checkout; package users usually do not need it.
- references/repo-routing-metadata.json stores structured scenario metadata for future managed repo-skill imports.
High-value entry points
from data_profiling import ProfileReport, compareProfileReport(df, minimal=True, progress_bar=False).to_file("report.html")df.profile_report(...)after importingdata_profilingdata_profiling --minimal --silent data.csv report.htmlprofile.to_json(),profile.to_html(),profile.get_description()profile_a.compare(profile_b)orcompare([profile_a, profile_b])
Backend and optional dependency honesty
The verified core scope is CPU/Pandas package usage. Spark support is a first-class optional workflow, but it requires Java plus PySpark and was not verified in the production environment used to create this skill. Notebook widgets require the notebook extra and active widget support. Great Expectations support remains in source APIs, but the public docs state that current versions no longer support that integration; treat it as a legacy/compatibility surface unless the user pins compatible versions.
Default response pattern
- Identify whether the user wants API, CLI, configuration, comparison/privacy, or optional integration guidance.
- Read the matching sub-skill and its nearest references/scripts.
- Prefer tiny local fixtures and bundled helpers for validation before running expensive profiles on real data.
- Avoid source-checkout dependencies: do not tell the user to open or run repository examples, docs, or tests unless they explicitly ask to maintain a repo checkout.
- Preserve privacy: for sensitive datasets, route to
comparison-and-qualitybefore suggesting samples, duplicates, or numeric treatment of identifiers.
04 同仓库更多 Skills
obsidian-clipper-template-creator
Guide for creating templates for the Obsidian Web Clipper. Use when you want to create a new clipping template, understand available variables, or format clipped content.
obsidian-clipper-template-creator
Guide for creating templates for the Obsidian Web Clipper. Use when you want to create a new clipping template, understand available variables, or format clipped content.
python-api
Programmatic Object-Detection-Metrics API guidance for BoundingBox, BoundingBoxes, Evaluator, enums, coordinate conversion, AP/mAP semantics, and source-style import diagnostics.
file-evaluation
Folder-based PASCAL VOC AP/mAP evaluation from ground-truth and detection text files.
object-detection-metrics
Guides legacy Object-Detection-Metrics PASCAL VOC AP/mAP evaluation from detection text folders and direct Python API classes.
nx-workspace-patterns
Configure and optimize Nx monorepo workspaces. Use when setting up Nx, configuring project boundaries, optimizing build caching, or implementing affected commands.