[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6FXNV4G2H2F0ZJ8KTDF8XPC":3,"skill-same:01M6FXNV4G2H2F0ZJ8KTDF8XPC":97},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":15,"categories":16,"keywords":17,"publishedAt":36,"linkOnly":37,"markdownContent":38,"markdownBody":39,"frontMatter":40,"refName":48,"commitSha":49,"skillDirectory":50,"forksCount":51,"repositoryHtmlUrl":52,"repositoryHomepageUrl":6,"ownerHtmlUrl":53,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":54,"install":55,"resources":68},"01M6FXNV4G2H2F0ZJ8KTDF8XPC","file-deduplicator",null,"Find and remove duplicate files intelligently. Save storage space, keep your system clean. Perfect for digital hoarders and document management.","kbarbel640-del\u002Fskills","kbarbel640-del","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F255315490?v=4","01M6CJPPQGCCESXMG3K7BBGQ5J","01M6CJPPX2PB2BCZERFVM2C2B3",1,"MIT","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fmichael-laffin\u002Ffile-deduplicator\u002FSKILL.md",[],[18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35],"file deduplicator","file","management","keep","duplicate","file-management","clean","document","files","remove","storage","find","system","save","disk","Tools","deduplication","cleanup","2026-11-10 10:12:30",false,"---\nname: file-deduplicator\ndescription: Find and remove duplicate files intelligently. Save storage space, keep your system clean. Perfect for digital hoarders and document management.\nmetadata:\n  {\n    \"openclaw\":\n      {\n        \"version\": \"1.0.0\",\n        \"author\": \"Vernox\",\n        \"license\": \"MIT\",\n        \"tags\": [\"deduplication\", \"storage\", \"cleanup\", \"file-management\", \"duplicate\", \"disk-space\"],\n        \"category\": \"tools\"\n      }\n  }\n---\n\n# File-Deduplicator - Find and Remove Duplicates\n\n**Vernox Utility Skill - Clean up your digital hoard.**\n\n## Overview\n\nFile-Deduplicator is an intelligent file duplicate finder and remover. Uses content hashing to identify identical files across directories, then provides options to remove duplicates safely.\n\n## Features\n\n### ✅ Duplicate Detection\n- Content-based hashing (MD5) for fast comparison\n- Size-based detection (exact match, near match)\n- Name-based detection (similar filenames)\n- Directory scanning (recursive)\n- Exclude patterns (.git, node_modules, etc.)\n\n### ✅ Removal Options\n- Auto-delete duplicates (keep newest\u002Foldest)\n- Interactive review before deletion\n- Move to archive instead of delete\n- Preserve permissions and metadata\n- Dry-run mode (preview changes)\n\n### ✅ Analysis Tools\n- Duplicate count summary\n- Space savings estimation\n- Largest duplicate files\n- Most common duplicate patterns\n- Detailed report generation\n\n### ✅ Safety Features\n- Confirmation prompts before deletion\n- Backup to archive folder\n- Size threshold (don't remove huge files by mistake)\n- Whitelist important directories\n- Undo functionality (log for recovery)\n\n## Installation\n\n```bash\nclawhub install file-deduplicator\n```\n\n## Quick Start\n\n### Find Duplicates in Directory\n\n```javascript\nconst result = await findDuplicates({\n  directories: ['.\u002Fdocuments', '.\u002Fdownloads', '.\u002Fprojects'],\n  options: {\n    method: 'content',  \u002F\u002F content-based comparison\n    includeSubdirs: true\n  }\n});\n\nconsole.log(`Found ${result.duplicateCount} duplicate groups`);\nconsole.log(`Potential space savings: ${result.spaceSaved}`);\n```\n\n### Remove Duplicates Automatically\n\n```javascript\nconst result = await removeDuplicates({\n  directories: ['.\u002Fdocuments', '.\u002Fdownloads'],\n  options: {\n    method: 'content',\n    keep: 'newest',  \u002F\u002F keep newest, delete oldest\n    action: 'delete',  \u002F\u002F or 'move' to archive\n    autoConfirm: false  \u002F\u002F show confirmation for each\n  }\n});\n\nconsole.log(`Removed ${result.filesRemoved} duplicates`);\nconsole.log(`Space saved: ${result.spaceSaved}`);\n```\n\n### Dry-Run Preview\n\n```javascript\nconst result = await removeDuplicates({\n  directories: ['.\u002Fdocuments', '.\u002Fdownloads'],\n  options: {\n    method: 'content',\n    keep: 'newest',\n    action: 'delete',\n    dryRun: true  \u002F\u002F Preview without actual deletion\n  }\n});\n\nconsole.log('Would remove:');\nresult.duplicates.forEach((dup, i) => {\n  console.log(`${i+1}. ${dup.file}`);\n});\n```\n\n## Tool Functions\n\n### `findDuplicates`\nFind duplicate files across directories.\n\n**Parameters:**\n- `directories` (array|string, required): Directory paths to scan\n- `options` (object, optional):\n  - `method` (string): 'content' | 'size' | 'name' - comparison method\n  - `includeSubdirs` (boolean): Scan recursively (default: true)\n  - `minSize` (number): Minimum size in bytes (default: 0)\n  - `maxSize` (number): Maximum size in bytes (default: 0)\n  - `excludePatterns` (array): Glob patterns to exclude (default: ['.git', 'node_modules'])\n  - `whitelist` (array): Directories to never scan (default: [])\n\n**Returns:**\n- `duplicates` (array): Array of duplicate groups\n  - `duplicateCount` (number): Number of duplicate groups found\n  - `totalFiles` (number): Total files scanned\n  - `scanDuration` (number): Time taken to scan (ms)\n  - `spaceWasted` (number): Total bytes wasted by duplicates\n  - `spaceSaved` (number): Potential savings if duplicates removed\n\n### `removeDuplicates`\nRemove duplicate files based on findings.\n\n**Parameters:**\n- `directories` (array|string, required): Same as findDuplicates\n- `options` (object, optional):\n  - `keep` (string): 'newest' | 'oldest' | 'smallest' | 'largest' - which to keep\n  - `action` (string): 'delete' | 'move' | 'archive'\n  - `archivePath` (string): Where to move files when action='move'\n  - `dryRun` (boolean): Preview without actual action\n  - `autoConfirm` (boolean): Auto-confirm deletions\n  - `sizeThreshold` (number): Don't remove files larger than this\n\n**Returns:**\n- `filesRemoved` (number): Number of files removed\u002Fmoved\n- `spaceSaved` (number): Bytes saved\n- `groupsProcessed` (number): Number of duplicate groups handled\n- `logPath` (string): Path to action log\n- `errors` (array): Any errors encountered\n\n### `analyzeDirectory`\nAnalyze a single directory for duplicates.\n\n**Parameters:**\n- `directory` (string, required): Path to directory\n- `options` (object, optional): Same as findDuplicates options\n\n**Returns:**\n- `fileCount` (number): Total files in directory\n- `totalSize` (number): Total bytes in directory\n- `duplicateSize` (number): Bytes in duplicate files\n- `duplicateRatio` (number): Percentage of files that are duplicates\n\n## Use Cases\n\n### Digital Hoarder Cleanup\n- Find duplicate photos\u002Fvideos\n- Identify wasted storage space\n- Remove old duplicates, keep newest\n- Clean up download folders\n\n### Document Management\n- Find duplicate PDFs, docs, reports\n- Keep latest version, archive old versions\n- Prevent version confusion\n- Reduce backup bloat\n\n### Project Cleanup\n- Find duplicate source files\n- Remove duplicate build artifacts\n- Clean up node_modules duplicates\n- Save storage on SSD\u002FHDD\n\n### Backup Optimization\n- Find duplicate backup files\n- Remove redundant backups\n- Identify what's actually duplicated\n- Save space on backup drives\n\n## Configuration\n\n### Edit `config.json`:\n```json\n{\n  \"detection\": {\n    \"defaultMethod\": \"content\",\n    \"sizeTolerancePercent\": 0,  \u002F\u002F exact match only\n    \"nameSimilarity\": 0.7,  \u002F\u002F 0-1, lower = more similar\n    \"includeSubdirs\": true\n  },\n  \"removal\": {\n    \"defaultAction\": \"delete\",\n    \"defaultKeep\": \"newest\",\n    \"archivePath\": \".\u002Farchive\",\n    \"sizeThreshold\": 10485760,  \u002F\u002F 10MB threshold\n    \"autoConfirm\": false,\n    \"dryRunDefault\": false\n  },\n  \"exclude\": {\n    \"patterns\": [\".git\", \"node_modules\", \".vscode\", \".idea\"],\n    \"whitelist\": [\"important\", \"work\", \"projects\"]\n  }\n}\n```\n\n## Methods\n\n### Content-Based (Recommended)\n- Fast MD5 hashing\n- Detects exact duplicates regardless of filename\n- Works across renamed files\n- Perfect for documents, code, archives\n\n### Size-Based\n- Compares file sizes\n- Faster than content hashing\n- Good for media files where content hashing is slow\n- Finds near-duplicates (similar but not exact)\n\n### Name-Based\n- Compares filenames\n- Detects similar named files\n- Good for finding version duplicates (file_v1, file_v2)\n\n## Examples\n\n### Find Duplicates in Documents\n```javascript\nconst result = await findDuplicates({\n  directories: '~\u002FDocuments',\n  options: {\n    method: 'content',\n    includeSubdirs: true\n  }\n});\n\nconsole.log(`Found ${result.duplicateCount} duplicate sets`);\nresult.duplicates.slice(0, 5).forEach((set, i) => {\n  console.log(`Set ${i+1}: ${set.files.length} files`);\n  console.log(`  Total size: ${set.totalSize} bytes`);\n});\n```\n\n### Remove Duplicates, Keep Newest\n```javascript\nconst result = await removeDuplicates({\n  directories: '~\u002FDocuments',\n  options: {\n    keep: 'newest',\n    action: 'delete'\n  }\n});\n\nconsole.log(`Removed ${result.filesRemoved} files`);\nconsole.log(`Saved ${result.spaceSaved} bytes`);\n```\n\n### Move to Archive Instead of Delete\n```javascript\nconst result = await removeDuplicates({\n  directories: '~\u002FDownloads',\n  options: {\n    keep: 'newest',\n    action: 'move',\n    archivePath: '~\u002FDocuments\u002FArchive'\n  }\n});\n\nconsole.log(`Archived ${result.filesRemoved} files`);\nconsole.log(`Safe in: ~\u002FDocuments\u002FArchive`);\n```\n\n### Dry-Run Preview Changes\n```javascript\nconst result = await removeDuplicates({\n  directories: '~\u002FDocuments',\n  options: {\n    dryRun: true  \u002F\u002F Just show what would happen\n  }\n});\n\nconsole.log('=== Dry Run Preview ===');\nresult.duplicates.forEach((set, i) => {\n  console.log(`Would delete: ${set.toDelete.join(', ')}`);\n});\n```\n\n## Performance\n\n### Scanning Speed\n- **Small directories** (\u003C1000 files): \u003C1s\n- **Medium directories** (1000-10000 files): 1-5s\n- **Large directories** (10000+ files): 5-20s\n\n### Detection Accuracy\n- **Content-based:** 100% (exact duplicates)\n- **Size-based:** Fast but may miss renamed files\n- **Name-based:** Detects naming patterns only\n\n### Memory Usage\n- **Hash cache:** ~1MB per 100,000 files\n- **Batch processing:** Processes 1000 files at a time\n- **Peak memory:** ~200MB for 1M files\n\n## Safety Features\n\n### Size Thresholding\nWon't remove files larger than configurable threshold (default: 10MB). Prevents accidental deletion of important large files.\n\n### Archive Mode\nMove files to archive directory instead of deleting. No data loss, full recoverability.\n\n### Action Logging\nAll deletions\u002Fmoves are logged to file for recovery and audit.\n\n### Undo Functionality\nLog file can be used to restore accidentally deleted files (limited undo window).\n\n## Error Handling\n\n### Permission Errors\n- Clear error message\n- Suggest running with sudo\n- Skip files that can't be accessed\n\n### File Lock Errors\n- Detect locked files\n- Skip and report\n- Suggest closing applications using files\n\n### Space Errors\n- Check available disk space before deletion\n- Warn if space is critically low\n- Prevent disk-full scenarios\n\n## Troubleshooting\n\n### Not Finding Expected Duplicates\n- Check detection method (content vs size vs name)\n- Verify exclude patterns aren't too broad\n- Check if files are in whitelisted directories\n- Try with includeSubdirs: false\n\n### Deletion Not Working\n- Check write permissions on directories\n- Verify action isn't 'delete' with autoConfirm: true\n- Check size threshold isn't blocking all deletions\n- Check file locks (is another program using files?)\n\n### Slow Scanning\n- Reduce includeSubdirs scope\n- Use size-based detection (faster)\n- Exclude large directories (node_modules, .git)\n- Process directories individually instead of batch\n\n## Tips\n\n### Best Results\n- Use content-based detection for documents (100% accurate)\n- Run dry-run first to preview changes\n- Archive instead of delete for important files\n- Check logs if anything unexpected deleted\n\n### Performance Optimization\n- Process frequently used directories first\n- Use size threshold to skip large media files\n- Exclude hidden directories from scan\n- Process directories in parallel when possible\n\n### Space Management\n- Regular duplicate cleanup prevents storage bloat\n- Delete temp directories regularly\n- Clear download folders of installers\n- Empty trash before large scans\n\n## Roadmap\n\n- [ ] Duplicate detection by image similarity\n- [ ] Near-duplicate detection (similar but not exact)\n- [ ] Duplicate detection across network drives\n- [ ] Cloud storage integration (S3, Google Drive)\n- [ ] Automatic scheduling of scans\n- [ ] Heuristic duplicate detection (ML-based)\n- [ ] Recover deleted files from backup\n- [ ] Duplicate detection by file content similarity (not just hash)\n\n## License\n\nMIT\n\n---\n\n**Find duplicates. Save space. Keep your system clean.** ?\n","# File-Deduplicator - Find and Remove Duplicates\n\n**Vernox Utility Skill - Clean up your digital hoard.**\n\n## Overview\n\nFile-Deduplicator is an intelligent file duplicate finder and remover. Uses content hashing to identify identical files across directories, then provides options to remove duplicates safely.\n\n## Features\n\n### ✅ Duplicate Detection\n- Content-based hashing (MD5) for fast comparison\n- Size-based detection (exact match, near match)\n- Name-based detection (similar filenames)\n- Directory scanning (recursive)\n- Exclude patterns (.git, node_modules, etc.)\n\n### ✅ Removal Options\n- Auto-delete duplicates (keep newest\u002Foldest)\n- Interactive review before deletion\n- Move to archive instead of delete\n- Preserve permissions and metadata\n- Dry-run mode (preview changes)\n\n### ✅ Analysis Tools\n- Duplicate count summary\n- Space savings estimation\n- Largest duplicate files\n- Most common duplicate patterns\n- Detailed report generation\n\n### ✅ Safety Features\n- Confirmation prompts before deletion\n- Backup to archive folder\n- Size threshold (don't remove huge files by mistake)\n- Whitelist important directories\n- Undo functionality (log for recovery)\n\n## Installation\n\n```bash\nclawhub install file-deduplicator\n```\n\n## Quick Start\n\n### Find Duplicates in Directory\n\n```javascript\nconst result = await findDuplicates({\n  directories: ['.\u002Fdocuments', '.\u002Fdownloads', '.\u002Fprojects'],\n  options: {\n    method: 'content',  \u002F\u002F content-based comparison\n    includeSubdirs: true\n  }\n});\n\nconsole.log(`Found ${result.duplicateCount} duplicate groups`);\nconsole.log(`Potential space savings: ${result.spaceSaved}`);\n```\n\n### Remove Duplicates Automatically\n\n```javascript\nconst result = await removeDuplicates({\n  directories: ['.\u002Fdocuments', '.\u002Fdownloads'],\n  options: {\n    method: 'content',\n    keep: 'newest',  \u002F\u002F keep newest, delete oldest\n    action: 'delete',  \u002F\u002F or 'move' to archive\n    autoConfirm: false  \u002F\u002F show confirmation for each\n  }\n});\n\nconsole.log(`Removed ${result.filesRemoved} duplicates`);\nconsole.log(`Space saved: ${result.spaceSaved}`);\n```\n\n### Dry-Run Preview\n\n```javascript\nconst result = await removeDuplicates({\n  directories: ['.\u002Fdocuments', '.\u002Fdownloads'],\n  options: {\n    method: 'content',\n    keep: 'newest',\n    action: 'delete',\n    dryRun: true  \u002F\u002F Preview without actual deletion\n  }\n});\n\nconsole.log('Would remove:');\nresult.duplicates.forEach((dup, i) => {\n  console.log(`${i+1}. ${dup.file}`);\n});\n```\n\n## Tool Functions\n\n### `findDuplicates`\nFind duplicate files across directories.\n\n**Parameters:**\n- `directories` (array|string, required): Directory paths to scan\n- `options` (object, optional):\n  - `method` (string): 'content' | 'size' | 'name' - comparison method\n  - `includeSubdirs` (boolean): Scan recursively (default: true)\n  - `minSize` (number): Minimum size in bytes (default: 0)\n  - `maxSize` (number): Maximum size in bytes (default: 0)\n  - `excludePatterns` (array): Glob patterns to exclude (default: ['.git', 'node_modules'])\n  - `whitelist` (array): Directories to never scan (default: [])\n\n**Returns:**\n- `duplicates` (array): Array of duplicate groups\n  - `duplicateCount` (number): Number of duplicate groups found\n  - `totalFiles` (number): Total files scanned\n  - `scanDuration` (number): Time taken to scan (ms)\n  - `spaceWasted` (number): Total bytes wasted by duplicates\n  - `spaceSaved` (number): Potential savings if duplicates removed\n\n### `removeDuplicates`\nRemove duplicate files based on findings.\n\n**Parameters:**\n- `directories` (array|string, required): Same as findDuplicates\n- `options` (object, optional):\n  - `keep` (string): 'newest' | 'oldest' | 'smallest' | 'largest' - which to keep\n  - `action` (string): 'delete' | 'move' | 'archive'\n  - `archivePath` (string): Where to move files when action='move'\n  - `dryRun` (boolean): Preview without actual action\n  - `autoConfirm` (boolean): Auto-confirm deletions\n  - `sizeThreshold` (number): Don't remove files larger than this\n\n**Returns:**\n- `filesRemoved` (number): Number of files removed\u002Fmoved\n- `spaceSaved` (number): Bytes saved\n- `groupsProcessed` (number): Number of duplicate groups handled\n- `logPath` (string): Path to action log\n- `errors` (array): Any errors encountered\n\n### `analyzeDirectory`\nAnalyze a single directory for duplicates.\n\n**Parameters:**\n- `directory` (string, required): Path to directory\n- `options` (object, optional): Same as findDuplicates options\n\n**Returns:**\n- `fileCount` (number): Total files in directory\n- `totalSize` (number): Total bytes in directory\n- `duplicateSize` (number): Bytes in duplicate files\n- `duplicateRatio` (number): Percentage of files that are duplicates\n\n## Use Cases\n\n### Digital Hoarder Cleanup\n- Find duplicate photos\u002Fvideos\n- Identify wasted storage space\n- Remove old duplicates, keep newest\n- Clean up download folders\n\n### Document Management\n- Find duplicate PDFs, docs, reports\n- Keep latest version, archive old versions\n- Prevent version confusion\n- Reduce backup bloat\n\n### Project Cleanup\n- Find duplicate source files\n- Remove duplicate build artifacts\n- Clean up node_modules duplicates\n- Save storage on SSD\u002FHDD\n\n### Backup Optimization\n- Find duplicate backup files\n- Remove redundant backups\n- Identify what's actually duplicated\n- Save space on backup drives\n\n## Configuration\n\n### Edit `config.json`:\n```json\n{\n  \"detection\": {\n    \"defaultMethod\": \"content\",\n    \"sizeTolerancePercent\": 0,  \u002F\u002F exact match only\n    \"nameSimilarity\": 0.7,  \u002F\u002F 0-1, lower = more similar\n    \"includeSubdirs\": true\n  },\n  \"removal\": {\n    \"defaultAction\": \"delete\",\n    \"defaultKeep\": \"newest\",\n    \"archivePath\": \".\u002Farchive\",\n    \"sizeThreshold\": 10485760,  \u002F\u002F 10MB threshold\n    \"autoConfirm\": false,\n    \"dryRunDefault\": false\n  },\n  \"exclude\": {\n    \"patterns\": [\".git\", \"node_modules\", \".vscode\", \".idea\"],\n    \"whitelist\": [\"important\", \"work\", \"projects\"]\n  }\n}\n```\n\n## Methods\n\n### Content-Based (Recommended)\n- Fast MD5 hashing\n- Detects exact duplicates regardless of filename\n- Works across renamed files\n- Perfect for documents, code, archives\n\n### Size-Based\n- Compares file sizes\n- Faster than content hashing\n- Good for media files where content hashing is slow\n- Finds near-duplicates (similar but not exact)\n\n### Name-Based\n- Compares filenames\n- Detects similar named files\n- Good for finding version duplicates (file_v1, file_v2)\n\n## Examples\n\n### Find Duplicates in Documents\n```javascript\nconst result = await findDuplicates({\n  directories: '~\u002FDocuments',\n  options: {\n    method: 'content',\n    includeSubdirs: true\n  }\n});\n\nconsole.log(`Found ${result.duplicateCount} duplicate sets`);\nresult.duplicates.slice(0, 5).forEach((set, i) => {\n  console.log(`Set ${i+1}: ${set.files.length} files`);\n  console.log(`  Total size: ${set.totalSize} bytes`);\n});\n```\n\n### Remove Duplicates, Keep Newest\n```javascript\nconst result = await removeDuplicates({\n  directories: '~\u002FDocuments',\n  options: {\n    keep: 'newest',\n    action: 'delete'\n  }\n});\n\nconsole.log(`Removed ${result.filesRemoved} files`);\nconsole.log(`Saved ${result.spaceSaved} bytes`);\n```\n\n### Move to Archive Instead of Delete\n```javascript\nconst result = await removeDuplicates({\n  directories: '~\u002FDownloads',\n  options: {\n    keep: 'newest',\n    action: 'move',\n    archivePath: '~\u002FDocuments\u002FArchive'\n  }\n});\n\nconsole.log(`Archived ${result.filesRemoved} files`);\nconsole.log(`Safe in: ~\u002FDocuments\u002FArchive`);\n```\n\n### Dry-Run Preview Changes\n```javascript\nconst result = await removeDuplicates({\n  directories: '~\u002FDocuments',\n  options: {\n    dryRun: true  \u002F\u002F Just show what would happen\n  }\n});\n\nconsole.log('=== Dry Run Preview ===');\nresult.duplicates.forEach((set, i) => {\n  console.log(`Would delete: ${set.toDelete.join(', ')}`);\n});\n```\n\n## Performance\n\n### Scanning Speed\n- **Small directories** (\u003C1000 files): \u003C1s\n- **Medium directories** (1000-10000 files): 1-5s\n- **Large directories** (10000+ files): 5-20s\n\n### Detection Accuracy\n- **Content-based:** 100% (exact duplicates)\n- **Size-based:** Fast but may miss renamed files\n- **Name-based:** Detects naming patterns only\n\n### Memory Usage\n- **Hash cache:** ~1MB per 100,000 files\n- **Batch processing:** Processes 1000 files at a time\n- **Peak memory:** ~200MB for 1M files\n\n## Safety Features\n\n### Size Thresholding\nWon't remove files larger than configurable threshold (default: 10MB). Prevents accidental deletion of important large files.\n\n### Archive Mode\nMove files to archive directory instead of deleting. No data loss, full recoverability.\n\n### Action Logging\nAll deletions\u002Fmoves are logged to file for recovery and audit.\n\n### Undo Functionality\nLog file can be used to restore accidentally deleted files (limited undo window).\n\n## Error Handling\n\n### Permission Errors\n- Clear error message\n- Suggest running with sudo\n- Skip files that can't be accessed\n\n### File Lock Errors\n- Detect locked files\n- Skip and report\n- Suggest closing applications using files\n\n### Space Errors\n- Check available disk space before deletion\n- Warn if space is critically low\n- Prevent disk-full scenarios\n\n## Troubleshooting\n\n### Not Finding Expected Duplicates\n- Check detection method (content vs size vs name)\n- Verify exclude patterns aren't too broad\n- Check if files are in whitelisted directories\n- Try with includeSubdirs: false\n\n### Deletion Not Working\n- Check write permissions on directories\n- Verify action isn't 'delete' with autoConfirm: true\n- Check size threshold isn't blocking all deletions\n- Check file locks (is another program using files?)\n\n### Slow Scanning\n- Reduce includeSubdirs scope\n- Use size-based detection (faster)\n- Exclude large directories (node_modules, .git)\n- Process directories individually instead of batch\n\n## Tips\n\n### Best Results\n- Use content-based detection for documents (100% accurate)\n- Run dry-run first to preview changes\n- Archive instead of delete for important files\n- Check logs if anything unexpected deleted\n\n### Performance Optimization\n- Process frequently used directories first\n- Use size threshold to skip large media files\n- Exclude hidden directories from scan\n- Process directories in parallel when possible\n\n### Space Management\n- Regular duplicate cleanup prevents storage bloat\n- Delete temp directories regularly\n- Clear download folders of installers\n- Empty trash before large scans\n\n## Roadmap\n\n- [ ] Duplicate detection by image similarity\n- [ ] Near-duplicate detection (similar but not exact)\n- [ ] Duplicate detection across network drives\n- [ ] Cloud storage integration (S3, Google Drive)\n- [ ] Automatic scheduling of scans\n- [ ] Heuristic duplicate detection (ML-based)\n- [ ] Recover deleted files from backup\n- [ ] Duplicate detection by file content similarity (not just hash)\n\n## License\n\nMIT\n\n---\n\n**Find duplicates. Save space. Keep your system clean.** ?\n",{"name":5,"metadata":41,"description":7},{"openclaw":42},{"tags":43,"author":45,"license":14,"version":46,"category":47},[34,28,35,23,22,44],"disk-space","Vernox","1.0.0","tools","main","e7e336ac628c3e3bd771aff1aaa469c93778f94a","skills\u002Fmichael-laffin\u002Ffile-deduplicator",0,"https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del","2026-08-23 22:39:37",{"source":8,"skillName":5,"commands":56,"prompt":66,"zipAvailable":67},[57,60,63],{"tool":58,"command":59},"npx","npx skills add kbarbel640-del\u002Fskills --skill file-deduplicator",{"tool":61,"command":62},"bunx","bunx skills add kbarbel640-del\u002Fskills --skill file-deduplicator",{"tool":64,"command":65},"pnpm","pnpm dlx skills add kbarbel640-del\u002Fskills --skill file-deduplicator","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fmichael-laffin\u002Ffile-deduplicator\u002FSKILL.md",true,[69,75,79,85,89,93],{"path":70,"resourceType":71,"resourceTypeDesc":72,"sizeBytes":73,"sourceHtmlUrl":74},"_meta.json","REFERENCE","参考文档",294,"https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fmichael-laffin\u002Ffile-deduplicator\u002F_meta.json",{"path":76,"resourceType":71,"resourceTypeDesc":72,"sizeBytes":77,"sourceHtmlUrl":78},"config.json",726,"https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fmichael-laffin\u002Ffile-deduplicator\u002Fconfig.json",{"path":80,"resourceType":81,"resourceTypeDesc":82,"sizeBytes":83,"sourceHtmlUrl":84},"index.js","SCRIPT","脚本",17911,"https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fmichael-laffin\u002Ffile-deduplicator\u002Findex.js",{"path":86,"resourceType":71,"resourceTypeDesc":72,"sizeBytes":87,"sourceHtmlUrl":88},"package.json",407,"https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fmichael-laffin\u002Ffile-deduplicator\u002Fpackage.json",{"path":90,"resourceType":71,"resourceTypeDesc":72,"sizeBytes":91,"sourceHtmlUrl":92},"README.md",6721,"https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fmichael-laffin\u002Ffile-deduplicator\u002FREADME.md",{"path":94,"resourceType":81,"resourceTypeDesc":82,"sizeBytes":95,"sourceHtmlUrl":96},"test.js",2528,"https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fmichael-laffin\u002Ffile-deduplicator\u002Ftest.js",[98,128,157,178,184,204],{"skillNo":99,"name":100,"nameZh":6,"description":101,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":102,"categories":103,"keywords":109,"publishedAt":36},"01M6G8J55967D6281ACMKAKTEQ","crowd-prompting","A marketplace where AI agents improve prompts, system instructions, tool descriptions, and other text-based content with domain expertise from real-world operations — and earn tokens for valuable contributions.","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fzzadrian\u002Fcrowd-prompting\u002FSKILL.md",[104],{"categoryNo":105,"categoryName":106,"taxonomyType":107,"taxonomyTypeDesc":108},"01JBSEEDCAT000000000000036","内容创作者","PROFESSION","适用职业",[110,111,112,113,114,115,116,117,118,119,120,121,30,122,123,124,125,126,127],"crowd prompting","prompting","api","with","tokens","domain","world","prompts","operations","instructions","text","tool","improve","productivity","marketplace","https","content","ai agents",{"skillNo":129,"name":130,"nameZh":6,"description":131,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":132,"categories":133,"keywords":139,"publishedAt":36},"01M6G8J0PKPAYVET6BWE8W4C26","dilemm-ai","Compete in DilemmAI, the prisoner's dilemma AI arena at dilemm.ai. Use when an OpenClaw agent wants to create an account, design and submit strategy prompts for their bot, enter matchmaking, analyze historical matches and leaderboards, and iterate on bot strategy. Requires headless browser automation (no API available yet).","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fzyori\u002Fdilemm-ai\u002FSKILL.md",[134],{"categoryNo":135,"categoryName":136,"taxonomyType":137,"taxonomyTypeDesc":138},"01JBSEEDCAT000000000000023","Skill与智能体开发","SCENARIO","使用场景",[140,112,141,142,143,144,145,146,147,148,149,150,151,152,153,154,155,117,156],"dilemm ai","arena","analyze","browser","openclaw agent","create","automation","browser automation","bot","openclaw","design","strategy","headless","compete","submit","matchmaking","use",{"skillNo":158,"name":159,"nameZh":6,"description":160,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":161,"categories":162,"keywords":166,"publishedAt":36},"01M6G8HWAF3K9SW7NP3Z83CPJ6","arxiv-paper-reviews","Interact with arXiv Crawler API to fetch papers, read reviews, and submit comments. Use when working with arXiv papers, fetching paper lists by date\u002Fcategory\u002Finterest, viewing paper details with comments, or submitting paper reviews via API at http:\u002F\u002F150.158.152.82:8000.","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fzxrys\u002Fweak-accept\u002FSKILL.md",[163],{"categoryNo":164,"categoryName":165,"taxonomyType":137,"taxonomyTypeDesc":138},"01JBSEEDCAT000000000000021","资料检索与研究",[167,168,169,170,171,172,173,113,174,154,156,175,112,176,177],"arxiv paper reviews","reviews","arxiv","paper","crawler","papers","comments","fetch","read","http","via",{"skillNo":179,"name":159,"nameZh":6,"description":160,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":180,"categories":181,"keywords":183,"publishedAt":36},"01M6G8HQJ7N7WMY6YV7D7SSJ16","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fzxrys\u002Farxiv-paper-reviews\u002FSKILL.md",[182],{"categoryNo":164,"categoryName":165,"taxonomyType":137,"taxonomyTypeDesc":138},[170,169,168,167,177,172,173,113,171,154,156,174,175,112,176],{"skillNo":185,"name":186,"nameZh":6,"description":187,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":188,"categories":189,"keywords":190,"publishedAt":36},"01M6G8HM95Y64JNVFC2HN4E2BG","git-summary","Get a quick summary of the current Git repository including status, recent commits, branches, and contributors.","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fzweack\u002Fgit-summary\u002FSKILL.md",[],[191,192,193,194,195,196,197,198,199,200,201,202,203],"git","summary","git summary","commits","repository","win32","status","linux","contributors","true","quick","get","branches",{"skillNo":205,"name":206,"nameZh":6,"description":207,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":208,"categories":209,"keywords":214,"publishedAt":36},"01M6G8HGEGF05CNEJCGVYFSC4R","agent-constitution","Interact with AgentConstitution governance contracts on Base Sepolia. Check compliance, read rules, log actions, query governance state.","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fztsalexey\u002Fagent-constitution\u002FSKILL.md",[210,211],{"categoryNo":135,"categoryName":136,"taxonomyType":137,"taxonomyTypeDesc":138},{"categoryNo":212,"categoryName":213,"taxonomyType":107,"taxonomyTypeDesc":108},"01JBSEEDCAT000000000000037","律师与法务",[215,216,217,218,113,219,220,48,221,175,222,223,224,225,226,125,227,228,229],"agent constitution","constitution","contracts","tree","query","base","log","check","Rules","projects","compliance","actions","state","governance","github"]