visual-dialogue-tools
Route image upload, click-mask segmentation, OCR, Husky VQA/captioning, inpainting, replacement, and ControlNet image workflows.
- License 许可
- Apache-2.0
- 最近更新
- 2026-10-08
- Stars
- ★ 11
- Forks
- 3
01 前言 Front Matter
- name
- visual-dialogue-tools
- license
- Apache 2.0
- metadata
- { "disco-role": "operating" }
- description
- Route image upload, click-mask segmentation, OCR, Husky VQA/captioning, inpainting, replacement, and ControlNet image workflows.
- disable-model-invocation
- true
02 资源文件 4
- 参考文档references/controller-state.md6.6 KB
- 参考文档references/image-tool-reference.md6.3 KB
- 参考文档references/image-workflows.md4.3 KB
- 参考文档references/troubleshooting.md4.4 KB
03 SKILL.md 正文
Visual Dialogue Tools
Use this sub-skill when the task is about uploading an image, clicking a region, asking about text or scene content, removing or replacing a masked object, saving a mask for later use, or generating/editing an image from segmentation, canny, scribble, depth, pose, line, or normal control maps.
Route elsewhere
- App launch/load strings, tab gating, certificates, and service-level model loading belong in
../app-deployment/SKILL.md. - ImageBind audio/thermal generation and DragGAN point editing belong in
../cross-modal-generation/SKILL.md. - Video upload, captioning, action recognition, dense captioning, and TikTok-style clip generation belong in
../video-understanding/SKILL.md.
Read first
- Read references/controller-state.md for the ConversationBot state model, upload flow, click-mask handling, memory updates, and path recovery rules.
- Read references/image-tool-reference.md when you need the exact tool names, comma-separated input grammar, checkpoint expectations, or output filename conventions.
- Read references/image-workflows.md for end-to-end recipes such as Pick, OCR on a clicked region, remove/replace, save-mask reuse, and control-map generation.
- Read references/troubleshooting.md when a tool is unloaded, a mask is empty, parent-image recovery fails, a checkpoint is missing, OCR returns no text, or the prompt grammar is ambiguous.
- Run scripts/validate_mask_inputs.py before handing a candidate image/mask pair to removal, replacement, or OCR workflows; it checks file existence, format, dimensions, non-empty masks, and an optional parent relationship.
Operating notes
- Treat
stateas the chat transcript anduser_state[0]as the live session cache. - Uploaded images seed both caption and OCR memory; clicked masks are saved under
image/with a recoverable parent anchor. - Use OCR when the user cares about exact characters; use HuskyVQA when the user cares about scene semantics inside a selected region.
- Removal uses the inpainting path; replacement uses the masked-object replacement path; both expect the image path first and the mask path second.
- Many models are e-mode aware and move to CPU between calls, so do not assume GPU residency across turns.
04 同仓库更多 Skills
obsidian-clipper-template-creator
Guide for creating templates for the Obsidian Web Clipper. Use when you want to create a new clipping template, understand available variables, or format clipped content.
obsidian-clipper-template-creator
Guide for creating templates for the Obsidian Web Clipper. Use when you want to create a new clipping template, understand available variables, or format clipped content.
python-api
Programmatic Object-Detection-Metrics API guidance for BoundingBox, BoundingBoxes, Evaluator, enums, coordinate conversion, AP/mAP semantics, and source-style import diagnostics.
file-evaluation
Folder-based PASCAL VOC AP/mAP evaluation from ground-truth and detection text files.
object-detection-metrics
Guides legacy Object-Detection-Metrics PASCAL VOC AP/mAP evaluation from detection text folders and direct Python API classes.
nx-workspace-patterns
Configure and optimize Nx monorepo workspaces. Use when setting up Nx, configuring project boundaries, optimizing build caching, or implementing affected commands.