[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M796TP40MTCG5VFX97XDH5YJ":3,"skill-same:01M796TP40MTCG5VFX97XDH5YJ":57},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":34,"commitSha":35,"skillDirectory":36,"forksCount":37,"repositoryHtmlUrl":38,"repositoryHomepageUrl":6,"ownerHtmlUrl":39,"ownerBlogUrl":40,"ownerDescription":41,"updatedAt":42,"install":43,"resources":56},"01M796TP40MTCG5VFX97XDH5YJ","vastai-data-handling",null,"Manage training data and model artifacts securely on Vast.ai GPU instances.\nUse when transferring data to instances, managing checkpoints,\nor implementing secure data lifecycle on rented hardware.\nTrigger with phrases like \"vastai data\", \"vastai upload data\",\n\"vastai checkpoints\", \"vastai data security\", \"vastai artifacts\".","jukeyman\u002Fjukeyman-skills","jukeyman","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F142960420?v=4","01M78FR4Y3DHMMCBCC0GXXNB3F","RICK JEFFERSON","01M78FR4Z8RVQRAD31Y5J7V6EB",1,"MIT","https:\u002F\u002Fgithub.com\u002Fjukeyman\u002Fjukeyman-skills\u002Fblob\u002Fmain\u002Fskills\u002Fsaas-packs--vastai-pack--vastai-data-handling\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: vastai-data-handling\ndescription: |\n  Manage training data and model artifacts securely on Vast.ai GPU instances.\n  Use when transferring data to instances, managing checkpoints,\n  or implementing secure data lifecycle on rented hardware.\n  Trigger with phrases like \"vastai data\", \"vastai upload data\",\n  \"vastai checkpoints\", \"vastai data security\", \"vastai artifacts\".\nallowed-tools: Read, Write, Edit, Bash(vastai:*), Bash(ssh:*), Bash(scp:*)\nversion: 1.0.0\nlicense: MIT\nauthor: Jeremy Longshore \u003Cjeremy@intentsolutions.io>\ncompatible-with: claude-code, codex, openclaw\ntags: [saas, vast-ai, compliance, data]\n---\n# Vast.ai Data Handling\n\n## Overview\nManage training data and model artifacts securely on Vast.ai GPU instances. Covers data transfer, encryption, checkpoint management, and cleanup. Critical consideration: Vast.ai instances run on shared hardware operated by third-party hosts.\n\n## Prerequisites\n- Vast.ai instance with SSH access\n- Cloud storage (S3, GCS) for persistent artifacts\n- Understanding of data sensitivity classification\n\n## Instructions\n\n### Step 1: Data Transfer Patterns\n\n```bash\n# Small datasets (\u003C5GB): Direct SCP\nscp -P $PORT -r .\u002Fdata\u002F root@$HOST:\u002Fworkspace\u002Fdata\u002F\n\n# Large datasets (5-50GB): Compressed transfer\ntar czf - .\u002Fdata\u002F | ssh -p $PORT root@$HOST \"tar xzf - -C \u002Fworkspace\u002F\"\n\n# Very large datasets (>50GB): Cloud storage staging\n# Upload to S3\u002FGCS first, then download on instance\nssh -p $PORT root@$HOST \"aws s3 sync s3:\u002F\u002Fbucket\u002Fdataset\u002F \u002Fworkspace\u002Fdata\u002F\"\n```\n\n### Step 2: Encrypted Data Transfer\n\n```python\nimport subprocess, os\n\ndef encrypt_and_upload(local_path, host, port, remote_path, passphrase):\n    \"\"\"Encrypt data before transferring to Vast.ai instance.\"\"\"\n    encrypted = f\"{local_path}.enc\"\n    # Encrypt with AES-256\n    subprocess.run([\n        \"openssl\", \"enc\", \"-aes-256-cbc\", \"-salt\", \"-pbkdf2\",\n        \"-in\", local_path, \"-out\", encrypted,\n        \"-pass\", f\"pass:{passphrase}\",\n    ], check=True)\n\n    # Transfer encrypted file\n    subprocess.run([\n        \"scp\", \"-P\", str(port), encrypted,\n        f\"root@{host}:{remote_path}.enc\",\n    ], check=True)\n\n    # Decrypt on instance\n    subprocess.run([\n        \"ssh\", \"-p\", str(port), f\"root@{host}\",\n        f\"openssl enc -aes-256-cbc -d -pbkdf2 \"\n        f\"-in {remote_path}.enc -out {remote_path} \"\n        f\"-pass pass:{passphrase} && rm {remote_path}.enc\"\n    ], check=True)\n\n    os.remove(encrypted)\n```\n\n### Step 3: Checkpoint to Cloud Storage\n\n```python\nimport torch, boto3, os\n\nclass CloudCheckpointManager:\n    def __init__(self, s3_bucket, prefix, save_every=500):\n        self.s3 = boto3.client(\"s3\")\n        self.bucket = s3_bucket\n        self.prefix = prefix\n        self.save_every = save_every\n\n    def save(self, model, optimizer, step, loss):\n        if step % self.save_every != 0:\n            return\n        local_path = f\"\u002Ftmp\u002Fckpt-{step}.pt\"\n        torch.save({\n            \"step\": step, \"loss\": loss,\n            \"model\": model.state_dict(),\n            \"optimizer\": optimizer.state_dict(),\n        }, local_path)\n        self.s3.upload_file(local_path, self.bucket,\n                           f\"{self.prefix}\u002Fckpt-{step}.pt\")\n        os.remove(local_path)\n        print(f\"Checkpoint saved: step {step}, loss {loss:.4f}\")\n\n    def load_latest(self):\n        resp = self.s3.list_objects_v2(Bucket=self.bucket, Prefix=self.prefix)\n        if not resp.get(\"Contents\"):\n            return None\n        latest = sorted(resp[\"Contents\"], key=lambda o: o[\"Key\"])[-1]\n        self.s3.download_file(self.bucket, latest[\"Key\"], \"\u002Ftmp\u002Flatest.pt\")\n        return torch.load(\"\u002Ftmp\u002Flatest.pt\")\n```\n\n### Step 4: Secure Cleanup Before Destroy\n\n```bash\n# ALWAYS clean sensitive data before destroying an instance\nssh -p $PORT root@$HOST \u003C\u003C 'CLEANUP'\n# Remove training data and checkpoints\nrm -rf \u002Fworkspace\u002Fdata \u002Fworkspace\u002Fcheckpoints \u002Fworkspace\u002F*.pt\n\n# Clear command history\nhistory -c && rm -f ~\u002F.bash_history\n\n# Overwrite sensitive files (optional, for high-security)\nfind \u002Fworkspace -name \"*.env\" -exec shred -u {} \\;\n\necho \"Cleanup complete\"\nCLEANUP\n\n# Then destroy\nvastai destroy instance $INSTANCE_ID\n```\n\n### Step 5: Data Lifecycle Policy\n\n| Data Type | On Instance | After Job | Retention |\n|-----------|-------------|-----------|-----------|\n| Training data | Decrypt on use | Delete before destroy | Source system only |\n| Checkpoints | Local + cloud sync | Keep in cloud storage | 30 days |\n| Final model | Local | Upload to model registry | Permanent |\n| Logs | Local | Upload to logging service | 90 days |\n| Temp files | \u002Ftmp | Auto-deleted on destroy | None |\n\n## Output\n- Data transfer patterns (SCP, compressed, cloud-staged)\n- Encrypted transfer for sensitive datasets\n- Cloud checkpoint manager with S3 integration\n- Secure cleanup script before instance destruction\n- Data lifecycle policy\n\n## Error Handling\n| Error | Cause | Solution |\n|-------|-------|----------|\n| SCP timeout | Large file or slow network | Use compressed transfer or cloud staging |\n| Checkpoint upload fails | S3 credentials not on instance | Pass AWS creds via env vars at instance creation |\n| Disk full during training | Insufficient disk allocation | Increase `--disk` or clean old checkpoints |\n| Data left after destroy | Skipped cleanup | Always run cleanup script before `vastai destroy` |\n\n## Resources\n- [Vast.ai Instance Management](https:\u002F\u002Fdocs.vast.ai\u002Fapi-reference\u002Finstances\u002Fcreate-instance)\n- [AWS S3 CLI](https:\u002F\u002Fdocs.aws.amazon.com\u002Fcli\u002Flatest\u002Freference\u002Fs3\u002F)\n\n## Next Steps\nFor enterprise access control, see `vastai-enterprise-rbac`.\n\n## Examples\n\n**Sensitive data workflow**: Encrypt dataset locally, SCP encrypted file to instance, decrypt on-instance, train, save checkpoints to S3, clean and destroy.\n\n**Resume after preemption**: Load latest checkpoint from S3 on new instance, continue training from last saved step.\n","# Vast.ai Data Handling\n\n## Overview\nManage training data and model artifacts securely on Vast.ai GPU instances. Covers data transfer, encryption, checkpoint management, and cleanup. Critical consideration: Vast.ai instances run on shared hardware operated by third-party hosts.\n\n## Prerequisites\n- Vast.ai instance with SSH access\n- Cloud storage (S3, GCS) for persistent artifacts\n- Understanding of data sensitivity classification\n\n## Instructions\n\n### Step 1: Data Transfer Patterns\n\n```bash\n# Small datasets (\u003C5GB): Direct SCP\nscp -P $PORT -r .\u002Fdata\u002F root@$HOST:\u002Fworkspace\u002Fdata\u002F\n\n# Large datasets (5-50GB): Compressed transfer\ntar czf - .\u002Fdata\u002F | ssh -p $PORT root@$HOST \"tar xzf - -C \u002Fworkspace\u002F\"\n\n# Very large datasets (>50GB): Cloud storage staging\n# Upload to S3\u002FGCS first, then download on instance\nssh -p $PORT root@$HOST \"aws s3 sync s3:\u002F\u002Fbucket\u002Fdataset\u002F \u002Fworkspace\u002Fdata\u002F\"\n```\n\n### Step 2: Encrypted Data Transfer\n\n```python\nimport subprocess, os\n\ndef encrypt_and_upload(local_path, host, port, remote_path, passphrase):\n    \"\"\"Encrypt data before transferring to Vast.ai instance.\"\"\"\n    encrypted = f\"{local_path}.enc\"\n    # Encrypt with AES-256\n    subprocess.run([\n        \"openssl\", \"enc\", \"-aes-256-cbc\", \"-salt\", \"-pbkdf2\",\n        \"-in\", local_path, \"-out\", encrypted,\n        \"-pass\", f\"pass:{passphrase}\",\n    ], check=True)\n\n    # Transfer encrypted file\n    subprocess.run([\n        \"scp\", \"-P\", str(port), encrypted,\n        f\"root@{host}:{remote_path}.enc\",\n    ], check=True)\n\n    # Decrypt on instance\n    subprocess.run([\n        \"ssh\", \"-p\", str(port), f\"root@{host}\",\n        f\"openssl enc -aes-256-cbc -d -pbkdf2 \"\n        f\"-in {remote_path}.enc -out {remote_path} \"\n        f\"-pass pass:{passphrase} && rm {remote_path}.enc\"\n    ], check=True)\n\n    os.remove(encrypted)\n```\n\n### Step 3: Checkpoint to Cloud Storage\n\n```python\nimport torch, boto3, os\n\nclass CloudCheckpointManager:\n    def __init__(self, s3_bucket, prefix, save_every=500):\n        self.s3 = boto3.client(\"s3\")\n        self.bucket = s3_bucket\n        self.prefix = prefix\n        self.save_every = save_every\n\n    def save(self, model, optimizer, step, loss):\n        if step % self.save_every != 0:\n            return\n        local_path = f\"\u002Ftmp\u002Fckpt-{step}.pt\"\n        torch.save({\n            \"step\": step, \"loss\": loss,\n            \"model\": model.state_dict(),\n            \"optimizer\": optimizer.state_dict(),\n        }, local_path)\n        self.s3.upload_file(local_path, self.bucket,\n                           f\"{self.prefix}\u002Fckpt-{step}.pt\")\n        os.remove(local_path)\n        print(f\"Checkpoint saved: step {step}, loss {loss:.4f}\")\n\n    def load_latest(self):\n        resp = self.s3.list_objects_v2(Bucket=self.bucket, Prefix=self.prefix)\n        if not resp.get(\"Contents\"):\n            return None\n        latest = sorted(resp[\"Contents\"], key=lambda o: o[\"Key\"])[-1]\n        self.s3.download_file(self.bucket, latest[\"Key\"], \"\u002Ftmp\u002Flatest.pt\")\n        return torch.load(\"\u002Ftmp\u002Flatest.pt\")\n```\n\n### Step 4: Secure Cleanup Before Destroy\n\n```bash\n# ALWAYS clean sensitive data before destroying an instance\nssh -p $PORT root@$HOST \u003C\u003C 'CLEANUP'\n# Remove training data and checkpoints\nrm -rf \u002Fworkspace\u002Fdata \u002Fworkspace\u002Fcheckpoints \u002Fworkspace\u002F*.pt\n\n# Clear command history\nhistory -c && rm -f ~\u002F.bash_history\n\n# Overwrite sensitive files (optional, for high-security)\nfind \u002Fworkspace -name \"*.env\" -exec shred -u {} \\;\n\necho \"Cleanup complete\"\nCLEANUP\n\n# Then destroy\nvastai destroy instance $INSTANCE_ID\n```\n\n### Step 5: Data Lifecycle Policy\n\n| Data Type | On Instance | After Job | Retention |\n|-----------|-------------|-----------|-----------|\n| Training data | Decrypt on use | Delete before destroy | Source system only |\n| Checkpoints | Local + cloud sync | Keep in cloud storage | 30 days |\n| Final model | Local | Upload to model registry | Permanent |\n| Logs | Local | Upload to logging service | 90 days |\n| Temp files | \u002Ftmp | Auto-deleted on destroy | None |\n\n## Output\n- Data transfer patterns (SCP, compressed, cloud-staged)\n- Encrypted transfer for sensitive datasets\n- Cloud checkpoint manager with S3 integration\n- Secure cleanup script before instance destruction\n- Data lifecycle policy\n\n## Error Handling\n| Error | Cause | Solution |\n|-------|-------|----------|\n| SCP timeout | Large file or slow network | Use compressed transfer or cloud staging |\n| Checkpoint upload fails | S3 credentials not on instance | Pass AWS creds via env vars at instance creation |\n| Disk full during training | Insufficient disk allocation | Increase `--disk` or clean old checkpoints |\n| Data left after destroy | Skipped cleanup | Always run cleanup script before `vastai destroy` |\n\n## Resources\n- [Vast.ai Instance Management](https:\u002F\u002Fdocs.vast.ai\u002Fapi-reference\u002Finstances\u002Fcreate-instance)\n- [AWS S3 CLI](https:\u002F\u002Fdocs.aws.amazon.com\u002Fcli\u002Flatest\u002Freference\u002Fs3\u002F)\n\n## Next Steps\nFor enterprise access control, see `vastai-enterprise-rbac`.\n\n## Examples\n\n**Sensitive data workflow**: Encrypt dataset locally, SCP encrypted file to instance, decrypt on-instance, train, save checkpoints to S3, clean and destroy.\n\n**Resume after preemption**: Load latest checkpoint from S3 on new instance, continue training from last saved step.\n",{"name":5,"tags":24,"author":29,"license":15,"version":30,"description":31,"allowed-tools":32,"compatible-with":33},[25,26,27,28],"saas","vast-ai","compliance","data","Jeremy Longshore \u003Cjeremy@intentsolutions.io>","1.0.0","Manage training data and model artifacts securely on Vast.ai GPU instances.\nUse when transferring data to instances, managing checkpoints,\nor implementing secure data lifecycle on rented hardware.\nTrigger with phrases like \"vastai data\", \"vastai upload data\",\n\"vastai checkpoints\", \"vastai data security\", \"vastai artifacts\".\n","Read, Write, Edit, Bash(vastai:*), Bash(ssh:*), Bash(scp:*)","claude-code, codex, openclaw","main","99825ad3f3bcc6597ddcc7294a14e6e922f2b67b","skills\u002Fsaas-packs--vastai-pack--vastai-data-handling",0,"https:\u002F\u002Fgithub.com\u002Fjukeyman\u002Fjukeyman-skills","https:\u002F\u002Fgithub.com\u002Fjukeyman","https:\u002F\u002FRJBUSINESSSOLUTIONS.ORG","Credit and Finance Expert | Developer\r\n\r\nI'm Rick Jefferson, a seasoned credit and finance expert with over a decade of experience in financial literacy,","2026-07-13 07:03:29",{"source":8,"skillName":5,"commands":44,"prompt":54,"zipAvailable":55},[45,48,51],{"tool":46,"command":47},"npx","npx skills add jukeyman\u002Fjukeyman-skills --skill vastai-data-handling",{"tool":49,"command":50},"bunx","bunx skills add jukeyman\u002Fjukeyman-skills --skill vastai-data-handling",{"tool":52,"command":53},"pnpm","pnpm dlx skills add jukeyman\u002Fjukeyman-skills --skill vastai-data-handling","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fjukeyman\u002Fjukeyman-skills\u002Fblob\u002Fmain\u002Fskills\u002Fsaas-packs--vastai-pack--vastai-data-handling\u002FSKILL.md",true,[],[58,65,72,79,86,94],{"skillNo":59,"name":60,"nameZh":6,"description":61,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":62,"categories":63,"keywords":64,"publishedAt":19},"01M79ANS2SM329NEP5ZCX106RR","zustand-store-creator","Create zustand store creator operations. Auto-activating skill for Frontend Development.\nTriggers on: zustand store creator, zustand store creator\nPart of the Frontend Development skill category. Use when working with zustand store creator functionality. Trigger with phrases like \"zustand store creator\", \"zustand creator\", \"zustand\".","https:\u002F\u002Fgithub.com\u002Fjukeyman\u002Fjukeyman-skills\u002Fblob\u002Fmain\u002Fskills\u002Fzustand-store-creator\u002FSKILL.md",[],[],{"skillNo":66,"name":67,"nameZh":6,"description":68,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":69,"categories":70,"keywords":71,"publishedAt":19},"01M79AMZKP4YDEZ7EHG1Y7PP74","zero-trust-config-helper","Configure with zero trust config helper operations. Auto-activating skill for Security Advanced.\nTriggers on: zero trust config helper, zero trust config helper\nPart of the Security Advanced skill category. Use when configuring systems or services. Trigger with phrases like \"zero trust config helper\", \"zero helper\", \"zero\".","https:\u002F\u002Fgithub.com\u002Fjukeyman\u002Fjukeyman-skills\u002Fblob\u002Fmain\u002Fskills\u002Fzero-trust-config-helper\u002FSKILL.md",[],[],{"skillNo":73,"name":74,"nameZh":6,"description":75,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":76,"categories":77,"keywords":78,"publishedAt":19},"01M79AMJSBCEJQNBTYNAHYN5HM","zapier-integration-helper","Assist with zapier integration helper operations. Auto-activating skill for Business Automation.\nTriggers on: zapier integration helper, zapier integration helper\nPart of the Business Automation skill category. Use when working with APIs or building integrations. Trigger with phrases like \"zapier integration helper\", \"zapier helper\", \"zapier\".","https:\u002F\u002Fgithub.com\u002Fjukeyman\u002Fjukeyman-skills\u002Fblob\u002Fmain\u002Fskills\u002Fzapier-integration-helper\u002FSKILL.md",[],[],{"skillNo":80,"name":81,"nameZh":6,"description":82,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":83,"categories":84,"keywords":85,"publishedAt":19},"01M79AHJZGVMARS13VFQYRR1MP","yaml-config-validator","Validate yaml config validator operations. Auto-activating skill for DevOps Basics.\nTriggers on: yaml config validator, yaml config validator\nPart of the DevOps Basics skill category. Use when configuring systems or services. Trigger with phrases like \"yaml config validator\", \"yaml validator\", \"yaml\".","https:\u002F\u002Fgithub.com\u002Fjukeyman\u002Fjukeyman-skills\u002Fblob\u002Fmain\u002Fskills\u002Fyaml-config-validator\u002FSKILL.md",[],[],{"skillNo":87,"name":88,"nameZh":6,"description":89,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":90,"sourceHtmlUrl":91,"categories":92,"keywords":93,"publishedAt":19},"01M79AHGDZRN0020RDQSQDPAM8","xvary-stock-research","Thesis-driven equity analysis from public SEC EDGAR and market data; \u002Fanalyze, \u002Fscore, \u002Fcompare workflows with bundled Python tools (Claude Code, Cursor, Codex).","https:\u002F\u002Fgithub.com\u002Fjukeyman\u002Fjukeyman-skills\u002Fblob\u002Fmain\u002Fskills\u002Fxvary-stock-research\u002FLICENSE","https:\u002F\u002Fgithub.com\u002Fjukeyman\u002Fjukeyman-skills\u002Fblob\u002Fmain\u002Fskills\u002Fxvary-stock-research\u002FSKILL.md",[],[],{"skillNo":95,"name":96,"nameZh":6,"description":97,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":98,"categories":99,"keywords":100,"publishedAt":19},"01M79AHCYJ9FV9RMHQ24HDRN33","xss-vulnerability-scanner","Scan xss vulnerability scanner operations. Auto-activating skill for Security Fundamentals.\nTriggers on: xss vulnerability scanner, xss vulnerability scanner\nPart of the Security Fundamentals skill category. Use when working with xss vulnerability scanner functionality. Trigger with phrases like \"xss vulnerability scanner\", \"xss scanner\", \"xss\".","https:\u002F\u002Fgithub.com\u002Fjukeyman\u002Fjukeyman-skills\u002Fblob\u002Fmain\u002Fskills\u002Fxss-vulnerability-scanner\u002FSKILL.md",[],[]]