[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6NB290R7F1HTGQPGDF61WQT":3,"skill-same:01M6NB290R7F1HTGQPGDF61WQT":83},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":39,"linkOnly":40,"markdownContent":41,"markdownBody":42,"frontMatter":43,"refName":52,"commitSha":53,"skillDirectory":54,"forksCount":14,"repositoryHtmlUrl":55,"repositoryHomepageUrl":6,"ownerHtmlUrl":56,"ownerBlogUrl":6,"ownerDescription":57,"updatedAt":58,"install":59,"resources":72},"01M6NB290R7F1HTGQPGDF61WQT","lambda-labs-gpu-cloud",null,"Reserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent filesystems, or high-performance multi-node clusters for large-scale training.","zhengliangliahu-cloud\u002Fskills","zhengliangliahu-cloud","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F248268067?v=4","01M6NAQ109P2Y11XSV5D9QJFFY","Lin","01M6NAQ15R1M4E18CA2KPJHC06",1,"MIT","https:\u002F\u002Fgithub.com\u002Fzhengliangliahu-cloud\u002Fskills\u002Fblob\u002Fmain\u002FAI-Research-SKILLs\u002F09-infrastructure\u002Flambda-labs\u002FSKILL.md",[],[19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38],"gpu","cloud","GPU Cloud","Lambda Labs","lambda","lambda labs gpu cloud","access","for","orchestra","you","Multi-Node","high-performance","instances","use","node","performance","Large-Scale Training","training","infrastructure","ml","2026-11-10 10:12:30",false,"---\nname: lambda-labs-gpu-cloud\ndescription: Reserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent filesystems, or high-performance multi-node clusters for large-scale training.\nversion: 1.0.0\nauthor: Orchestra Research\nlicense: MIT\ntags: [Infrastructure, GPU Cloud, Training, Inference, Lambda Labs]\ndependencies: [lambda-cloud-client>=1.0.0]\n---\n\n# Lambda Labs GPU Cloud\n\nComprehensive guide to running ML workloads on Lambda Labs GPU cloud with on-demand instances and 1-Click Clusters.\n\n## When to use Lambda Labs\n\n**Use Lambda Labs when:**\n- Need dedicated GPU instances with full SSH access\n- Running long training jobs (hours to days)\n- Want simple pricing with no egress fees\n- Need persistent storage across sessions\n- Require high-performance multi-node clusters (16-512 GPUs)\n- Want pre-installed ML stack (Lambda Stack with PyTorch, CUDA, NCCL)\n\n**Key features:**\n- **GPU variety**: B200, H100, GH200, A100, A10, A6000, V100\n- **Lambda Stack**: Pre-installed PyTorch, TensorFlow, CUDA, cuDNN, NCCL\n- **Persistent filesystems**: Keep data across instance restarts\n- **1-Click Clusters**: 16-512 GPU Slurm clusters with InfiniBand\n- **Simple pricing**: Pay-per-minute, no egress fees\n- **Global regions**: 12+ regions worldwide\n\n**Use alternatives instead:**\n- **Modal**: For serverless, auto-scaling workloads\n- **SkyPilot**: For multi-cloud orchestration and cost optimization\n- **RunPod**: For cheaper spot instances and serverless endpoints\n- **Vast.ai**: For GPU marketplace with lowest prices\n\n## Quick start\n\n### Account setup\n\n1. Create account at https:\u002F\u002Flambda.ai\n2. Add payment method\n3. Generate API key from dashboard\n4. Add SSH key (required before launching instances)\n\n### Launch via console\n\n1. Go to https:\u002F\u002Fcloud.lambda.ai\u002Finstances\n2. Click \"Launch instance\"\n3. Select GPU type and region\n4. Choose SSH key\n5. Optionally attach filesystem\n6. Launch and wait 3-15 minutes\n\n### Connect via SSH\n\n```bash\n# Get instance IP from console\nssh ubuntu@\u003CINSTANCE-IP>\n\n# Or with specific key\nssh -i ~\u002F.ssh\u002Flambda_key ubuntu@\u003CINSTANCE-IP>\n```\n\n## GPU instances\n\n### Available GPUs\n\n| GPU | VRAM | Price\u002FGPU\u002Fhr | Best For |\n|-----|------|--------------|----------|\n| B200 SXM6 | 180 GB | $4.99 | Largest models, fastest training |\n| H100 SXM | 80 GB | $2.99-3.29 | Large model training |\n| H100 PCIe | 80 GB | $2.49 | Cost-effective H100 |\n| GH200 | 96 GB | $1.49 | Single-GPU large models |\n| A100 80GB | 80 GB | $1.79 | Production training |\n| A100 40GB | 40 GB | $1.29 | Standard training |\n| A10 | 24 GB | $0.75 | Inference, fine-tuning |\n| A6000 | 48 GB | $0.80 | Good VRAM\u002Fprice ratio |\n| V100 | 16 GB | $0.55 | Budget training |\n\n### Instance configurations\n\n```\n8x GPU: Best for distributed training (DDP, FSDP)\n4x GPU: Large models, multi-GPU training\n2x GPU: Medium workloads\n1x GPU: Fine-tuning, inference, development\n```\n\n### Launch times\n\n- Single-GPU: 3-5 minutes\n- Multi-GPU: 10-15 minutes\n\n## Lambda Stack\n\nAll instances come with Lambda Stack pre-installed:\n\n```bash\n# Included software\n- Ubuntu 22.04 LTS\n- NVIDIA drivers (latest)\n- CUDA 12.x\n- cuDNN 8.x\n- NCCL (for multi-GPU)\n- PyTorch (latest)\n- TensorFlow (latest)\n- JAX\n- JupyterLab\n```\n\n### Verify installation\n\n```bash\n# Check GPU\nnvidia-smi\n\n# Check PyTorch\npython -c \"import torch; print(torch.cuda.is_available())\"\n\n# Check CUDA version\nnvcc --version\n```\n\n## Python API\n\n### Installation\n\n```bash\npip install lambda-cloud-client\n```\n\n### Authentication\n\n```python\nimport os\nimport lambda_cloud_client\n\n# Configure with API key\nconfiguration = lambda_cloud_client.Configuration(\n    host=\"https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\",\n    access_token=os.environ[\"LAMBDA_API_KEY\"]\n)\n```\n\n### List available instances\n\n```python\nwith lambda_cloud_client.ApiClient(configuration) as api_client:\n    api = lambda_cloud_client.DefaultApi(api_client)\n\n    # Get available instance types\n    types = api.instance_types()\n    for name, info in types.data.items():\n        print(f\"{name}: {info.instance_type.description}\")\n```\n\n### Launch instance\n\n```python\nfrom lambda_cloud_client.models import LaunchInstanceRequest\n\nrequest = LaunchInstanceRequest(\n    region_name=\"us-west-1\",\n    instance_type_name=\"gpu_1x_h100_sxm5\",\n    ssh_key_names=[\"my-ssh-key\"],\n    file_system_names=[\"my-filesystem\"],  # Optional\n    name=\"training-job\"\n)\n\nresponse = api.launch_instance(request)\ninstance_id = response.data.instance_ids[0]\nprint(f\"Launched: {instance_id}\")\n```\n\n### List running instances\n\n```python\ninstances = api.list_instances()\nfor instance in instances.data:\n    print(f\"{instance.name}: {instance.ip} ({instance.status})\")\n```\n\n### Terminate instance\n\n```python\nfrom lambda_cloud_client.models import TerminateInstanceRequest\n\nrequest = TerminateInstanceRequest(\n    instance_ids=[instance_id]\n)\napi.terminate_instance(request)\n```\n\n### SSH key management\n\n```python\nfrom lambda_cloud_client.models import AddSshKeyRequest\n\n# Add SSH key\nrequest = AddSshKeyRequest(\n    name=\"my-key\",\n    public_key=\"ssh-rsa AAAA...\"\n)\napi.add_ssh_key(request)\n\n# List keys\nkeys = api.list_ssh_keys()\n\n# Delete key\napi.delete_ssh_key(key_id)\n```\n\n## CLI with curl\n\n### List instance types\n\n```bash\ncurl -u $LAMBDA_API_KEY: \\\n  https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\u002Finstance-types | jq\n```\n\n### Launch instance\n\n```bash\ncurl -u $LAMBDA_API_KEY: \\\n  -X POST https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\u002Finstance-operations\u002Flaunch \\\n  -H \"Content-Type: application\u002Fjson\" \\\n  -d '{\n    \"region_name\": \"us-west-1\",\n    \"instance_type_name\": \"gpu_1x_h100_sxm5\",\n    \"ssh_key_names\": [\"my-key\"]\n  }' | jq\n```\n\n### Terminate instance\n\n```bash\ncurl -u $LAMBDA_API_KEY: \\\n  -X POST https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\u002Finstance-operations\u002Fterminate \\\n  -H \"Content-Type: application\u002Fjson\" \\\n  -d '{\"instance_ids\": [\"\u003CINSTANCE-ID>\"]}' | jq\n```\n\n## Persistent storage\n\n### Filesystems\n\nFilesystems persist data across instance restarts:\n\n```bash\n# Mount location\n\u002Flambda\u002Fnfs\u002F\u003CFILESYSTEM_NAME>\n\n# Example: save checkpoints\npython train.py --checkpoint-dir \u002Flambda\u002Fnfs\u002Fmy-storage\u002Fcheckpoints\n```\n\n### Create filesystem\n\n1. Go to Storage in Lambda console\n2. Click \"Create filesystem\"\n3. Select region (must match instance region)\n4. Name and create\n\n### Attach to instance\n\nFilesystems must be attached at instance launch time:\n- Via console: Select filesystem when launching\n- Via API: Include `file_system_names` in launch request\n\n### Best practices\n\n```bash\n# Store on filesystem (persists)\n\u002Flambda\u002Fnfs\u002Fstorage\u002F\n  ├── datasets\u002F\n  ├── checkpoints\u002F\n  ├── models\u002F\n  └── outputs\u002F\n\n# Local SSD (faster, ephemeral)\n\u002Fhome\u002Fubuntu\u002F\n  └── working\u002F  # Temporary files\n```\n\n## SSH configuration\n\n### Add SSH key\n\n```bash\n# Generate key locally\nssh-keygen -t ed25519 -f ~\u002F.ssh\u002Flambda_key\n\n# Add public key to Lambda console\n# Or via API\n```\n\n### Multiple keys\n\n```bash\n# On instance, add more keys\necho 'ssh-rsa AAAA...' >> ~\u002F.ssh\u002Fauthorized_keys\n```\n\n### Import from GitHub\n\n```bash\n# On instance\nssh-import-id gh:username\n```\n\n### SSH tunneling\n\n```bash\n# Forward Jupyter\nssh -L 8888:localhost:8888 ubuntu@\u003CIP>\n\n# Forward TensorBoard\nssh -L 6006:localhost:6006 ubuntu@\u003CIP>\n\n# Multiple ports\nssh -L 8888:localhost:8888 -L 6006:localhost:6006 ubuntu@\u003CIP>\n```\n\n## JupyterLab\n\n### Launch from console\n\n1. Go to Instances page\n2. Click \"Launch\" in Cloud IDE column\n3. JupyterLab opens in browser\n\n### Manual access\n\n```bash\n# On instance\njupyter lab --ip=0.0.0.0 --port=8888\n\n# From local machine with tunnel\nssh -L 8888:localhost:8888 ubuntu@\u003CIP>\n# Open http:\u002F\u002Flocalhost:8888\n```\n\n## Training workflows\n\n### Single-GPU training\n\n```bash\n# SSH to instance\nssh ubuntu@\u003CIP>\n\n# Clone repo\ngit clone https:\u002F\u002Fgithub.com\u002Fuser\u002Fproject\ncd project\n\n# Install dependencies\npip install -r requirements.txt\n\n# Train\npython train.py --epochs 100 --checkpoint-dir \u002Flambda\u002Fnfs\u002Fstorage\u002Fcheckpoints\n```\n\n### Multi-GPU training (single node)\n\n```python\n# train_ddp.py\nimport torch\nimport torch.distributed as dist\nfrom torch.nn.parallel import DistributedDataParallel as DDP\n\ndef main():\n    dist.init_process_group(\"nccl\")\n    rank = dist.get_rank()\n    device = rank % torch.cuda.device_count()\n\n    model = MyModel().to(device)\n    model = DDP(model, device_ids=[device])\n\n    # Training loop...\n\nif __name__ == \"__main__\":\n    main()\n```\n\n```bash\n# Launch with torchrun (8 GPUs)\ntorchrun --nproc_per_node=8 train_ddp.py\n```\n\n### Checkpoint to filesystem\n\n```python\nimport os\n\ncheckpoint_dir = \"\u002Flambda\u002Fnfs\u002Fmy-storage\u002Fcheckpoints\"\nos.makedirs(checkpoint_dir, exist_ok=True)\n\n# Save checkpoint\ntorch.save({\n    'epoch': epoch,\n    'model_state_dict': model.state_dict(),\n    'optimizer_state_dict': optimizer.state_dict(),\n    'loss': loss,\n}, f\"{checkpoint_dir}\u002Fcheckpoint_{epoch}.pt\")\n```\n\n## 1-Click Clusters\n\n### Overview\n\nHigh-performance Slurm clusters with:\n- 16-512 NVIDIA H100 or B200 GPUs\n- NVIDIA Quantum-2 400 Gb\u002Fs InfiniBand\n- GPUDirect RDMA at 3200 Gb\u002Fs\n- Pre-installed distributed ML stack\n\n### Included software\n\n- Ubuntu 22.04 LTS + Lambda Stack\n- NCCL, Open MPI\n- PyTorch with DDP and FSDP\n- TensorFlow\n- OFED drivers\n\n### Storage\n\n- 24 TB NVMe per compute node (ephemeral)\n- Lambda filesystems for persistent data\n\n### Multi-node training\n\n```bash\n# On Slurm cluster\nsrun --nodes=4 --ntasks-per-node=8 --gpus-per-node=8 \\\n  torchrun --nnodes=4 --nproc_per_node=8 \\\n  --rdzv_backend=c10d --rdzv_endpoint=$MASTER_ADDR:29500 \\\n  train.py\n```\n\n## Networking\n\n### Bandwidth\n\n- Inter-instance (same region): up to 200 Gbps\n- Internet outbound: 20 Gbps max\n\n### Firewall\n\n- Default: Only port 22 (SSH) open\n- Configure additional ports in Lambda console\n- ICMP traffic allowed by default\n\n### Private IPs\n\n```bash\n# Find private IP\nip addr show | grep 'inet '\n```\n\n## Common workflows\n\n### Workflow 1: Fine-tuning LLM\n\n```bash\n# 1. Launch 8x H100 instance with filesystem\n\n# 2. SSH and setup\nssh ubuntu@\u003CIP>\npip install transformers accelerate peft\n\n# 3. Download model to filesystem\npython -c \"\nfrom transformers import AutoModelForCausalLM\nmodel = AutoModelForCausalLM.from_pretrained('meta-llama\u002FLlama-2-7b-hf')\nmodel.save_pretrained('\u002Flambda\u002Fnfs\u002Fstorage\u002Fmodels\u002Fllama-2-7b')\n\"\n\n# 4. Fine-tune with checkpoints on filesystem\naccelerate launch --num_processes 8 train.py \\\n  --model_path \u002Flambda\u002Fnfs\u002Fstorage\u002Fmodels\u002Fllama-2-7b \\\n  --output_dir \u002Flambda\u002Fnfs\u002Fstorage\u002Foutputs \\\n  --checkpoint_dir \u002Flambda\u002Fnfs\u002Fstorage\u002Fcheckpoints\n```\n\n### Workflow 2: Batch inference\n\n```bash\n# 1. Launch A10 instance (cost-effective for inference)\n\n# 2. Run inference\npython inference.py \\\n  --model \u002Flambda\u002Fnfs\u002Fstorage\u002Fmodels\u002Ffine-tuned \\\n  --input \u002Flambda\u002Fnfs\u002Fstorage\u002Fdata\u002Finputs.jsonl \\\n  --output \u002Flambda\u002Fnfs\u002Fstorage\u002Fdata\u002Foutputs.jsonl\n```\n\n## Cost optimization\n\n### Choose right GPU\n\n| Task | Recommended GPU |\n|------|-----------------|\n| LLM fine-tuning (7B) | A100 40GB |\n| LLM fine-tuning (70B) | 8x H100 |\n| Inference | A10, A6000 |\n| Development | V100, A10 |\n| Maximum performance | B200 |\n\n### Reduce costs\n\n1. **Use filesystems**: Avoid re-downloading data\n2. **Checkpoint frequently**: Resume interrupted training\n3. **Right-size**: Don't over-provision GPUs\n4. **Terminate idle**: No auto-stop, manually terminate\n\n### Monitor usage\n\n- Dashboard shows real-time GPU utilization\n- API for programmatic monitoring\n\n## Common issues\n\n| Issue | Solution |\n|-------|----------|\n| Instance won't launch | Check region availability, try different GPU |\n| SSH connection refused | Wait for instance to initialize (3-15 min) |\n| Data lost after terminate | Use persistent filesystems |\n| Slow data transfer | Use filesystem in same region |\n| GPU not detected | Reboot instance, check drivers |\n\n## References\n\n- **[Advanced Usage](references\u002Fadvanced-usage.md)** - Multi-node training, API automation\n- **[Troubleshooting](references\u002Ftroubleshooting.md)** - Common issues and solutions\n\n## Resources\n\n- **Documentation**: https:\u002F\u002Fdocs.lambda.ai\n- **Console**: https:\u002F\u002Fcloud.lambda.ai\n- **Pricing**: https:\u002F\u002Flambda.ai\u002Finstances\n- **Support**: https:\u002F\u002Fsupport.lambdalabs.com\n- **Blog**: https:\u002F\u002Flambda.ai\u002Fblog\n","# Lambda Labs GPU Cloud\n\nComprehensive guide to running ML workloads on Lambda Labs GPU cloud with on-demand instances and 1-Click Clusters.\n\n## When to use Lambda Labs\n\n**Use Lambda Labs when:**\n- Need dedicated GPU instances with full SSH access\n- Running long training jobs (hours to days)\n- Want simple pricing with no egress fees\n- Need persistent storage across sessions\n- Require high-performance multi-node clusters (16-512 GPUs)\n- Want pre-installed ML stack (Lambda Stack with PyTorch, CUDA, NCCL)\n\n**Key features:**\n- **GPU variety**: B200, H100, GH200, A100, A10, A6000, V100\n- **Lambda Stack**: Pre-installed PyTorch, TensorFlow, CUDA, cuDNN, NCCL\n- **Persistent filesystems**: Keep data across instance restarts\n- **1-Click Clusters**: 16-512 GPU Slurm clusters with InfiniBand\n- **Simple pricing**: Pay-per-minute, no egress fees\n- **Global regions**: 12+ regions worldwide\n\n**Use alternatives instead:**\n- **Modal**: For serverless, auto-scaling workloads\n- **SkyPilot**: For multi-cloud orchestration and cost optimization\n- **RunPod**: For cheaper spot instances and serverless endpoints\n- **Vast.ai**: For GPU marketplace with lowest prices\n\n## Quick start\n\n### Account setup\n\n1. Create account at https:\u002F\u002Flambda.ai\n2. Add payment method\n3. Generate API key from dashboard\n4. Add SSH key (required before launching instances)\n\n### Launch via console\n\n1. Go to https:\u002F\u002Fcloud.lambda.ai\u002Finstances\n2. Click \"Launch instance\"\n3. Select GPU type and region\n4. Choose SSH key\n5. Optionally attach filesystem\n6. Launch and wait 3-15 minutes\n\n### Connect via SSH\n\n```bash\n# Get instance IP from console\nssh ubuntu@\u003CINSTANCE-IP>\n\n# Or with specific key\nssh -i ~\u002F.ssh\u002Flambda_key ubuntu@\u003CINSTANCE-IP>\n```\n\n## GPU instances\n\n### Available GPUs\n\n| GPU | VRAM | Price\u002FGPU\u002Fhr | Best For |\n|-----|------|--------------|----------|\n| B200 SXM6 | 180 GB | $4.99 | Largest models, fastest training |\n| H100 SXM | 80 GB | $2.99-3.29 | Large model training |\n| H100 PCIe | 80 GB | $2.49 | Cost-effective H100 |\n| GH200 | 96 GB | $1.49 | Single-GPU large models |\n| A100 80GB | 80 GB | $1.79 | Production training |\n| A100 40GB | 40 GB | $1.29 | Standard training |\n| A10 | 24 GB | $0.75 | Inference, fine-tuning |\n| A6000 | 48 GB | $0.80 | Good VRAM\u002Fprice ratio |\n| V100 | 16 GB | $0.55 | Budget training |\n\n### Instance configurations\n\n```\n8x GPU: Best for distributed training (DDP, FSDP)\n4x GPU: Large models, multi-GPU training\n2x GPU: Medium workloads\n1x GPU: Fine-tuning, inference, development\n```\n\n### Launch times\n\n- Single-GPU: 3-5 minutes\n- Multi-GPU: 10-15 minutes\n\n## Lambda Stack\n\nAll instances come with Lambda Stack pre-installed:\n\n```bash\n# Included software\n- Ubuntu 22.04 LTS\n- NVIDIA drivers (latest)\n- CUDA 12.x\n- cuDNN 8.x\n- NCCL (for multi-GPU)\n- PyTorch (latest)\n- TensorFlow (latest)\n- JAX\n- JupyterLab\n```\n\n### Verify installation\n\n```bash\n# Check GPU\nnvidia-smi\n\n# Check PyTorch\npython -c \"import torch; print(torch.cuda.is_available())\"\n\n# Check CUDA version\nnvcc --version\n```\n\n## Python API\n\n### Installation\n\n```bash\npip install lambda-cloud-client\n```\n\n### Authentication\n\n```python\nimport os\nimport lambda_cloud_client\n\n# Configure with API key\nconfiguration = lambda_cloud_client.Configuration(\n    host=\"https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\",\n    access_token=os.environ[\"LAMBDA_API_KEY\"]\n)\n```\n\n### List available instances\n\n```python\nwith lambda_cloud_client.ApiClient(configuration) as api_client:\n    api = lambda_cloud_client.DefaultApi(api_client)\n\n    # Get available instance types\n    types = api.instance_types()\n    for name, info in types.data.items():\n        print(f\"{name}: {info.instance_type.description}\")\n```\n\n### Launch instance\n\n```python\nfrom lambda_cloud_client.models import LaunchInstanceRequest\n\nrequest = LaunchInstanceRequest(\n    region_name=\"us-west-1\",\n    instance_type_name=\"gpu_1x_h100_sxm5\",\n    ssh_key_names=[\"my-ssh-key\"],\n    file_system_names=[\"my-filesystem\"],  # Optional\n    name=\"training-job\"\n)\n\nresponse = api.launch_instance(request)\ninstance_id = response.data.instance_ids[0]\nprint(f\"Launched: {instance_id}\")\n```\n\n### List running instances\n\n```python\ninstances = api.list_instances()\nfor instance in instances.data:\n    print(f\"{instance.name}: {instance.ip} ({instance.status})\")\n```\n\n### Terminate instance\n\n```python\nfrom lambda_cloud_client.models import TerminateInstanceRequest\n\nrequest = TerminateInstanceRequest(\n    instance_ids=[instance_id]\n)\napi.terminate_instance(request)\n```\n\n### SSH key management\n\n```python\nfrom lambda_cloud_client.models import AddSshKeyRequest\n\n# Add SSH key\nrequest = AddSshKeyRequest(\n    name=\"my-key\",\n    public_key=\"ssh-rsa AAAA...\"\n)\napi.add_ssh_key(request)\n\n# List keys\nkeys = api.list_ssh_keys()\n\n# Delete key\napi.delete_ssh_key(key_id)\n```\n\n## CLI with curl\n\n### List instance types\n\n```bash\ncurl -u $LAMBDA_API_KEY: \\\n  https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\u002Finstance-types | jq\n```\n\n### Launch instance\n\n```bash\ncurl -u $LAMBDA_API_KEY: \\\n  -X POST https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\u002Finstance-operations\u002Flaunch \\\n  -H \"Content-Type: application\u002Fjson\" \\\n  -d '{\n    \"region_name\": \"us-west-1\",\n    \"instance_type_name\": \"gpu_1x_h100_sxm5\",\n    \"ssh_key_names\": [\"my-key\"]\n  }' | jq\n```\n\n### Terminate instance\n\n```bash\ncurl -u $LAMBDA_API_KEY: \\\n  -X POST https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\u002Finstance-operations\u002Fterminate \\\n  -H \"Content-Type: application\u002Fjson\" \\\n  -d '{\"instance_ids\": [\"\u003CINSTANCE-ID>\"]}' | jq\n```\n\n## Persistent storage\n\n### Filesystems\n\nFilesystems persist data across instance restarts:\n\n```bash\n# Mount location\n\u002Flambda\u002Fnfs\u002F\u003CFILESYSTEM_NAME>\n\n# Example: save checkpoints\npython train.py --checkpoint-dir \u002Flambda\u002Fnfs\u002Fmy-storage\u002Fcheckpoints\n```\n\n### Create filesystem\n\n1. Go to Storage in Lambda console\n2. Click \"Create filesystem\"\n3. Select region (must match instance region)\n4. Name and create\n\n### Attach to instance\n\nFilesystems must be attached at instance launch time:\n- Via console: Select filesystem when launching\n- Via API: Include `file_system_names` in launch request\n\n### Best practices\n\n```bash\n# Store on filesystem (persists)\n\u002Flambda\u002Fnfs\u002Fstorage\u002F\n  ├── datasets\u002F\n  ├── checkpoints\u002F\n  ├── models\u002F\n  └── outputs\u002F\n\n# Local SSD (faster, ephemeral)\n\u002Fhome\u002Fubuntu\u002F\n  └── working\u002F  # Temporary files\n```\n\n## SSH configuration\n\n### Add SSH key\n\n```bash\n# Generate key locally\nssh-keygen -t ed25519 -f ~\u002F.ssh\u002Flambda_key\n\n# Add public key to Lambda console\n# Or via API\n```\n\n### Multiple keys\n\n```bash\n# On instance, add more keys\necho 'ssh-rsa AAAA...' >> ~\u002F.ssh\u002Fauthorized_keys\n```\n\n### Import from GitHub\n\n```bash\n# On instance\nssh-import-id gh:username\n```\n\n### SSH tunneling\n\n```bash\n# Forward Jupyter\nssh -L 8888:localhost:8888 ubuntu@\u003CIP>\n\n# Forward TensorBoard\nssh -L 6006:localhost:6006 ubuntu@\u003CIP>\n\n# Multiple ports\nssh -L 8888:localhost:8888 -L 6006:localhost:6006 ubuntu@\u003CIP>\n```\n\n## JupyterLab\n\n### Launch from console\n\n1. Go to Instances page\n2. Click \"Launch\" in Cloud IDE column\n3. JupyterLab opens in browser\n\n### Manual access\n\n```bash\n# On instance\njupyter lab --ip=0.0.0.0 --port=8888\n\n# From local machine with tunnel\nssh -L 8888:localhost:8888 ubuntu@\u003CIP>\n# Open http:\u002F\u002Flocalhost:8888\n```\n\n## Training workflows\n\n### Single-GPU training\n\n```bash\n# SSH to instance\nssh ubuntu@\u003CIP>\n\n# Clone repo\ngit clone https:\u002F\u002Fgithub.com\u002Fuser\u002Fproject\ncd project\n\n# Install dependencies\npip install -r requirements.txt\n\n# Train\npython train.py --epochs 100 --checkpoint-dir \u002Flambda\u002Fnfs\u002Fstorage\u002Fcheckpoints\n```\n\n### Multi-GPU training (single node)\n\n```python\n# train_ddp.py\nimport torch\nimport torch.distributed as dist\nfrom torch.nn.parallel import DistributedDataParallel as DDP\n\ndef main():\n    dist.init_process_group(\"nccl\")\n    rank = dist.get_rank()\n    device = rank % torch.cuda.device_count()\n\n    model = MyModel().to(device)\n    model = DDP(model, device_ids=[device])\n\n    # Training loop...\n\nif __name__ == \"__main__\":\n    main()\n```\n\n```bash\n# Launch with torchrun (8 GPUs)\ntorchrun --nproc_per_node=8 train_ddp.py\n```\n\n### Checkpoint to filesystem\n\n```python\nimport os\n\ncheckpoint_dir = \"\u002Flambda\u002Fnfs\u002Fmy-storage\u002Fcheckpoints\"\nos.makedirs(checkpoint_dir, exist_ok=True)\n\n# Save checkpoint\ntorch.save({\n    'epoch': epoch,\n    'model_state_dict': model.state_dict(),\n    'optimizer_state_dict': optimizer.state_dict(),\n    'loss': loss,\n}, f\"{checkpoint_dir}\u002Fcheckpoint_{epoch}.pt\")\n```\n\n## 1-Click Clusters\n\n### Overview\n\nHigh-performance Slurm clusters with:\n- 16-512 NVIDIA H100 or B200 GPUs\n- NVIDIA Quantum-2 400 Gb\u002Fs InfiniBand\n- GPUDirect RDMA at 3200 Gb\u002Fs\n- Pre-installed distributed ML stack\n\n### Included software\n\n- Ubuntu 22.04 LTS + Lambda Stack\n- NCCL, Open MPI\n- PyTorch with DDP and FSDP\n- TensorFlow\n- OFED drivers\n\n### Storage\n\n- 24 TB NVMe per compute node (ephemeral)\n- Lambda filesystems for persistent data\n\n### Multi-node training\n\n```bash\n# On Slurm cluster\nsrun --nodes=4 --ntasks-per-node=8 --gpus-per-node=8 \\\n  torchrun --nnodes=4 --nproc_per_node=8 \\\n  --rdzv_backend=c10d --rdzv_endpoint=$MASTER_ADDR:29500 \\\n  train.py\n```\n\n## Networking\n\n### Bandwidth\n\n- Inter-instance (same region): up to 200 Gbps\n- Internet outbound: 20 Gbps max\n\n### Firewall\n\n- Default: Only port 22 (SSH) open\n- Configure additional ports in Lambda console\n- ICMP traffic allowed by default\n\n### Private IPs\n\n```bash\n# Find private IP\nip addr show | grep 'inet '\n```\n\n## Common workflows\n\n### Workflow 1: Fine-tuning LLM\n\n```bash\n# 1. Launch 8x H100 instance with filesystem\n\n# 2. SSH and setup\nssh ubuntu@\u003CIP>\npip install transformers accelerate peft\n\n# 3. Download model to filesystem\npython -c \"\nfrom transformers import AutoModelForCausalLM\nmodel = AutoModelForCausalLM.from_pretrained('meta-llama\u002FLlama-2-7b-hf')\nmodel.save_pretrained('\u002Flambda\u002Fnfs\u002Fstorage\u002Fmodels\u002Fllama-2-7b')\n\"\n\n# 4. Fine-tune with checkpoints on filesystem\naccelerate launch --num_processes 8 train.py \\\n  --model_path \u002Flambda\u002Fnfs\u002Fstorage\u002Fmodels\u002Fllama-2-7b \\\n  --output_dir \u002Flambda\u002Fnfs\u002Fstorage\u002Foutputs \\\n  --checkpoint_dir \u002Flambda\u002Fnfs\u002Fstorage\u002Fcheckpoints\n```\n\n### Workflow 2: Batch inference\n\n```bash\n# 1. Launch A10 instance (cost-effective for inference)\n\n# 2. Run inference\npython inference.py \\\n  --model \u002Flambda\u002Fnfs\u002Fstorage\u002Fmodels\u002Ffine-tuned \\\n  --input \u002Flambda\u002Fnfs\u002Fstorage\u002Fdata\u002Finputs.jsonl \\\n  --output \u002Flambda\u002Fnfs\u002Fstorage\u002Fdata\u002Foutputs.jsonl\n```\n\n## Cost optimization\n\n### Choose right GPU\n\n| Task | Recommended GPU |\n|------|-----------------|\n| LLM fine-tuning (7B) | A100 40GB |\n| LLM fine-tuning (70B) | 8x H100 |\n| Inference | A10, A6000 |\n| Development | V100, A10 |\n| Maximum performance | B200 |\n\n### Reduce costs\n\n1. **Use filesystems**: Avoid re-downloading data\n2. **Checkpoint frequently**: Resume interrupted training\n3. **Right-size**: Don't over-provision GPUs\n4. **Terminate idle**: No auto-stop, manually terminate\n\n### Monitor usage\n\n- Dashboard shows real-time GPU utilization\n- API for programmatic monitoring\n\n## Common issues\n\n| Issue | Solution |\n|-------|----------|\n| Instance won't launch | Check region availability, try different GPU |\n| SSH connection refused | Wait for instance to initialize (3-15 min) |\n| Data lost after terminate | Use persistent filesystems |\n| Slow data transfer | Use filesystem in same region |\n| GPU not detected | Reboot instance, check drivers |\n\n## References\n\n- **[Advanced Usage](references\u002Fadvanced-usage.md)** - Multi-node training, API automation\n- **[Troubleshooting](references\u002Ftroubleshooting.md)** - Common issues and solutions\n\n## Resources\n\n- **Documentation**: https:\u002F\u002Fdocs.lambda.ai\n- **Console**: https:\u002F\u002Fcloud.lambda.ai\n- **Pricing**: https:\u002F\u002Flambda.ai\u002Finstances\n- **Support**: https:\u002F\u002Fsupport.lambdalabs.com\n- **Blog**: https:\u002F\u002Flambda.ai\u002Fblog\n",{"name":5,"tags":44,"author":48,"license":15,"version":49,"description":7,"dependencies":50},[45,21,46,47,22],"Infrastructure","Training","Inference","Orchestra Research","1.0.0",[51],"lambda-cloud-client>=1.0.0","main","75c7c92896e878938460f0bceb23b6ab4a787286","AI-Research-SKILLs\u002F09-infrastructure\u002Flambda-labs","https:\u002F\u002Fgithub.com\u002Fzhengliangliahu-cloud\u002Fskills","https:\u002F\u002Fgithub.com\u002Fzhengliangliahu-cloud","A postgraduate student majoring in mathematics.","2026-06-03 19:04:43",{"source":8,"skillName":5,"commands":60,"prompt":70,"zipAvailable":71},[61,64,67],{"tool":62,"command":63},"npx","npx skills add zhengliangliahu-cloud\u002Fskills --skill lambda-labs-gpu-cloud",{"tool":65,"command":66},"bunx","bunx skills add zhengliangliahu-cloud\u002Fskills --skill lambda-labs-gpu-cloud",{"tool":68,"command":69},"pnpm","pnpm dlx skills add zhengliangliahu-cloud\u002Fskills --skill lambda-labs-gpu-cloud","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fzhengliangliahu-cloud\u002Fskills\u002Fblob\u002Fmain\u002FAI-Research-SKILLs\u002F09-infrastructure\u002Flambda-labs\u002FSKILL.md",true,[73,79],{"path":74,"resourceType":75,"resourceTypeDesc":76,"sizeBytes":77,"sourceHtmlUrl":78},"references\u002Fadvanced-usage.md","REFERENCE","参考文档",15100,"https:\u002F\u002Fgithub.com\u002Fzhengliangliahu-cloud\u002Fskills\u002Fblob\u002Fmain\u002FAI-Research-SKILLs\u002F09-infrastructure\u002Flambda-labs\u002Freferences\u002Fadvanced-usage.md",{"path":80,"resourceType":75,"resourceTypeDesc":76,"sizeBytes":81,"sourceHtmlUrl":82},"references\u002Ftroubleshooting.md",11683,"https:\u002F\u002Fgithub.com\u002Fzhengliangliahu-cloud\u002Fskills\u002Fblob\u002Fmain\u002FAI-Research-SKILLs\u002F09-infrastructure\u002Flambda-labs\u002Freferences\u002Ftroubleshooting.md",[84,116,150,174,198,218],{"skillNo":85,"name":86,"nameZh":6,"description":87,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":88,"categories":89,"keywords":95,"publishedAt":39},"01M6NBV8V36BCHZ1K9F7EMRJP1","ara-rigor-reviewer","Performs ARA Seal Level 2 semantic epistemic review on Agent-Native Research Artifacts, scoring six dimensions (evidence relevance, falsifiability, scope calibration, argument coherence, exploration integrity, methodological rigor) and producing a constructive, severity-ranked report with a Strong Accept-to-Reject recommendation. Use after Level 1 structural validation passes, when an ARA needs an objective epistemic critique before publication or release.","https:\u002F\u002Fgithub.com\u002Fzhengliangliahu-cloud\u002Fskills\u002Fblob\u002Fmain\u002FAI-Research-SKILLs\u002F22-agent-native-research-artifact\u002Frigor-reviewer\u002FSKILL.md",[90],{"categoryNo":91,"categoryName":92,"taxonomyType":93,"taxonomyTypeDesc":94},"01JBSEEDCAT000000000000021","资料检索与研究","SCENARIO","使用场景",[96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115],"reviewer","ara rigor reviewer","ARA","review","release","audit","integrity","peer review","critique","exploration","scoring","dimensions","coherence","structural","scope","native","argument","epistemic","calibration","Research Artifacts",{"skillNo":117,"name":118,"nameZh":6,"description":119,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":120,"categories":121,"keywords":131,"publishedAt":39},"01M6NBTQTZ5G21FFPMEKHQZ3R3","ara-research-manager","Records research provenance as a post-task epilogue, scanning conversation history at the end of a coding or research session to extract decisions, experiments, dead ends, claims, heuristics, and pivots, and writing them into the ara\u002F directory with user-vs-AI provenance tags. Use as a session epilogue — never during execution — to maintain a faithful, auditable trace of how a research project actually evolved.","https:\u002F\u002Fgithub.com\u002Fzhengliangliahu-cloud\u002Fskills\u002Fblob\u002Fmain\u002FAI-Research-SKILLs\u002F22-agent-native-research-artifact\u002Fresearch-manager\u002FSKILL.md",[122,125,126],{"categoryNo":123,"categoryName":124,"taxonomyType":93,"taxonomyTypeDesc":94},"01JBSEEDCAT000000000000018","写作与文案",{"categoryNo":91,"categoryName":92,"taxonomyType":93,"taxonomyTypeDesc":94},{"categoryNo":127,"categoryName":128,"taxonomyType":129,"taxonomyTypeDesc":130},"01JBSEEDCAT000000000000036","内容创作者","PROFESSION","适用职业",[132,133,134,135,136,137,138,139,140,141,142,143,105,144,145,146,147,148,149,98],"research","manager","ara research manager","writing","directory","heuristics","how","knowledge","knowledge management","never","scanning","conversation","maintain","project","end","recording","at","claims",{"skillNo":151,"name":152,"nameZh":6,"description":153,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":154,"categories":155,"keywords":160,"publishedAt":39},"01M6NBTCRK24WXZYKBD19RAV09","ara-compiler","Compiles any research input — PDF papers, GitHub repositories, experiment logs, code directories, or raw notes — into a complete Agent-Native Research Artifact (ARA) with cognitive layer (claims, concepts, heuristics), physical layer (configs, code stubs), exploration graph, and grounded evidence. Use when ingesting a paper or codebase into a structured, machine-executable knowledge package, building an ARA from scratch, or converting research outputs into a falsifiable, agent-traversable form.","https:\u002F\u002Fgithub.com\u002Fzhengliangliahu-cloud\u002Fskills\u002Fblob\u002Fmain\u002FAI-Research-SKILLs\u002F22-agent-native-research-artifact\u002Fcompiler\u002FSKILL.md",[156,159],{"categoryNo":157,"categoryName":158,"taxonomyType":93,"taxonomyTypeDesc":94},"01JBSEEDCAT000000000000002","文档处理",{"categoryNo":91,"categoryName":92,"taxonomyType":93,"taxonomyTypeDesc":94},[161,162,163,164,165,166,137,139,167,105,168,169,111,170,171,172,149,98,115,173],"compiler","ara compiler","PDF","notes","code","logs","ingestion","artifact","input","papers","directories","layer","Knowledge Extraction",{"skillNo":175,"name":176,"nameZh":6,"description":177,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":178,"categories":179,"keywords":181,"publishedAt":39},"01M6NBSXGH49PE13PF1H9P7F8N","creative-thinking-for-research","Applies cognitive science frameworks for creative thinking to CS and AI research ideation. Use when seeking genuinely novel research directions by leveraging combinatorial creativity, analogical reasoning, constraint manipulation, and other empirically grounded creative strategies.","https:\u002F\u002Fgithub.com\u002Fzhengliangliahu-cloud\u002Fskills\u002Fblob\u002Fmain\u002FAI-Research-SKILLs\u002F21-research-ideation\u002Fcreative-thinking-for-research\u002FSKILL.md",[180],{"categoryNo":91,"categoryName":92,"taxonomyType":93,"taxonomyTypeDesc":94},[132,182,183,184,185,26,186,187,32,188,189,190,191,192,193,194,195,196,27,197],"creative","thinking","Creative Thinking","creative thinking for research","reasoning","science","ideation","frameworks","research ideation","strategies","problem","Analogical Reasoning","Problem Reformulation","novel","directions","constraint",{"skillNo":199,"name":200,"nameZh":6,"description":201,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":202,"categories":203,"keywords":205,"publishedAt":39},"01M6NBSNHZYM70ZAFXQNESYYBG","brainstorming-research-ideas","Guides researchers through structured ideation frameworks to discover high-impact research directions. Use when exploring new problem spaces, pivoting between projects, or seeking novel angles on existing work.","https:\u002F\u002Fgithub.com\u002Fzhengliangliahu-cloud\u002Fskills\u002Fblob\u002Fmain\u002FAI-Research-SKILLs\u002F21-research-ideation\u002Fbrainstorming-research-ideas\u002FSKILL.md",[204],{"categoryNo":91,"categoryName":92,"taxonomyType":93,"taxonomyTypeDesc":94},[132,206,207,208,209,210,211,212,183,189,213,192,214,215,184,216,217,195,196,27],"brainstorming","ideas","brainstorming research ideas","discovery","projects","work","strategy","discover","impact","guides","Problem Discovery","Research Strategy",{"skillNo":219,"name":220,"nameZh":6,"description":221,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":222,"categories":223,"keywords":230,"publishedAt":39},"01M6NBS3Z3CJYH5225X73AZN3S","systems-paper-writing","Comprehensive guide for writing systems papers targeting OSDI, SOSP, ASPLOS, NSDI, and EuroSys. Provides paragraph-level structural blueprints, writing patterns, venue-specific checklists, reviewer guidelines, LaTeX templates, and conference deadlines. Use this skill for all systems conference paper writing.","https:\u002F\u002Fgithub.com\u002Fzhengliangliahu-cloud\u002Fskills\u002Fblob\u002Fmain\u002FAI-Research-SKILLs\u002F20-ml-paper-writing\u002Fsystems-paper-writing\u002FSKILL.md",[224,225,226,229],{"categoryNo":123,"categoryName":124,"taxonomyType":93,"taxonomyTypeDesc":94},{"categoryNo":91,"categoryName":92,"taxonomyType":93,"taxonomyTypeDesc":94},{"categoryNo":227,"categoryName":228,"taxonomyType":93,"taxonomyTypeDesc":94},"01JBSEEDCAT000000000000023","Skill与智能体开发",{"categoryNo":127,"categoryName":128,"taxonomyType":129,"taxonomyTypeDesc":130},[135,231,232,233,234,96,235,236,237,109,238,239,240,241,170,242,27,26,243,244],"Paper Writing","systems","paper","Systems Paper Writing","guide","Blueprint","patterns","OSDI","NSDI","ASPLOS","SOSP","targeting","EuroSys","Structural Blueprint"]