[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6QMX4MGRJCWA02S5VB2D574":3,"skill-same:01M6QMX4MGRJCWA02S5VB2D574":95},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":39,"linkOnly":40,"markdownContent":41,"markdownBody":42,"frontMatter":43,"refName":62,"commitSha":63,"skillDirectory":64,"forksCount":14,"repositoryHtmlUrl":65,"repositoryHomepageUrl":66,"ownerHtmlUrl":67,"ownerBlogUrl":68,"ownerDescription":69,"updatedAt":70,"install":71,"resources":84},"01M6QMX4MGRJCWA02S5VB2D574","evaluating-cosmos-policy",null,"Evaluates NVIDIA Cosmos Policy on LIBERO and RoboCasa simulation environments. Use when setting up cosmos-policy for robot manipulation evaluation, running headless GPU evaluations with EGL rendering, or profiling inference latency on cluster or local GPU machines.","Tashima-Tarsh\u002FDisha6.6","Tashima-Tarsh","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F269906498?v=4","01M6PBH98X03XERH0HFT4PFB1P","NITISH KUMAR","01M6PBH9DA0M6KM3Z12P848F0K",0,"MIT","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fqc-cosmos-policy\u002FSKILL.md",[],[19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38],"evaluating cosmos policy","Cosmos Policy","cosmos","policy","latency","for","orchestra","headless","environments","rendering","cluster","local","robotics","up","use","simulation","Transformers","NVIDIA","Evaluation","git","2026-11-10 10:12:30",false,"---\nname: evaluating-cosmos-policy\ndescription: Evaluates NVIDIA Cosmos Policy on LIBERO and RoboCasa simulation environments. Use when setting up cosmos-policy for robot manipulation evaluation, running headless GPU evaluations with EGL rendering, or profiling inference latency on cluster or local GPU machines.\nversion: 1.0.0\nauthor: Orchestra Research\nlicense: MIT\ntags: [Cosmos Policy, VLA, Robotics, LIBERO, RoboCasa, Simulation, Evaluation, Profiling, EGL Rendering]\ndependencies: [torch>=2.1.0, mujoco>=3.0.0, robosuite>=1.4.0, \"robocasa @ git+https:\u002F\u002Fgithub.com\u002Fmoojink\u002Frobocasa-cosmos-policy.git\", transformers>=4.40.0, \"cosmos-policy @ git+https:\u002F\u002Fgithub.com\u002FNVlabs\u002Fcosmos-policy.git\"]\ncategory: \"ai-research\"\n---\n\n# Cosmos Policy Evaluation\n\nEvaluation workflows for NVIDIA Cosmos Policy on LIBERO and RoboCasa simulation environments from the public `cosmos-policy` repository. Covers blank-machine setup, headless GPU evaluation, and inference profiling.\n\n## Quick start\n\nRun a minimal LIBERO evaluation using the official public eval module:\n\n```bash\nuv run --extra cu128 --group libero --python 3.10 \\\n  python -m cosmos_policy.experiments.robot.libero.run_libero_eval \\\n    --config cosmos_predict2_2b_480p_libero__inference_only \\\n    --ckpt_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B \\\n    --config_file cosmos_policy\u002Fconfig\u002Fconfig.py \\\n    --use_wrist_image True \\\n    --use_proprio True \\\n    --normalize_proprio True \\\n    --unnormalize_actions True \\\n    --dataset_stats_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B\u002Flibero_dataset_statistics.json \\\n    --t5_text_embeddings_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B\u002Flibero_t5_embeddings.pkl \\\n    --trained_with_image_aug True \\\n    --chunk_size 16 \\\n    --num_open_loop_steps 16 \\\n    --task_suite_name libero_10 \\\n    --num_trials_per_task 1 \\\n    --local_log_dir cosmos_policy\u002Fexperiments\u002Frobot\u002Flibero\u002Flogs\u002F \\\n    --seed 195 \\\n    --randomize_seed False \\\n    --deterministic True \\\n    --run_id_note smoke \\\n    --ar_future_prediction False \\\n    --ar_value_prediction False \\\n    --use_jpeg_compression True \\\n    --flip_images True \\\n    --num_denoising_steps_action 5 \\\n    --num_denoising_steps_future_state 1 \\\n    --num_denoising_steps_value 1 \\\n    --data_collection False\n```\n\n## Core concepts\n\n**What Cosmos Policy is**: NVIDIA Cosmos Policy is a vision-language-action (VLA) model that uses Cosmos Tokenizer to encode visual observations into discrete tokens, then predicts robot actions conditioned on language instructions and visual context.\n\n**Key architecture choices**:\n\n| Component | Design |\n|-----------|--------|\n| Visual encoder | Cosmos Tokenizer (discrete tokens) |\n| Language conditioning | Cross-attention to language embeddings |\n| Action prediction | Autoregressive action token generation |\n\n**Public command surface**: The supported evaluation entrypoints are `cosmos_policy.experiments.robot.libero.run_libero_eval` and `cosmos_policy.experiments.robot.robocasa.run_robocasa_eval`. Keep reproduction notes anchored to these public modules and their documented flags.\n\n## Compute requirements\n\n| Task | GPU | VRAM | Typical wall time |\n|------|-----|------|-------------------|\n| LIBERO smoke eval (1 trial) | 1x A40\u002FA100 | ~16 GB | 5-10 min |\n| LIBERO full eval (50 trials) | 1x A40\u002FA100 | ~16 GB | 2-4 hours |\n| RoboCasa single-task (2 trials) | 1x A40\u002FA100 | ~18 GB | 10-15 min |\n| RoboCasa all-tasks | 1x A40\u002FA100 | ~18 GB | 4-8 hours |\n\n## When to use vs alternatives\n\n**Use this skill when:**\n- Evaluating NVIDIA Cosmos Policy on LIBERO or RoboCasa benchmarks\n- Profiling inference latency and throughput for Cosmos Policy\n- Setting up headless EGL rendering for robot simulation on GPU clusters\n\n**Use alternatives when:**\n- Training or fine-tuning Cosmos Policy from scratch (use official Cosmos training docs)\n- Working with OpenVLA-based policies (use `fine-tuning-openvla-oft`)\n- Working with Physical Intelligence pi0 models (use `fine-tuning-serving-openpi`)\n- Running real-robot evaluation rather than simulation\n\n---\n\n## Workflow 1: LIBERO evaluation\n\nCopy this checklist and track progress:\n\n```text\nLIBERO Eval Progress:\n- [ ] Step 1: Install environment and dependencies\n- [ ] Step 2: Configure headless EGL rendering\n- [ ] Step 3: Run smoke evaluation\n- [ ] Step 4: Validate outputs and parse results\n- [ ] Step 5: Run full benchmark if smoke passes\n```\n\n**Step 1: Install environment**\n\n```bash\ngit clone https:\u002F\u002Fgithub.com\u002FNVlabs\u002Fcosmos-policy.git\ncd cosmos-policy\n# Follow SETUP.md to build and enter the supported Docker container.\n# Then, inside the container:\nuv sync --extra cu128 --group libero --python 3.10\n```\n\n**Step 2: Configure headless rendering**\n\n```bash\nexport CUDA_VISIBLE_DEVICES=0\nexport MUJOCO_EGL_DEVICE_ID=0\nexport MUJOCO_GL=egl\nexport PYOPENGL_PLATFORM=egl\n```\n\n**Step 3: Run smoke evaluation**\n\n```bash\nuv run --extra cu128 --group libero --python 3.10 \\\n  python -m cosmos_policy.experiments.robot.libero.run_libero_eval \\\n    --config cosmos_predict2_2b_480p_libero__inference_only \\\n    --ckpt_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B \\\n    --config_file cosmos_policy\u002Fconfig\u002Fconfig.py \\\n    --use_wrist_image True \\\n    --use_proprio True \\\n    --normalize_proprio True \\\n    --unnormalize_actions True \\\n    --dataset_stats_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B\u002Flibero_dataset_statistics.json \\\n    --t5_text_embeddings_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B\u002Flibero_t5_embeddings.pkl \\\n    --trained_with_image_aug True \\\n    --chunk_size 16 \\\n    --num_open_loop_steps 16 \\\n    --task_suite_name libero_10 \\\n    --num_trials_per_task 1 \\\n    --local_log_dir cosmos_policy\u002Fexperiments\u002Frobot\u002Flibero\u002Flogs\u002F \\\n    --seed 195 \\\n    --randomize_seed False \\\n    --deterministic True \\\n    --run_id_note smoke \\\n    --ar_future_prediction False \\\n    --ar_value_prediction False \\\n    --use_jpeg_compression True \\\n    --flip_images True \\\n    --num_denoising_steps_action 5 \\\n    --num_denoising_steps_future_state 1 \\\n    --num_denoising_steps_value 1 \\\n    --data_collection False\n```\n\n**Step 4: Validate and parse results**\n\n```python\nimport json\nimport glob\n\n# Find latest evaluation result from the official log directory\nlog_files = sorted(glob.glob(\"cosmos_policy\u002Fexperiments\u002Frobot\u002Flibero\u002Flogs\u002F**\u002F*.json\", recursive=True))\nwith open(log_files[-1]) as f:\n    results = json.load(f)\n\nprint(results)\n```\n\n**Step 5: Scale up**\n\nRun across all four LIBERO task suites with 50 trials:\n\n```bash\nfor suite in libero_spatial libero_object libero_goal libero_10; do\n  uv run --extra cu128 --group libero --python 3.10 \\\n    python -m cosmos_policy.experiments.robot.libero.run_libero_eval \\\n      --config cosmos_predict2_2b_480p_libero__inference_only \\\n      --ckpt_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B \\\n      --config_file cosmos_policy\u002Fconfig\u002Fconfig.py \\\n      --use_wrist_image True \\\n      --use_proprio True \\\n      --normalize_proprio True \\\n      --unnormalize_actions True \\\n      --dataset_stats_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B\u002Flibero_dataset_statistics.json \\\n      --t5_text_embeddings_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B\u002Flibero_t5_embeddings.pkl \\\n      --trained_with_image_aug True \\\n      --chunk_size 16 \\\n      --num_open_loop_steps 16 \\\n      --task_suite_name \"$suite\" \\\n      --num_trials_per_task 50 \\\n      --local_log_dir cosmos_policy\u002Fexperiments\u002Frobot\u002Flibero\u002Flogs\u002F \\\n      --seed 195 \\\n      --randomize_seed False \\\n      --deterministic True \\\n      --run_id_note \"suite_${suite}\" \\\n      --ar_future_prediction False \\\n      --ar_value_prediction False \\\n      --use_jpeg_compression True \\\n      --flip_images True \\\n      --num_denoising_steps_action 5 \\\n      --num_denoising_steps_future_state 1 \\\n      --num_denoising_steps_value 1 \\\n      --data_collection False\ndone\n```\n\n---\n\n## Workflow 2: RoboCasa evaluation\n\nCopy this checklist and track progress:\n\n```text\nRoboCasa Eval Progress:\n- [ ] Step 1: Install RoboCasa assets and verify macros\n- [ ] Step 2: Run single-task smoke evaluation\n- [ ] Step 3: Validate outputs\n- [ ] Step 4: Expand to multi-task runs\n```\n\n**Step 1: Install RoboCasa**\n\n```bash\ngit clone https:\u002F\u002Fgithub.com\u002Fmoojink\u002Frobocasa-cosmos-policy.git\nuv pip install -e robocasa-cosmos-policy\npython -m robocasa.scripts.setup_macros\npython -m robocasa.scripts.download_kitchen_assets\n```\n\nThis fork installs the `robocasa` Python package expected by Cosmos Policy while preserving the patched environment changes used in the public RoboCasa eval path. Verify `macros_private.py` exists and paths are correct.\n\n**Step 2: Single-task smoke evaluation**\n\n```bash\nuv run --extra cu128 --group robocasa --python 3.10 \\\n  python -m cosmos_policy.experiments.robot.robocasa.run_robocasa_eval \\\n    --config cosmos_predict2_2b_480p_robocasa_50_demos_per_task__inference \\\n    --ckpt_path nvidia\u002FCosmos-Policy-RoboCasa-Predict2-2B \\\n    --config_file cosmos_policy\u002Fconfig\u002Fconfig.py \\\n    --use_wrist_image True \\\n    --num_wrist_images 1 \\\n    --use_proprio True \\\n    --normalize_proprio True \\\n    --unnormalize_actions True \\\n    --dataset_stats_path nvidia\u002FCosmos-Policy-RoboCasa-Predict2-2B\u002Frobocasa_dataset_statistics.json \\\n    --t5_text_embeddings_path nvidia\u002FCosmos-Policy-RoboCasa-Predict2-2B\u002Frobocasa_t5_embeddings.pkl \\\n    --trained_with_image_aug True \\\n    --chunk_size 32 \\\n    --num_open_loop_steps 16 \\\n    --task_name TurnOffMicrowave \\\n    --obj_instance_split A \\\n    --num_trials_per_task 2 \\\n    --local_log_dir cosmos_policy\u002Fexperiments\u002Frobot\u002Frobocasa\u002Flogs\u002F \\\n    --seed 195 \\\n    --randomize_seed False \\\n    --deterministic True \\\n    --run_id_note smoke \\\n    --use_variance_scale False \\\n    --use_jpeg_compression True \\\n    --flip_images True \\\n    --num_denoising_steps_action 5 \\\n    --num_denoising_steps_future_state 1 \\\n    --num_denoising_steps_value 1 \\\n    --data_collection False\n```\n\n**Step 3: Validate outputs**\n\n- Confirm the eval log prints the expected task name, object split, and checkpoint\u002Fconfig values.\n- Inspect the final `Success rate:` line in the log.\n\n**Step 4: Expand scope**\n\nIncrease `--num_trials_per_task` or add more tasks. Keep `--obj_instance_split` fixed across repeated runs for comparability.\n\n---\n\n## Workflow 3: Blank-machine cluster launch\n\n```text\nCluster Launch Progress:\n- [ ] Step 1: Clone the public repo and enter the supported runtime\n- [ ] Step 2: Sync the benchmark-specific dependency group\n- [ ] Step 3: Export rendering and cache environment variables before eval\n```\n\n**Step 1: Clone and enter the supported runtime**\n\n```bash\ngit clone https:\u002F\u002Fgithub.com\u002FNVlabs\u002Fcosmos-policy.git\ncd cosmos-policy\n# Follow SETUP.md, start the Docker container, and enter it before continuing.\n```\n\n**Step 2: Sync dependencies**\n\n```bash\nuv sync --extra cu128 --group libero --python 3.10\n# or, for RoboCasa:\nuv sync --extra cu128 --group robocasa --python 3.10\n# then install the Cosmos-compatible RoboCasa fork:\ngit clone https:\u002F\u002Fgithub.com\u002Fmoojink\u002Frobocasa-cosmos-policy.git\nuv pip install -e robocasa-cosmos-policy\n```\n\n**Step 3: Export runtime environment**\n\n```bash\nexport CUDA_VISIBLE_DEVICES=0\nexport MUJOCO_EGL_DEVICE_ID=0\nexport MUJOCO_GL=egl\nexport PYOPENGL_PLATFORM=egl\nexport HF_HOME=${HF_HOME:-$HOME\u002F.cache\u002Fhuggingface}\nexport TRANSFORMERS_CACHE=${TRANSFORMERS_CACHE:-$HF_HOME}\n```\n\n---\n\n## Expected performance benchmarks\n\nReference values from official evaluation (tied to specific setup and seeds):\n\n| Task Suite | Success Rate | Notes |\n|-----------|-------------|-------|\n| LIBERO-Spatial | 98.1% | Official LIBERO spatial result |\n| LIBERO-Object | 100.0% | Official LIBERO object result |\n| LIBERO-Goal | 98.2% | Official LIBERO goal result |\n| LIBERO-Long | 97.6% | Official LIBERO long-horizon result |\n| LIBERO-Average | 98.5% | Official average across LIBERO suites |\n| RoboCasa | 67.1% | Official RoboCasa average result |\n\n**Reproduction note**: Published success rates still depend on checkpoint choice, task suite, seeds, and simulator setup. Record the exact command and environment alongside any reported number.\n\n---\n\n## Non-negotiable rules\n\n- **EGL alignment**: Always set `CUDA_VISIBLE_DEVICES`, `MUJOCO_EGL_DEVICE_ID`, `MUJOCO_GL=egl`, and `PYOPENGL_PLATFORM=egl` together on headless GPU nodes.\n- **Official runtime first**: If host-Python installs hit binary compatibility issues, fall back to the supported container workflow from `SETUP.md` before debugging package internals.\n- **Cache consistency**: Use the same cache directory across setup and eval so Hugging Face and dependency caches are reused.\n- **Run comparability**: Keep task name, object split, seed, and trial count fixed across repeated runs.\n\n---\n\n## Common issues\n\n**Issue: binary compatibility or loader failures on host Python**\n\nFix: rerun inside the official container\u002Fruntime from `SETUP.md`. Do not assume host-package rebuilds will match the public release environment.\n\n**Issue: LIBERO prompts for config path in a non-interactive shell**\n\nFix: pre-create `LIBERO_CONFIG_PATH\u002Fconfig.yaml`:\n\n```python\nimport os, yaml\n\nconfig_dir = os.path.expanduser(\"~\u002F.libero\")\nos.makedirs(config_dir, exist_ok=True)\nwith open(os.path.join(config_dir, \"config.yaml\"), \"w\") as f:\n    yaml.dump({\"benchmark_root\": \"\u002Fpath\u002Fto\u002Flibero\u002Fdatasets\"}, f)\n```\n\n**Issue: EGL initialization or shutdown noise**\n\nFix: align EGL environment variables first. Treat teardown-only `EGL_NOT_INITIALIZED` warnings as low-signal unless the job exits non-zero.\n\n**Issue: Kitchen object sampling NaNs or asset lookup failures in RoboCasa**\n\nFix: rerun asset setup and confirm the patched robocasa install is intact:\n\n```bash\npython -m robocasa.scripts.download_kitchen_assets\npython -c \"import robocasa; print(robocasa.__file__)\"\n```\n\n**Issue: MuJoCo rendering mismatch**\n\nFix: verify GPU device alignment:\n\n```python\nimport os\ncuda_dev = os.environ.get(\"CUDA_VISIBLE_DEVICES\", \"not set\")\negl_dev = os.environ.get(\"MUJOCO_EGL_DEVICE_ID\", \"not set\")\nassert cuda_dev == egl_dev, f\"GPU mismatch: CUDA={cuda_dev}, EGL={egl_dev}\"\nprint(f\"Rendering on GPU {cuda_dev}\")\n```\n\n---\n\n## Advanced topics\n\n**LIBERO command matrix**: See [references\u002Flibero-commands.md](references\u002Flibero-commands.md)\n**RoboCasa command matrix**: See [references\u002Frobocasa-commands.md](references\u002Frobocasa-commands.md)\n\n## Resources\n\n- Cosmos Policy repository: https:\u002F\u002Fgithub.com\u002FNVlabs\u002Fcosmos-policy\n- LIBERO benchmark: https:\u002F\u002Fgithub.com\u002FLifelong-Robot-Learning\u002FLIBERO\n- Cosmos-compatible RoboCasa fork: https:\u002F\u002Fgithub.com\u002Fmoojink\u002Frobocasa-cosmos-policy\n- Upstream RoboCasa project: https:\u002F\u002Fgithub.com\u002Frobocasa\u002Frobocasa\n- MuJoCo documentation: https:\u002F\u002Fmujoco.readthedocs.io\u002F\n","# Cosmos Policy Evaluation\n\nEvaluation workflows for NVIDIA Cosmos Policy on LIBERO and RoboCasa simulation environments from the public `cosmos-policy` repository. Covers blank-machine setup, headless GPU evaluation, and inference profiling.\n\n## Quick start\n\nRun a minimal LIBERO evaluation using the official public eval module:\n\n```bash\nuv run --extra cu128 --group libero --python 3.10 \\\n  python -m cosmos_policy.experiments.robot.libero.run_libero_eval \\\n    --config cosmos_predict2_2b_480p_libero__inference_only \\\n    --ckpt_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B \\\n    --config_file cosmos_policy\u002Fconfig\u002Fconfig.py \\\n    --use_wrist_image True \\\n    --use_proprio True \\\n    --normalize_proprio True \\\n    --unnormalize_actions True \\\n    --dataset_stats_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B\u002Flibero_dataset_statistics.json \\\n    --t5_text_embeddings_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B\u002Flibero_t5_embeddings.pkl \\\n    --trained_with_image_aug True \\\n    --chunk_size 16 \\\n    --num_open_loop_steps 16 \\\n    --task_suite_name libero_10 \\\n    --num_trials_per_task 1 \\\n    --local_log_dir cosmos_policy\u002Fexperiments\u002Frobot\u002Flibero\u002Flogs\u002F \\\n    --seed 195 \\\n    --randomize_seed False \\\n    --deterministic True \\\n    --run_id_note smoke \\\n    --ar_future_prediction False \\\n    --ar_value_prediction False \\\n    --use_jpeg_compression True \\\n    --flip_images True \\\n    --num_denoising_steps_action 5 \\\n    --num_denoising_steps_future_state 1 \\\n    --num_denoising_steps_value 1 \\\n    --data_collection False\n```\n\n## Core concepts\n\n**What Cosmos Policy is**: NVIDIA Cosmos Policy is a vision-language-action (VLA) model that uses Cosmos Tokenizer to encode visual observations into discrete tokens, then predicts robot actions conditioned on language instructions and visual context.\n\n**Key architecture choices**:\n\n| Component | Design |\n|-----------|--------|\n| Visual encoder | Cosmos Tokenizer (discrete tokens) |\n| Language conditioning | Cross-attention to language embeddings |\n| Action prediction | Autoregressive action token generation |\n\n**Public command surface**: The supported evaluation entrypoints are `cosmos_policy.experiments.robot.libero.run_libero_eval` and `cosmos_policy.experiments.robot.robocasa.run_robocasa_eval`. Keep reproduction notes anchored to these public modules and their documented flags.\n\n## Compute requirements\n\n| Task | GPU | VRAM | Typical wall time |\n|------|-----|------|-------------------|\n| LIBERO smoke eval (1 trial) | 1x A40\u002FA100 | ~16 GB | 5-10 min |\n| LIBERO full eval (50 trials) | 1x A40\u002FA100 | ~16 GB | 2-4 hours |\n| RoboCasa single-task (2 trials) | 1x A40\u002FA100 | ~18 GB | 10-15 min |\n| RoboCasa all-tasks | 1x A40\u002FA100 | ~18 GB | 4-8 hours |\n\n## When to use vs alternatives\n\n**Use this skill when:**\n- Evaluating NVIDIA Cosmos Policy on LIBERO or RoboCasa benchmarks\n- Profiling inference latency and throughput for Cosmos Policy\n- Setting up headless EGL rendering for robot simulation on GPU clusters\n\n**Use alternatives when:**\n- Training or fine-tuning Cosmos Policy from scratch (use official Cosmos training docs)\n- Working with OpenVLA-based policies (use `fine-tuning-openvla-oft`)\n- Working with Physical Intelligence pi0 models (use `fine-tuning-serving-openpi`)\n- Running real-robot evaluation rather than simulation\n\n---\n\n## Workflow 1: LIBERO evaluation\n\nCopy this checklist and track progress:\n\n```text\nLIBERO Eval Progress:\n- [ ] Step 1: Install environment and dependencies\n- [ ] Step 2: Configure headless EGL rendering\n- [ ] Step 3: Run smoke evaluation\n- [ ] Step 4: Validate outputs and parse results\n- [ ] Step 5: Run full benchmark if smoke passes\n```\n\n**Step 1: Install environment**\n\n```bash\ngit clone https:\u002F\u002Fgithub.com\u002FNVlabs\u002Fcosmos-policy.git\ncd cosmos-policy\n# Follow SETUP.md to build and enter the supported Docker container.\n# Then, inside the container:\nuv sync --extra cu128 --group libero --python 3.10\n```\n\n**Step 2: Configure headless rendering**\n\n```bash\nexport CUDA_VISIBLE_DEVICES=0\nexport MUJOCO_EGL_DEVICE_ID=0\nexport MUJOCO_GL=egl\nexport PYOPENGL_PLATFORM=egl\n```\n\n**Step 3: Run smoke evaluation**\n\n```bash\nuv run --extra cu128 --group libero --python 3.10 \\\n  python -m cosmos_policy.experiments.robot.libero.run_libero_eval \\\n    --config cosmos_predict2_2b_480p_libero__inference_only \\\n    --ckpt_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B \\\n    --config_file cosmos_policy\u002Fconfig\u002Fconfig.py \\\n    --use_wrist_image True \\\n    --use_proprio True \\\n    --normalize_proprio True \\\n    --unnormalize_actions True \\\n    --dataset_stats_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B\u002Flibero_dataset_statistics.json \\\n    --t5_text_embeddings_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B\u002Flibero_t5_embeddings.pkl \\\n    --trained_with_image_aug True \\\n    --chunk_size 16 \\\n    --num_open_loop_steps 16 \\\n    --task_suite_name libero_10 \\\n    --num_trials_per_task 1 \\\n    --local_log_dir cosmos_policy\u002Fexperiments\u002Frobot\u002Flibero\u002Flogs\u002F \\\n    --seed 195 \\\n    --randomize_seed False \\\n    --deterministic True \\\n    --run_id_note smoke \\\n    --ar_future_prediction False \\\n    --ar_value_prediction False \\\n    --use_jpeg_compression True \\\n    --flip_images True \\\n    --num_denoising_steps_action 5 \\\n    --num_denoising_steps_future_state 1 \\\n    --num_denoising_steps_value 1 \\\n    --data_collection False\n```\n\n**Step 4: Validate and parse results**\n\n```python\nimport json\nimport glob\n\n# Find latest evaluation result from the official log directory\nlog_files = sorted(glob.glob(\"cosmos_policy\u002Fexperiments\u002Frobot\u002Flibero\u002Flogs\u002F**\u002F*.json\", recursive=True))\nwith open(log_files[-1]) as f:\n    results = json.load(f)\n\nprint(results)\n```\n\n**Step 5: Scale up**\n\nRun across all four LIBERO task suites with 50 trials:\n\n```bash\nfor suite in libero_spatial libero_object libero_goal libero_10; do\n  uv run --extra cu128 --group libero --python 3.10 \\\n    python -m cosmos_policy.experiments.robot.libero.run_libero_eval \\\n      --config cosmos_predict2_2b_480p_libero__inference_only \\\n      --ckpt_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B \\\n      --config_file cosmos_policy\u002Fconfig\u002Fconfig.py \\\n      --use_wrist_image True \\\n      --use_proprio True \\\n      --normalize_proprio True \\\n      --unnormalize_actions True \\\n      --dataset_stats_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B\u002Flibero_dataset_statistics.json \\\n      --t5_text_embeddings_path nvidia\u002FCosmos-Policy-LIBERO-Predict2-2B\u002Flibero_t5_embeddings.pkl \\\n      --trained_with_image_aug True \\\n      --chunk_size 16 \\\n      --num_open_loop_steps 16 \\\n      --task_suite_name \"$suite\" \\\n      --num_trials_per_task 50 \\\n      --local_log_dir cosmos_policy\u002Fexperiments\u002Frobot\u002Flibero\u002Flogs\u002F \\\n      --seed 195 \\\n      --randomize_seed False \\\n      --deterministic True \\\n      --run_id_note \"suite_${suite}\" \\\n      --ar_future_prediction False \\\n      --ar_value_prediction False \\\n      --use_jpeg_compression True \\\n      --flip_images True \\\n      --num_denoising_steps_action 5 \\\n      --num_denoising_steps_future_state 1 \\\n      --num_denoising_steps_value 1 \\\n      --data_collection False\ndone\n```\n\n---\n\n## Workflow 2: RoboCasa evaluation\n\nCopy this checklist and track progress:\n\n```text\nRoboCasa Eval Progress:\n- [ ] Step 1: Install RoboCasa assets and verify macros\n- [ ] Step 2: Run single-task smoke evaluation\n- [ ] Step 3: Validate outputs\n- [ ] Step 4: Expand to multi-task runs\n```\n\n**Step 1: Install RoboCasa**\n\n```bash\ngit clone https:\u002F\u002Fgithub.com\u002Fmoojink\u002Frobocasa-cosmos-policy.git\nuv pip install -e robocasa-cosmos-policy\npython -m robocasa.scripts.setup_macros\npython -m robocasa.scripts.download_kitchen_assets\n```\n\nThis fork installs the `robocasa` Python package expected by Cosmos Policy while preserving the patched environment changes used in the public RoboCasa eval path. Verify `macros_private.py` exists and paths are correct.\n\n**Step 2: Single-task smoke evaluation**\n\n```bash\nuv run --extra cu128 --group robocasa --python 3.10 \\\n  python -m cosmos_policy.experiments.robot.robocasa.run_robocasa_eval \\\n    --config cosmos_predict2_2b_480p_robocasa_50_demos_per_task__inference \\\n    --ckpt_path nvidia\u002FCosmos-Policy-RoboCasa-Predict2-2B \\\n    --config_file cosmos_policy\u002Fconfig\u002Fconfig.py \\\n    --use_wrist_image True \\\n    --num_wrist_images 1 \\\n    --use_proprio True \\\n    --normalize_proprio True \\\n    --unnormalize_actions True \\\n    --dataset_stats_path nvidia\u002FCosmos-Policy-RoboCasa-Predict2-2B\u002Frobocasa_dataset_statistics.json \\\n    --t5_text_embeddings_path nvidia\u002FCosmos-Policy-RoboCasa-Predict2-2B\u002Frobocasa_t5_embeddings.pkl \\\n    --trained_with_image_aug True \\\n    --chunk_size 32 \\\n    --num_open_loop_steps 16 \\\n    --task_name TurnOffMicrowave \\\n    --obj_instance_split A \\\n    --num_trials_per_task 2 \\\n    --local_log_dir cosmos_policy\u002Fexperiments\u002Frobot\u002Frobocasa\u002Flogs\u002F \\\n    --seed 195 \\\n    --randomize_seed False \\\n    --deterministic True \\\n    --run_id_note smoke \\\n    --use_variance_scale False \\\n    --use_jpeg_compression True \\\n    --flip_images True \\\n    --num_denoising_steps_action 5 \\\n    --num_denoising_steps_future_state 1 \\\n    --num_denoising_steps_value 1 \\\n    --data_collection False\n```\n\n**Step 3: Validate outputs**\n\n- Confirm the eval log prints the expected task name, object split, and checkpoint\u002Fconfig values.\n- Inspect the final `Success rate:` line in the log.\n\n**Step 4: Expand scope**\n\nIncrease `--num_trials_per_task` or add more tasks. Keep `--obj_instance_split` fixed across repeated runs for comparability.\n\n---\n\n## Workflow 3: Blank-machine cluster launch\n\n```text\nCluster Launch Progress:\n- [ ] Step 1: Clone the public repo and enter the supported runtime\n- [ ] Step 2: Sync the benchmark-specific dependency group\n- [ ] Step 3: Export rendering and cache environment variables before eval\n```\n\n**Step 1: Clone and enter the supported runtime**\n\n```bash\ngit clone https:\u002F\u002Fgithub.com\u002FNVlabs\u002Fcosmos-policy.git\ncd cosmos-policy\n# Follow SETUP.md, start the Docker container, and enter it before continuing.\n```\n\n**Step 2: Sync dependencies**\n\n```bash\nuv sync --extra cu128 --group libero --python 3.10\n# or, for RoboCasa:\nuv sync --extra cu128 --group robocasa --python 3.10\n# then install the Cosmos-compatible RoboCasa fork:\ngit clone https:\u002F\u002Fgithub.com\u002Fmoojink\u002Frobocasa-cosmos-policy.git\nuv pip install -e robocasa-cosmos-policy\n```\n\n**Step 3: Export runtime environment**\n\n```bash\nexport CUDA_VISIBLE_DEVICES=0\nexport MUJOCO_EGL_DEVICE_ID=0\nexport MUJOCO_GL=egl\nexport PYOPENGL_PLATFORM=egl\nexport HF_HOME=${HF_HOME:-$HOME\u002F.cache\u002Fhuggingface}\nexport TRANSFORMERS_CACHE=${TRANSFORMERS_CACHE:-$HF_HOME}\n```\n\n---\n\n## Expected performance benchmarks\n\nReference values from official evaluation (tied to specific setup and seeds):\n\n| Task Suite | Success Rate | Notes |\n|-----------|-------------|-------|\n| LIBERO-Spatial | 98.1% | Official LIBERO spatial result |\n| LIBERO-Object | 100.0% | Official LIBERO object result |\n| LIBERO-Goal | 98.2% | Official LIBERO goal result |\n| LIBERO-Long | 97.6% | Official LIBERO long-horizon result |\n| LIBERO-Average | 98.5% | Official average across LIBERO suites |\n| RoboCasa | 67.1% | Official RoboCasa average result |\n\n**Reproduction note**: Published success rates still depend on checkpoint choice, task suite, seeds, and simulator setup. Record the exact command and environment alongside any reported number.\n\n---\n\n## Non-negotiable rules\n\n- **EGL alignment**: Always set `CUDA_VISIBLE_DEVICES`, `MUJOCO_EGL_DEVICE_ID`, `MUJOCO_GL=egl`, and `PYOPENGL_PLATFORM=egl` together on headless GPU nodes.\n- **Official runtime first**: If host-Python installs hit binary compatibility issues, fall back to the supported container workflow from `SETUP.md` before debugging package internals.\n- **Cache consistency**: Use the same cache directory across setup and eval so Hugging Face and dependency caches are reused.\n- **Run comparability**: Keep task name, object split, seed, and trial count fixed across repeated runs.\n\n---\n\n## Common issues\n\n**Issue: binary compatibility or loader failures on host Python**\n\nFix: rerun inside the official container\u002Fruntime from `SETUP.md`. Do not assume host-package rebuilds will match the public release environment.\n\n**Issue: LIBERO prompts for config path in a non-interactive shell**\n\nFix: pre-create `LIBERO_CONFIG_PATH\u002Fconfig.yaml`:\n\n```python\nimport os, yaml\n\nconfig_dir = os.path.expanduser(\"~\u002F.libero\")\nos.makedirs(config_dir, exist_ok=True)\nwith open(os.path.join(config_dir, \"config.yaml\"), \"w\") as f:\n    yaml.dump({\"benchmark_root\": \"\u002Fpath\u002Fto\u002Flibero\u002Fdatasets\"}, f)\n```\n\n**Issue: EGL initialization or shutdown noise**\n\nFix: align EGL environment variables first. Treat teardown-only `EGL_NOT_INITIALIZED` warnings as low-signal unless the job exits non-zero.\n\n**Issue: Kitchen object sampling NaNs or asset lookup failures in RoboCasa**\n\nFix: rerun asset setup and confirm the patched robocasa install is intact:\n\n```bash\npython -m robocasa.scripts.download_kitchen_assets\npython -c \"import robocasa; print(robocasa.__file__)\"\n```\n\n**Issue: MuJoCo rendering mismatch**\n\nFix: verify GPU device alignment:\n\n```python\nimport os\ncuda_dev = os.environ.get(\"CUDA_VISIBLE_DEVICES\", \"not set\")\negl_dev = os.environ.get(\"MUJOCO_EGL_DEVICE_ID\", \"not set\")\nassert cuda_dev == egl_dev, f\"GPU mismatch: CUDA={cuda_dev}, EGL={egl_dev}\"\nprint(f\"Rendering on GPU {cuda_dev}\")\n```\n\n---\n\n## Advanced topics\n\n**LIBERO command matrix**: See [references\u002Flibero-commands.md](references\u002Flibero-commands.md)\n**RoboCasa command matrix**: See [references\u002Frobocasa-commands.md](references\u002Frobocasa-commands.md)\n\n## Resources\n\n- Cosmos Policy repository: https:\u002F\u002Fgithub.com\u002FNVlabs\u002Fcosmos-policy\n- LIBERO benchmark: https:\u002F\u002Fgithub.com\u002FLifelong-Robot-Learning\u002FLIBERO\n- Cosmos-compatible RoboCasa fork: https:\u002F\u002Fgithub.com\u002Fmoojink\u002Frobocasa-cosmos-policy\n- Upstream RoboCasa project: https:\u002F\u002Fgithub.com\u002Frobocasa\u002Frobocasa\n- MuJoCo documentation: https:\u002F\u002Fmujoco.readthedocs.io\u002F\n",{"name":5,"tags":44,"author":52,"license":15,"version":53,"category":54,"description":7,"dependencies":55},[20,45,46,47,48,49,37,50,51],"VLA","Robotics","LIBERO","RoboCasa","Simulation","Profiling","EGL Rendering","Orchestra Research","1.0.0","ai-research",[56,57,58,59,60,61],"torch>=2.1.0","mujoco>=3.0.0","robosuite>=1.4.0","robocasa @ git+https:\u002F\u002Fgithub.com\u002Fmoojink\u002Frobocasa-cosmos-policy.git","transformers>=4.40.0","cosmos-policy @ git+https:\u002F\u002Fgithub.com\u002FNVlabs\u002Fcosmos-policy.git","main","0da4485785ee599388900be50db1635489d53056",".agents\u002Fskills\u002Fqc-cosmos-policy","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6","https:\u002F\u002Fdisha6.6.thenitishkr.in\u002F","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh","www.thenitishkr","thenitishkr | AI • Cyber-security • Research\r\n","2026-11-08 03:33:25",{"source":8,"skillName":5,"commands":72,"prompt":82,"zipAvailable":83},[73,76,79],{"tool":74,"command":75},"npx","npx skills add Tashima-Tarsh\u002FDisha6.6 --skill evaluating-cosmos-policy",{"tool":77,"command":78},"bunx","bunx skills add Tashima-Tarsh\u002FDisha6.6 --skill evaluating-cosmos-policy",{"tool":80,"command":81},"pnpm","pnpm dlx skills add Tashima-Tarsh\u002FDisha6.6 --skill evaluating-cosmos-policy","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fqc-cosmos-policy\u002FSKILL.md",true,[85,91],{"path":86,"resourceType":87,"resourceTypeDesc":88,"sizeBytes":89,"sourceHtmlUrl":90},"references\u002Flibero-commands.md","REFERENCE","参考文档",6863,"https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fqc-cosmos-policy\u002Freferences\u002Flibero-commands.md",{"path":92,"resourceType":87,"resourceTypeDesc":88,"sizeBytes":93,"sourceHtmlUrl":94},"references\u002Frobocasa-commands.md",5894,"https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fqc-cosmos-policy\u002Freferences\u002Frobocasa-commands.md",[96,127,151,178,202,226],{"skillNo":97,"name":98,"nameZh":6,"description":99,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":100,"categories":101,"keywords":107,"publishedAt":39},"01M6QRD07D4TGNDK6VJ4EHF8BV","youtube-full","Use when the user needs YouTube transcripts, video search, channel browsing, playlist extraction, or content monitoring. Trigger phrases: 'get the transcript for', 'search YouTube for', 'what are the latest videos on', 'list this playlist', 'monitor this channel', or any request involving a YouTube URL, video ID, or @handle. Do NOT use for downloading video or audio files, YouTube engagement data (likes, comments), or private\u002Fage-restricted videos.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fyoutube-full\u002FSKILL.md",[102],{"categoryNo":103,"categoryName":104,"taxonomyType":105,"taxonomyTypeDesc":106},"01JBSEEDCAT000000000000016","图像与多媒体","SCENARIO","使用场景",[108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,24,124,125,126],"youtube full","youtube","full","transcript","search","monitoring","data","Video","Audio","list","files","do","get","age","trigger","URL","browsing","request","youtube transcripts",{"skillNo":128,"name":129,"nameZh":6,"description":130,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":131,"categories":132,"keywords":133,"publishedAt":39},"01M6QRCJ3112VYPA97YG7KGMC2","x-twitter-growth","X\u002FTwitter growth engine for building audience, crafting viral content, and analyzing engagement. Use when the user wants to grow on X\u002FTwitter, write tweets or threads, analyze their X profile, research competitors on X, plan a posting strategy, or optimize engagement. Complements social-content (generic multi-platform) with X-specific depth: algorithm mechanics, thread engineering, reply strategy, profile optimization, and competitive intelligence via web search.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fx-twitter-growth\u002FSKILL.md",[],[134,135,136,137,112,138,139,140,141,142,143,144,145,146,33,147,148,149,150,24],"twitter","x twitter growth","growth","research","content","engineering","plan","web search","competitors","analyze","engine","write","strategy","platform","grow","posting","competitive",{"skillNo":152,"name":153,"nameZh":6,"description":154,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":155,"categories":156,"keywords":160,"publishedAt":39},"01M6QRBN3EHQNJY42RERP7A149","write-a-skill","Create new agent skills with proper structure, progressive disclosure, and bundled resources. Use when user wants to create, write, build, or author a new skill.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fwrite-a-skill\u002FSKILL.md",[157],{"categoryNo":158,"categoryName":159,"taxonomyType":105,"taxonomyTypeDesc":106},"01JBSEEDCAT000000000000023","Skill与智能体开发",[161,145,162,163,164,165,166,167,33,168,169,62,170,171,172,173,174,175,176,177],"write a skill","github","create","https","productivity","matt pocock","direct","example","build","new skill","structure","new agent","resources","with","tree","progressive disclosure","author",{"skillNo":179,"name":180,"nameZh":6,"description":181,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":182,"categories":183,"keywords":184,"publishedAt":39},"01M6QRB6G8P33PNGAF9Y69EJ9T","wrap-up","Close out a launched Claude Managed Agent — recap every primitive the founder now owns, regenerate the single-file overview page, and suggest the next 1-2 upgrades. Use when the user says \"wrap up\", \"close this out\", \"what do I own now\", \"give me the summary\", \"recap the agent\", or when the orchestrator routes phase=wrap-up. primitives_inventory.py tables everything owned (agent, environment, session, memory, outcome, deployment); overview_page.py regenerates a self-contained .\u002Fmy-agent\u002Fagent-overview.html; upgrade_suggester.py ranks the next moves from recorded deferrals plus standing hardening steps. Companion to run-without-you; the last stop before phase=done.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fwrap-up\u002FSKILL.md",[],[185,32,186,187,188,189,190,191,192,33,193,119,194,195,196,197,198,199,200,201],"wrap up","wrap","gemini","deployment","run","file","hardening","closeout","stop","upgrade","founder","close","companion","you","tables","directions","phase",{"skillNo":203,"name":204,"nameZh":6,"description":205,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":206,"categories":207,"keywords":209,"publishedAt":39},"01M6QRA5AYC1RBFZ39GTWGS3N8","workflow-builder","Design and write deterministic multi-agent workflow scripts (.js files in .claude\u002Fworkflows\u002F) for Claude Code's Workflow tool. Use when a user wants to build, create, author, scaffold, or run a custom Claude Code workflow, orchestrate sub-agents (fan-out, pipeline, loop, judge-panel), or automate a repeatable multi-step task across fresh-context agents.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fworkflow-builder\u002FSKILL.md",[208],{"categoryNo":158,"categoryName":159,"taxonomyType":105,"taxonomyTypeDesc":106},[210,211,212,213,214,163,189,215,216,217,218,219,145,220,118,221,222,223,224,225],"workflow","workflow builder","builder","design","workflows","code","orchestrate","pipeline","loop","multi-agent","context","across","fresh","scripts","judge","claude code workflow",{"skillNo":227,"name":228,"nameZh":6,"description":229,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":230,"categories":231,"keywords":232,"publishedAt":39},"01M6QR7QMCZESKQA0ERW1E657M","weekly-review","Use when someone wants to run a weekly review, close open loops, audit stalled projects and commitments, get their system back to trusted, restart a lapsed review habit, or says \"\u002Fcs:weekly-review\". Walks David Allen's three-phase loop — GET CLEAR, GET CURRENT, GET CREATIVE — with deterministic scripts that inventory open loops, gate the checklist with named gaps, and score commitment health 0-100.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fweekly-review\u002FSKILL.md",[],[233,234,235,236,237,238,239,240,241,218,242,243,244,245,246,247,120,248,249,201],"review","weekly review","weekly","deterministic scripts","reflect","feeds","inventory","open","team","projects","project-management","scanner","conversation","back","project","sprint","cadence"]