[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M74A746TS88VRF18VMHKFAYT":3,"skill-same:01M74A746TS88VRF18VMHKFAYT":46},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":24,"commitSha":25,"skillDirectory":26,"forksCount":27,"repositoryHtmlUrl":28,"repositoryHomepageUrl":29,"ownerHtmlUrl":30,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":31,"install":32,"resources":45},"01M74A746TS88VRF18VMHKFAYT","cross-repo-testing",null,"This skill should be used when the user asks to \"test a saas cross-repo feature\", \"deploy a feature branch to staging\", \"test SDK against OH Cloud branch\", \"e2e test a cloud workspace feature\", \"test secrets saas inheritance\", or when changes span the SDK and OpenHands enterprise and need end-to-end validation against a staging deployment.","ViBench\u002Fvibench-public","ViBench","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F249048395?v=4","01M72TFFDAAQM58ETV10NMYSRR","ViBench - A Benchmark for realistic llm coding","01M72TFFE09MSERW0CDESPY9WC",46,"Apache-2.0","https:\u002F\u002Fgithub.com\u002FViBench\u002Fvibench-public\u002Fblob\u002Fmain\u002F_harness\u002Fopenhands-sdk\u002F.agents\u002Fskills\u002Fcross-repo-testing\u002FSKILL.md",[],[],"2026-11-11 15:11:14",false,"---\nname: cross-repo-testing\ndescription: This skill should be used when the user asks to \"test a saas cross-repo feature\", \"deploy a feature branch to staging\", \"test SDK against OH Cloud branch\", \"e2e test a cloud workspace feature\", \"test secrets saas inheritance\", or when changes span the SDK and OpenHands enterprise and need end-to-end validation against a staging deployment.\n---\n\n# Cross-Repo Testing: SDK ↔ OpenHands Cloud\n\nHow to end-to-end test features that span `OpenHands\u002Fsoftware-agent-sdk` and `OpenHands\u002FOpenHands` (the Cloud backend).\n\n## Repository Map\n\n| Repo | Role | What lives here |\n|------|------|-----------------|\n| [`software-agent-sdk`](https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk) | Agent core | `openhands-sdk`, `openhands-workspace`, `openhands-tools` packages. `OpenHandsCloudWorkspace` lives here. |\n| [`OpenHands`](https:\u002F\u002Fgithub.com\u002FOpenHands\u002FOpenHands) | Cloud backend | FastAPI server (`openhands\u002Fapp_server\u002F`), sandbox management, auth, enterprise integrations. Deployed as OH Cloud. |\n| [`deploy`](https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fdeploy) | Infrastructure | Helm charts + GitHub Actions that build the enterprise Docker image and deploy to staging\u002Fproduction. |\n\n**Data flow:** SDK client → OH Cloud API (`\u002Fapi\u002Fv1\u002F...`) → sandbox agent-server (inside runtime container)\n\n## When You Need This\n\nThere are **two flows** depending on which direction the dependency goes:\n\n| Flow | When | Example |\n|------|------|---------|\n| **A — SDK client → new Cloud API** | The SDK calls an API that doesn't exist yet on production | `workspace.get_llm()` calling `GET \u002Fapi\u002Fv1\u002Fusers\u002Fme?expose_secrets=true` |\n| **B — OH server → new SDK code** | The Cloud server needs unreleased SDK packages or a new agent-server image | Server consumes a new tool, agent behavior, or workspace method from the SDK |\n\nFlow A only requires deploying the server PR. Flow B requires pinning the SDK to an unreleased commit in the server PR **and** using the SDK PR's agent-server image. Both flows may apply simultaneously.\n\n---\n\n## Flow A: SDK Client Tests Against New Cloud API\n\nUse this when the SDK calls an endpoint that only exists on the server PR branch.\n\n### A1. Write and test the server-side changes\n\nIn the `OpenHands` repo, implement the new API endpoint(s). Run unit tests:\n\n```bash\ncd OpenHands\npoetry run pytest tests\u002Funit\u002Fapp_server\u002Ftest_\u003Crelevant>.py -v\n```\n\nPush a PR. Wait for the **\"Push Enterprise Image\" (Docker) CI job** to succeed — this builds `ghcr.io\u002Fopenhands\u002Fenterprise-server:sha-\u003CCOMMIT>`.\n\n### A2. Write the SDK-side changes\n\nIn `software-agent-sdk`, implement the client code (e.g., new methods on `OpenHandsCloudWorkspace`). Run SDK unit tests:\n\n```bash\ncd software-agent-sdk\npip install -e openhands-sdk -e openhands-workspace\npytest tests\u002F -v\n```\n\nPush a PR. SDK CI is independent — it doesn't need the server changes to pass unit tests.\n\n### A3. Deploy the server PR to staging\n\nSee [Deploying to a Staging Feature Environment](#deploying-to-a-staging-feature-environment) below.\n\n### A4. Run the SDK e2e test against staging\n\nSee [Running E2E Tests Against Staging](#running-e2e-tests-against-staging) below.\n\n---\n\n## Flow B: OH Server Needs Unreleased SDK Code\n\nUse this when the Cloud server depends on SDK changes that haven't been released to PyPI yet. The server's runtime containers run the `agent-server` image built from the SDK repo, so the server PR must be configured to use the SDK PR's image and packages.\n\n### B1. Get the SDK PR merged (or identify the commit)\n\nThe SDK PR must have CI pass so its agent-server Docker image is built. The image is tagged with the **merge-commit SHA** from GitHub Actions — NOT the head-commit SHA shown in the PR.\n\nFind the correct image tag:\n- Check the SDK PR description for an `AGENT_SERVER_IMAGES` section\n- Or check the \"Consolidate Build Information\" CI job for `\"short_sha\": \"\u003Ctag>\"`\n\n### B2. Pin SDK packages to the commit in the OpenHands PR\n\nIn the `OpenHands` repo PR, update 3 files + regenerate 3 lock files (see the `update-sdk` skill for full details):\n\n**`pyproject.toml`** — pin all 3 SDK packages in **both** `dependencies` and `[tool.poetry.dependencies]`:\n```toml\n# dependencies array (PEP 508)\n\"openhands-sdk @ git+https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk.git@\u003CCOMMIT>#subdirectory=openhands-sdk\",\n\"openhands-agent-server @ git+https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk.git@\u003CCOMMIT>#subdirectory=openhands-agent-server\",\n\"openhands-tools @ git+https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk.git@\u003CCOMMIT>#subdirectory=openhands-tools\",\n\n# [tool.poetry.dependencies]\nopenhands-sdk = { git = \"https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk.git\", rev = \"\u003CCOMMIT>\", subdirectory = \"openhands-sdk\" }\nopenhands-agent-server = { git = \"https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk.git\", rev = \"\u003CCOMMIT>\", subdirectory = \"openhands-agent-server\" }\nopenhands-tools = { git = \"https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk.git\", rev = \"\u003CCOMMIT>\", subdirectory = \"openhands-tools\" }\n```\n\n**`openhands\u002Fapp_server\u002Fsandbox\u002Fsandbox_spec_service.py`** — use the SDK's merge-commit SHA:\n```python\nAGENT_SERVER_IMAGE = 'ghcr.io\u002Fopenhands\u002Fagent-server:\u003Cmerge-commit-sha>-python'\n```\n\n**Regenerate lock files:**\n```bash\npoetry lock && uv lock && cd enterprise && poetry lock && cd ..\n```\n\n### B3. Wait for the OpenHands enterprise image to build\n\nPush the pinned changes. The OpenHands CI will build a new enterprise Docker image (`ghcr.io\u002Fopenhands\u002Fenterprise-server:sha-\u003COH_COMMIT>`) that bundles the unreleased SDK. Wait for the \"Push Enterprise Image\" job to succeed.\n\n### B4. Deploy and test\n\nFollow [Deploying to a Staging Feature Environment](#deploying-to-a-staging-feature-environment) using the new OpenHands commit SHA.\n\n### B5. Before merging: remove the pin\n\n**CI guard:** `check-package-versions.yml` blocks merge to `main` if `[tool.poetry.dependencies]` contains `rev` fields. Before the OpenHands PR can merge, the SDK PR must be merged and released to PyPI, then the pin must be replaced with the released version number.\n\n---\n\n## Deploying to a Staging Feature Environment\n\nThe `deploy` repo creates preview environments from OpenHands PRs.\n\n**Option A — GitHub Actions UI (preferred):**\nGo to `OpenHands\u002Fdeploy` → Actions → \"Create OpenHands preview PR\" → enter the OpenHands PR number. This creates a branch `ohpr-\u003CPR>-\u003Crandom>` and opens a deploy PR.\n\n**Option B — Update an existing feature branch:**\n```bash\ncd deploy\ngit checkout ohpr-\u003CPR>-\u003Crandom>\n# In .github\u002Fworkflows\u002Fdeploy.yaml, update BOTH:\n#   OPENHANDS_SHA: \"\u003Cfull-40-char-commit>\"\n#   OPENHANDS_RUNTIME_IMAGE_TAG: \"\u003Csame-commit>-nikolaik\"\ngit commit -am \"Update OPENHANDS_SHA to \u003Ccommit>\" && git push\n```\n\n**Before updating the SHA**, verify the enterprise Docker image exists:\n```bash\ngh api repos\u002FOpenHands\u002FOpenHands\u002Factions\u002Fruns \\\n  --jq '.workflow_runs[] | select(.head_sha==\"\u003CCOMMIT>\") | \"\\(.name): \\(.conclusion)\"' \\\n  | grep Docker\n# Must show: \"Docker: success\"\n```\n\nThe deploy CI auto-triggers and creates the environment at:\n```\nhttps:\u002F\u002Fohpr-\u003CPR>-\u003Crandom>.staging.all-hands.dev\n```\n\n**Wait for it to be live:**\n```bash\ncurl -s -o \u002Fdev\u002Fnull -w \"%{http_code}\" https:\u002F\u002Fohpr-\u003CPR>-\u003Crandom>.staging.all-hands.dev\u002Fapi\u002Fv1\u002Fhealth\n# 401 = server is up (auth required). DNS may take 1-2 min on first deploy.\n```\n\n## Running E2E Tests Against Staging\n\n**Critical: Feature deployments have their own Keycloak instance.** API keys from `app.all-hands.dev` or `$OPENHANDS_API_KEY` will NOT work. You need a test API key for the specific feature deployment. The user must provide one.\n\n```python\nfrom openhands.workspace import OpenHandsCloudWorkspace\n\nSTAGING = \"https:\u002F\u002Fohpr-\u003CPR>-\u003Crandom>.staging.all-hands.dev\"\n\nwith OpenHandsCloudWorkspace(\n    cloud_api_url=STAGING,\n    cloud_api_key=\"\u003Ctest-api-key-for-this-deployment>\",\n) as workspace:\n    # Test the new feature\n    llm = workspace.get_llm()\n    secrets = workspace.get_secrets()\n    print(f\"LLM: {llm.model}, secrets: {list(secrets.keys())}\")\n```\n\nOr run an example script:\n```bash\nOPENHANDS_CLOUD_API_KEY=\"\u003Ckey>\" \\\nOPENHANDS_CLOUD_API_URL=\"https:\u002F\u002Fohpr-\u003CPR>-\u003Crandom>.staging.all-hands.dev\" \\\npython examples\u002F02_remote_agent_server\u002F10_cloud_workspace_saas_credentials.py\n```\n\n### Recording results\n\nPush test output to the SDK PR's `.pr\u002Flogs\u002F` directory:\n```bash\ncd software-agent-sdk\npython test_script.py 2>&1 | tee .pr\u002Flogs\u002F\u003Ctest_name>.log\ngit add -f .pr\u002Flogs\u002F\u003Ctest_name>.log .pr\u002FREADME.md\ngit commit -m \"docs: add e2e test results\" && git push\n```\n\nComment on **both PRs** with pass\u002Ffail summary and link to logs.\n\n## Key Gotchas\n\n| Gotcha | Details |\n|--------|---------|\n| **Feature env auth is isolated** | Each `ohpr-*` deployment has its own Keycloak. Production API keys don't work. |\n| **Two SHAs in deploy.yaml** | `OPENHANDS_SHA` and `OPENHANDS_RUNTIME_IMAGE_TAG` must both be updated. The runtime tag is `\u003Csha>-nikolaik`. |\n| **Enterprise image must exist** | The Docker CI job on the OpenHands PR must succeed before you can deploy. If it hasn't run, push an empty commit to trigger it. |\n| **DNS propagation** | First deployment of a new branch takes 1-2 min for DNS. Subsequent deploys are instant. |\n| **Merge-commit SHA ≠ head SHA** | SDK CI tags Docker images with GitHub Actions' merge-commit SHA, not the PR head SHA. Check the SDK PR description or CI logs for the correct tag. |\n| **SDK pin blocks merge** | `check-package-versions.yml` prevents merging an OpenHands PR that has `rev` fields in `[tool.poetry.dependencies]`. The SDK must be released to PyPI first. |\n| **Flow A: stock agent-server is fine** | When only the Cloud API changes, `OpenHandsCloudWorkspace` talks to the Cloud server, not the agent-server. No custom image needed. |\n| **Flow B: agent-server image is required** | When the server needs new SDK code inside runtime containers, you must pin to the SDK PR's agent-server image. |\n","# Cross-Repo Testing: SDK ↔ OpenHands Cloud\n\nHow to end-to-end test features that span `OpenHands\u002Fsoftware-agent-sdk` and `OpenHands\u002FOpenHands` (the Cloud backend).\n\n## Repository Map\n\n| Repo | Role | What lives here |\n|------|------|-----------------|\n| [`software-agent-sdk`](https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk) | Agent core | `openhands-sdk`, `openhands-workspace`, `openhands-tools` packages. `OpenHandsCloudWorkspace` lives here. |\n| [`OpenHands`](https:\u002F\u002Fgithub.com\u002FOpenHands\u002FOpenHands) | Cloud backend | FastAPI server (`openhands\u002Fapp_server\u002F`), sandbox management, auth, enterprise integrations. Deployed as OH Cloud. |\n| [`deploy`](https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fdeploy) | Infrastructure | Helm charts + GitHub Actions that build the enterprise Docker image and deploy to staging\u002Fproduction. |\n\n**Data flow:** SDK client → OH Cloud API (`\u002Fapi\u002Fv1\u002F...`) → sandbox agent-server (inside runtime container)\n\n## When You Need This\n\nThere are **two flows** depending on which direction the dependency goes:\n\n| Flow | When | Example |\n|------|------|---------|\n| **A — SDK client → new Cloud API** | The SDK calls an API that doesn't exist yet on production | `workspace.get_llm()` calling `GET \u002Fapi\u002Fv1\u002Fusers\u002Fme?expose_secrets=true` |\n| **B — OH server → new SDK code** | The Cloud server needs unreleased SDK packages or a new agent-server image | Server consumes a new tool, agent behavior, or workspace method from the SDK |\n\nFlow A only requires deploying the server PR. Flow B requires pinning the SDK to an unreleased commit in the server PR **and** using the SDK PR's agent-server image. Both flows may apply simultaneously.\n\n---\n\n## Flow A: SDK Client Tests Against New Cloud API\n\nUse this when the SDK calls an endpoint that only exists on the server PR branch.\n\n### A1. Write and test the server-side changes\n\nIn the `OpenHands` repo, implement the new API endpoint(s). Run unit tests:\n\n```bash\ncd OpenHands\npoetry run pytest tests\u002Funit\u002Fapp_server\u002Ftest_\u003Crelevant>.py -v\n```\n\nPush a PR. Wait for the **\"Push Enterprise Image\" (Docker) CI job** to succeed — this builds `ghcr.io\u002Fopenhands\u002Fenterprise-server:sha-\u003CCOMMIT>`.\n\n### A2. Write the SDK-side changes\n\nIn `software-agent-sdk`, implement the client code (e.g., new methods on `OpenHandsCloudWorkspace`). Run SDK unit tests:\n\n```bash\ncd software-agent-sdk\npip install -e openhands-sdk -e openhands-workspace\npytest tests\u002F -v\n```\n\nPush a PR. SDK CI is independent — it doesn't need the server changes to pass unit tests.\n\n### A3. Deploy the server PR to staging\n\nSee [Deploying to a Staging Feature Environment](#deploying-to-a-staging-feature-environment) below.\n\n### A4. Run the SDK e2e test against staging\n\nSee [Running E2E Tests Against Staging](#running-e2e-tests-against-staging) below.\n\n---\n\n## Flow B: OH Server Needs Unreleased SDK Code\n\nUse this when the Cloud server depends on SDK changes that haven't been released to PyPI yet. The server's runtime containers run the `agent-server` image built from the SDK repo, so the server PR must be configured to use the SDK PR's image and packages.\n\n### B1. Get the SDK PR merged (or identify the commit)\n\nThe SDK PR must have CI pass so its agent-server Docker image is built. The image is tagged with the **merge-commit SHA** from GitHub Actions — NOT the head-commit SHA shown in the PR.\n\nFind the correct image tag:\n- Check the SDK PR description for an `AGENT_SERVER_IMAGES` section\n- Or check the \"Consolidate Build Information\" CI job for `\"short_sha\": \"\u003Ctag>\"`\n\n### B2. Pin SDK packages to the commit in the OpenHands PR\n\nIn the `OpenHands` repo PR, update 3 files + regenerate 3 lock files (see the `update-sdk` skill for full details):\n\n**`pyproject.toml`** — pin all 3 SDK packages in **both** `dependencies` and `[tool.poetry.dependencies]`:\n```toml\n# dependencies array (PEP 508)\n\"openhands-sdk @ git+https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk.git@\u003CCOMMIT>#subdirectory=openhands-sdk\",\n\"openhands-agent-server @ git+https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk.git@\u003CCOMMIT>#subdirectory=openhands-agent-server\",\n\"openhands-tools @ git+https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk.git@\u003CCOMMIT>#subdirectory=openhands-tools\",\n\n# [tool.poetry.dependencies]\nopenhands-sdk = { git = \"https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk.git\", rev = \"\u003CCOMMIT>\", subdirectory = \"openhands-sdk\" }\nopenhands-agent-server = { git = \"https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk.git\", rev = \"\u003CCOMMIT>\", subdirectory = \"openhands-agent-server\" }\nopenhands-tools = { git = \"https:\u002F\u002Fgithub.com\u002FOpenHands\u002Fsoftware-agent-sdk.git\", rev = \"\u003CCOMMIT>\", subdirectory = \"openhands-tools\" }\n```\n\n**`openhands\u002Fapp_server\u002Fsandbox\u002Fsandbox_spec_service.py`** — use the SDK's merge-commit SHA:\n```python\nAGENT_SERVER_IMAGE = 'ghcr.io\u002Fopenhands\u002Fagent-server:\u003Cmerge-commit-sha>-python'\n```\n\n**Regenerate lock files:**\n```bash\npoetry lock && uv lock && cd enterprise && poetry lock && cd ..\n```\n\n### B3. Wait for the OpenHands enterprise image to build\n\nPush the pinned changes. The OpenHands CI will build a new enterprise Docker image (`ghcr.io\u002Fopenhands\u002Fenterprise-server:sha-\u003COH_COMMIT>`) that bundles the unreleased SDK. Wait for the \"Push Enterprise Image\" job to succeed.\n\n### B4. Deploy and test\n\nFollow [Deploying to a Staging Feature Environment](#deploying-to-a-staging-feature-environment) using the new OpenHands commit SHA.\n\n### B5. Before merging: remove the pin\n\n**CI guard:** `check-package-versions.yml` blocks merge to `main` if `[tool.poetry.dependencies]` contains `rev` fields. Before the OpenHands PR can merge, the SDK PR must be merged and released to PyPI, then the pin must be replaced with the released version number.\n\n---\n\n## Deploying to a Staging Feature Environment\n\nThe `deploy` repo creates preview environments from OpenHands PRs.\n\n**Option A — GitHub Actions UI (preferred):**\nGo to `OpenHands\u002Fdeploy` → Actions → \"Create OpenHands preview PR\" → enter the OpenHands PR number. This creates a branch `ohpr-\u003CPR>-\u003Crandom>` and opens a deploy PR.\n\n**Option B — Update an existing feature branch:**\n```bash\ncd deploy\ngit checkout ohpr-\u003CPR>-\u003Crandom>\n# In .github\u002Fworkflows\u002Fdeploy.yaml, update BOTH:\n#   OPENHANDS_SHA: \"\u003Cfull-40-char-commit>\"\n#   OPENHANDS_RUNTIME_IMAGE_TAG: \"\u003Csame-commit>-nikolaik\"\ngit commit -am \"Update OPENHANDS_SHA to \u003Ccommit>\" && git push\n```\n\n**Before updating the SHA**, verify the enterprise Docker image exists:\n```bash\ngh api repos\u002FOpenHands\u002FOpenHands\u002Factions\u002Fruns \\\n  --jq '.workflow_runs[] | select(.head_sha==\"\u003CCOMMIT>\") | \"\\(.name): \\(.conclusion)\"' \\\n  | grep Docker\n# Must show: \"Docker: success\"\n```\n\nThe deploy CI auto-triggers and creates the environment at:\n```\nhttps:\u002F\u002Fohpr-\u003CPR>-\u003Crandom>.staging.all-hands.dev\n```\n\n**Wait for it to be live:**\n```bash\ncurl -s -o \u002Fdev\u002Fnull -w \"%{http_code}\" https:\u002F\u002Fohpr-\u003CPR>-\u003Crandom>.staging.all-hands.dev\u002Fapi\u002Fv1\u002Fhealth\n# 401 = server is up (auth required). DNS may take 1-2 min on first deploy.\n```\n\n## Running E2E Tests Against Staging\n\n**Critical: Feature deployments have their own Keycloak instance.** API keys from `app.all-hands.dev` or `$OPENHANDS_API_KEY` will NOT work. You need a test API key for the specific feature deployment. The user must provide one.\n\n```python\nfrom openhands.workspace import OpenHandsCloudWorkspace\n\nSTAGING = \"https:\u002F\u002Fohpr-\u003CPR>-\u003Crandom>.staging.all-hands.dev\"\n\nwith OpenHandsCloudWorkspace(\n    cloud_api_url=STAGING,\n    cloud_api_key=\"\u003Ctest-api-key-for-this-deployment>\",\n) as workspace:\n    # Test the new feature\n    llm = workspace.get_llm()\n    secrets = workspace.get_secrets()\n    print(f\"LLM: {llm.model}, secrets: {list(secrets.keys())}\")\n```\n\nOr run an example script:\n```bash\nOPENHANDS_CLOUD_API_KEY=\"\u003Ckey>\" \\\nOPENHANDS_CLOUD_API_URL=\"https:\u002F\u002Fohpr-\u003CPR>-\u003Crandom>.staging.all-hands.dev\" \\\npython examples\u002F02_remote_agent_server\u002F10_cloud_workspace_saas_credentials.py\n```\n\n### Recording results\n\nPush test output to the SDK PR's `.pr\u002Flogs\u002F` directory:\n```bash\ncd software-agent-sdk\npython test_script.py 2>&1 | tee .pr\u002Flogs\u002F\u003Ctest_name>.log\ngit add -f .pr\u002Flogs\u002F\u003Ctest_name>.log .pr\u002FREADME.md\ngit commit -m \"docs: add e2e test results\" && git push\n```\n\nComment on **both PRs** with pass\u002Ffail summary and link to logs.\n\n## Key Gotchas\n\n| Gotcha | Details |\n|--------|---------|\n| **Feature env auth is isolated** | Each `ohpr-*` deployment has its own Keycloak. Production API keys don't work. |\n| **Two SHAs in deploy.yaml** | `OPENHANDS_SHA` and `OPENHANDS_RUNTIME_IMAGE_TAG` must both be updated. The runtime tag is `\u003Csha>-nikolaik`. |\n| **Enterprise image must exist** | The Docker CI job on the OpenHands PR must succeed before you can deploy. If it hasn't run, push an empty commit to trigger it. |\n| **DNS propagation** | First deployment of a new branch takes 1-2 min for DNS. Subsequent deploys are instant. |\n| **Merge-commit SHA ≠ head SHA** | SDK CI tags Docker images with GitHub Actions' merge-commit SHA, not the PR head SHA. Check the SDK PR description or CI logs for the correct tag. |\n| **SDK pin blocks merge** | `check-package-versions.yml` prevents merging an OpenHands PR that has `rev` fields in `[tool.poetry.dependencies]`. The SDK must be released to PyPI first. |\n| **Flow A: stock agent-server is fine** | When only the Cloud API changes, `OpenHandsCloudWorkspace` talks to the Cloud server, not the agent-server. No custom image needed. |\n| **Flow B: agent-server image is required** | When the server needs new SDK code inside runtime containers, you must pin to the SDK PR's agent-server image. |\n",{"name":5,"description":7},"main","534dbc446a2319e82683a892929d357abd9adfcd","_harness\u002Fopenhands-sdk\u002F.agents\u002Fskills\u002Fcross-repo-testing",14,"https:\u002F\u002Fgithub.com\u002FViBench\u002Fvibench-public","https:\u002F\u002Fvibench.ai","https:\u002F\u002Fgithub.com\u002FViBench","2026-11-04 04:27:04",{"source":8,"skillName":5,"commands":33,"prompt":43,"zipAvailable":44},[34,37,40],{"tool":35,"command":36},"npx","npx skills add ViBench\u002Fvibench-public --skill cross-repo-testing",{"tool":38,"command":39},"bunx","bunx skills add ViBench\u002Fvibench-public --skill cross-repo-testing",{"tool":41,"command":42},"pnpm","pnpm dlx skills add ViBench\u002Fvibench-public --skill cross-repo-testing","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FViBench\u002Fvibench-public\u002Fblob\u002Fmain\u002F_harness\u002Fopenhands-sdk\u002F.agents\u002Fskills\u002Fcross-repo-testing\u002FSKILL.md",true,[],[47,55,62,69,75,82],{"skillNo":48,"name":49,"nameZh":6,"description":50,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":51,"licenseFileUrl":6,"sourceHtmlUrl":52,"categories":53,"keywords":54,"publishedAt":19},"01M74A7W2YA5QY8PZBYF234RP4","python-linting","This skill helps lint Python code using ruff. Use when the user asks to \"lint\", \"check code quality\", or \"fix style issues\".","MIT","https:\u002F\u002Fgithub.com\u002FViBench\u002Fvibench-public\u002Fblob\u002Fmain\u002F_harness\u002Fopenhands-sdk\u002Fexamples\u002F05_skills_and_plugins\u002F02_loading_plugins\u002Fexample_plugins\u002Fcode-quality\u002Fskills\u002Flinting\u002FSKILL.md",[],[],{"skillNo":56,"name":57,"nameZh":6,"description":58,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":51,"licenseFileUrl":6,"sourceHtmlUrl":59,"categories":60,"keywords":61,"publishedAt":19},"01M74A7SMK8WQ3WE81S8YDFDS8","rot13-encryption","This skill helps encrypt and decrypt messages using ROT13 cipher. Use when the user asks to \"encrypt\" or \"decrypt\" a message.","https:\u002F\u002Fgithub.com\u002FViBench\u002Fvibench-public\u002Fblob\u002Fmain\u002F_harness\u002Fopenhands-sdk\u002Fexamples\u002F05_skills_and_plugins\u002F01_loading_agentskills\u002Fexample_skills\u002Frot13-encryption\u002FSKILL.md",[],[],{"skillNo":63,"name":64,"nameZh":6,"description":65,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":51,"licenseFileUrl":6,"sourceHtmlUrl":66,"categories":67,"keywords":68,"publishedAt":19},"01M74A7R6THS8V5WPSK6VR5SFA","code-style-guide","Project coding standards and style guidelines. Always follow these conventions when writing or reviewing code.","https:\u002F\u002Fgithub.com\u002FViBench\u002Fvibench-public\u002Fblob\u002Fmain\u002F_harness\u002Fopenhands-sdk\u002Fexamples\u002F05_skills_and_plugins\u002F01_loading_agentskills\u002Fexample_skills\u002Fcode-style-guide\u002FSKILL.md",[],[],{"skillNo":70,"name":71,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":72,"categories":73,"keywords":74,"publishedAt":19},"01M74A7QD9MQB3VJXV38K3B2EN","greeting-helper","https:\u002F\u002Fgithub.com\u002FViBench\u002Fvibench-public\u002Fblob\u002Fmain\u002F_harness\u002Fopenhands-sdk\u002Fexamples\u002F01_standalone_sdk\u002F43_mixed_marketplace_skills\u002Fskills\u002Fgreeting-helper\u002FSKILL.md",[],[],{"skillNo":76,"name":77,"nameZh":6,"description":78,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":79,"categories":80,"keywords":81,"publishedAt":19},"01M74A7K8F92ACMZTWSRFPE3D6","sdk-release","This skill should be used when the user asks to \"release the SDK\", \"prepare a release\", \"publish a new version\", \"cut a release\", \"do a release\", or mentions the SDK release checklist or release process. Guides through the full software-agent-sdk release workflow from version bump to PyPI publication, emphasizing human checkpoints.","https:\u002F\u002Fgithub.com\u002FViBench\u002Fvibench-public\u002Fblob\u002Fmain\u002F_harness\u002Fopenhands-sdk\u002F.agents\u002Fskills\u002Fsdk-release\u002FSKILL.md",[],[],{"skillNo":83,"name":84,"nameZh":6,"description":85,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":86,"categories":87,"keywords":88,"publishedAt":19},"01M74A7EKGR9V5996BVGSWBQWP","manage-evals","This skill should be used when the user asks to \"trigger an eval\", \"run evaluation\", \"run swebench\", \"run gaia\", \"run benchmark\", \"compare eval runs\", \"compare evaluation results\", \"check eval regression\", \"compare benchmark results\", \"what changed in the eval\", \"diff eval runs\", or mentions triggering, comparing, or reporting on SWE-bench, GAIA, or other benchmark evaluation results. Provides workflow for triggering evaluations on different benchmarks, finding and comparing runs, and reporting performance differences.","https:\u002F\u002Fgithub.com\u002FViBench\u002Fvibench-public\u002Fblob\u002Fmain\u002F_harness\u002Fopenhands-sdk\u002F.agents\u002Fskills\u002Fmanage-evals\u002FSKILL.md",[],[]]