fix: reduce docs-noob-tester scope to prevent timeout#23742
Conversation
- Increase timeout-minutes from 30 to 45 - Remove unnecessary npm run build from Step 1 - Reduce page visits from 5+ to exactly 3 with explicit stop instruction - Import shared/keep-it-short.md to encourage concise responses - Update success criteria to match 3-page scope Agent-Logs-Url: https://github.com/github/gh-aw/sessions/278c6821-d845-4912-bd15-70f7cff0527c Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Agent-Logs-Url: https://github.com/github/gh-aw/sessions/278c6821-d845-4912-bd15-70f7cff0527c Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
There was a problem hiding this comment.
Pull request overview
Adjusts the docs-noob-tester agentic workflow to avoid 30-minute timeouts by reducing navigation scope, tightening instructions to prevent drift, and aligning runtime limits with observed execution time.
Changes:
- Increased workflow/agent execution timeouts from 30 → 45 minutes.
- Reduced setup work by removing
npm run buildand importingshared/keep-it-short.mdto curb verbosity. - Replaced open-ended navigation with an explicit 3-page visit list and updated success criteria accordingly.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.
| File | Description |
|---|---|
| .github/workflows/docs-noob-tester.md | Updates the workflow instructions to remove build, hard-cap navigation to 3 pages, add keep-it-short import, and adjust success criteria/timeout. |
| .github/workflows/docs-noob-tester.lock.yml | Regenerates the compiled lock workflow to reflect the new timeout and added import. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
| ## Step 1: Build and Serve Documentation Site | ||
|
|
||
| Navigate to the docs folder and build the documentation site using the steps from docs.yml: | ||
| Navigate to the docs folder and start the documentation site: |
There was a problem hiding this comment.
The Step 1 heading still says "Build and Serve Documentation Site", but the build step was removed and the instructions now only install deps and start the dev server via the shared lifecycle. Please rename the heading (and any nearby wording that implies a separate build step) so the instructions match what the agent is expected to do.
See below for a potential fix:
Act as a complete beginner who has never used GitHub Agentic Workflows before. Set up and navigate the documentation site, follow tutorials step-by-step, and document any issues you encounter.
## Step 1: Install Dependencies and Serve Documentation Site
Navigate to the docs folder and install dependencies:
The
docs-noob-testerworkflow was timing out at 30 min (69 turns × ~28.2s/turn ≈ 32.5 min) because the agent visited 8+ pages instead of the prescribed 5, with no hard stop enforced.Changes
timeout-minutes30 → 45 — matches observed worst-case runtimenpm run build— unnecessary for the Astro dev server; saves ~2 turnsshared/keep-it-short.md— suppresses verbose multi-turn analysisWarning
Firewall rules blocked me from connecting to one or more addresses (expand for details)
I tried to connect to the following addresses, but was blocked by firewall rules:
https://api.github.com/graphql/usr/bin/gh /usr/bin/gh api graphql -f query=query($owner: String!, $name: String!) { repository(owner: $owner, name: $name) { hasDiscussionsEnabled } } -f owner=github -f name=gh-aw(http block)/usr/bin/gh /usr/bin/gh api graphql -f query=query($owner: String!, $name: String!) { repository(owner: $owner, name: $name) { hasDiscussionsEnabled } } -f owner=github -f name=gh-aw Knyp6mx8tU0d(http block)/usr/bin/gh /usr/bin/gh api graphql -f query=query($owner: String!, $name: String!) { repository(owner: $owner, name: $name) { hasDiscussionsEnabled } } -f owner=github -f name=gh-aw -pack /home/REDACTED/work/gh-aw/gh-aw/cmd/gh-aw/main.go(http block)https://api.github.com/orgs/test-owner/actions/secrets/usr/bin/gh gh api /orgs/test-owner/actions/secrets --jq .secrets[].name -json GO111MODULE x_amd64/compile GOINSECURE waK3xTA/uohjQXH8-unsafeptr=false GOMODCACHE x_amd64/compile env -json GO111MODULE x_amd64/compile GOINSECURE GOMOD GOMODCACHE x_amd64/compile(http block)/usr/bin/gh gh api /orgs/test-owner/actions/secrets --jq .secrets[].name "prettier" --wriGOINSECURE git 64/bin/go tierignore /opt/hostedtoolcenv /usr/bin/git node /hom�� --write ../../../**/*.jsGOMOD 64/bin/go --ignore-path ../../../.pretti/home/REDACTED/work/gh-aw/gh-aw/actions/setup/js/node_modules/.bin/prettier /usr/bin/git go(http block)https://api.github.com/repos/actions/ai-inference/git/ref/tags/v1/usr/bin/gh gh api /repos/actions/ai-inference/git/ref/tags/v1 --jq .object.sha --show-toplevel x_amd64/vet /usr/bin/git -json GO111MODULE x_amd64/vet git rev-�� --show-toplevel x_amd64/vet /usr/bin/infocmp m/workflows GO111MODULE x_amd64/vet infocmp(http block)/usr/bin/gh gh api /repos/actions/ai-inference/git/ref/tags/v1 --jq .object.sha --show-toplevel go /usr/bin/git -json GO111MODULE 64/bin/go git chec�� -b feature-branch /usr/bin/git 01 GO111MODULE es/.bin/node git(http block)https://api.github.com/repos/actions/checkout/git/ref/tags/v3/usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v3 --jq .object.sha -bool l /tmp/go-build3921222824/b411/fileutil.test -errorsas -ifaceassert -nilfunc /tmp/go-build3921222824/b411/fileutil.test -tes�� -test.paniconexit0 -test.v=true /usr/bin/git -test.timeout=10git -test.run=^Test -test.short=true--show-toplevel git(http block)/usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v3 --jq .object.sha k/gh-aw/gh-aw --check /usr/bin/git **/*.ts **/*.json --ignore-path git -c log.showsignature=false l /usr/bin/git -n1 --format=format:rev-parse f12cb1bea1cc04cd--show-toplevel git(http block)https://api.github.com/repos/actions/checkout/git/ref/tags/v5/usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v5 --jq .object.sha 8232666/b003/_pkg_.a om/segmentio/asm@v1.1.3/cpu/cpu.-ifaceassert 64/pkg/tool/linux_amd64/vet GOINSECURE GOMOD GOMODCACHE 64/pkg/tool/linu--json env 8232666/b230/_pk--workflow kmbI/DF4yalWSRBznonexistent-workflow 64/pkg/tool/linu--limit GOINSECURE contextprotocol/rev-parse GOMODCACHE 64/pkg/tool/linux_amd64/vet(http block)/usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v5 --jq .object.sha download 3 /usr/bin/git test-logs/run-3 Sc8KyN6c6 64/pkg/tool/linu--show-toplevel git rev-�� --show-toplevel 64/pkg/tool/linux_amd64/vet /usr/bin/git h8bVUHHkv .cfg 64/pkg/tool/linurun git(http block)/usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v5 --jq .object.sha --show-toplevel ache/go/1.25.0/x64/pkg/tool/linux_amd64/vet /usr/bin/git se 1222824/b242/vetrev-parse 0/x64/bin/node git rev-�� --show-toplevel ache/go/1.25.0/x64/pkg/tool/linux_amd64/vet /usr/bin/git vaScript32546303git -dwarf=false /opt/hostedtoolc--show-toplevel git(http block)https://api.github.com/repos/actions/checkout/git/ref/tags/v6/usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v6 --jq .object.sha k/gh-aw/gh-aw/.github/workflows/blog-auditor.md x_amd64/compile /usr/bin/git -json GO111MODULE x_amd64/vet git rev-�� --show-toplevel x_amd64/vet /usr/bin/git -json GO111MODULE x_amd64/vet git(http block)/usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v6 --jq .object.sha --show-toplevel x_amd64/compile /opt/hostedtoolcache/go/1.25.0/x64/pkg/tool/linux_amd64/vet -json GO111MODULE x_amd64/vet /opt/hostedtoolcache/go/1.25.0/x64/pkg/tool/linux_amd64/vet -ato�� -bool -buildtags /usr/bin/git -errorsas -ifaceassert -nilfunc git(http block)/usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v6 --jq .object.sha --show-toplevel O7F_o3I-aQkcZnGXlK/isALfm8EMSaAAw_nkoZZ/LXmaSKllWDNa36pM8If8 /usr/bin/git 2108800356 1222824/b118/vetrev-parse g_.a git rev-�� --show-toplevel ache/go/1.25.0/x64/pkg/tool/linux_amd64/vet /usr/bin/git /tmp/go-build304git -trimpath ache/go/1.25.0/x--show-toplevel git(http block)https://api.github.com/repos/actions/github-script/git/ref/tags/v8/usr/bin/gh gh api /repos/actions/github-script/git/ref/tags/v8 --jq .object.sha -json GO111MODULE x_amd64/compile GOINSECURE GOMOD GOMODCACHE x_amd64/compile env -json GO111MODULE x_amd64/asm GOINSECURE GOMOD GOMODCACHE x_amd64/asm(http block)/usr/bin/gh gh api /repos/actions/github-script/git/ref/tags/v8 --jq .object.sha -json GO111MODULE x_amd64/compile GOINSECURE GOMOD GOMODCACHE x_amd64/compile env -json 1.4.1/jsonrpc/js-ifaceassert x_amd64/compile GOINSECURE GOMOD GOMODCACHE x_amd64/compile(http block)/usr/bin/gh gh api /repos/actions/github-script/git/ref/tags/v8 --jq .object.sha -json GO111MODULE x_amd64/compile GOINSECURE GOMOD GOMODCACHE x_amd64/compile env -json GO111MODULE x_amd64/compile GOINSECURE GOMOD bytealg/indexbyt--show-toplevel x_amd64/compile(http block)https://api.github.com/repos/actions/setup-go/git/ref/tags/v4/usr/bin/gh gh api /repos/actions/setup-go/git/ref/tags/v4 --jq .object.sha ue.number x_amd64/compile /usr/bin/git -json GO111MODULE x_amd64/vet git chec�� .github/workflows/test.md x_amd64/vet /opt/hostedtoolcache/node/24.14.0/x64/bin/node -json GO111MODULE x_amd64/vet node(http block)/usr/bin/gh gh api /repos/actions/setup-go/git/ref/tags/v4 --jq .object.sha runs/20260331-144125-46329/test-3298023511 go /usr/bin/git -json GO111MODULE 64/bin/go git rev-�� --show-toplevel go /usr/bin/git -json GO111MODULE 64/bin/go git(http block)/usr/bin/gh gh api /repos/actions/setup-go/git/ref/tags/v4 --jq .object.sha json' --ignore-path ../../../.pr**/*.json GO111MODULE node GOINSECURE GOMOD GOMODCACHE go ules�� -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go(http block)https://api.github.com/repos/actions/setup-node/git/ref/tags/v4/usr/bin/gh gh api /repos/actions/setup-node/git/ref/tags/v4 --jq .object.sha --show-toplevel x_amd64/compile /usr/bin/git -json GO111MODULE x_amd64/link git -C /tmp/gh-aw-test-runs/20260331-143838-32841/test-2108800356 rev-parse /usr/bin/git @{u} rty x_amd64/vet git(http block)/usr/bin/gh gh api /repos/actions/setup-node/git/ref/tags/v4 --jq .object.sha --show-toplevel go /usr/bin/git -json GO111MODULE 64/bin/go git rev-�� --show-toplevel go /usr/bin/git -json GO111MODULE 64/bin/go git(http block)/usr/bin/gh gh api /repos/actions/setup-node/git/ref/tags/v4 --jq .object.sha json' --ignore-path ../../../.pr**/*.json GO111MODULE ules/.bin/prettier GOINSECURE GOMOD GOMODCACHE go env -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go(http block)https://api.github.com/repos/astral-sh/setup-uv/git/ref/tags/eac588ad8def6316056a12d4907a9d4d84ff7a3b/usr/bin/gh gh api /repos/astral-sh/setup-uv/git/ref/tags/eac588ad8def6316056a12d4907a9d4d84ff7a3b --jq .object.sha(http block)