ci: make what's new updates incremental (#25817)

## Summary

Fix the Sonnet 5 request failure by removing the deprecated temperature
setting. Make daily curation incremental: skip the model when there are
no unseen merges or expired highlights, review only unseen merge dates
when work exists, and retain a manual full-window recalibration option.

Generated by Codex

Author: dvdksn

.agents/skills/curate-whats-new/SKILL.md

@@ -52,17 +52,29 @@ status only when the relative importance of the candidate set changes.
 ## Procedure
 
 1. Read `data/whats-new.json`.
-2. List every PR merged in the requested period:
+2. Determine the review mode from the request:
+   - For an incremental review, list PRs merged from the day after the supplied
+     checkpoint through the end of the publication window. Retain existing
+     items inside the publication window without re-reviewing their source PRs.
+   - For a full review, inspect every PR merged in the supplied publication
+     window.
+3. List PRs in the range that applies to the review mode:
 
    ```console
    $ gh pr list --repo docker/docs --state merged --search 'merged:START..END' --limit 200
    ```
 
-3. Inspect the diff and resulting pages for every plausible candidate.
-4. Decide what qualifies using only evidence in the merged documentation.
-5. Replace `period_start`, `period_end`, and `items` in
+   If an incremental search returns no PRs, skip candidate inspection and only
+   remove expired items.
+4. Inspect the diff and resulting pages for every plausible new candidate.
+5. Decide what qualifies using only evidence in the merged documentation.
+6. Remove existing items published before the requested publication window.
+   Add newly qualifying launches, combine related PRs, and reconsider featured
+   status across the resulting list. Do not replace or rewrite retained items
+   merely because they were not part of the incremental candidate range.
+7. Replace `period_start`, `period_end`, and `items` in
    `data/whats-new.json`. Sort items by `published` date, newest first.
-6. Write `.pr-body.md` with the publication period, selected highlights and
+8. Write `.pr-body.md` with the publication period, selected highlights and
    source PRs, plus concise reasons for plausible exclusions.
 
 Each item must contain `product`, `title`, `description`, `url`, `published`,

.github/agents/whats-new.yaml

@@ -4,7 +4,6 @@ models:
     provider: anthropic
     model: claude-sonnet-5
     max_tokens: 4096
-    temperature: 0.1
 
 agents:
   root:

.github/workflows/update-whats-new.yml

@@ -2,14 +2,18 @@ name: Update What's New
 
 on:
   schedule:
-    # Review the previous 30 complete UTC days every day at 06:00 UTC.
+    # Review new merges and expire old highlights every day at 06:00 UTC.
     - cron: "0 6 * * *"
   workflow_dispatch:
     inputs:
       dry-run:
         description: "Propose highlights without opening a pull request"
         type: boolean
         default: false
+      full-rescan:
+        description: "Re-evaluate every pull request in the 30-day window"
+        type: boolean
+        default: false
 
 permissions:
   contents: write
@@ -40,6 +44,14 @@ jobs:
           echo "start=$(date -u -d "$PERIOD_END - 29 days" +%F)" >> "$GITHUB_OUTPUT"
           echo "end=$PERIOD_END" >> "$GITHUB_OUTPUT"
 
+      - name: Restore curator state
+        uses: actions/cache/restore@668228422ae6a00e4ad889ee87cd7109ec5666a7 # v5.0.4
+        with:
+          path: ${{ runner.temp }}/whats-new-state.json
+          key: whats-new-state-${{ github.repository }}-${{ github.run_id }}
+          restore-keys: |
+            whats-new-state-${{ github.repository }}-
+
       - name: Configure AWS credentials
         id: aws-credentials
         continue-on-error: true
@@ -68,16 +80,47 @@ jobs:
             git show "origin/$BRANCH_NAME:data/whats-new.json" > data/whats-new.json
           fi
 
+      - name: Set review mode and checkpoint
+        id: review
+        env:
+          FULL_RESCAN: ${{ inputs.full-rescan == true }}
+          PERIOD_END: ${{ steps.period.outputs.end }}
+          STATE_FILE: ${{ runner.temp }}/whats-new-state.json
+        run: |
+          REVIEWED_THROUGH=$(jq -r '.reviewed_through // empty' "$STATE_FILE" 2>/dev/null || true)
+          if ! [[ "$REVIEWED_THROUGH" =~ ^[0-9]{4}-[0-9]{2}-[0-9]{2}$ ]]; then
+            REVIEWED_THROUGH=$(jq -r '.period_end' data/whats-new.json)
+          fi
+          DATA_PERIOD_END=$(jq -r '.period_end' data/whats-new.json)
+          if [[ "$DATA_PERIOD_END" > "$REVIEWED_THROUGH" ]]; then
+            REVIEWED_THROUGH=$DATA_PERIOD_END
+          fi
+
+          if [ "$FULL_RESCAN" = "true" ]; then
+            MODE=full
+          else
+            MODE=incremental
+          fi
+
+          jq -n --arg reviewed_through "$PERIOD_END" \
+            '{reviewed_through: $reviewed_through}' > "$STATE_FILE"
+
+          {
+            echo "mode=$MODE"
+            echo "reviewed-through=$REVIEWED_THROUGH"
+          } >> "$GITHUB_OUTPUT"
+
       - name: Curate highlights
         uses: docker/docker-agent-action@e96a4bb40cac114f64358621e1d08346c8eadc8c # v2.0.1
         env:
           GH_TOKEN: ${{ env.GITHUB_APP_TOKEN || github.token }}
         with:
           agent: ${{ github.workspace }}/.github/agents/whats-new.yaml
           prompt: >-
-            Use the curate-whats-new skill to review documentation pull requests merged from
-            ${{ steps.period.outputs.start }} through
-            ${{ steps.period.outputs.end }}, inclusive.
+            Use the curate-whats-new skill in ${{ steps.review.outputs.mode }} mode.
+            The publication window is ${{ steps.period.outputs.start }} through
+            ${{ steps.period.outputs.end }}, inclusive. The last successful incremental
+            review covered through ${{ steps.review.outputs.reviewed-through }}.
           anthropic-api-key: ${{ secrets.ANTHROPIC_API_KEY }}
           github-token: ${{ env.GITHUB_APP_TOKEN || github.token }}
           timeout: 1200
@@ -158,3 +201,10 @@ jobs:
               --base main \
               --head "$BRANCH_NAME"
           fi
+
+      - name: Save curator state
+        if: success() && inputs.dry-run != true && steps.changes.outputs.changed != 'true'
+        uses: actions/cache/save@668228422ae6a00e4ad889ee87cd7109ec5666a7 # v5.0.4
+        with:
+          path: ${{ runner.temp }}/whats-new-state.json
+          key: whats-new-state-${{ github.repository }}-${{ github.run_id }}