[prompt-clustering] Copilot Agent Prompt Clustering Analysis — 2026-01-21 to 2026-02-07

[github-actions[bot]]

Summary

• Analysis Period: 2026-01-21 to 2026-02-07
• Total Tasks Analyzed: 973
• Overall Success Rate: 69.2% (673/973 merged)
• Clusters Identified: 8

Cluster Overview

Rank	Theme	Tasks	% of Total	Success Rate	Top Keywords
1	General Feature & Code Improvements	264	27%	75%	reference, review, update, fix
2	Issue-Driven Tasks (CI / Deep-Report)	242	25%	62%	issue, section, add, workflow
3	MCP Server & gh-aw Tooling Updates	142	15%	61%	mcp, gh, version, aw
4	Agentic Workflow Config (.md Files)	105	11%	79%	agentic, agentic workflow, workflows, md
5	Safe-Outputs Feature Work	103	11%	75%	safe, project, safe outputs, outputs
6	Campaign & Project Management	60	6%	67%	campaign, security, project, analyze
7	CI Failure Investigation (Structured)	30	3%	80%	job, fix, analyze, id
8	Agentic Workflow Failure Debugging	27	3%	59%	workflow failure, failure, debug, agent

Key Findings

1. Most Common Task Type: General Feature & Code Improvements — 264 tasks (27% of all work)
2. Highest Success Rate: CI Failure Investigation (Structured) at 80% (24/30 merged)
3. Lowest Success Rate: Agentic Workflow Failure Debugging at 59% (16/27 merged) — needs attention
4. Most Complex Tasks: Campaign & Project Management with avg 4.8 commits and 9.1 files changed
5. Most Iterative: MCP Server & gh-aw Tooling Updates with avg 4.5 review comments per PR

Detailed Cluster Analysis

Cluster 1: General Feature & Code Improvements

Metric	Value
Size	264 tasks (27% of total)
Success Rate	75.0% (198/264 merged)
Avg Commits	3.9
Avg Files Changed	19.4
Avg Comments	2.9
Top Keywords	reference, review, update, fix, agent, remove

Representative Tasks:

• Add interactive engine selection and secret configuration to init command #11064 — Add interactive engine selection and secret configuration to init command

  Update the init command behavior as follows: When the command is invoked without arguments, it should enter an interactive mode and prompt the user to select which agent engine...

• [WIP] Fix network configuration for MCP server time #11065 — [WIP] Fix network configuration for MCP server time

  Thanks for asking me to work on this. I will get started on it and keep this PR's description up to date as I form a plan and make progress....

---

Cluster 2: Issue-Driven Tasks (CI / Deep-Report)

Metric	Value
Size	242 tasks (25% of total)
Success Rate	61.6% (149/242 merged)
Avg Commits	3.1
Avg Files Changed	11.0
Avg Comments	1.0
Top Keywords	issue, section, add, workflow, discussion, code

Representative Tasks:

• Fix ephemerals tests after blockquote prefix requirement in PR #11036 #11058 — Fix ephemerals tests after blockquote prefix requirement in PR Fix expiration detection for quoted footers and legacy format #11036

  [CI Failure Doctor] Test failures after PR Fix expiration detection for quoted footers and legacy format #11036: regex pattern changes without test updates...

• Install Go toolchain in daily-cli-performance workflow #11059 — Install Go toolchain in daily-cli-performance workflow

  [deep-report] Install Go toolchain in Daily CLI Performance Agent workflow...

---

Cluster 3: MCP Server & gh-aw Tooling Updates

Metric	Value
Size	142 tasks (15% of total)
Success Rate	60.6% (86/142 merged)
Avg Commits	3.8
Avg Files Changed	40.2
Avg Comments	4.5
Top Keywords	mcp, gh, version, aw, gh aw, server

Representative Tasks:

• chore: Update Sentry MCP server to 0.27.0 #11050 — chore: Update Sentry MCP server to 0.27.0

  Run the update command and ensure that the Sentry MCP is updated. It should be upgraded to version 0.27.0, as shown in the dependency pull-request description attached below...

• Add missing get_repository tool to repos toolset #11067 — Add missing get_repository tool to repos toolset

  [deep-report] Fix GitHub Remote MCP Authentication Test tool availability...

---

Cluster 4: Agentic Workflow Config (.md Files)

Metric	Value
Size	105 tasks (11% of total)
Success Rate	79.0% (83/105 merged)
Avg Commits	4.0
Avg Files Changed	17.4
Avg Comments	3.0
Top Keywords	agentic, agentic workflow, agentic workflows, md, workflows, workflow

Representative Tasks:

• Update parent issue template for agentic-workflow failures #11053 — Update parent issue template for agentic-workflow failures

  Update the template used to create the parent issue for all agentic-workflow issues so that it creates a conclusion job. Set the issue title to "agentic-workflows failures"...

• Auto-assign @copilot to workflow sync issues when agent token available #11054 — Auto-assign @copilot to workflow sync issues when agent token available

  If you update the code that checks whether workflows are in sync in the agentic maintenance workflow, and the workflows are not in sync, and the gh-aw-agent-token secret is available...

---

Cluster 5: Safe-Outputs Feature Work

Metric	Value
Size	103 tasks (11% of total)
Success Rate	74.8% (77/103 merged)
Avg Commits	4.3
Avg Files Changed	20.7
Avg Comments	3.7
Top Keywords	safe, project, safe outputs, outputs, safe output, create

Representative Tasks:

• Validate safe-outputs target field at compile time #11112 — Validate safe-outputs target field at compile time

  Add compile-time validation for safe-outputs target field. The compiler previously accepted invalid values for the target field in safe-outputs configuration...

• Fix create_pull_request in safe-outputs container by installing git #11116 — Fix create_pull_request in safe-outputs container by installing git

  safe-output create-pull-request is failing. Since we moved safe-outputs to a container...

---

Cluster 6: Campaign & Project Management

Metric	Value
Size	60 tasks (6% of total)
Success Rate	66.7% (40/60 merged)
Avg Commits	4.8
Avg Files Changed	9.1
Avg Comments	1.8
Top Keywords	campaign, security, project, analyze, issue, docs

Representative Tasks:

• chore: campaign discovery via label-based approach #11070 — chore: campaign discovery via label-based approach

  Don't rely on cache memory for campaign discovery but use labels. Each campaign issue (epic or worker) should get a label "agentic-campaign"...

• Clarify tracker-id is optional for campaign worker workflows #11080 — Clarify tracker-id is optional for campaign worker workflows

  Don't require a tracker-id for campaign worker workflows...

---

Cluster 7: CI Failure Investigation (Structured)

Metric	Value
Size	30 tasks (3% of total)
Success Rate	80.0% (24/30 merged)
Avg Commits	3.4
Avg Files Changed	24.8
Avg Comments	0.4
Top Keywords	job, fix, analyze, id, implement, root cause

Representative Tasks:

• [WIP] Fix failing GitHub Actions workflow for JavaScript #11096 — [WIP] Fix failing GitHub Actions workflow for JavaScript

  Fix the failing GitHub Actions workflow. Analyze the workflow logs, identify the root cause of the failure, and implement a fix. Job ID: 610707634...

• Fix staticcheck S1009 lint error: remove redundant nil check on map #11915 — Fix staticcheck S1009 lint error: remove redundant nil check on map

  Fix the failing GitHub Actions workflow lint-go. Analyze the workflow logs, identify the root cause of the failure, and implement a fix. Job ID: 615011...

---

Cluster 8: Agentic Workflow Failure Debugging

Metric	Value
Size	27 tasks (3% of total)
Success Rate	59.3% (16/27 merged)
Avg Commits	3.0
Avg Files Changed	9.9
Avg Comments	2.1
Top Keywords	workflow failure, failure, debug, agent, workflow, failed

Representative Tasks:

• Add error handling to agent output ingestion for better failure diagnostics #11093 — Add error handling to agent output ingestion for better failure diagnostics

  [agentics] Instructions Janitor failed. Workflow Failure investigation...

• Investigation: Code Scanning Fixer transient API error - no fix required #11106 — Investigation: Code Scanning Fixer transient API error - no fix required

  [agentics] Code Scanning Fixer failed. Workflow Failure investigation...

---

Recommendations

• Prioritize Agentic Workflow Failure Debugging improvements: At 59% success, these tasks have the most room for improvement. Ensure clearer failure context and expected outcomes in prompts.
• Template the General Feature & Code Improvements pattern: The largest cluster (264 tasks) benefits from a structured template — formalize the prompt format that drives 75% success.
• Reduce complexity in Campaign & Project Management tasks: Avg 5 commits suggests tasks may be too large — consider breaking into smaller atomic subtasks.
• Add explicit test instructions to Agentic Workflow Failure Debugging prompts: Low success rate clusters often lack explicit testing and validation requirements.

References: §23509641458

AI generated by Copilot Agent Prompt Clustering Analysis · history

• expires on Mar 25, 2026, 8:22 PM UTC

[github-actions[bot]]

This discussion has been marked as outdated by Copilot Agent Prompt Clustering Analysis.

A newer discussion is available at Discussion #22970.