Skip to content

Commit ea8401e

Browse files
sophiethekingCopilotmyarbjc-clark
authored
[2026-02-20] Introduce organization-level Copilot metrics dashboard [public preview] (#59447)
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Melanie Yarbrough <11952755+myarb@users.noreply.github.com> Co-authored-by: Joe Clark <31087804+jc-clark@users.noreply.github.com>
1 parent 47da0e7 commit ea8401e

File tree

18 files changed

+83
-99
lines changed

18 files changed

+83
-99
lines changed

content/copilot/concepts/copilot-usage-metrics/copilot-metrics.md

Lines changed: 6 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -33,21 +33,10 @@ category:
3333
Metrics are available through:
3434

3535
* The {% data variables.product.prodname_copilot_short %} usage metrics APIs, which provide detailed, exportable data at the enterprise, organization, and user levels.
36-
* The {% data variables.product.prodname_copilot_short %} usage metrics dashboard, which visualizes 28-day usage trends across your enterprise.
37-
* The code generation dashboard, which breaks down how code is being generated by users and agents across your enterprise.
36+
* The {% data variables.product.prodname_copilot_short %} usage metrics dashboard, which visualizes 28-day usage trends across your enterprise and organizations.
37+
* The code generation dashboard, which breaks down how code is being generated by users and agents across your enterprise and organizations.
3838
* The {% data variables.product.prodname_copilot_short %} usage metrics NDJSON export, which offers raw data for custom BI tools or long-term storage.
3939

40-
### Organization-level metrics
41-
42-
Organization-level metrics are **only available through the APIs**. Both dashboards provide enterprise-level reporting.
43-
44-
To access organization-level metrics, the "{% data variables.product.prodname_copilot_short %} usage metrics" policy must be enabled for the enterprise or organization:
45-
46-
* For information on how to enable the "{% data variables.product.prodname_copilot_short %} usage metrics" policy at the enterprise level, see [AUTOTITLE](/copilot/how-tos/administer-copilot/manage-for-enterprise/manage-enterprise-policies#defining-policies-for-your-enterprise).
47-
* For information on how to enable the "{% data variables.product.prodname_copilot_short %} usage metrics" policy for organizations on a {% data variables.product.prodname_free_team %} or {% data variables.product.prodname_team %} plan that do not belong to an enterprise, see [AUTOTITLE](/copilot/how-tos/administer-copilot/manage-for-organization/manage-policies#enabling-copilot-features-and-models-in-your-organization).
48-
49-
For a complete list of available metrics and data fields, see [AUTOTITLE](/copilot/reference/copilot-usage-metrics).
50-
5140
## Which usage is included?
5241

5342
The {% data variables.product.prodname_copilot_short %} usage metrics are derived exclusively from telemetry sent by IDEs. In order for an end user to be counted towards these metrics, they **must have telemetry enabled in their IDE**.
@@ -70,7 +59,7 @@ The following API resources expose {% data variables.product.prodname_copilot_sh
7059
7160
| API resource | Scope | Key capabilities |
7261
| --- | --- | --- |
73-
| [AUTOTITLE](/rest/copilot/copilot-usage-metrics) | Advanced enterprise- and user-level event telemetry | Provides unified telemetry across completions, chat, and agent modes. Includes usage and lines of code metrics across all IDE modes, languages, and models. Supports detailed breakdowns by feature, IDE, language, model, and user, and is the primary API resource being actively developed and maintained. |
62+
| [AUTOTITLE](/rest/copilot/copilot-usage-metrics) | Advanced enterprise-, organization-, and user-level event telemetry | Provides unified telemetry across completions, chat, and agent modes. Includes usage and lines of code metrics across all IDE modes, languages, and models. Supports detailed breakdowns by feature, IDE, language, model, and user, and is the primary API resource being actively developed and maintained. |
7463
| [AUTOTITLE](/rest/copilot/copilot-user-management) | License and seat assignment | Lists assigned {% data variables.product.prodname_copilot_short %} seats for an organization or enterprise, including license state, user association, and `last_activity_at`. This API resource is the source of truth for license and seat information. |
7564
| [AUTOTITLE](/rest/copilot/copilot-metrics) | Enterprise-, organization-, and team-level usage metrics | Provides aggregated usage data for {% data variables.product.prodname_copilot_short %} features on {% data variables.product.prodname_dotcom_the_website %} (such as pull request summaries) and some IDE-based completions and chat. Does not include Agent or Edit mode telemetry. Offers enterprise-wide and per-feature breakdowns by IDE and language. Does not include individual-level data. |
7665

@@ -118,7 +107,7 @@ For example, all usage data for a Monday (which closes at midnight UTC) will be
118107

119108
{% data variables.product.prodname_copilot_short %} usage metrics can be grouped into a few main categories: Adoption, engagement, acceptance rate, Lines of Code (LoC), and pull request lifecycle metrics.
120109

121-
**Adoption** measures how many licensed developers are actively using {% data variables.product.prodname_copilot_short %} within your enterprise. For example, daily active users (DAU) tells you how many unique users interacted with {% data variables.product.prodname_copilot_short %} on a given day. Ideally, you'll see a consistent upward trend in these metrics during rollout.
110+
**Adoption** measures how many licensed developers are actively using {% data variables.product.prodname_copilot_short %}. For example, daily active users (DAU) tells you how many unique users interacted with {% data variables.product.prodname_copilot_short %} on a given day. Ideally, you'll see a consistent upward trend in these metrics during rollout.
122111

123112
**Engagement** measures describe how deeply developers use {% data variables.product.prodname_copilot_short %} once they’ve adopted it. Key engagement metrics show not only frequency of use but also breadth across features. For example, average chat requests per active user measures how often users open and interact with {% data variables.copilot.copilot_chat_short %}. You'd want to see regular and increasing chat use across languages and IDEs.
124113

@@ -146,6 +135,6 @@ Look for patterns across these signals rather than focusing on any single number
146135

147136
Now that you understand what each {% data variables.product.prodname_copilot_short %} metric measures and how to use them, you can explore the dashboards to see these metrics in action.
148137

149-
* To view adoption and usage trends across your enterprise, see [AUTOTITLE](/copilot/how-tos/administer-copilot/manage-for-enterprise/view-usage-and-adoption).
138+
* To view adoption and usage trends across your enterprise and organizations, see [AUTOTITLE](/copilot/how-tos/administer-copilot/manage-for-enterprise/view-usage-and-adoption).
150139
* To analyze how code is being generated by users and agents, see [AUTOTITLE](/copilot/how-tos/administer-copilot/manage-for-enterprise/view-code-generation).
151-
* To access enterprise-, organization-, and user-level metrics programmatically, see [AUTOTITLE](/rest/copilot/copilot-usage-metrics).
140+
* To access {% data variables.product.prodname_copilot_short %} usage metrics programmatically, see [AUTOTITLE](/rest/copilot/copilot-usage-metrics).

content/copilot/concepts/copilot-usage-metrics/index.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -13,8 +13,8 @@ sidebarLink:
1313
href: /copilot/concepts/copilot-usage-metrics
1414
children:
1515
- /copilot-metrics
16-
- /content/copilot/how-tos/administer-copilot/manage-for-enterprise/view-usage-and-adoption
17-
- /content/copilot/how-tos/administer-copilot/manage-for-enterprise/view-code-generation
16+
- /content/copilot/how-tos/administer-copilot/view-usage-and-adoption
17+
- /content/copilot/how-tos/administer-copilot/view-code-generation
1818
- /content/copilot/reference/copilot-usage-metrics/copilot-usage-metrics
1919
- /content/copilot/reference/copilot-usage-metrics/interpret-copilot-metrics
2020
- /content/copilot/reference/copilot-usage-metrics/reconciling-usage-metrics

content/copilot/how-tos/administer-copilot/index.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
22
title: Administer GitHub Copilot for your team
33
shortTitle: Administer Copilot
4-
intro: 'Learn how to administer {% data variables.product.prodname_copilot %} for your organization or enterprise.'
4+
intro: Manage {% data variables.product.prodname_copilot %} for your team by configuring settings, monitoring usage, and accessing activity reports to optimize adoption.
55
versions:
66
feature: copilot
77
topics:
@@ -11,6 +11,8 @@ children:
1111
- /manage-for-enterprise
1212
- /manage-mcp-usage
1313
- /download-activity-report
14+
- /view-usage-and-adoption
15+
- /view-code-generation
1416
redirect_from:
1517
- /copilot/how-tos/administer
1618
contentType: how-tos

content/copilot/how-tos/administer-copilot/manage-for-enterprise/index.md

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
22
title: Managing GitHub Copilot in your enterprise
33
shortTitle: Manage for enterprise
4-
intro: 'Enterprise owners can subscribe to {% data variables.product.prodname_copilot_short %}, manage {% data variables.product.prodname_copilot_short %} for organizations in the enterprise, and control {% data variables.product.prodname_copilot_short %} policies.'
4+
intro: Manage and govern {% data variables.product.prodname_copilot %} across your enterprise by controlling licensing and access, setting policies and guardrails, and monitoring adoption and usage.
55
versions:
66
feature: copilot
77
topics:
@@ -12,8 +12,6 @@ children:
1212
- /manage-enterprise-policies
1313
- /manage-agents
1414
- /manage-spark
15-
- /view-usage-and-adoption
16-
- /view-code-generation
1715
- /use-your-own-api-keys
1816
redirect_from:
1917
- /copilot/managing-copilot/managing-copilot-for-your-enterprise

content/copilot/how-tos/administer-copilot/manage-for-enterprise/view-code-generation.md

Lines changed: 0 additions & 48 deletions
This file was deleted.
Lines changed: 44 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,44 @@
1+
---
2+
title: Viewing the code generation dashboard
3+
shortTitle: View code generation
4+
intro: The code generation dashboard shows how {% data variables.product.prodname_copilot_short %} generates code across your enterprise, including activity from both users and agents.
5+
permissions: '{% data reusables.copilot.usage-metrics-permissions %}'
6+
versions:
7+
feature: copilot
8+
topics:
9+
- Copilot
10+
contentType: how-tos
11+
allowTitleToDifferFromFilename: true
12+
redirect_from:
13+
- /copilot/how-tos/administer-copilot/manage-for-enterprise/view-code-generation
14+
category:
15+
- Copilot usage metrics
16+
- View metrics
17+
- Track Copilot usage
18+
---
19+
20+
{% data reusables.copilot.usage-metrics-preview %}
21+
22+
By comparing user-initiated and agent-initiated activity across models, languages, and modes, you can see how teams are adopting AI-assisted and agent-driven development.
23+
24+
The dashboard shows aggregated code generation activity, including:
25+
26+
* **Lines of code changed with AI**. The total lines of code added and deleted across all modes.
27+
* **User-initiated code changes**. Lines suggested or manually added through completions and chat actions.
28+
* **Agent-initiated code changes**. Lines automatically added or deleted by agents across edit, agent, and custom modes.
29+
* **Activity by model and language**. User-initiated and agent-initiated activity grouped by model and language.
30+
31+
For a detailed list of available metrics and definitions, see [AUTOTITLE](/copilot/reference/copilot-usage-metrics/copilot-usage-metrics#code-generation-dashboard-metrics).
32+
33+
## Prerequisite
34+
35+
{% data reusables.copilot.copilot-metrics-dashboard-prereq %}
36+
37+
## Accessing the dashboard
38+
39+
{% data reusables.copilot.access-copilot-metrics-dashboard %}
40+
1. In the left sidebar, click **Code generation**.
41+
42+
## Next steps
43+
44+
To learn how to interpret the data in each chart and act on usage trends, see [AUTOTITLE](/copilot/reference/interpret-copilot-metrics).

content/copilot/how-tos/administer-copilot/manage-for-enterprise/view-usage-and-adoption.md renamed to content/copilot/how-tos/administer-copilot/view-usage-and-adoption.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,16 @@
11
---
22
title: Viewing the Copilot usage metrics dashboard
33
shortTitle: View usage and adoption
4-
intro: '{% data variables.product.prodname_copilot_short %} usage metrics dashboards provide a centralized view of adoption and usage across your enterprise, based on IDE telemetry from developers using {% data variables.product.prodname_copilot_short %}.'
4+
intro: 'Monitor adoption trends and use of {% data variables.product.prodname_copilot_short %} to support long-term enablement.'
55
permissions: '{% data reusables.copilot.usage-metrics-permissions %}'
66
versions:
77
feature: copilot
88
topics:
99
- Copilot
1010
contentType: how-tos
1111
allowTitleToDifferFromFilename: true
12+
redirect_from:
13+
- /copilot/how-tos/administer-copilot/manage-for-enterprise/view-usage-and-adoption
1214
category:
1315
- Copilot usage metrics
1416
- View metrics
@@ -21,14 +23,14 @@ After your initial rollout, the {% data variables.product.prodname_copilot_short
2123

2224
## Prerequisite
2325

24-
"{% data variables.product.prodname_copilot_short %} usage metrics" must be enabled on the AI Control tab. See [AUTOTITLE](/copilot/how-tos/administer-copilot/manage-for-enterprise/manage-enterprise-policies#defining-policies-for-your-enterprise).
26+
{% data reusables.copilot.copilot-metrics-dashboard-prereq %}
2527

2628
## Accessing the dashboard
2729

2830
{% data reusables.copilot.access-copilot-metrics-dashboard %}
2931
1. In the left sidebar, click **{% data variables.product.prodname_copilot_short %} usage**.
3032

31-
Data in the dashboard reports data at the enterprise level, is based only on IDE telemetry, and may appear up to three full UTC days behind the current date. See [AUTOTITLE](/copilot/concepts/copilot-metrics).
33+
Data in the dashboard is based only on IDE telemetry, and may appear up to three full UTC days behind the current date. See [AUTOTITLE](/copilot/concepts/copilot-metrics).
3234

3335
## Using {% data variables.copilot.copilot_chat_short %} to analyze exported data
3436

content/copilot/reference/copilot-usage-metrics/copilot-usage-metrics.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -21,8 +21,8 @@ category:
2121

2222
The {% data variables.product.prodname_copilot_short %} usage metrics dashboard and APIs display and export data using a consistent set of fields. This reference lists all available metrics and describes how to interpret their values in both dashboard visuals and NDJSON or API exports.
2323

24-
* The {% data variables.product.prodname_copilot_short %} usage metrics dashboard reports data at the **enterprise** level. To access the dashboard, see [AUTOTITLE](/copilot/how-tos/administer-copilot/manage-for-enterprise/view-usage-and-adoption).
25-
* The {% data variables.product.prodname_copilot_short %} usage metrics APIs support **enterprise-, organization-, and user-level** records. To retrieve this data programmatically, see [AUTOTITLE](/rest/copilot/copilot-usage-metrics).
24+
* The {% data variables.product.prodname_copilot_short %} usage metrics dashboards are available at the **enterprise** and **organization** level.
25+
* The {% data variables.product.prodname_copilot_short %} usage metrics APIs support **enterprise-, organization-, and user-level** records.
2626

2727
For guidance on how to read and interpret these metrics, see [AUTOTITLE](/copilot/concepts/copilot-metrics).
2828

content/copilot/reference/copilot-usage-metrics/interpret-copilot-metrics.md

Lines changed: 4 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -18,15 +18,13 @@ category:
1818
- Track Copilot usage
1919
---
2020

21-
>[!NOTE] The {% data variables.product.prodname_copilot_short %} usage metrics dashboard is currently in {% data variables.release-phases.public_preview %} and subject to change.
21+
{% data reusables.copilot.usage-metrics-preview %}
2222

2323
After you’ve viewed the {% data variables.product.prodname_copilot_short %} usage metrics dashboard, you can use this article to interpret each chart and identify opportunities to increase adoption and engagement.
2424

25-
> [!NOTE] The dashboard reports enterprise-level data. Organization-level views are available through the {% data variables.product.prodname_copilot_short %} usage metrics APIs.
26-
2725
## Reviewing overall usage trends
2826

29-
Use the main usage charts in the dashboard to understand overall adoption and engagement patterns across your enterprise. These charts help you identify where usage is growing, leveling off, or declining, so you can take action to maintain engagement.
27+
Use the main usage charts in the dashboard to understand overall adoption and engagement patterns. These charts help you identify where usage is growing, leveling off, or declining, so you can take action to maintain engagement.
3028

3129
| Metric | What it shows | How to interpret it |
3230
|:--|:--|:--|
@@ -45,11 +43,11 @@ The "Requests per chat mode" and "Agent adoption" charts show how developers are
4543

4644
## Reviewing model adoption
4745

48-
The "Model usage per day" and "Model usage per chat mode" charts help you understand which AI models are most frequently used in your enterprise.
46+
The "Model usage per day" and "Model usage per chat mode" charts help you understand which AI models are most frequently used.
4947

5048
| Chart | Description | Insights to derive |
5149
|:--|:--|:--|
52-
| Model usage per day | Shows which AI models power {% data variables.copilot.copilot_chat_short %} activity across the enterprise. | Identify whether users are primarily engaging with default models or experimenting with newer ones. |
50+
| Model usage per day | Shows which AI models power {% data variables.copilot.copilot_chat_short %} activity. | Identify whether users are primarily engaging with default models or experimenting with newer ones. |
5351
| Model usage per chat mode | Breaks down model usage by chat mode (Ask, Edit, Agent). | Monitor how model adoption evolves as new models are released. |
5452

5553
> [!NOTE]

content/copilot/reference/copilot-usage-metrics/lines-of-code-metrics.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ Lines of Code (LoC) metrics provide a directional measure of {% data variables.p
2626

2727
You may encounter LoC metrics in:
2828

29-
* **Code generation dashboard (enterprise level)** — visualizes LoC-based user and agent activity. See [AUTOTITLE](/copilot/how-tos/administer-copilot/manage-for-enterprise/view-code-generation).
29+
* **Code generation dashboard (enterprise and organization level)** — visualizes LoC-based user and agent activity. See [AUTOTITLE](/copilot/how-tos/administer-copilot/manage-for-enterprise/view-code-generation).
3030
* **Exports and APIs (enterprise, organization, and user level)** — expose LoC fields such as `loc_suggested_to_add_sum`, `loc_added_sum`, and `loc_deleted_sum`. See [AUTOTITLE](/rest/copilot/copilot-usage-metrics).
3131
* **"Data available in {% data variables.product.prodname_copilot_short %} usage metrics" reference** — lists all dashboard and API fields derived from LoC. See [AUTOTITLE](/copilot/reference/copilot-usage-metrics/copilot-usage-metrics).
3232

0 commit comments

Comments
 (0)