You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
title: Load data into a Dataverse table and build a dataflows monitoring report with Power BI
2
+
title: Load data in a Dataverse table and build a dataflows monitoring report with Power BI
3
3
description: How to use the dataflows connector in Power Automate to create a dataflows monitoring report with Power BI
4
4
author: miquelladeboer
5
5
6
6
ms.service: powerquery
7
7
ms.reviewer: kvivek
8
8
ms.topic: conceptual
9
-
ms.date: 12/15/2020
9
+
ms.date: 11/12/2021
10
10
ms.author: mideboer
11
11
---
12
-
# Load Data into a Dataverse table and Build a Dataflows Monitoring Report with Power BI
12
+
# Load data in a Dataverse table and build a dataflows monitoring report with Power BI
13
13
14
-
## Introduction
14
+
This tutorial demonstrates how to load data in a Dataverse table to create a dataflows monitoring report in Power BI.
15
15
16
-
In this step-by-step tutorial, we will show you how to set up your own monitoring dashboard for all of your dataflows:
16
+
17
17
18
-
18
+
You can use this dashboard to monitor your dataflows' refresh duration and failure count. With this dashboard, you can track any issues with your dataflows performance and share the data with others.
19
19
20
-
You can use this dashboard to monitor your dataflows' refresh duration and failure count. With this dashboard, you can track any issues with your dataflows performance and share the data with others.
20
+
First, you'll create a new Dataverse table that stores all the metadata from the dataflow run. For every refresh of a dataflow, a record is added to this table. You can also store metadata for multiple dataflow runs in the same table. After the table is created, you'll connect the Power BI file to the Dataverse table.
21
21
22
-
First, you will create a new Dataverse table which stores all the metadata from the dataflow run. For every refresh of a dataflow, a record is added to this table. You can also store metadata for multiple dataflows runs in the same table. After the table is created, you will connect the Power BI file to the Dataverse table.
*[Power BI Desktop](https://www.microsoft.com/download/details.aspx?id=58494).
28
27
29
28
* A [Dataverse environment](/powerapps/maker/common-data-service/data-platform-intro) with permissions to create new custom tables.
30
29
31
-
* A [Premium Power Automate Licence](/power-platform/admin/pricing-billing-skus).
30
+
* A [Premium Power Automate License](/power-platform/admin/pricing-billing-skus).
32
31
33
32
* A [Power BI dataflow](/power-bi/transform-model/dataflows/dataflows-introduction-self-service) or [Power Platform dataflow](/powerapps/maker/common-data-service/create-and-use-dataflows).
34
33
@@ -38,67 +37,68 @@ First, download the Dataverse [.pbit file](https://download.microsoft.com/downlo
38
37
39
38
## Create a new table in Dataverse
40
39
41
-
* Navigate to the [Power Apps portal](https://powerapps.microsoft.com/).
40
+
1. Navigate to the [Power Apps portal](https://powerapps.microsoft.com/).
41
+
42
+
2. On the left navigation pane expand **Data**, select **Tables**, and then select **New table**.
42
43
43
-
* Follow these [instructions](/powerapps/maker/common-data-service/create-custom-entity) to create a newtable.
44
+
[](media/new-table-dialog.png#lightbox)
44
45
45
-
* In the right pane, enter the following values, and then select `Create`
46
-
***Display name**: "Dataflow Name"
47
-
***Data type**: Text
48
-
***Required**: Checked
46
+
3. In the **New table** pane:
47
+
1. Enter **Dataflows Monitoring** in **Display name**.
48
+
1. Under **Primary Name Column**, enter **Dataflow name** in **Display name**.
***Display name**: "Start Time", **Data type**: Date and Time, **Required**: Required.
56
+
***Display name**: "End Time", **Data type**: Date and Time, **Required**: Required.
57
+
58
+
[](media/new-column-dialog.png#lightbox)
55
59
56
60
## Create a dataflow
57
61
58
-
If you do not already have one, create a dataflow. This can be done in either [Power BI dataflows](/power-bi/transform-model/dataflows/dataflows-introduction-self-service) or [Power Apps dataflows](/powerapps/maker/common-data-service/create-and-use-dataflows).
62
+
If you don't already have one, create a dataflow. You can create a dataflow in either [Power BI dataflows](/power-bi/transform-model/dataflows/dataflows-introduction-self-service) or [Power Apps dataflows](/powerapps/maker/common-data-service/create-and-use-dataflows).
59
63
60
-
## Create a Power Automate Flow
64
+
## Create a Power Automate flow
61
65
62
-
* Navigate to [Power Automate](https://flow.microsoft.com).
63
-
* Create a new **automated cloud flow**
66
+
1. Navigate to [Power Automate](https://flow.microsoft.com).
67
+
2. Select **Create** > **Automated cloud flow**.
68
+
3. Enter a flow name, and then search for the "When a dataflow refresh completes" connector. Select this connector from the list, and then select **Create**.
69
+
4. Customize the connector. Enter the following information on your dataflow:
64
70
65
-
* Search for the connector "When a dataflow refresh completes (preview)". If you encounter difficulty, see these [instructions](/power-automate/get-started-logic-flow).
66
-
* Customize the connector. You need to enter information on your dataflow:
67
-
***Group Type**: Select *Environment* when connecting to Power Apps and *Workspace* when connecting to Power BI.
68
-
***Group**: Select the Power Apps environment or the Power BI workspace your dataflow is in.
69
-
***Dataflow**: Select your dataflow by name.
71
+
***Group Type**: Select *Environment* when connecting to Power Apps and *Workspace* when connecting to Power BI.
72
+
***Group**: Select the Power Apps environment or the Power BI workspace your dataflow is in.
73
+
***Dataflow**: Select your dataflow by name.
70
74
71
-
* Click on **new step** to add an action to your flow.
72
-
* Search for the connector "Create a new record" form Dataverse.
73
-
* Customize the connector. You need to enter information:
74
-
***Environment**: Select your Dataverse environment.
75
-
***Entity Name**: Select the entity named "Dataflows Monitoring" which you previously created.
75
+
5. Select **New step** to add an action to your flow.
76
+
6. Search for the "Add a new row" connector from Dataverse, and then select it.
77
+
7. In **Add a new row**, select **Choose a table** and then choose **Dataflows Monitoring** from the list.
76
78
79
+
77
80
78
-
81
+
8. For every required field, you need to add a dynamic value. This value is the output of the metadata of the dataflow that's run.
82
+
1. Select the field next to **Dataflow Name** and then select **Dataflow Name** from the dynamic content.
79
83
80
-
* Add dynamic values to the required fields.
84
+
[](media/dynamic.png#lightbox)
81
85
82
-
For every required field, you need to add a dynamic value. This value is the output of the metadata of the dataflow run.
83
-
* Select the field next to **Dataflow ID** and then select the lightning button.
84
-
85
-
86
+
2. Repeat this process for all required fields.
86
87
87
-
* Repeat this process for all required fields.
88
-
89
-
88
+
90
89
91
-
* Save the flow.
90
+
9. Save the flow.
92
91
93
92
## Create a Power BI Report
94
93
95
-
* Open the `.pbit` file.
94
+
1. Open the `.pbit` file.
95
+
96
+
2. Connect to your Dataverse entity **Dataflows Monitoring**.
96
97
97
-
* Connect to your Dataverse entity **Dataflow Monitoring**.
98
+
In this dashboard, for every dataflow in your specified time interval, you can monitor:
98
99
99
-
In this dashboard, you can monitor, for every dataflow in your specified time interval:
100
-
* the dataflow duration
101
-
* the dataflow count
102
-
* the dataflow failure count
100
+
* The dataflow duration
101
+
* The dataflow count
102
+
* The dataflow failure count
103
103
104
-
The uniqueID for every dataflow is generated by a merge between the dataflow name and the dataflow start time.
104
+
The unique ID for every dataflow is generated by a merge between the dataflow name and the dataflow start time.
title: Load Data into Excel Online and build a Dataflows Monitoring Report with Power BI
3
-
description: How to use and Excel file and the dataflows connector in Power Automate to create a dataflows monitoring report in Power BI
2
+
title: Load data in Excel Online and build a dataflows monitoring report with Power BI
3
+
description: How to use an Excel file and the dataflows connector in Power Automate to create a dataflows monitoring report in Power BI
4
4
author: miquelladeboer
5
5
6
6
ms.service: powerquery
7
7
ms.reviewer: kvivek
8
8
ms.topic: conceptual
9
-
ms.date: 12/15/2020
9
+
ms.date: 11/16/2021
10
10
ms.author: mideboer
11
11
---
12
12
13
-
# Load Data into Excel Online and Build a Dataflows Monitoring Report with Power BI
13
+
# Load data in Excel Online and build a dataflows monitoring report with Power BI
14
14
15
-
## Introduction
15
+
This tutorial demonstrates how to use an Excel file and the dataflows connector in Power Automate to create a dataflows monitoring report in Power BI.
16
16
17
-
In this step-by-step tutorial, we will show you how to set up your own monitoring dashboard for all of your dataflows:
17
+
18
18
19
-
19
+
First, you'll download the Excel file and save it in OneDrive for Business or SharePoint. Next, you'll create a Power Automate connector that loads metadata from your dataflow to the Excel file in OneDrive for Business or SharePoint. Lastly, you'll connect a Power BI file to the Excel file to visualize the metadata and start monitoring the dataflows.
20
20
21
-
First, you will download the Excel file and save it in OneDrive for Business or SharePoint. Next, you will create a Power Automate connector which will load metadata from your dataflow into the Excel file in OneDrive for Business or SharePoint. Lastly, you will connect a Power BI file to the Excel file to visualize the metadata and start monitoring the dataflows.
22
-
23
-
You can use this dashboard to monitor your dataflows' refresh duration and failure count. With this dashboard, you can track any issues with your dataflows performance and share the data with others.
24
-
25
-
21
+
You can use this dashboard to monitor your dataflows' refresh duration and failure count. With this dashboard, you can track any issues with your dataflows performance and share the data with others.
26
22
23
+
*[Power BI Desktop](https://www.microsoft.com/download/details.aspx?id=58494).
@@ -40,59 +38,61 @@ You can use this dashboard to monitor your dataflows' refresh duration and failu
40
38
41
39
First, download the [.pbit file](https://download.microsoft.com/download/1/4/E/14EDED28-6C58-4055-A65C-23B4DA81C4DE/excel-template.pbit).
42
40
43
-
## Download the Excel file and Save to OneDrive
41
+
## Download the Excel file and save to OneDrive
44
42
45
43
Next, download the [.xlsx file](https://download.microsoft.com/download/1/4/E/14EDED28-6C58-4055-A65C-23B4DA81C4DE/dataflow_monitoring.xlsx) and save the file to a location on OneDrive for Business or SharePoint
46
44
47
45
## Create a dataflow
48
46
49
-
If you do not already have one, create a dataflow. This can be done in either [Power BI dataflows](/power-bi/transform-model/dataflows/dataflows-introduction-self-service) or [Power Apps dataflows](/powerapps/maker/common-data-service/create-and-use-dataflows).
47
+
If you don't already have one, create a dataflow. You can create a dataflow in either [Power BI dataflows](/power-bi/transform-model/dataflows/dataflows-introduction-self-service) or [Power Apps dataflows](/powerapps/maker/common-data-service/create-and-use-dataflows).
50
48
51
-
## Create a flow in Power Automate
49
+
## Create a flow in Power Automate
52
50
53
-
* Navigate to [Power Automate](https://flow.microsoft.com).
51
+
1. Navigate to [Power Automate](https://flow.microsoft.com).
52
+
2. Select **Create** > **Automated cloud flow**.
53
+
3. Enter a flow name, and then search for the "When a dataflow refresh completes" connector. Select this connector from the list, and then select **Create**.
54
54
55
-
* Search for the template "When a dataflow refresh completes, output status into Excel". If you encounter difficulty, see these [instructions](/power-automate/get-started-logic-template).
55
+
4. Customize the connector. Enter the following information on your dataflow:
56
56
57
-
57
+
***Group Type**: Select *Environment* when connecting to Power Apps and *Workspace* when connecting to Power BI.
58
+
***Group**: Select the Power Apps environment or the Power BI workspace your dataflow is in.
59
+
***Dataflow**: Select your dataflow by name.
60
+
61
+
5. Select **New step** to add an action to your flow.
62
+
6. Search for the "Add a row into a table" connector from Excel Online (Business), and then select it.
58
63
59
-
* Customize the flow. Actions that require input from you will automatically be expanded.
64
+
7. Customize the connector. Enter the *Location* of the Excel file and the specific *Table* the data loads to.
65
+
***Location**: Select the location of the Excel file on OneDrive for Business or SharePoint.
66
+
***Document Library**: Select the library of the Excel file.
67
+
***File**: Select the file path to the Excel file.
68
+
***Table**: Select "Dataflow_monitoring".
60
69
61
-
The **Dataflow Refresh** trigger is expanded because you need to enter information on your dataflow:
62
-
***Group Type**: Select *Environment* when connecting to Power Apps and *Workspace* when connecting to Power BI.
63
-
***Group**: Select the Power Apps environment or the Power BI workspace your dataflow is in.
64
-
***Dataflow**: Select your dataflow by name.
65
-
66
-
The **Add a row into a table** action is expanded because you need to enter the *Location* of the Excel file and the specific *Table* the data loads to.
67
-
***Location**: Select the location of the Excel file on OneDrive for Business or SharePoint.
68
-
***Document Library**: Select the library of the Excel file.
69
-
***File**: Select the file path to the Excel file.
70
-
***Table**: Select "Dataflow_monitoring".
70
+
71
+
72
+
8. Add dynamic values to the required fields.
71
73
72
-
* Add dynamic values to the required fields.
74
+
For every required field, you need to add a dynamic value. This value is the output of the metadata of the dataflow run.
73
75
74
-
For every required field, you need to add a dynamic value. This value is the output of the metadata of the dataflow run.
75
-
* Select the field next to **Dataflow ID** and then select the lightning button.
76
-
77
-
76
+
1. Select the field next to **dataflowname_name**.
78
77
79
-
* Select the Dataflow ID as the dynamic content.
80
-
78
+
2. Select **Dataflow Name** from the **Dynamic content** context box.
81
79
82
-
* Repeat this process for all required fields.
80
+
[](media/dynamicexcel1.png#lightbox)
83
81
84
-
* Save the flow.
82
+
3. Repeat this process for all required fields.
85
83
84
+
9. Save the flow.
86
85
87
86
## Create a Power BI Report
88
87
89
-
* Open the `.pbit` file.
88
+
1. Open the `.pbit` file.
89
+
90
+
2. Connect to your Excel file.
90
91
91
-
* Connect to your Excel file.
92
+
In this dashboard, for every dataflow in your specified time interval, you can monitor:
92
93
93
-
In this dashboard, you can monitor, for every dataflow in your specified time interval:
94
-
* the dataflow duration
95
-
* the dataflow count
96
-
* the dataflow failure count
94
+
* The dataflow duration
95
+
* The dataflow count
96
+
* The dataflow failure count
97
97
98
-
The uniqueID for every dataflow is generated by a merge between the dataflow name and the dataflow start time.
98
+
The uniqueID for every dataflow is generated by a merge between the dataflow name and the dataflow start time.
0 commit comments