Skip to content

Commit 7409b27

Browse files
authored
[MLOB-2995] Update LLMO Evaluations doc with BYOK token dashboard (#30048)
* link to BYOK dashbaord * nit * rephrase * nit
1 parent bdabede commit 7409b27

File tree

1 file changed

+5
-2
lines changed

1 file changed

+5
-2
lines changed

content/en/llm_observability/evaluations/ootb_evaluations.md

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ LLM Observability out-of-the-box evaluations leverage LLMs. To connect your LLM
2323

2424
## Connect your LLM provider account
2525

26-
Configure the LLM provider you would like to use for bring-your-own-key evaluations. You only have to complete this step once.
26+
Configure the LLM provider you would like to use for bring-your-own-key (BYOK) evaluations. You only have to complete this step once.
2727

2828
{{< tabs >}}
2929
{{% tab "OpenAI" %}}
@@ -110,7 +110,9 @@ After you click **Save**, LLM Observability uses the LLM account you connected t
110110

111111
### Estimated token usage
112112

113-
LLM Observability provides metrics to help you monitor and manage the token usage associated with evaluations that power LLM Observability. The following metrics allow you to track the LLM resources consumed to power evaluations:
113+
You can monitor the token usage of your BYOK out-of-the-box evaluations using [this dashboard][7].
114+
115+
If you need more details, the following metrics allow you to track the LLM resources consumed to power evaluations:
114116

115117

116118
- `ml_obs.estimated_usage.llm.input.tokens`
@@ -285,4 +287,5 @@ This check ensures that sensitive information is handled appropriately and secur
285287
[4]: /security/sensitive_data_scanner/
286288
[5]: https://docs.datadoghq.com/api/latest/ip-ranges/
287289
[6]: https://docs.datadoghq.com/llm_observability/setup/sdk/
290+
[7]: https://app.datadoghq.com/dash/integration/llm_byok_token_usage
288291

0 commit comments

Comments
 (0)