Skip to content

Commit 5a4d3f2

Browse files
[MLOB-4557] Update the External Evaluations doc (#32927)
* [MLOB-4557] Update the External Evaluations doc Replace generic reference to custom metrics naming with inline documentation of evaluation label naming rules. * Update content/en/llm_observability/evaluations/external_evaluations.md Co-authored-by: Joe Peeples <[email protected]> --------- Co-authored-by: Joe Peeples <[email protected]>
1 parent b933f68 commit 5a4d3f2

File tree

1 file changed

+7
-1
lines changed

1 file changed

+7
-1
lines changed

content/en/llm_observability/evaluations/external_evaluations.md

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,13 @@ further_reading:
1919
## Overview
2020

2121
In the context of LLM applications, it's important to track user feedback and evaluate the quality of your LLM application's responses.
22-
While LLM Observability provides a few out-of-the-box evaluations for your traces, you can submit your own evaluations to LLM Observability in two ways: with Datadog's [SDK](#submitting-evaluations-with-the-sdk), or with the [LLM Observability API](#submitting-evaluations-with-the-api). See [Naming custom metrics][1] for guidelines on how to choose an appropriate label for your evaluations.
22+
While LLM Observability provides a few out-of-the-box evaluations for your traces, you can submit your own evaluations to LLM Observability in two ways: with Datadog's [SDK](#submitting-evaluations-with-the-sdk), or with the [LLM Observability API](#submitting-evaluations-with-the-api). Use this naming convention for the evaluation label:
23+
24+
* Evaluation labels must start with a letter.
25+
* Evaluation labels must only contain ASCII alphanumerics or underscores.
26+
* Other characters, including spaces, are converted to underscores.
27+
* Unicode is not supported.
28+
* Evaluation labels must not exceed 200 characters. Fewer than 100 is preferred from a UI perspective.
2329

2430
<div class="alert alert-info">Evaluation labels must be unique for a given LLM application (<code>ml_app</code>) and organization.</div>
2531

0 commit comments

Comments
 (0)