Skip to content

Commit d8c7410

Browse files
[MLOB-4557] Update the External Evaluations doc
Replace generic reference to custom metrics naming with inline documentation of evaluation label naming rules.
1 parent 3ecc6e8 commit d8c7410

File tree

1 file changed

+7
-1
lines changed

1 file changed

+7
-1
lines changed

content/en/llm_observability/evaluations/external_evaluations.md

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,13 @@ further_reading:
1919
## Overview
2020

2121
In the context of LLM applications, it's important to track user feedback and evaluate the quality of your LLM application's responses.
22-
While LLM Observability provides a few out-of-the-box evaluations for your traces, you can submit your own evaluations to LLM Observability in two ways: with Datadog's [SDK](#submitting-evaluations-with-the-sdk), or with the [LLM Observability API](#submitting-evaluations-with-the-api). See [Naming custom metrics][1] for guidelines on how to choose an appropriate label for your evaluations.
22+
While LLM Observability provides a few out-of-the-box evaluations for your traces, you can submit your own evaluations to LLM Observability in two ways: with Datadog's [SDK](#submitting-evaluations-with-the-sdk), or with the [LLM Observability API](#submitting-evaluations-with-the-api). The following naming convention must be followed for the evaluation label:
23+
24+
* Metric names must start with a letter.
25+
* Metric names must only contain ASCII alphanumerics, underscores.
26+
* Other characters, including spaces, are converted to underscores.
27+
* Unicode is not supported.
28+
* Metric names must not exceed 200 characters. Fewer than 100 is preferred from a UI perspective.
2329

2430
<div class="alert alert-info">Evaluation labels must be unique for a given LLM application (<code>ml_app</code>) and organization.</div>
2531

0 commit comments

Comments
 (0)