Skip to content

Conversation

@anistark
Copy link
Member

@anistark anistark commented Oct 23, 2025

Changes Made

Documentation (docs/getstarted/evals.md):

  • Added quickstart cmd to follow through guide with an example project.
  • Updated "Custom Evaluation with LLMs" to reference DiscreteMetric from
    generated code
  • Replaced static examples with modern llm_factory API
  • Changed "Using Pre-Built Metrics" to AspectCritic with modern async/await
    syntax
  • Updated "Evaluating on a Dataset" to use ragas.Dataset API

Build Configuration (mkdocs.yml):

  • Made social plugin conditional: enabled: !ENV [MKDOCS_CI, true]

Makefile:

  • Added explicit MKDOCS_CI=false to serve-docs target. This avoids social plugin error in macos if in case cairosvg is not found.

@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Oct 23, 2025
@anistark anistark marked this pull request as draft October 26, 2025 08:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:L This PR changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant