🐢 Open-Source Evaluation & Testing for AI & LLM systems
-
Updated
Jun 23, 2025 - Python
🐢 Open-Source Evaluation & Testing for AI & LLM systems
Deliver safe & effective language models
Agent testing library that uses an agent to test your agent
MIT-licensed Framework for LLMs, RAGs, Chatbots testing. Configurable via YAML and integrable into CI pipelines for automated testing.
GPT4Go: AI-Powered Test Case Generation for Golang 🧪
A Python library for verifying code properties using natural language assertions.
Übungsaufgaben zum Buch "Basiswissen KI-Testen"
Agent testing library that uses an agent to test your agent, in Go.
Agent testing library that uses an agent to test your agent, in Typescript.
A CLI for testing your UI. Easy
Burro is a command-line interface (CLI) tool built with Deno for evaluating Large Language Model (LLM) outputs. It provides a straightforward way to run different types of evaluations with secure API key management.
An automated approach for exploring and testing conversational agents using large language models. TRACER discovers chatbot functionalities, generates user profiles, and creates comprehensive test suites for conversational AI systems.
Evaluation results and experimental data for TRACER, demonstrating its effectiveness in discovering chatbot functionalities and detecting errors with coverage analysis and mutation testing.
A plug & play framework for generative ai projects to be tested & automated
AI Generated BDD for Java and Junit using ChatGPT4o code
🧠🧪 AI-powered test generation tool that automatically creates comprehensive test suites for JavaScript/TypeScript codebases.
📚 Xtest Blog - AI-powered testing insights, tutorials, and best practices for modern software development
A comprehensive corpus of interconnected texts and protocols designed as a conceptual stress-test for advanced AI.
Add a description, image, and links to the ai-testing topic page so that developers can more easily learn about it.
To associate your repository with the ai-testing topic, visit your repo's landing page and select "manage topics."