The open source developer platform to build AI/LLM applications and models with confidence. Enhance your AI applications with end-to-end tracking, observability, and evaluations, all in one integrated platform.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Structured Outputs

ChatGPT 中文指南🔥，ChatGPT 中文调教指南，指令指南，应用开发指南，精选资源清单，更好的使用 chatGPT 让你的生产力 up up up! 🚀

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

A language model programming library.

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc

Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%

The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

Optimizing inference proxy for LLMs

A framework for prompt tuning using Intent-based Prompt Calibration

A unified evaluation framework for large language models

Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

Your Automatic Prompt Engineering Assistant for GenAI Applications

Community for applying LLMs to robotics and a robot simulator with ChatGPT integration