confident-ai/deepeval

DeepEval is an open-source LLM evaluation framework, described as similar to Pytest but specialized for unit testing LLM apps. It provides evaluation metrics such as G-Eval, task completion, answer relevancy and hallucination, which use LLM-as-a-judge and other NLP models running locally. It can evaluate LLM apps end-to-end, complete agent trajectories, and individual agent steps.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/confident-ai/deepeval
confident-ai/deepeval website preview

Links

Tags