Directory
Published directory entries matching your search.
A free downloadable guide from Kolena Inc. on testing large language models. It identifies principles for creating reliable testing protocols and details approaches for measuring model effectiveness in NLP tasks such as text summarization and prompt engineering, and discusses tracking performance differences over time.
Promptfoo is a tool for testing AI prompts, agents and RAG systems. It supports red teaming, penetration testing and vulnerability scanning for AI, enables performance comparison across models including GPT, Claude, Gemini and DeepSeek, uses simple declarative configuration, and integrates with command line and CI/CD workflows.
Evaligo is a visual drag-and-drop AI workflow builder platform that includes built-in A/B testing capabilities. Users can construct workflows combining prompts, agents and tools, run them across multiple AI models, score outputs using blind AI judge panels, compare performance metrics including quality, cost and speed per output, train per-input model routers, and deploy any workflow as an API. A free plan with no credit card requirement is offered.
Testing framework dedicated to ML models, from tabular to LLMs. Detect risks of biases, performance issues and errors in 4 lines of code.
