Directory
Published directory entries matching your search.
Tusk is an AI testing platform for API testing, unit testing, and integration testing. It generates test cases using live traffic and business context to catch regressions, and maintains existing test suites on each commit. Tests can run locally or in CI.
A free downloadable guide from Kolena Inc. on testing large language models. It identifies principles for creating reliable testing protocols and details approaches for measuring model effectiveness in NLP tasks such as text summarization and prompt engineering, and discusses tracking performance differences over time.
Promptfoo is a tool for testing AI prompts, agents and RAG systems. It supports red teaming, penetration testing and vulnerability scanning for AI, enables performance comparison across models including GPT, Claude, Gemini and DeepSeek, uses simple declarative configuration, and integrates with command line and CI/CD workflows.
TestDriver is an AI code reviewer that runs every pull request in a real desktop sandbox, finds bugs, and builds end-to-end UI tests. It adds tests back as a new pull request and runs unattended in CI. Pricing starts at $20 per seat per month on the ProCloud plan with 120 testing minutes included, plus $0.14 per testing minute.
DeepCode AI is an AI-powered code review and application security tool for static application security testing (SAST), part of the Snyk platform. It offers AI code autofix capabilities, hybrid AI scanning for high accuracy, risk-based prioritization of security issues, and simplified creation of security rules for developers.
AI SDK is a developer tool, library, or framework for building, testing, or maintaining software.
ClearML is an AI infrastructure platform organized in three layers. The Infrastructure Control Plane connects and manages GPU clusters across on-premises, cloud, and hybrid environments, with multi-tenancy, role-based access control, and billing. The AI Development Center provides a workbench for developing, training, and testing models. The GenAI App Engine deploys LLMs onto clusters, with ClearML handling networking, authentication, and security.
Archai is an open-source project developed by Microsoft and hosted on GitHub. It is designed to accelerate neural architecture search (NAS) research by providing fast, reproducible, and modular tooling for developing, testing, and refining new neural network architectures.
An NBER working paper presenting an approach for automatically generating and testing social scientific hypotheses in silico, using large language models with structural causal models. The approach is demonstrated in a negotiation, a bail hearing, a job interview, and an auction.
DAIN (Depth-Aware Video Frame Interpolation) is a CVPR 2019 research project that explicitly detects occlusion by exploring depth cues. It develops a depth-aware flow projection layer to synthesize intermediate flows that sample closer objects than farther ones. The repository provides code, pre-trained models, testing and training instructions, and a Google Colab demo.
A blog covering the AI movement and offering practical advice for builders. Posts include topics such as QA stacks for enterprise engineering teams, free tools for generating API test data, continuous security scanning, browser extensions for QA engineers, and quality assurance versus testing.
DeepEval is an open-source LLM evaluation framework, described as similar to Pytest but specialized for unit testing LLM apps. It provides evaluation metrics such as G-Eval, task completion, answer relevancy and hallucination, which use LLM-as-a-judge and other NLP models running locally. It can evaluate LLM apps end-to-end, complete agent trajectories, and individual agent steps.
ContextQA is an AI test automation platform for enterprise applications and AI agents. It generates test cases, repairs broken selectors automatically, and supports web, API, cross-browser, and cross-device testing. It also offers MCP integration with Cursor and Claude Code.
DEAP is an evolutionary computation framework for Python aimed at rapid prototyping and testing of ideas. It provides genetic algorithms over representations such as lists, arrays, sets, dictionaries, trees and Numpy arrays, genetic programming with prefix trees, evolution strategies including CMA-ES, multi-objective optimisation, and co-evolution of multiple populations. It supports parallelisation via multiprocessing and SCOOP and works out of the box with Python 3 since version 0.8.
Supports software work with AI-assisted coding, testing or application development.
Deepchecks is an open-source project for validating machine learning models and data from research to production. It includes built-in and custom checks and suites for tabular, NLP and CV validation, CI and testing management, and monitoring of deployed models. Installation is via pip.
Direct is a tool that allows users to chat directly with leading frontier AI search models. It enables comparison of model outputs, prompt testing and exploration of capable AI systems in a single interface. The page includes a notice that inputs are processed by third-party AI and responses may be inaccurate.
Supports software work with AI-assisted coding, testing or application development.
Supports software work with AI-assisted coding, testing or application development.
Epsilla is an agent-as-a-service platform for enterprises to build, deploy and manage custom AI agents without coding. It offers a no-code agent builder, RAG as a service, multi-tenancy, analytics and A/B testing, with SaaS, on-premise or private cloud deployment. The site also describes HarnessRouter, a unified Agent API for running multiple agent harnesses.
Evaligo is a visual drag-and-drop AI workflow builder platform that includes built-in A/B testing capabilities. Users can construct workflows combining prompts, agents and tools, run them across multiple AI models, score outputs using blind AI judge panels, compare performance metrics including quality, cost and speed per output, train per-input model routers, and deploy any workflow as an API. A free plan with no credit card requirement is offered.
Build faster with AI coding agents. Factory Droids automate coding, testing, and deployment for startups and enterprises.
Set of tools for creating and testing machine learning features, with a scikit-learn compatible API.
Gemini Omni Prompts is an independent, unofficial library of prompts for Gemini Omni, a multimodal generative model launched at Google I/O 2026. Prompts are adapted from official documentation and community testing, with cited sources and live video tests; the site states it is not affiliated with Google.
