Directory
Published directory entries matching your search.
Agent Leaderboard is a Hugging Face Space created by galileo-ai that displays interactive leaderboards ranking large language models on agentic tasks. Users can select a task category, evaluation methodology, and performance metric to generate updated comparison tables and visualizations of model performance.
A market intelligence site for AI compute that tracks live GPU cloud and LLM API pricing, performance benchmarks and market data across AI infrastructure providers. It publishes comparisons of GPU cloud pricing by provider and of LLM performance versus cost, including articles on Azure, AWS, Google Cloud, CoreWeave and Lambda GPU offerings.
Seventh Sense provides AI email orchestration and performance management for HubSpot and Marketo, including per-person send-time optimization, deliverability monitoring and audience recycling. It surfaces per-inbox-provider performance and engagement data, with a free start using synthetic data or a connected account.
The Wolfram LLM Benchmarking Project is an ongoing initiative that tracks large language model performance using a benchmark centered on Wolfram Language code generation tasks. It publishes the results of its ongoing performance tracking for LLMs.
Anyword is a generative AI content platform and performance API for go-to-market teams. It adds A/B-tested data and brand context to prompts and works with any AI model or application. The platform includes a data-driven editor, content intelligence, brand voice features, and integrations with marketing channels such as Google Ads, Meta, and LinkedIn.
Arena is a platform that provides leaderboards to compare and benchmark leading frontier AI models across text, image, vision, and other modalities. Its rankings are powered by real user sessions from a global user base, it tracks new model releases, and offers features including live agent sessions, side-by-side model comparison, and user voting for model performance.
Arena Editing is an AI image editing leaderboard that displays overall rankings, performance scores, and vote counts for compared image editing AI models. It includes multiple categories for model evaluation.
Artificial Analysis provides comparison and analysis of AI models and API hosting providers. It offers independent benchmarks across performance metrics including quality, price, output speed and latency, along with an intelligence index and cost-per-task measures.
AuditZap is a website audit tool that performs SEO, performance, and AI search visibility (AEO/GEO) checks on user-submitted websites. It generates AI-powered fix instructions prioritized by estimated revenue impact, with platform-specific guidance for systems including WordPress, Shopify, and Webflow. The service offers 3 free audits per month with no credit card required, with paid plans available for expanded features.
This is the official blog for Wren AI, which publishes practical guides covering GenBI, text-to-SQL, context layers, AI agents, embedded analytics, and secure self-hosted deployment for data teams. Posts include topics such as the role of context in AI agent performance and migrating open-source Wren projects to the cloud.
Candle is a minimalist machine learning framework for Rust with a focus on performance, including GPU support, and ease of use. It provides examples and online browser demos for models such as whisper, LLaMA2, T5, yolo and Segment Anything.
ComfyUI-ZLUDA is a Windows-only version of ComfyUI that uses ZLUDA to improve performance with AMD GPUs. It is a fork of Comfy-Org/ComfyUI and keeps the graph/nodes interface for Stable Diffusion.
DeepSWE is a GitHub repository that provides a benchmark for measuring the performance of frontier coding AI agents on original, long-horizon engineering tasks. The repository includes documentation on task format, quickstart guides, and details about supported agents and models.
Desbordante is a high-performance open-source data profiler. It uses a variety of algorithms to discover different patterns in data and supports running data cleaning scenarios using these algorithms. The tool is available as a console version and an easy-to-use web application.
DesignArena is a crowdsourced benchmark platform for AI-generated design, described as the world's fastest-growing of its kind. It hosts leaderboards for AI design tasks including website, UI component, data visualization, 3D asset, image, logo, slides, video, and audio generation, as well as comparisons of model performance by preference versus speed and preference versus price. It also offers tools to build AI-powered design projects.
High performance library for time series distances (DTW) and time series clustering.
DuckDB is an analytical in-process SQL database management system. It is a high-performance analytical database system designed to be fast, reliable, portable and easy to use, with a rich SQL dialect supporting nested correlated subqueries, window functions, collations and complex types. It is available as a standalone CLI application with clients for Python, R, Java and Wasm.
Eden AI offers a unified API for accessing large language models and specialist AI models, including OCR, speech, translation and vision. It standardizes requests, responses, authentication, billing and monitoring across providers, and supports routing requests by cost, performance and region.
Effective Python: 125 Specific Ways to Write Better Python, 3rd Edition is a book by Brett Slatkin, published by Pearson Addison-Wesley in November 2024. It expands on the second edition from 90 to 125 best practices for writing Python code, adds new chapters on robustness and performance, and covers the language through Python version 3.13.
ELKI is an open source data mining software written in Java. It focuses on research in algorithms, emphasizing unsupervised methods in cluster analysis and outlier detection, and offers data index structures for performance and scalability. It is designed for researchers and students to extend.
This is an article by Terence Tao, Professor of Mathematics at the University of California, Los Angeles, published as part of Microsoft Unlocked's AI Anthology. It discusses human expectations of information technology, including historical performance improvement trends, input data requirements for software tools, and interoperability challenges between different tools and providers.
Epsilla is a high-performance vector database hosted on GitHub under the epsilla-cloud organization. It leverages parallel graph computing for its operations, and offers an experimental option to use it as a Python library without requiring a Docker image, alongside Epsilla Cloud as a deployment option.
Evaligo is a visual drag-and-drop AI workflow builder platform that includes built-in A/B testing capabilities. Users can construct workflows combining prompts, agents and tools, run them across multiple AI models, score outputs using blind AI judge panels, compare performance metrics including quality, cost and speed per output, train per-input model routers, and deploy any workflow as an API. A free plan with no credit card requirement is offered.
Uncover LLM evaluation's importance and explore methods for assessing its performance and impact across industries.
