Directory
Published directory entries matching your search.
bitnet.cpp is the official inference framework for 1-bit LLMs such as BitNet b1.58. It provides optimized kernels for inference of 1.58-bit models on CPU and GPU, with NPU support stated as coming next. The repository includes documentation and setup scripts, and the project is released under the MIT license.
BurnRate is an AI usage analytics tool that tracks costs, tokens and usage patterns across AI coding providers. It connects OpenAI and Anthropic reporting accounts for provider-reported spend and offers a local CLI for session-level detail. Cloud workspaces come in Free, Pro at $12/month and Team at $29/seat/month plans.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
ByteHub is an open-source tool designed to simplify the creation and management of feature stores. It is maintained as a public repository on GitHub under the bytehub-ai organization, with documentation and tutorials available for users.
Helps teams build, deploy, observe or operate machine-learning systems.
CHICKEN is a compiler for the Scheme programming language that produces portable and efficient C. It supports the R5RS and R7RS standards and many extensions, runs on Linux, OS X, Windows, and many Unix flavours, and is distributed free under the BSD License. Libraries and extensions are available at Eggs Unlimited.
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
Cortex is cloud infrastructure for machine learning at scale, used to deploy, manage and scale machine learning models in production. It supports realtime, async and batch serverless workloads, along with automated cluster management including cluster autoscaling and spot instances with on-demand backups. Environments, provisioning and CI/CD and observability integrations are also listed. A notice states the project is joining Databricks.
Cortex Memory is a production-ready cognitive foundation for autonomous systems such as Embodied-AI and OpenClaw. It provides memory management functionality including extraction, search, and automated optimization, and includes SKILL, CLI, API, MCP, and an insights dashboard out-of-the-box.
Fast inference engine for Transformer models in C++.
Curated list of awesome vector search framework/engine, library, cloud service and research papers to vector similarity search.
Enjoy unlimited API calls with Serverless AI Workers/LLMs for just $25 per month. No rate or concurrency limits.
Deep ML supports machine learning models, deployment, inspection, datasets, or AI development workflows.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
DeepSeek provides machine-learning models, research, training resources, or evaluation tools.
DeepSpeed is a deep learning optimization library intended to make distributed training easy, efficient and effective. It offers system innovations including ZeRO, 3D-Parallelism, DeepSpeed-MoE and ZeRO-Infinity, and has been integrated with several open-source deep learning frameworks.
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
A market intelligence site for AI compute that tracks live GPU cloud and LLM API pricing, performance benchmarks and market data across AI infrastructure providers. It publishes comparisons of GPU cloud pricing by provider and of LLM performance versus cost, including articles on Azure, AWS, Google Cloud, CoreWeave and Lambda GPU offerings.
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. It works with PyTorch and TensorFlow, offering a Python library, command line interface, and web UI for managing machine learning workflows.
Dominodatalab supports deploying, serving, monitoring, or operating AI and machine-learning systems.
dstack is an open framework for confidential AI that runs containers inside confidential VMs with Intel TDX, using existing Docker Compose files. It supports attested workload identities and native NVIDIA Confidential Computing on H100 and Blackwell GPUs, with options for self-hosted TDX machines or Phala Cloud.
Eden AI offers a unified API for accessing large language models and specialist AI models, including OCR, speech, translation and vision. It standardizes requests, responses, authentication, billing and monitoring across providers, and supports routing requests by cost, performance and region.
Edward is a Python library for probabilistic modeling, inference, and criticism. It is a testbed for experimentation and research with probabilistic models, from hierarchical models on small data sets to deep probabilistic models on large data sets. It fuses Bayesian statistics and machine learning, deep learning, and probabilistic programming, and is built on TensorFlow.
Evidently is an open-source observability framework for machine learning and large language models, hosted on GitHub under the evidentlyai organization. It enables users to evaluate, test, and monitor AI-powered systems and data pipelines, with support for use cases ranging from tabular data processing to generative AI, and includes more than 100 built-in metrics.
