Directory
Published directory entries matching your search.
Amadeus Code provides music AI infrastructure spanning rights-cleared training data, audio supply and royalty management. Its products include MusicTGA for MIDI songwriting ideas, FUJIYAMA AI SOUND for music and sound materials, and Evoke Music, a royalty-free library. CONNECT is a royalty management platform for copyrights and master rights in Japan.
ANEE is an experimental dynamic inference wrapper for pretrained Transformer language models, currently GPT-2. It exposes an energy_budget and performs early exit inside the model's forward pass rather than always running all layers. It adds per-token adaptive computation using a profiler and learned controller to skip redundant layers while keeping the KV-cache aligned.
Applied ML is a curated collection of papers, articles and blogs about data science and machine learning in production, organized under topics such as data quality, recommendation, search and ranking, and MLOps. It is licensed under MIT and covers how organizations frame problems and which techniques worked.
Arize Phoenix is an AI observability and evaluation tool built by Arize AI and the open-source community on OpenTelemetry and OpenInference. It provides tracing for debugging individual runs, evaluations to score output quality, a prompt playground, and datasets and experiments for comparing changes on the same inputs.
Drop-in AsyncOpenAI replacement that transparently batches requests via the Batch API for cheaper LLM inference.
Awesome AutoDL is a curated list of automated deep learning resources and an in-depth analysis, subtitled that neural architecture search is not the end. It collects papers, libraries and benchmarks covering neural architecture search and hyper-parameter optimization.
Banana provides GPU inference hosting for AI teams. The platform scales GPUs up and down automatically and includes monitoring, business analytics, a CLI, SDKs, and an open automation API. Backends can be written with Potassium, an open-source HTTP framework. Paid Team and Enterprise tiers are offered.
BayesPy is an open-source Python library that provides tools for performing Bayesian inference. It is hosted as a public repository on GitHub where users can access the code and contribute to its development.
Beam provides a bare-metal cloud for agents, with persistent forkable microVMs that boot in seconds and can be paused, resumed, network-isolated and GPU-accelerated. Virtual machines are billed per second while running, with no compute charges while stopped. The platform also offers serverless GPU tasks, sandboxes and on-demand GPU machines.
BentoML is a unified model serving framework. It enables users to build model inference APIs, job queues, LLM applications, and multi-model pipelines. The framework supports local execution and deployment via Docker.
An open-source LLM gateway with routing, load balancing, guardrails, and observability for 1000+ models. opensource.
bitnet.cpp is the official inference framework for 1-bit LLMs such as BitNet b1.58. It provides optimized kernels for inference of 1.58-bit models on CPU and GPU, with NPU support stated as coming next. The repository includes documentation and setup scripts, and the project is released under the MIT license.
BudgetML is a tool for deploying a machine learning inference service to a secured HTTPS API endpoint with less than 10 lines of code. It runs the model on a Google Cloud Platform preemptible instance, generates a FastAPI server endpoint, and provides interactive Swagger docs. The project states that the library is not being actively maintained.
BurnRate is an AI usage analytics tool that tracks costs, tokens and usage patterns across AI coding providers. It connects OpenAI and Anthropic reporting accounts for provider-reported spend and offers a local CLI for session-level detail. Cloud workspaces come in Free, Pro at $12/month and Team at $29/seat/month plans.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
ByteHub is an open-source tool designed to simplify the creation and management of feature stores. It is maintained as a public repository on GitHub under the bytehub-ai organization, with documentation and tutorials available for users.
Helps teams build, deploy, observe or operate machine-learning systems.
CHICKEN is a compiler for the Scheme programming language that produces portable and efficient C. It supports the R5RS and R7RS standards and many extensions, runs on Linux, OS X, Windows, and many Unix flavours, and is distributed free under the BSD License. Libraries and extensions are available at Eggs Unlimited.
A personal blog about AI system design and bringing AI into production. Posts cover topics including generative AI applications, agents, multimodal models, LLM research challenges, model routing, generation configurations, and machine learning systems.
Open-source project that supports AI agents, automated workflows, orchestration, or delegated tasks.
Clip-as-a-service is an open-source tool that provides scalable embedding, reasoning, and ranking capabilities for images and text using the CLIP model. It is maintained as a public repository on GitHub under the jina-ai organization, with documentation and installation guides available.
CML, or Continuous Machine Learning, is an open-source CLI tool for implementing CI/CD with a focus on MLOps. It is used to automate development workflows, including machine provisioning, model training and evaluation, comparing ML experiments across project history, and monitoring changing datasets. It can generate a visual report with results and metrics automatically on every pull request, using GitLab, GitHub, or Bitbucket.
Cog is an open-source tool that packages machine learning models in standard, production-ready containers. Users define the environment in a configuration file, and it generates a Docker image with Nvidia base images and dependency caching. Model inputs and outputs are defined in Python, from which Cog generates an OpenAPI schema and an HTTP inference server. Models can be deployed to own infrastructure or Replicate.
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
