Directory
Explore AI Infrastructure & MLOps resources in AI & Machine Learning.
Bifrost is an open-source AI gateway for LLMs, MCP and agents, offered by Maxim AI. It provides routing, governance, guardrails and observability, and is described as a drop-in replacement for AI SDKs. Enterprise adds features such as SSO, RBAC, adaptive load balancing, cluster mode and in-VPC deployment, free for 14 days.
Metorial is an agentic infrastructure platform for AI-native companies. It provides a single unified platform for employees, AI agents, and AI clients to connect tools and skills, with built-in governance, access control, and tracing capabilities. The platform supports development of customer-facing agents, internal assistants, and scalable AI workforces.
Milvus is open source vector database for production AI, written in Go and C++, scalable and blazing fast for billions of embedding vectors.
Full-stack AI platform focused on multimodal agents and consumer-scale deployment.
MLEM is an open source tool designed to package, serve, and deploy machine learning models on any platform. The project's primary repository is currently archived, with maintainers noting plans to resurrect it in the future.
MLflow is an open source AI engineering platform for agents, LLMs, and ML models. It provides tools for debugging, evaluating, monitoring, and optimizing AI applications, including tracing, evaluation metrics, prompt management, an AI gateway, and an agent server. The project is released under the Apache 2.0 license.
MLOps Community is a global community for machine learning engineers focused on MLOps. It facilitates knowledge sharing, real-world problem solving, networking, and career advancement through in-person meetups and conferences, virtual tech talks, podcasts, workshops, and masterclasses. It reports membership of over 70,000 to 90,000 ML practitioners.
A guide explaining MLOps concepts and how to build an MLOps environment. It covers theory and a tutorial using tools such as DVC, CML, IBM Watson Machine Learning, IBM Watson OpenScale, Terraform and Cookiecutter. The guide is described as modular, allowing tools to be swapped according to project preferences and use cases.
MLOps Now supports deploying, serving, monitoring, or operating AI and machine-learning systems.
MLReef is an open source ML-Ops platform for collaborating, reproducing and sharing machine learning work. The repository notes it is no longer supported or updated there, with work continuing on GitLab. Described sections include data management with versioned data hosting, containerized code repositories, experiment tracking and ML pipelines on Kubernetes, cloud or bare metal.
Machine learning model serving framework with dynamic batching and pipelined stages, provides an easy-to-use Python interface.
Msty describes private AI for individuals, teams and organizations, with four products connected as one system: Studio, a private AI workspace; Go, for agents; Nexus, a model gateway hub; and Stack, for organizing knowledge. Studio pricing lists a free tier and an Aurum plan billed yearly at $149 per user.
MyVibe is a tool that uses AI to transform web projects into deployable applications. It allows users to upload, convert, and publish their web creations instantly, and is powered by ArcBlock.
NASGym is a proof-of-concept OpenAI Gym environment for Neural Architecture Search. It implements reinforcement learning steps for NAS and encodes networks using the Neural Structure Code from BlockQNN. A network is modeled as a list of NSCs, an action adds a layer, and the reward is accuracy after early-stop training. CIFAR-10 is the default dataset. The code and documentation may contain minor bugs.
NCNN is a neural network inference framework optimized for mobile, embedded, and desktop deployment. It has no third-party runtime dependencies and runs across CPU and Vulkan GPU backends. Tools such as pnnx convert PyTorch and ONNX models to ncnn, allowing deployment to phones, PCs, browsers, and edge devices. The project is used in several Tencent applications.
NDScala is a Scala 3 library for N-dimensional and multi-dimensional arrays (tensors), described as comparable to NumPy ndarray or PyTorch Tensor, with type safety over shapes, array and axis labels and numeric data types. The repository includes materials on shape-safe neural network training and an ONNXScala component.
Easy-to-use library to boost AI inference.
Neuraxle is an AutoML library that supports hyperparameter tuning via pipeline abstractions to build clean deep learning production pipelines. Pipeline steps can have associated hyperparameter spaces, and the library is compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks, and MLOps environments.
Nimblebox supports deploying, serving, monitoring, or operating AI and machine-learning systems.
An Easy-to-Use and High-Performance AI deployment framework.
Neural networks framework in pure C: training and inference, no dependencies.
Ombre is an open-source AI infrastructure layer. It runs eight specialized agents on every request to handle security, caching, memory, hallucination detection, and tamper-proof audit trails. It is installed with one line of code, and user data never leaves the user's server.
Simplifies and accelerates MLOps by bridging the gap between ML models and edge hardware.
onWatch is an open-source tool developed by onllm-dev that tracks AI API quotas for services including Synthetic, Z.ai, Anthropic Claude Code, Codex, GitHub Copilot and Antigravity in real time. It functions as a lightweight background daemon that uses less than 50MB of RAM, stores data in SQLite, and provides a Material Design 3 dashboard. The tool does not collect telemetry.
