Kubeflow is described as the cloud native AI platform, composed of modular open source projects forming a Kubernetes-native stack for data and AI workloads. Its subprojects include Kubeflow Pipelines for building and deploying portable machine learning workflows, Kubeflow Trainer for distributed AI training and LLM fine-tuning, Kubeflow Katib for automated machine learning, Kubeflow Notebooks for interactive development environments, and Kubeflow Hub for indexing models and metadata. It is a Cloud Native Computing Foundation project.
Bifrost is an open-source AI gateway for LLMs, MCP and agents, offered by Maxim AI. It provides routing, governance, guardrails and observability, and is described as a drop-in replacement for AI SDKs. Enterprise adds features such as SSO, RBAC, adaptive load balancing, cluster mode and in-VPC deployment, free for 14 days.
LiteLLM is an open-source library that provides a single, unified interface to call over 100 LLMs using the OpenAI format. It includes a Python SDK whose completion() function uses the same arguments across providers and returns responses in the OpenAI Chat Completions format, plus a self-hosted gateway with virtual keys, cost tracking and an admin UI.
Apache Storm is a free and open source distributed realtime computation system. It processes unbounded streams of data and is simple, can be used with any programming language, and integrates with queueing and database technologies. Listed use cases include realtime analytics, online machine learning, continuous computation, distributed RPC and ETL.
Self-hosted control plane that sits between connected AI clients, model providers, and tools. It applies access rules to users and agents, routes supported model requests through a gateway, checks governed tool calls before execution, and records policy decisions, execution records, and usage in the operator's environment. It deploys a Rust runtime with PostgreSQL on infrastructure the operator controls.
Lunary is an observability and prompt management platform for LLM-based applications. It provides chatbot analytics, agent tracing, prompt templates, topic classification, PII masking and feedback tracking. A self-hostable option is offered. The Team cloud plan costs $20 per user per month, billed monthly, and payment is required to activate a workspace.
MLflow is an open source AI engineering platform for agents, LLMs, and ML models. It provides tools for debugging, evaluating, monitoring, and optimizing AI applications, including tracing, evaluation metrics, prompt management, an AI gateway, and an agent server. The project is released under the Apache 2.0 license.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
Bifrost is an open-source AI gateway for LLMs, MCP and agents, offered by Maxim AI. It provides routing, governance, guardrails and observability, and is described as a drop-in replacement for AI SDKs. Enterprise adds features such as SSO, RBAC, adaptive load balancing, cluster mode and in-VPC deployment, free for 14 days.
LiteLLM is an open-source library that provides a single, unified interface to call over 100 LLMs using the OpenAI format. It includes a Python SDK whose completion() function uses the same arguments across providers and returns responses in the OpenAI Chat Completions format, plus a self-hosted gateway with virtual keys, cost tracking and an admin UI.
Apache Storm is a free and open source distributed realtime computation system. It processes unbounded streams of data and is simple, can be used with any programming language, and integrates with queueing and database technologies. Listed use cases include realtime analytics, online machine learning, continuous computation, distributed RPC and ETL.
Self-hosted control plane that sits between connected AI clients, model providers, and tools. It applies access rules to users and agents, routes supported model requests through a gateway, checks governed tool calls before execution, and records policy decisions, execution records, and usage in the operator's environment. It deploys a Rust runtime with PostgreSQL on infrastructure the operator controls.
Lunary is an observability and prompt management platform for LLM-based applications. It provides chatbot analytics, agent tracing, prompt templates, topic classification, PII masking and feedback tracking. A self-hostable option is offered. The Team cloud plan costs $20 per user per month, billed monthly, and payment is required to activate a workspace.
MLflow is an open source AI engineering platform for agents, LLMs, and ML models. It provides tools for debugging, evaluating, monitoring, and optimizing AI applications, including tracing, evaluation metrics, prompt management, an AI gateway, and an agent server. The project is released under the Apache 2.0 license.
