KServe is a standardized distributed generative and predictive AI inference platform for scalable, multi-framework deployment on Kubernetes. It is a Cloud Native Computing Foundation incubating project. The platform supports backends such as vLLM and llm-d for serving LLMs, and multi-framework predictive serving. Standalone installation on standard Kubernetes is described as more lightweight but without canary deployment or request-based autoscaling with scale-to-zero.
LiteLLM is an open-source library that provides a single, unified interface to call over 100 LLMs using the OpenAI format. It includes a Python SDK whose completion() function uses the same arguments across providers and returns responses in the OpenAI Chat Completions format, plus a self-hosted gateway with virtual keys, cost tracking and an admin UI.
Kubeflow is described as the cloud native AI platform, composed of modular open source projects forming a Kubernetes-native stack for data and AI workloads. Its subprojects include Kubeflow Pipelines for building and deploying portable machine learning workflows, Kubeflow Trainer for distributed AI training and LLM fine-tuning, Kubeflow Katib for automated machine learning, Kubeflow Notebooks for interactive development environments, and Kubeflow Hub for indexing models and metadata. It is a Cloud Native Computing Foundation project.
Pipeline Conversations is a podcast from ZenML featuring interviews with platform engineers, ML practitioners and technical leaders building production AI systems. Episodes cover MLOps and LLMOps topics including Kubernetes workflows, model fine-tuning and evaluation, LLM security, cost optimization, prompt engineering and agents in production.
Quix is described as an agentic AI platform for hardware engineering. It turns test-rig and sensor data into real-time insight and is presented as automating engineering workflows across the V, from requirements through verification, validation and operation.
Superwise is a platform offering AI Gateway, Secure AI Chat, and AI Services. Its Sentinel product prevents sensitive data from leaking into external AI tools, Chat provides a safe AI workspace for teams, and its services help organizations plan, build, and govern AI use cases.
Guild is a vendor-neutral control plane for AI agents. It lets engineering teams manage, govern, and share agents in production, with security and observability built in. Features include scoped credentials, action approval, policy enforcement, tracing, and evaluations. It supports any model or framework and provides a shared agent catalog and CLI access.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
LiteLLM is an open-source library that provides a single, unified interface to call over 100 LLMs using the OpenAI format. It includes a Python SDK whose completion() function uses the same arguments across providers and returns responses in the OpenAI Chat Completions format, plus a self-hosted gateway with virtual keys, cost tracking and an admin UI.
Kubeflow is described as the cloud native AI platform, composed of modular open source projects forming a Kubernetes-native stack for data and AI workloads. Its subprojects include Kubeflow Pipelines for building and deploying portable machine learning workflows, Kubeflow Trainer for distributed AI training and LLM fine-tuning, Kubeflow Katib for automated machine learning, Kubeflow Notebooks for interactive development environments, and Kubeflow Hub for indexing models and metadata. It is a Cloud Native Computing Foundation project.
Pipeline Conversations is a podcast from ZenML featuring interviews with platform engineers, ML practitioners and technical leaders building production AI systems. Episodes cover MLOps and LLMOps topics including Kubernetes workflows, model fine-tuning and evaluation, LLM security, cost optimization, prompt engineering and agents in production.
Quix is described as an agentic AI platform for hardware engineering. It turns test-rig and sensor data into real-time insight and is presented as automating engineering workflows across the V, from requirements through verification, validation and operation.
Superwise is a platform offering AI Gateway, Secure AI Chat, and AI Services. Its Sentinel product prevents sensitive data from leaking into external AI tools, Chat provides a safe AI workspace for teams, and its services help organizations plan, build, and govern AI use cases.
Guild is a vendor-neutral control plane for AI agents. It lets engineering teams manage, govern, and share agents in production, with security and observability built in. Features include scoped credentials, action approval, policy enforcement, tracing, and evaluations. It supports any model or framework and provides a shared agent catalog and CLI access.
