Triton Inference Server is open source inference serving software that streamlines AI inferencing. It enables teams to deploy models from multiple deep learning and machine learning frameworks across cloud, data center, edge and embedded devices.
Bifrost is an open-source AI gateway for LLMs, MCP and agents, offered by Maxim AI. It provides routing, governance, guardrails and observability, and is described as a drop-in replacement for AI SDKs. Enterprise adds features such as SSO, RBAC, adaptive load balancing, cluster mode and in-VPC deployment, free for 14 days.
LiteLLM is an open-source library that provides a single, unified interface to call over 100 LLMs using the OpenAI format. It includes a Python SDK whose completion() function uses the same arguments across providers and returns responses in the OpenAI Chat Completions format, plus a self-hosted gateway with virtual keys, cost tracking and an admin UI.
Kubeflow is described as the cloud native AI platform, composed of modular open source projects forming a Kubernetes-native stack for data and AI workloads. Its subprojects include Kubeflow Pipelines for building and deploying portable machine learning workflows, Kubeflow Trainer for distributed AI training and LLM fine-tuning, Kubeflow Katib for automated machine learning, Kubeflow Notebooks for interactive development environments, and Kubeflow Hub for indexing models and metadata. It is a Cloud Native Computing Foundation project.
SimpleCV is an open source framework for building computer vision applications, providing access to libraries such as OpenCV without requiring knowledge of bit depths, file formats, color spaces or buffer management. The platform uses Python, and examples include connecting to a camera, binarizing images and drawing text.
Groq is a platform for inference, described as one fully integrated platform for infrastructure, inference, and control. It offers tiers including GroqMetal for bare-metal infrastructure, GroqCore for an inference stack, and GroqAssured for governance, auditability, and control.
Hopsworks is a platform for building, deploying, and scaling production machine learning systems. It combines a feature store with MLOps tooling, using dual online and offline storage to manage, reuse, and serve features. The platform covers the ML lifecycle: train, deploy, and monitor. An O'Reilly book covers building batch, real-time, and LLM systems with feature stores.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
Bifrost is an open-source AI gateway for LLMs, MCP and agents, offered by Maxim AI. It provides routing, governance, guardrails and observability, and is described as a drop-in replacement for AI SDKs. Enterprise adds features such as SSO, RBAC, adaptive load balancing, cluster mode and in-VPC deployment, free for 14 days.
LiteLLM is an open-source library that provides a single, unified interface to call over 100 LLMs using the OpenAI format. It includes a Python SDK whose completion() function uses the same arguments across providers and returns responses in the OpenAI Chat Completions format, plus a self-hosted gateway with virtual keys, cost tracking and an admin UI.
Kubeflow is described as the cloud native AI platform, composed of modular open source projects forming a Kubernetes-native stack for data and AI workloads. Its subprojects include Kubeflow Pipelines for building and deploying portable machine learning workflows, Kubeflow Trainer for distributed AI training and LLM fine-tuning, Kubeflow Katib for automated machine learning, Kubeflow Notebooks for interactive development environments, and Kubeflow Hub for indexing models and metadata. It is a Cloud Native Computing Foundation project.
SimpleCV is an open source framework for building computer vision applications, providing access to libraries such as OpenCV without requiring knowledge of bit depths, file formats, color spaces or buffer management. The platform uses Python, and examples include connecting to a camera, binarizing images and drawing text.
Groq is a platform for inference, described as one fully integrated platform for infrastructure, inference, and control. It offers tiers including GroqMetal for bare-metal infrastructure, GroqCore for an inference stack, and GroqAssured for governance, auditability, and control.
Hopsworks is a platform for building, deploying, and scaling production machine learning systems. It combines a feature store with MLOps tooling, using dual online and offline storage to manage, reuse, and serve features. The platform covers the ML lifecycle: train, deploy, and monitor. An O'Reilly book covers building batch, real-time, and LLM systems with feature stores.
