Python-free Rust inference server with OpenAI API compatibility and hot model swapping.
Groq is a platform for inference, described as one fully integrated platform for infrastructure, inference, and control. It offers tiers including GroqMetal for bare-metal infrastructure, GroqCore for an inference stack, and GroqAssured for governance, auditability, and control.
Hopsworks is a platform for building, deploying, and scaling production machine learning systems. It combines a feature store with MLOps tooling, using dual online and offline storage to manage, reuse, and serve features. The platform covers the ML lifecycle: train, deploy, and monitor. An O'Reilly book covers building batch, real-time, and LLM systems with feature stores.
Bifrost is an open-source AI gateway for LLMs, MCP and agents, offered by Maxim AI. It provides routing, governance, guardrails and observability, and is described as a drop-in replacement for AI SDKs. Enterprise adds features such as SSO, RBAC, adaptive load balancing, cluster mode and in-VPC deployment, free for 14 days.
MLOps Now supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Msty describes private AI for individuals, teams and organizations, with four products connected as one system: Studio, a private AI workspace; Go, for agents; Nexus, a model gateway hub; and Stack, for organizing knowledge. Studio pricing lists a free tier and an Aurum plan billed yearly at $149 per user.
Banana provides GPU inference hosting for AI teams. The platform scales GPUs up and down automatically and includes monitoring, business analytics, a CLI, SDKs, and an open automation API. Backends can be written with Potassium, an open-source HTTP framework. Paid Team and Enterprise tiers are offered.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
Groq is a platform for inference, described as one fully integrated platform for infrastructure, inference, and control. It offers tiers including GroqMetal for bare-metal infrastructure, GroqCore for an inference stack, and GroqAssured for governance, auditability, and control.
Hopsworks is a platform for building, deploying, and scaling production machine learning systems. It combines a feature store with MLOps tooling, using dual online and offline storage to manage, reuse, and serve features. The platform covers the ML lifecycle: train, deploy, and monitor. An O'Reilly book covers building batch, real-time, and LLM systems with feature stores.
Bifrost is an open-source AI gateway for LLMs, MCP and agents, offered by Maxim AI. It provides routing, governance, guardrails and observability, and is described as a drop-in replacement for AI SDKs. Enterprise adds features such as SSO, RBAC, adaptive load balancing, cluster mode and in-VPC deployment, free for 14 days.
MLOps Now supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Msty describes private AI for individuals, teams and organizations, with four products connected as one system: Studio, a private AI workspace; Go, for agents; Nexus, a model gateway hub; and Stack, for organizing knowledge. Studio pricing lists a free tier and an Aurum plan billed yearly at $149 per user.
Banana provides GPU inference hosting for AI teams. The platform scales GPUs up and down automatically and includes monitoring, business analytics, a CLI, SDKs, and an open automation API. Backends can be written with Potassium, an open-source HTTP framework. Paid Team and Enterprise tiers are offered.
