Portkey is a production stack for generative AI builders that offers a suite of tools including an AI gateway, observability features, guardrails and prompt management modules. It is designed to help organizations democratize and productionize generative AI.
A personal blog about AI system design and bringing AI into production. Posts cover topics including generative AI applications, agents, multimodal models, LLM research challenges, model routing, generation configurations, and machine learning systems.
Bifrost is an open-source AI gateway for LLMs, MCP and agents, offered by Maxim AI. It provides routing, governance, guardrails and observability, and is described as a drop-in replacement for AI SDKs. Enterprise adds features such as SSO, RBAC, adaptive load balancing, cluster mode and in-VPC deployment, free for 14 days.
Groq is a platform for inference, described as one fully integrated platform for infrastructure, inference, and control. It offers tiers including GroqMetal for bare-metal infrastructure, GroqCore for an inference stack, and GroqAssured for governance, auditability, and control.
Hopsworks is a platform for building, deploying, and scaling production machine learning systems. It combines a feature store with MLOps tooling, using dual online and offline storage to manage, reuse, and serve features. The platform covers the ML lifecycle: train, deploy, and monitor. An O'Reilly book covers building batch, real-time, and LLM systems with feature stores.
SocialBu is a social media management tool for planning, scheduling, responding to, automating, and analyzing social media across connected accounts. It offers AI-assisted drafting and refinement of posts and captions, content curation, listening streams for mentions and keywords, a unified inbox, automation rules, and performance reports. A 7-day free trial is mentioned. An MCP Server connects compatible AI clients to supported tasks.
MLOps Now supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
A personal blog about AI system design and bringing AI into production. Posts cover topics including generative AI applications, agents, multimodal models, LLM research challenges, model routing, generation configurations, and machine learning systems.
Bifrost is an open-source AI gateway for LLMs, MCP and agents, offered by Maxim AI. It provides routing, governance, guardrails and observability, and is described as a drop-in replacement for AI SDKs. Enterprise adds features such as SSO, RBAC, adaptive load balancing, cluster mode and in-VPC deployment, free for 14 days.
Groq is a platform for inference, described as one fully integrated platform for infrastructure, inference, and control. It offers tiers including GroqMetal for bare-metal infrastructure, GroqCore for an inference stack, and GroqAssured for governance, auditability, and control.
Hopsworks is a platform for building, deploying, and scaling production machine learning systems. It combines a feature store with MLOps tooling, using dual online and offline storage to manage, reuse, and serve features. The platform covers the ML lifecycle: train, deploy, and monitor. An O'Reilly book covers building batch, real-time, and LLM systems with feature stores.
SocialBu is a social media management tool for planning, scheduling, responding to, automating, and analyzing social media across connected accounts. It offers AI-assisted drafting and refinement of posts and captions, content curation, listening streams for mentions and keywords, a unified inbox, automation rules, and performance reports. A 7-day free trial is mentioned. An MCP Server connects compatible AI clients to supported tasks.
MLOps Now supports deploying, serving, monitoring, or operating AI and machine-learning systems.
