github.com
Machine learning model serving framework with dynamic batching and pipelined stages, provides an easy-to-use Python interface.
Directory
Search results
Published directory entries matching your search.
msty.ai
Private AI for individuals, teams, and organizations. Workspaces, agents, models, and knowledge—one connected system on your terms.
github.com
Proof-of-concept OpenAI Gym environment for Neural Architecture Search (NAS).
github.com
Ncnn is a high-performance neural network inference framework optimized for the mobile platform.
github.com
Easy-to-use library to boost AI inference.
github.com
A framework providing the right abstractions to ease research, development, and deployment of your ML pipelines.
github.com
An Easy-to-Use and High-Performance AI deployment framework.
github.com
Neural networks framework in pure C: training and inference, no dependencies.
omniml.ai
Simplifies and accelerates MLOps by bridging the gap between ML models and edge hardware.
github.com
Open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics. opensource.
github.com
Open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease.
github.com
Turns your ML code into microservices with web API, interactive GUI, and more.
github.com
Vector database plugin for Postgres, written in Rust, specifically designed for LLM.
github.com
Open-source vector similarity search for Postgres.
podcast.zenml.io
MLOps and LLMOps, from the trenches.
portkey.ai
Democratize and productionize Gen AI across your entire org with Portkey.
promptlayer.com
Prompt Engineering platform. Collaborate, test, evaluate, and monitor your LLM applications.
quix.io
Quix is the agentic AI platform for hardware engineering — turn test-rig and sensor data into real-time insight.
Examples showing how to use the OpenAI vision API to run inference on images, video files and webcam streams.
github.com
Provides containers to encapsulate and deploy EdgeML pipelines and applications.
github.com
MLOps framework to package, deploy, monitor and manage thousands of production machine learning models.
github.com
Python-free Rust inference server with OpenAI API compatibility and hot model swapping.
github.com
An MLOps/LLMOps platform for model building, evaluation, and fine-tuning.
github.com
Lets you create apps for your ML projects with deceptively simple Python scripts.