github.com
Generic mechanism for data scientists to build, run, and monitor ML tasks and pipelines.
Directory
Search results
Published directory entries matching your search.
github.com
Machine learning model serving framework with dynamic batching and pipelined stages, provides an easy-to-use Python interface.
msty.ai
Private AI for individuals, teams, and organizations. Workspaces, agents, models, and knowledge—one connected system on your terms.
github.com
Proof-of-concept OpenAI Gym environment for Neural Architecture Search (NAS).
github.com
Ncnn is a high-performance neural network inference framework optimized for the mobile platform.
github.com
Easy-to-use library to boost AI inference.
github.com
A framework providing the right abstractions to ease research, development, and deployment of your ML pipelines.
github.com
An Easy-to-Use and High-Performance AI deployment framework.
github.com
Neural networks framework in pure C: training and inference, no dependencies.
github.com
Open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics. opensource.
github.com
Open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease.
github.com
Turns your ML code into microservices with web API, interactive GUI, and more.
parea.ai
Platform and SDK for AI Engineers providing tools for LLM evaluation, observability, and a version-controlled enhanced prompt playground.
github.com
Vector database plugin for Postgres, written in Rust, specifically designed for LLM.
github.com
Open-source vector similarity search for Postgres.
podcast.zenml.io
MLOps and LLMOps, from the trenches.
portkey.ai
Democratize and productionize Gen AI across your entire org with Portkey.
promptlayer.com
Prompt Engineering platform. Collaborate, test, evaluate, and monitor your LLM applications.
github.com
OpenAI-compatible LLM inference server for Apple Silicon using MLX. 2-4x faster than Ollama with tool calling and prompt caching.
Examples showing how to use the OpenAI vision API to run inference on images, video files and webcam streams.
github.com
Provides containers to encapsulate and deploy EdgeML pipelines and applications.
github.com
MLOps framework to package, deploy, monitor and manage thousands of production machine learning models.
github.com
Python-free Rust inference server with OpenAI API compatibility and hot model swapping.
github.com
An MLOps/LLMOps platform for model building, evaluation, and fine-tuning.