github.com
Easy-to-use library to boost AI inference.
Directory
Search results
Published directory entries matching your search.
github.com
A framework providing the right abstractions to ease research, development, and deployment of your ML pipelines.
github.com
An Easy-to-Use and High-Performance AI deployment framework.
github.com
Neural networks framework in pure C: training and inference, no dependencies.
omniml.ai
Simplifies and accelerates MLOps by bridging the gap between ML models and edge hardware.
github.com
Open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics. opensource.
github.com
Open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease.
github.com
Turns your ML code into microservices with web API, interactive GUI, and more.
parea.ai
Platform and SDK for AI Engineers providing tools for LLM evaluation, observability, and a version-controlled enhanced prompt playground.
github.com
Vector database plugin for Postgres, written in Rust, specifically designed for LLM.
github.com
Open-source vector similarity search for Postgres.
podcast.zenml.io
MLOps and LLMOps, from the trenches.
portkey.ai
Democratize and productionize Gen AI across your entire org with Portkey.
promptlayer.com
Prompt Engineering platform. Collaborate, test, evaluate, and monitor your LLM applications.
quix.io
Quix is the agentic AI platform for hardware engineering — turn test-rig and sensor data into real-time insight.
github.com
OpenAI-compatible LLM inference server for Apple Silicon using MLX. 2-4x faster than Ollama with tool calling and prompt caching.
Examples showing how to use the OpenAI vision API to run inference on images, video files and webcam streams.
github.com
Provides containers to encapsulate and deploy EdgeML pipelines and applications.
github.com
MLOps framework to package, deploy, monitor and manage thousands of production machine learning models.
github.com
Python-free Rust inference server with OpenAI API compatibility and hot model swapping.
github.com
An MLOps/LLMOps platform for model building, evaluation, and fine-tuning.
github.com
Lets you create apps for your ML projects with deceptively simple Python scripts.
tensorzero.com
TensorZero builds open-source tools for production-grade LLM applications: LLM gateway, observability, optimization, evaluations, and experimentation.
github.com
Inference for text-embedding models.