Neural networks framework in pure C: training and inference, no dependencies.
Directory
Search results
Published directory entries matching your search.
Serve Llama 2 and other large language models locally from command line or through a browser interface.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Simplifies and accelerates MLOps by bridging the gap between ML models and edge hardware.
Voice AI that turns calls into outcomes - and gets sharper with each one. Our own model, built for the phone. Sub-400ms response. Live in days.
Fujitsu Research's post-training quantization pipeline for LLMs (QEP, AutoBit, JointQ, rotation) with vLLM plugin (arXiv:2603.28845).
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics. opensource.
Turns your ML code into microservices with web API, interactive GUI, and more.
Platform and SDK for AI Engineers providing tools for LLM evaluation, observability, and a version-controlled enhanced prompt playground.
Vector database plugin for Postgres, written in Rust, specifically designed for LLM.
Open-source vector similarity search for Postgres.
MLOps and LLMOps, from the trenches.
Use AutoML to do model compression.
Democratize and productionize Gen AI across your entire org with Portkey.
A high-speed inference engine for deploying LLMs locally.
"An Open Source Language Model Specialized in Evaluating Other Language Models.".
Prompt Engineering platform. Collaborate, test, evaluate, and monitor your LLM applications.
Open-source tool to simplify the process of creating and managing LLM workflows and prompts as a self-hosted solution.
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Python Library for Probabalistic Programming (Bayesian Inference and Machine Learning).
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.