github.com
Ncnn is a high-performance neural network inference framework optimized for the mobile platform.
Directory
Search results
Published directory entries matching your search.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
Easy-to-use library to boost AI inference.
github.com
A framework providing the right abstractions to ease research, development, and deployment of your ML pipelines.
blog.nimblebox.ai
Nimblebox supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
An Easy-to-Use and High-Performance AI deployment framework.
github.com
Neural networks framework in pure C: training and inference, no dependencies.
github.com
Serve Llama 2 and other large language models locally from command line or through a browser interface.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
omniml.ai
Simplifies and accelerates MLOps by bridging the gap between ML models and edge hardware.
harmony.ai
Voice AI that turns calls into outcomes - and gets sharper with each one. Our own model, built for the phone. Sub-400ms response. Live in days.
github.com
Fujitsu Research's post-training quantization pipeline for LLMs (QEP, AutoBit, JointQ, rotation) with vLLM plugin (arXiv:2603.28845).
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
Open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics. opensource.
github.com
Jan - Run LLMs like Mistral or Llama2 locally and offline on your computer, or connect to remote AI APIs.
parea.ai
Platform and SDK for AI Engineers providing tools for LLM evaluation, observability, and a version-controlled enhanced prompt playground.
github.com
Vector database plugin for Postgres, written in Rust, specifically designed for LLM.
github.com
Open-source vector similarity search for Postgres.
podcast.zenml.io
MLOps and LLMOps, from the trenches.
github.com
Use AutoML to do model compression.
portkey.ai
Democratize and productionize Gen AI across your entire org with Portkey.
github.com
A high-speed inference engine for deploying LLMs locally.
developers.llamaindex.ai
"An Open Source Language Model Specialized in Evaluating Other Language Models.".