A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
Directory
Search results
Published directory entries matching your search.
LLM App is a Python library that helps you build real-time AI-powered data pipelines with few lines of code.
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
A platform for deploying and serving machine learning models.
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
Intuitive convenience tooling for lightning-fast, efficient development and ensuring quality in LLM-based applications.
Version and deploy your ML models following GitOps principles.
Open source MLOps platform that helps you collaborate, reproduce and share your ML work.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
ModelFox is a platform for managing and deploying machine learning models.
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others).
Machine learning model serving framework with dynamic batching and pipelined stages, provides an easy-to-use Python interface.
Deploy LangChain Agents and connect them to Telegram.
Self-hosted downloader and player for YouTube, Bilibili, Twitch, MissAV, and yt-dlp sites. Features channel subscriptions, auto-downloads, and local storage for media. Organize your library into collections with a sleek UI. Includes built-in Cloudflare Tunnel support for secure remote access without port forwarding. Docker-ready deployment.
Proof-of-concept OpenAI Gym environment for Neural Architecture Search (NAS).
Ncnn is a high-performance neural network inference framework optimized for the mobile platform.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Easy-to-use library to boost AI inference.
Neural networks framework in pure C: training and inference, no dependencies.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Fujitsu Research's post-training quantization pipeline for LLMs (QEP, AutoBit, JointQ, rotation) with vLLM plugin (arXiv:2603.28845).
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.