github.com
LLM Ops platform with Analytics, Monitoring, Evaluations and an LLM Optimization Studio powered by DSPy.
Directory
Search results
Published directory entries matching your search.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
Neural network inference from the command line, implemented in CHICKEN Scheme.
github.com
A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
github.com
LLM App is a Python library that helps you build real-time AI-powered data pipelines with few lines of code.
github.com
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
github.com
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
github.com
A platform for deploying and serving machine learning models.
github.com
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
github.com
Intuitive convenience tooling for lightning-fast, efficient development and ensuring quality in LLM-based applications.
github.com
Version and deploy your ML models following GitOps principles.
github.com
Open source MLOps platform that helps you collaborate, reproduce and share your ML work.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others).
github.com
Machine learning model serving framework with dynamic batching and pipelined stages, provides an easy-to-use Python interface.
github.com
Self-hosted downloader and player for YouTube, Bilibili, Twitch, MissAV, and yt-dlp sites. Features channel subscriptions, auto-downloads, and local storage for media. Organize your library into collections with a sleek UI. Includes built-in Cloudflare Tunnel support for secure remote access without port forwarding. Docker-ready deployment.
github.com
Proof-of-concept OpenAI Gym environment for Neural Architecture Search (NAS).
github.com
Ncnn is a high-performance neural network inference framework optimized for the mobile platform.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
Easy-to-use library to boost AI inference.
github.com
Neural networks framework in pure C: training and inference, no dependencies.
github.com
Serve Llama 2 and other large language models locally from command line or through a browser interface.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
Fujitsu Research's post-training quantization pipeline for LLMs (QEP, AutoBit, JointQ, rotation) with vLLM plugin (arXiv:2603.28845).