Search results

A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.

LLM App is a Python library that helps you build real-time AI-powered data pipelines with few lines of code.

Open-source project that provides machine-learning models, research, training resources, or evaluation tools.

Open-source project that provides machine-learning models, research, training resources, or evaluation tools.

A platform for deploying and serving machine learning models.

MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

Intuitive convenience tooling for lightning-fast, efficient development and ensuring quality in LLM-based applications.

Version and deploy your ML models following GitOps principles.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others).

Machine learning model serving framework with dynamic batching and pipelined stages, provides an easy-to-use Python interface.

Proof-of-concept OpenAI Gym environment for Neural Architecture Search (NAS).

Ncnn is a high-performance neural network inference framework optimized for the mobile platform.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Easy-to-use library to boost AI inference.

A framework providing the right abstractions to ease research, development, and deployment of your ML pipelines.

An Easy-to-Use and High-Performance AI deployment framework.

Neural networks framework in pure C: training and inference, no dependencies.

Serve Llama 2 and other large language models locally from command line or through a browser interface.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Fujitsu Research's post-training quantization pipeline for LLMs (QEP, AutoBit, JointQ, rotation) with vLLM plugin (arXiv:2603.28845).

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics. opensource.