github.com
Go binding for MXNet c predict api to do inference with a pre-trained model.
Directory
Search results
Published directory entries matching your search.
huggingface.co
Showcase streaming text generation using the @huggingface/inference JS lib.
github.com
Standardized Serverless ML Inference Platform on Kubernetes.
github.com
Neural network inference from the command line, implemented in CHICKEN Scheme.
github.com
A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
libra.cs.uoregon.edu
Algorithms for learning and inference with discrete probabilistic models.
github.com
Extensible Toolkit for Finetuning and Inference of Large Foundation Models.
github.com
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
github.com
Ncnn is a high-performance neural network inference framework optimized for the mobile platform.
github.com
Easy-to-use library to boost AI inference.
github.com
Neural networks framework in pure C: training and inference, no dependencies.
huggingface.co
NeMo Parakeet ASR Models attain strong speech recognition accuracy while being efficient for inference. Available in CTC and RNN-Transducer variants.
github.com
A high-speed inference engine for deploying LLMs locally.
pymc.io
Python Library for Probabalistic Programming (Bayesian Inference and Machine Learning).
github.com
OpenAI-compatible LLM inference server for Apple Silicon using MLX. 2-4x faster than Ollama with tool calling and prompt caching.
Examples showing how to use the OpenAI vision API to run inference on images, video files and webcam streams.
github.com
Python-free Rust inference server with OpenAI API compatibility and hot model swapping.
github.com
AI-powered social listening tool that tracks brand mentions across Google, Instagram, Facebook, TikTok, Reddit, and X (Twitter). Uses HasData SERP API + LLM inference to extract structured insights, generate charts, export CSV reports, and send Telegram notifications on a 24-hour automated cycle.
github.com
Inference engine for TensorRT on Nvidia GPUs.
github.com
Uniform deep learning inference framework for mobile, desktop and server.
github.com
Provides an optimized cloud and edge inferencing solution.
github.com
Store, search, organize and make machine-learned inferences over big data at serving time.
docs.vllm.ai
An inference and serving engine for language models.
github.com
A Whisper CLI client compatible with the original OpenAI client, using CTranslate2 for faster inference. opensource.