Search results

Host inference APIs, bulk inference and fine tune text, vision, audio and multi-modal models.

Helps teams build, deploy, observe or operate machine-learning systems.

Inference for text-embedding models.

Large Language Model Text Generation Inference.

A machine learning / bayesian inference assigning attributes to objects.

Example chatbot using Gradio, huggingface hub, and the Hugging Face Inference API.

Drop-in AsyncOpenAI replacement that transparently batches requests via the Batch API for cheaper LLM inference.

Example chatbot using Gradio, huggingface hub, and the Hugging Face Inference API.

Inference hosting for AI teams who ship fast and scale faster.

Bayesian Inference Tools in Python.

Run sandboxes, task queues, and custom model inference with ultrafast boot times, instant autoscaling, and a developer experience that just works.

Official inference framework for 1-bit LLMs, by Microsoft. opensource.

Deploy a ML inference service on a budget in less than 10 lines of code.

Layer - Neural network inference from the command line, implemented in.

An agentic company research tool powered by LangGraph and Tavily that conducts deep diligence on companies using a multi-agent framework. It leverages Google's Gemini 2.5 Flash and OpenAI's GPT-5.1 on the backend for inference.

Fast inference engine for Transformer models in C++.

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

Track real-time GPU and LLM pricing across all cloud and inference providers.

Run AI products in production with a unified stack for agents, inference, and cloud—built for control, performance, and economics at scale.

A library for probabilistic modelling, inference, and criticism. Built on top of TensorFlow.

Fast inference engine for whisper in C++ using CTranslate2.

FeatherCNN is a high performance inference engine for convolutional neural networks.

Library for high performance deep learning inference on NVIDIA GPUs.

Benchmarks of machine learning inference for Go.