Search results

Ncnn is a high-performance neural network inference framework optimized for the mobile platform.

Easy-to-use library to boost AI inference.

A framework providing the right abstractions to ease research, development, and deployment of your ML pipelines.

An Easy-to-Use and High-Performance AI deployment framework.

Neural networks framework in pure C: training and inference, no dependencies.

Open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics. opensource.

Vector database plugin for Postgres, written in Rust, specifically designed for LLM.

Open-source vector similarity search for Postgres.

OpenAI-compatible LLM inference server for Apple Silicon using MLX. 2-4x faster than Ollama with tool calling and prompt caching.

Provides containers to encapsulate and deploy EdgeML pipelines and applications.

MLOps framework to package, deploy, monitor and manage thousands of production machine learning models.

Python-free Rust inference server with OpenAI API compatibility and hot model swapping.

An MLOps/LLMOps platform for model building, evaluation, and fine-tuning.

Lets you create apps for your ML projects with deceptively simple Python scripts.

Inference for text-embedding models.

A flexible and easy to use tool for serving PyTorch models.

Provides an optimized cloud and edge inferencing solution.

Highly Scalable Distributed Vector Search Engine.

Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.

Python vector database you just need - no more, no less.

Store, search, organize and make machine-learned inferences over big data at serving time.

Machine Learning Operations - An awesome list of references for MLOps.

specification.website is an open source tool or library for SEO, metadata, crawling, routing, or website optimization.

Alibi is a miscellaneous web resource for discovery, directories, archives, web culture, or useful tools.