Directory
Published directory entries matching your search.
Quix is described as an agentic AI platform for hardware engineering. It turns test-rig and sensor data into real-time insight and is presented as automating engineering workflows across the V, from requirements through verification, validation and operation.
The open source solution for monitoring your AI models in production.
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
Examples showing how to use the OpenAI vision API to run inference on images, video files and webcam streams.
Rockpool is a Python package for developing signal processing applications with spiking neural networks. It allows users to build networks, simulate, train and test them, and deploy them in simulation or on event-driven neuromorphic compute hardware. It provides layers with simulation backends including Brian2, Torch, JAX, Numba and raw numpy.
Rune is a project that provides containers to encapsulate and deploy EdgeML pipelines and applications. It is associated with the repository hotg-ai/rune and is licensed under Apache 2.0 or MIT at the user's option.
RunThisLLM is a website that provides hardware requirements for running local AI models. It lists over 295 models with full build specifications, performance estimates, and benchmarks. It also offers a Chrome extension and a custom machine building service.
MLOps framework to package, deploy, monitor and manage thousands of production machine learning models.
Semantic Cache Router is a distributed semantic cache and stateful routing system hosted on GitHub. It includes documentation covering the problem it addresses, its solutions, key strengths, and system architecture.
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
SinglebaseCloud is an AI-native backend platform and Firebase alternative that combines document and vector databases, authentication, storage, and built-in AI services to support the development and scaling of modern applications.
SocialBu is a social media management tool for planning, scheduling, responding to, automating, and analyzing social media across connected accounts. It offers AI-assisted drafting and refinement of posts and captions, content curation, listening streams for mentions and keywords, a unified inbox, automation rules, and performance reports. A 7-day free trial is mentioned. An MCP Server connects compatible AI clients to supported tasks.
Stan is software for Bayesian data analysis that combines statistical modeling capabilities with user-friendly interfaces and open-source development. Its probabilistic programming language supports applications from simple linear regression to multi-level models and time-series analysis. Interfaces exist for Python, Julia, R, and the Unix shell, usable on laptops, clusters, or in the cloud. Official documentation covers the language, inference algorithms, and built-in functions.
Lets you create apps for your ML projects with deceptively simple Python scripts.
Superwise is a platform offering AI Gateway, Secure AI Chat, and AI Services. Its Sentinel product prevents sensitive data from leaking into external AI tools, Chat provides a safe AI workspace for teams, and its services help organizations plan, build, and govern AI use cases.
TeamoRouter provides machine-learning models, research, training resources, or evaluation tools.
Tecton supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Inference engine for TensorRT on Nvidia GPUs.
TensorZero builds open-source tools for production-grade LLM applications, including an LLM gateway, observability, optimization, evaluations, and experimentation. The project remains available on GitHub but is no longer maintained. Its website is tensorzero.com.
A toolkit for deploying and serving open source text embeddings and sequence classification models. It supports models including FlagEmbedding, Ember, GTE and E5, and features token based dynamic batching, Flash Attention and Candle optimized inference, Safetensors and ONNX weight loading, and Metal support for local execution on Macs.
Text Generation Inference is a toolkit for deploying and serving large language models, implemented as a Rust, Python and gRPC server. It supports models including Llama, Falcon, StarCoder, BLOOM and GPT-NeoX, with features such as token streaming, continuous batching and quantization. The repository is archived, read-only, and in maintenance mode, with pull requests limited to minor bug fixes and maintenance.
Flexible, high-performance serving system for machine learning models.
TNN is a deep learning inference framework for mobile, desktop and server, developed by Tencent Youtu Lab and Guangying Lab. It is based on ncnn and Rapidnet and extends support to X86 and NV GPUs. The project states that it has been used in Tencent applications including Mobile QQ, Weishi and Pitu.
TorchServe is an open-source tool for serving, optimizing, and scaling PyTorch models in production. It offers quick start guides for TorchServe, conda, and Docker, and includes an announcement about security changes.
