databricks.com
Tecton supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Directory
AI Infrastructure & MLOps
Explore AI Infrastructure & MLOps resources in AI & Machine Learning.
tensorzero.com
TensorZero builds open-source tools for production-grade LLM applications, including an LLM gateway, observability, optimization, evaluations, and experimentation. The project remains available on GitHub but is no longer maintained. Its website is tensorzero.com.
github.com
A toolkit for deploying and serving open source text embeddings and sequence classification models. It supports models including FlagEmbedding, Ember, GTE and E5, and features token based dynamic batching, Flash Attention and Candle optimized inference, Safetensors and ONNX weight loading, and Metal support for local execution on Macs.
github.com
TorchServe is an open-source tool for serving, optimizing, and scaling PyTorch models in production. It offers quick start guides for TorchServe, conda, and Docker, and includes an announcement about security changes.
github.com
Traceloop OpenLLMetry is an open-source observability tool for GenAI and LLM applications, based on OpenTelemetry and maintained by Traceloop. It provides instrumentation for vector databases and frameworks, and includes documentation on getting started and supported destinations.
trackingai.org
TrackingAI compares AI model results on two IQ tests, Mensa Norway and an Offline Test whose questions are not published. It presents charts of AI IQ scores, model rankings, answer speed, cost, question-by-question accuracy and changes over time.
github.com
Triton Inference Server is open source inference serving software that streamlines AI inferencing. It enables teams to deploy models from multiple deep learning and machine learning frameworks across cloud, data center, edge and embedded devices.
truefoundry.com
TrueFoundry is an enterprise AI gateway that sits between applications and LLM providers and MCP servers. It offers a unified API for accessing more than 1000 LLMs, along with routing, fallbacks, rate limiting, access control, budgets, guardrails and observability. Deployment options include SaaS, hybrid and self-hosted VPC environments.
truss.baseten.co
Package, configure, and iterate on a model with Truss at whatever level of control your model needs.
github.com
Vald is a highly scalable distributed vector search engine. It is hosted on GitHub and provides documentation on installation using Helm, requirements, and usage. The project focuses on delivering a scalable solution for vector search.
valohai.com
Valohai is an MLOps platform for AI products that combine LLMs and specialized models. It provides experiment tracking, data versioning, hyperparameter optimization, pipeline automation and compute orchestration, and runs on existing AWS, Azure, GCP or on-prem infrastructure. Pricing is per user license across Pro and Enterprise tiers.
github.com
Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
github.com
VectorDB is a Python vector database designed to be simple and sufficient. It can be used locally or as a service, with server and client components. The project emphasizes ease of use for vector database needs.
cloud.google.com
Gemini Enterprise Agent Platform, formerly known as Vertex AI, is a comprehensive platform for developers to build, scale, govern, and optimize agents. It provides tools and services for agent lifecycle management.
github.com
Vespa is an AI search platform. Its repository contains the code required to build and run Vespa. The project covers searching, making inferences in and organizing vectors, tensors, text and structured data at serving time and any scale. It is licensed under Apache 2.0.
github.com
Machine Learning Operations - An awesome list of references for MLOps.
wallaroo.ai
Wallaroo.AI supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
weco.ai
Weco is a research and product lab building recursively self-improving AI. Its platform points at an eval script and iteratively optimizes code against a metric the user defines, such as speed, accuracy or cost. Supported model providers include GPT, Claude, Gemini, Kimi, GLM and MiniMax, with bring your own key.
docs.wandb.ai
Documentation for Weights & Biases (Prompts), covering setup, features, and practical usage.
github.com
Whylogs is an open-source data logging library for machine learning models and data pipelines. It provides visibility into data quality and model performance over time, and supports privacy-preserving data collection to support system safety and robustness.