Tecton supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Directory
Search results
Published directory entries matching your search.
Inference engine for TensorRT on Nvidia GPUs.
TensorZero builds open-source tools for production-grade LLM applications, including an LLM gateway, observability, optimization, evaluations, and experimentation. The project remains available on GitHub but is no longer maintained. Its website is tensorzero.com.
A toolkit for deploying and serving open source text embeddings and sequence classification models. It supports models including FlagEmbedding, Ember, GTE and E5, and features token based dynamic batching, Flash Attention and Candle optimized inference, Safetensors and ONNX weight loading, and Metal support for local execution on Macs.
Text Generation Inference is a toolkit for deploying and serving large language models, implemented as a Rust, Python and gRPC server. It supports models including Llama, Falcon, StarCoder, BLOOM and GPT-NeoX, with features such as token streaming, continuous batching and quantization. The repository is archived, read-only, and in maintenance mode, with pull requests limited to minor bug fixes and maintenance.
tfdeploy is a GitHub repository that enables deployment of TensorFlow graphs for fast evaluation and export to environments without TensorFlow using NumPy. It supports ensemble models and optimization for efficient inference.
Flexible, high-performance serving system for machine learning models.
TNN is a deep learning inference framework for mobile, desktop and server, developed by Tencent Youtu Lab and Guangying Lab. It is based on ncnn and Rapidnet and extends support to X86 and NV GPUs. The project states that it has been used in Tencent applications including Mobile QQ, Weishi and Pitu.
TorchServe is an open-source tool for serving, optimizing, and scaling PyTorch models in production. It offers quick start guides for TorchServe, conda, and Docker, and includes an announcement about security changes.
Traceloop OpenLLMetry is an open-source observability tool for GenAI and LLM applications, based on OpenTelemetry and maintained by Traceloop. It provides instrumentation for vector databases and frameworks, and includes documentation on getting started and supported destinations.
TrackingAI compares AI model results on two IQ tests, Mensa Norway and an Offline Test whose questions are not published. It presents charts of AI IQ scores, model rankings, answer speed, cost, question-by-question accuracy and changes over time.
Triton Inference Server is open source inference serving software that streamlines AI inferencing. It enables teams to deploy models from multiple deep learning and machine learning frameworks across cloud, data center, edge and embedded devices.
Package, configure, and iterate on a model with Truss at whatever level of control your model needs.
Tune is a Python library for experiment execution and hyperparameter tuning at any scale. It supports machine learning frameworks including PyTorch, XGBoost, and TensorFlow and Keras, and runs algorithms such as Population Based Training (PBT) and HyperBand/ASHA. It also integrates with hyperparameter optimization tools including Ax, BayesOpt, BOHB, Nevergrad, and Optuna.
Liveuamap is an independent global news and information site that reports on topics such as conflicts, human rights issues, protests, terrorism, weapons deployment, health matters, natural disasters and weather. It presents news through a map-centric approach and provides open online access to a chronological archive. It was founded in 2014 to inform about the Ukrainian conflict and later expanded to other regions.
v0 is a Vercel-built collaborative AI assistant for designing, iterating, and scaling full-stack web applications. It supports prompt-based app building, template starters, design mode editing, design system creation, repository syncing, third-party app integration, and direct deployment to Vercel. The tool is described as agentic by default, and offers multiple plan options for different user types.
V2Rocket.com is a resource site about the German A-4/V-2 rocket, described as the world's first long-range ballistic missile deployed in combat. The site aims to give an accurate account of the rocket's design, production and combat deployment in World War II. It states that it does not promote any political ideology.
Vald is a highly scalable distributed vector search engine. It is hosted on GitHub and provides documentation on installation using Helm, requirements, and usage. The project focuses on delivering a scalable solution for vector search.
Valohai is an MLOps platform for AI products that combine LLMs and specialized models. It provides experiment tracking, data versioning, hyperparameter optimization, pipeline automation and compute orchestration, and runs on existing AWS, Azure, GCP or on-prem infrastructure. Pricing is per user license across Pro and Enterprise tiers.
Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
VectorDB is a Python vector database designed to be simple and sufficient. It can be used locally or as a service, with server and client components. The project emphasizes ease of use for vector database needs.
Velda is a serverless GPU cloud service for running training and inference jobs without container or cluster management. A vrun prefix runs commands from the local development environment, and compute is provisioned only while jobs run. Pricing is pay-as-you-go, with listed GPU and CPU pools billed per hour and optional self-hosted or enterprise deployment.
Vellum is a personal AI assistant available locally or in the cloud, with long-term memory across conversations. It can send emails, manage calendars, browse the web, create slides, write code, run research, and execute recurring background tasks. It offers fine-grained permissions requiring approval for high-stakes actions until marked trusted. Two plans exist: Base (free) and Pro packages Mighty, Super, and Ultra.
Vercel provides agentic infrastructure and a platform for building and deploying applications and AI agents. Its offerings include an autonomous stack that supports scalable app deployment, sandboxed environments for agent operation, AI model gateway access, and durable orchestration tools, used by organizations including Notion and Zapier.