Text Generation Inference is a toolkit for deploying and serving large language models, implemented as a Rust, Python and gRPC server. It supports models including Llama, Falcon, StarCoder, BLOOM and GPT-NeoX, with features such as token streaming, continuous batching and quantization. The repository is archived, read-only, and in maintenance mode, with pull requests limited to minor bug fixes and maintenance.
GFPGAN is a face restoration algorithm for old photos or AI-generated faces, created by tencentarc and available on Replicate. The model runs on Nvidia L40S GPU hardware and costs approximately $0.0076 to run. It is also open source and can be run on a personal computer with Docker.
Infer.NET is a framework for running Bayesian inference in graphical models. It can be used for machine learning problems such as classification, recommendation or clustering, and for probabilistic programming. It is published as open source on GitHub under the MIT license and available as NuGet packages.
Humanloop was a development platform for LLM applications that provided management and evaluation of AI applications. The team announced it is joining Anthropic, and the Humanloop platform is to be sunset on September 8th, 2025. A migration guide covers exporting Files, Versions, Logs and Evaluations.
Creates, rewrites or summarizes written content with language models.
Aerosolve is a machine learning package built on the JVM. It provides features such as geo-based features, controllable quantization and feature interaction, and a feature transform language that gives developers control over features. General additive models are used. Scala handles feature training, with a lightweight Java API for run time inference.
PressPulse AI is an AI agent built for HARO monitoring. It sends relevant media opportunities from across the internet and supports reviewing and responding to them. The tool matches requests to a professional background and offers AI pitch drafting, domain authority data, first-mover notifications, favorites and blocklists, and integration with platforms including Twitter, LinkedIn and Substack.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
GFPGAN is a face restoration algorithm for old photos or AI-generated faces, created by tencentarc and available on Replicate. The model runs on Nvidia L40S GPU hardware and costs approximately $0.0076 to run. It is also open source and can be run on a personal computer with Docker.
Infer.NET is a framework for running Bayesian inference in graphical models. It can be used for machine learning problems such as classification, recommendation or clustering, and for probabilistic programming. It is published as open source on GitHub under the MIT license and available as NuGet packages.
Humanloop was a development platform for LLM applications that provided management and evaluation of AI applications. The team announced it is joining Anthropic, and the Humanloop platform is to be sunset on September 8th, 2025. A migration guide covers exporting Files, Versions, Logs and Evaluations.
Creates, rewrites or summarizes written content with language models.
Aerosolve is a machine learning package built on the JVM. It provides features such as geo-based features, controllable quantization and feature interaction, and a feature transform language that gives developers control over features. General additive models are used. Scala handles feature training, with a lightweight Java API for run time inference.
PressPulse AI is an AI agent built for HARO monitoring. It sends relevant media opportunities from across the internet and supports reviewing and responding to them. The tool matches requests to a professional background and offers AI pitch drafting, domain authority data, first-mover notifications, favorites and blocklists, and integration with platforms including Twitter, LinkedIn and Substack.
