DeepSpeed is a deep learning optimization library intended to make distributed training easy, efficient and effective. It offers system innovations including ZeRO, 3D-Parallelism, DeepSpeed-MoE and ZeRO-Infinity, and has been integrated with several open-source deep learning frameworks.
Odysseus is a self-hosted AI workspace for running language models on one's own hardware. It offers chat, autonomous agents, tools and MCP connections, model serving, an email assistant, deep research, model comparison and persistent memory. The project is described as local-first and privacy-first, with no telemetry.
A market intelligence site for AI compute that tracks live GPU cloud and LLM API pricing, performance benchmarks and market data across AI infrastructure providers. It publishes comparisons of GPU cloud pricing by provider and of LLM performance versus cost, including articles on Azure, AWS, Google Cloud, CoreWeave and Lambda GPU offerings.
MMDeploy is documented at version 1.3.1 and covers getting started, converting, running, evaluating and quantizing models, building from source or Docker image, and SDK usage. Its backend support pages describe ncnn, ONNX Runtime, OpenVINO, PPLNN, SNPE, TensorRT, TorchScript, RKNN, TVM and Core ML, and its codebase support covers several OpenMMLab projects.
LM Studio helps build, test, automate, or manage AI agents, prompts, models, and API workflows.
A tool that generates consolidated llms.txt text files from websites for LLM training and inference, powered by Firecrawl. The site states the API is being deprecated in favor of the main endpoints and will no longer be maintained after June 30, 2025, though the endpoint remains active.
Open WebUI is a self-hosted AI interface for running AI on the user's own hardware. It connects to local or cloud models including Ollama, OpenAI, Anthropic, or compatible services, and can be extended with Python. The project offers community-shared prompts, models, tools, and functions, and lists deployment options including on-premises or air-gapped setups. Installation can be done with a pip command.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
Odysseus is a self-hosted AI workspace for running language models on one's own hardware. It offers chat, autonomous agents, tools and MCP connections, model serving, an email assistant, deep research, model comparison and persistent memory. The project is described as local-first and privacy-first, with no telemetry.
A market intelligence site for AI compute that tracks live GPU cloud and LLM API pricing, performance benchmarks and market data across AI infrastructure providers. It publishes comparisons of GPU cloud pricing by provider and of LLM performance versus cost, including articles on Azure, AWS, Google Cloud, CoreWeave and Lambda GPU offerings.
MMDeploy is documented at version 1.3.1 and covers getting started, converting, running, evaluating and quantizing models, building from source or Docker image, and SDK usage. Its backend support pages describe ncnn, ONNX Runtime, OpenVINO, PPLNN, SNPE, TensorRT, TorchScript, RKNN, TVM and Core ML, and its codebase support covers several OpenMMLab projects.
LM Studio helps build, test, automate, or manage AI agents, prompts, models, and API workflows.
A tool that generates consolidated llms.txt text files from websites for LLM training and inference, powered by Firecrawl. The site states the API is being deprecated in favor of the main endpoints and will no longer be maintained after June 30, 2025, though the endpoint remains active.
Open WebUI is a self-hosted AI interface for running AI on the user's own hardware. It connects to local or cloud models including Ollama, OpenAI, Anthropic, or compatible services, and can be extended with Python. The project offers community-shared prompts, models, tools, and functions, and lists deployment options including on-premises or air-gapped setups. Installation can be done with a pip command.
