github.com
Platform for deploying your Machine Learning to production.
Directory
Search results
Published directory entries matching your search.
github.com
A service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services.
Code for hyperparameter tuning/optimization of machine learning and deep learning algorithms.
github.com
A python package that integrates an LLM copilot inside the keras model development workflow.
github.com
FastAPI framework to build production-grade LLM applications.
github.com
Serverless LLM apps on Production with Jina AI Cloud (Archived).
github.com
LLM Ops platform with Analytics, Monitoring, Evaluations and an LLM Optimization Studio powered by DSPy.
github.com
LLM App is a Python library that helps you build real-time AI-powered data pipelines with few lines of code.
github.com
A tool that provides a Model Context Protocol (MCP) server for any web application with an OpenAPI specification.
github.com
A chat LLM based on the state-space model architecture.
github.com
A model-agnostic visual debugging tool for machine learning.
github.com
Small Language Model tailored for edge devices.
github.com
A platform for deploying and serving machine learning models.
github.com
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
github.com
Intuitive convenience tooling for lightning-fast, efficient development and ensuring quality in LLM-based applications.
github.com
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others).
github.com
Serve Llama 2 and other large language models locally from command line or through a browser interface.
github.com
Fujitsu Research's post-training quantization pipeline for LLMs (QEP, AutoBit, JointQ, rotation) with vLLM plugin (arXiv:2603.28845).
github.com
Jan - Run LLMs like Mistral or Llama2 locally and offline on your computer, or connect to remote AI APIs.
github.com
Use AutoML to do model compression.
github.com
A high-speed inference engine for deploying LLMs locally.
github.com
Open-source tool to simplify the process of creating and managing LLM workflows and prompts as a self-hosted solution.
github.com
AI-generated visualization prototyping and editing platform, support 2D, 3D models, combined with LLM(Large Language Model) for quick editing.
github.com
Inference engine for TensorRT on Nvidia GPUs.