github.com
layer is a command-line tool for neural network inference, following the Unix philosophy. It enables users to perform inference from the command line. The project is open-source and hosted on GitHub.
Directory
Search results
Published directory entries matching your search.
Filters
github.com
libonnx is a lightweight, portable pure C99 ONNX inference engine for embedded devices with hardware acceleration support. Its .c and .h files can be dropped into a project and compiled with it. Models are loaded from a file into a context, and inference runs on input tensors via onnx_run. It is based on ONNX version v1.17.0 with opset 24 support, and some operators are not implemented.
libra.cs.uoregon.edu
The Libra Toolkit is a collection of algorithms for learning and inference with discrete probabilistic models, including Bayesian networks, Markov networks, dependency networks, sum-product networks and arithmetic circuits. Each algorithm is implemented as a command-line program with consistent options and file formats, and all methods are written in OCaml.
docs.litellm.ai
LiteLLM is an open-source library that provides a single, unified interface to call over 100 LLMs using the OpenAI format. It includes a Python SDK whose completion() function uses the same arguments across providers and returns responses in the OpenAI Chat Completions format, plus a self-hosted gateway with virtual keys, cost tracking and an admin UI.
lunary.ai
Lunary is an observability and prompt management platform for LLM-based applications. It provides chatbot analytics, agent tracing, prompt templates, topic classification, PII masking and feedback tracking. A self-hostable option is offered. The Team cloud plan costs $20 per user per month, billed monthly, and payment is required to activate a workspace.
mastra.ai
Mastra is a TypeScript AI framework for building agents and AI applications. It includes built-in memory, tool support, MCP compatibility, and observability features to support development from prototype to production. The framework also offers workflow tools, agent factory functionality, cloud deployment servers, and an agent builder for evaluation and iteration.
getmaxim.ai
Bifrost is an open-source AI gateway for LLMs, MCP and agents, offered by Maxim AI. It provides routing, governance, guardrails and observability, and is described as a drop-in replacement for AI SDKs. Enterprise adds features such as SSO, RBAC, adaptive load balancing, cluster mode and in-VPC deployment, free for 14 days.
metorial.com
Metorial is an agentic infrastructure platform for AI-native companies. It provides a single unified platform for employees, AI agents, and AI clients to connect tools and skills, with built-in governance, access control, and tracing capabilities. The platform supports development of customer-facing agents, internal assistants, and scalable AI workforces.
milvus.io
Milvus is open source vector database for production AI, written in Go and C++, scalable and blazing fast for billions of embedding vectors.
minimaxi.com
Full-stack AI platform focused on multimodal agents and consumer-scale deployment.
github.com
MLEM is an open source tool designed to package, serve, and deploy machine learning models on any platform. The project's primary repository is currently archived, with maintainers noting plans to resurrect it in the future.
mlops.community
MLOps Community is a global community for machine learning engineers focused on MLOps. It facilitates knowledge sharing, real-world problem solving, networking, and career advancement through in-person meetups and conferences, virtual tech talks, podcasts, workshops, and masterclasses. It reports membership of over 70,000 to 90,000 ML practitioners.
mlops-guide.github.io
A guide explaining MLOps concepts and how to build an MLOps environment. It covers theory and a tutorial using tools such as DVC, CML, IBM Watson Machine Learning, IBM Watson OpenScale, Terraform and Cookiecutter. The guide is described as modular, allowing tools to be swapped according to project preferences and use cases.
github.com
MLReef is an open source ML-Ops platform for collaborating, reproducing and sharing machine learning work. The repository notes it is no longer supported or updated there, with work continuing on GitLab. Described sections include data management with versioned data hosting, containerized code repositories, experiment tracking and ML pipelines on Kubernetes, cloud or bare metal.
myvibe.so
MyVibe is a tool that uses AI to transform web projects into deployable applications. It allows users to upload, convert, and publish their web creations instantly, and is powered by ArcBlock.
github.com
NASGym is a proof-of-concept OpenAI Gym environment for Neural Architecture Search. It implements reinforcement learning steps for NAS and encodes networks using the Neural Structure Code from BlockQNN. A network is modeled as a list of NSCs, an action adds a layer, and the reward is accuracy after early-stop training. CIFAR-10 is the default dataset. The code and documentation may contain minor bugs.
github.com
NCNN is a neural network inference framework optimized for mobile, embedded, and desktop deployment. It has no third-party runtime dependencies and runs across CPU and Vulkan GPU backends. Tools such as pnnx convert PyTorch and ONNX models to ncnn, allowing deployment to phones, PCs, browsers, and edge devices. The project is used in several Tencent applications.
github.com
NDScala is a Scala 3 library for N-dimensional and multi-dimensional arrays (tensors), described as comparable to NumPy ndarray or PyTorch Tensor, with type safety over shapes, array and axis labels and numeric data types. The repository includes materials on shape-safe neural network training and an ONNXScala component.
github.com
Easy-to-use library to boost AI inference.
github.com
Neuraxle is an AutoML library that supports hyperparameter tuning via pipeline abstractions to build clean deep learning production pipelines. Pipeline steps can have associated hyperparameter spaces, and the library is compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks, and MLOps environments.
github.com
An Easy-to-Use and High-Performance AI deployment framework.
github.com
Neural networks framework in pure C: training and inference, no dependencies.
github.com
Ombre is an open-source AI infrastructure layer. It runs eight specialized agents on every request to handle security, caching, memory, hallucination detection, and tamper-proof audit trails. It is installed with one line of code, and user data never leaves the user's server.
omniml.ai
Simplifies and accelerates MLOps by bridging the gap between ML models and edge hardware.