Directory
Published directory entries matching your search.
Knowledge Repo is a next-generation curated knowledge sharing platform designed for data scientists and other technical professionals. It is maintained as a public open source repository on GitHub under the Airbnb organization.
Modern columnar data format for ML implemented in Rust.
Lux is a Python library for automated data exploration. When a pandas dataframe is printed in a Jupyter notebook, Lux recommends a set of visualizations highlighting trends and patterns, shown in an interactive widget for browsing and exploring the dataset.
Marquez is an open source metadata service for collecting, aggregating and visualizing a data ecosystem's metadata. It maintains provenance of how datasets are consumed and produced and provides visibility into job runtime and dataset access. Metadata is collected via OpenLineage, and a web UI shows job and dataset dependencies through a lineage graph.
Mars is an open source tensor-based unified framework for large-scale data computation. It scales numpy, pandas and scikit-learn, offering tensor, DataFrame and learn interfaces that resemble the original libraries. A session can be started locally or connected to an existing Mars cluster.
MeTA is a modern C++ data sciences toolkit. It provides text tokenization including deep semantic features like parse trees, inverted and forward indexes with compression and caching strategies, ranking functions for searching indexes, topic models, classification algorithms, graph algorithms, language models, a CRF implementation for POS-tagging and shallow parsing, and wrappers for liblinear and libsvm.
Analyzes structured data and helps produce queries, insights or visualizations.
ModelDB is an open-source system for versioning machine learning models, including their code, data, config and environment, and for tracking ML metadata across the model lifecycle. It supports reproducible models, experiment management and lifecycle tracking. It runs on Docker and Kubernetes, offers Python and Scala clients, and is maintained by Verta.ai.
Algorithm capable of fully capturing the impact of data drift on performance.
Bring multiple data streams into one dashboard.
Cleansing, pre-processing, feature engineering, exploratory data analysis and easy ML with PySpark backend.
Panthera is an open-source Clojure library available on GitHub that provides data-frame and array functionality for the Clojure programming language. The repository is maintained by alanmarazzi and accepts contributions from users.
PigPen is an open-source Map-Reduce library for the Clojure programming language, hosted on GitHub under the Netflix organization. The repository includes documentation for getting started, tutorials, and support for data formats including Parquet and Avro.
Polars is an extremely fast open-source query engine for DataFrames written in Rust, hosted as a GitHub repository under the pola-rs organization. It is built to handle large datasets, including data volumes that exceed available system RAM.
Potato is a portable annotation tool developed by davidjurgens and hosted on GitHub. It supports annotation work across a range of data types and annotation schemes, with documentation available for quick start guidance and use case details.
Julia package for loading many of the data sets available in R.
Analyzes structured data and helps produce queries, insights or visualizations.
Somoclu is a massively parallel implementation of self-organizing maps, using multicore CPUs, MPI for cluster workload distribution, and CUDA acceleration. It supports OpenMP, MPI, and CUDA, runs on Linux, macOS, and Windows, and offers planar and toroid maps, rectangular and hexagonal grids, and Gaussian and bubble neighborhood functions. Both dense and sparse input data are supported, with interfaces for Python, R, Julia, and MATLAB.
Spark is a fast and general engine for large-scale data processing.
Analyzes structured data and helps produce queries, insights or visualizations.
A data exploration platform designed to be visual, intuitive, and interactive.
TimeSeries.jl is a lightweight framework for working with time series data in Julia. It is installed through the Julia package manager and provides a TimeArray type built from date or timestamp ranges and values.
A data and concept drift library for PyTorch.
Minimalist neural network library optimized for sparse data and single machine environments.
