Git Large File Storage (Git LFS) is an open source Git extension for versioning large files. It replaces large files such as audio samples, videos, datasets, and graphics with text pointers inside Git while storing the file contents on a remote server like GitHub.com or GitHub Enterprise. Installation is available for Windows, Mac, and Linux. Tracking file types does not convert pre-existing files, which requires the git lfs migrate command.
Apache Storm is a free and open source distributed realtime computation system. It processes unbounded streams of data and is simple, can be used with any programming language, and integrates with queueing and database technologies. Listed use cases include realtime analytics, online machine learning, continuous computation, distributed RPC and ETL.
Apache Superset is an open-source data exploration and visualization platform. It offers a no-code visualization builder and a SQL IDE, connects to SQL-based databases, and ships with more than 40 pre-installed visualization types. It includes dashboards, a chart builder, SQL Lab and datasets, with a plug-in architecture for custom visualizations.
Dask is an open-source Python library for parallel computing maintained by contributors across dozens of companies. The site describes uses including Dask DataFrames for pandas, parallel for loops, large arrays with NumPy and Xarray, and machine learning. It can run on a laptop or be deployed on resource managers such as Kubernetes or cloud.
The Pile is an 825 GiB open source language modelling data set made of 22 smaller high-quality datasets combined together. It is offered as a training set and as a benchmark, and is distributed as jsonlines data compressed with zstandard.
Vega-Altair is a declarative visualization library for Python with a simple, friendly and consistent API built on the Vega-Lite grammar. The project states it is not affiliated with Altair Engineering, Inc.
A personal blog by Chris Said, a data scientist at Propel. The blog is mostly about statistics, technology, and science, and the site links to blog posts on topics such as A/B testing and statistics.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
Apache Storm is a free and open source distributed realtime computation system. It processes unbounded streams of data and is simple, can be used with any programming language, and integrates with queueing and database technologies. Listed use cases include realtime analytics, online machine learning, continuous computation, distributed RPC and ETL.
Apache Superset is an open-source data exploration and visualization platform. It offers a no-code visualization builder and a SQL IDE, connects to SQL-based databases, and ships with more than 40 pre-installed visualization types. It includes dashboards, a chart builder, SQL Lab and datasets, with a plug-in architecture for custom visualizations.
Dask is an open-source Python library for parallel computing maintained by contributors across dozens of companies. The site describes uses including Dask DataFrames for pandas, parallel for loops, large arrays with NumPy and Xarray, and machine learning. It can run on a laptop or be deployed on resource managers such as Kubernetes or cloud.
The Pile is an 825 GiB open source language modelling data set made of 22 smaller high-quality datasets combined together. It is offered as a training set and as a benchmark, and is distributed as jsonlines data compressed with zstandard.
Vega-Altair is a declarative visualization library for Python with a simple, friendly and consistent API built on the Vega-Lite grammar. The project states it is not affiliated with Altair Engineering, Inc.
A personal blog by Chris Said, a data scientist at Propel. The blog is mostly about statistics, technology, and science, and the site links to blog posts on topics such as A/B testing and statistics.
