Hadoop Illuminated's Chapter 16 page lists pointers to publicly available big data sets, covering generic repositories, geo data, web data and government data. It links to sources such as Amazon AWS data sets, InfoChimps, the Comprehensive Knowledge Archive Network, OpenStreetMap, Wikipedia data, Google N-gram data, Freebase, data.gov and World Bank data.
Apache Hadoop is an open-source project that develops software for reliable, scalable, distributed computing. Its library is a framework for distributed processing of large data sets across clusters of computers using simple programming models, scaling from single servers to thousands of machines with local computation and storage, and detecting failures at the application layer.
DataTalks.Club is an online community for data science professionals, ML engineers and AI practitioners. It offers free courses, weekly podcasts, webinars, workshops and book discussions, along with articles, a Slack group and a weekly newsletter. Events and podcast episodes cover topics such as machine learning, AI platforms and LLM engineering.
RAWGraphs is a free and open source tool for data visualization. It is a web app that offers almost 30 visual models to visualize quantities, hierarchies and time series. Data inserted is processed only by the web browser, and projects can be saved or exported as vector or raster images.
An R package that creates interactive Leaflet maps using the Leaflet JavaScript library and htmlwidgets. Maps can be used from the R console, RStudio, Shiny applications and R Markdown documents. It is linked to the open-source Leaflet JavaScript library for interactive maps.
quanteda is an R package for managing and analyzing text, described as a fast, flexible, and comprehensive framework for quantitative text analysis in R. It provides functionality for corpus management, tokens and n-grams, keywords in context, sparse matrices, content dictionaries, and supervised and unsupervised machine learning.
Handbook and recipes for data-driven solutions of real-world problems.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
Apache Hadoop is an open-source project that develops software for reliable, scalable, distributed computing. Its library is a framework for distributed processing of large data sets across clusters of computers using simple programming models, scaling from single servers to thousands of machines with local computation and storage, and detecting failures at the application layer.
DataTalks.Club is an online community for data science professionals, ML engineers and AI practitioners. It offers free courses, weekly podcasts, webinars, workshops and book discussions, along with articles, a Slack group and a weekly newsletter. Events and podcast episodes cover topics such as machine learning, AI platforms and LLM engineering.
RAWGraphs is a free and open source tool for data visualization. It is a web app that offers almost 30 visual models to visualize quantities, hierarchies and time series. Data inserted is processed only by the web browser, and projects can be saved or exported as vector or raster images.
An R package that creates interactive Leaflet maps using the Leaflet JavaScript library and htmlwidgets. Maps can be used from the R console, RStudio, Shiny applications and R Markdown documents. It is linked to the open-source Leaflet JavaScript library for interactive maps.
quanteda is an R package for managing and analyzing text, described as a fast, flexible, and comprehensive framework for quantitative text analysis in R. It provides functionality for corpus management, tokens and n-grams, keywords in context, sparse matrices, content dictionaries, and supervised and unsupervised machine learning.
Handbook and recipes for data-driven solutions of real-world problems.
