Directory
Published directory entries matching your search.
A book by Roger D. Peng and Elizabeth Matsui, dated 2017, about data analysis as an art. It discusses the thought process behind data analysis and covers R software development for building data science tools, including handling complex data, building R packages and custom data visualizations.
IGSR, the International Genome Sample Resource, provides open human variation data. Data files from many studies are shared via FTP, with key data sets presented in a data portal browsable by sample, population, technology, data type and collection. Ensembl presents some key call sets in genomic context. Bulk downloads are recommended via Globus, with FTP and Aspera also available.
CKAN is an open-source data management system for creating and operating data hubs and portals. It enables organizations to publish, share, and use data. It powers government data sites such as data.gov, open.canada.ca, and humdata.org.
Clearbit is a B2B data provider that has joined HubSpot and describes itself as the first HubSpot Native Data Provider. It enriches records for leads, contacts and accounts, scores and routes leads in real time, and reveals buying intent from anonymous website traffic. Data comes from public web data, proprietary data and LLMs.
Data Science Weekly is a free weekly data science newsletter published by DATAYOU, LLC. It delivers curated data science news, articles, job listings, tutorials, and learning resources to subscribers every Thursday. The service also maintains an archive of past newsletter issues and offers additional data science guides and course materials on its website.
A book by Brian Caffo, Roger D. Peng and Jeffrey Leek on assembling and leading a data science enterprise, based on the Johns Hopkins Executive Data Science Specialization. It covers a crash course in data science, recruiting and evaluating a team, and the structure of the data science pipeline. Available as PDF and EPUB; printed copies are sold through Lulu.
An article comparing the roles of data scientist and data engineer. It states that the positions are sometimes confused for each other and are often treated as the same, though the two roles work together. It notes that companies can encounter problems with team efficiency and system performance when the roles are conflated, and that the average company needs far more data engineers.
Pachyderm is a project for data-centric pipelines and data versioning. It provides parallelized processing of multi-stage, language-agnostic pipelines with data versioning and data lineage tracking, and pipelines trigger automatically when data changes. It runs on Kubernetes and uses standard object stores for storage.
The Indian Institute of Technology Madras offers the BS in Data Science & Applications, a web-enabled undergraduate program focused on data science and programming. Learners may earn a Bachelor’s degree (BS or BSc, based on completed credits) or a diploma in Programming or Data Science upon successful completion of required courses. The program has no age limit, offers scholarships, and provides academic resources in multiple Indian languages.
ChatGPT Prompts for Data Science is a GitHub repository containing 60 useful prompts for data science tasks. It includes prompts for writing Python code, automatic machine learning, and other data science workflows.
Data Engineering Podcast is a show that covers the tools, techniques, and challenges of the data engineering discipline. Its episodes address topics including databases, workflows, automation, and data manipulation, and it is available for listening on a range of podcast platforms.
Data Science Cartoons is a directory of data science-themed cartoons and comics hosted on CartoonStock, which is described as the world's largest online collection of cartoons and comics. The listing provides access to funny pictures related to the field of data science.
Data News is a Tumblr blog with information, data and behind-the-scenes details from the WNYC Data News Team. Posts describe data projects, including a judicial election tool and a town hall tracker.
distilabel is a framework for synthetic data generation and AI feedback intended for engineers. It provides fast, reliable, and scalable pipelines based on verified research papers, supporting data synthesis for AI systems and on-the-fly feedback addition. The framework aims to improve AI output quality via enhanced data quality, give users control over their data and models, and boost efficiency through rapid iteration on research and large language models.
Apache Flink is a distributed data processing engine for stateful computations over data streams. It offers exactly-once state consistency, event-time processing, layered APIs including SQL on stream and batch data, and flexible deployment with savepoints. Its stated use cases include event-driven applications, stream and batch analytics, and data pipelines and ETL.
The Data Science MSc is a postgraduate taught programme at the University of Edinburgh. It covers the computational principles, methods and systems for extracting and structuring knowledge from data, and the application of those principles. The programme notes that large data sets are generated by almost every activity in science, society and commerce.
NCEI is a NOAA center that provides environmental data on historical weather, climate, ocean and magnetic field conditions. It maintains an archive of oceanic, atmospheric and geophysical data, archiving over 229 terabytes each month from over 130 observing platforms. NCEI is moving its data and applications to the cloud, which may cause temporary data access delays.
OpenDataPhilly is a catalog of open data in the Philadelphia region. It is the official open data repository for the City of Philadelphia and also includes data sets from many organizations in the region. The catalog covers categories such as arts, culture and history, boundaries, budget and finance, economy, education, elections and politics, environment, food, health and human services, parks and recreation, planning and zoning, public safety, real estate and land records, and transportation.
Prash Chan is associated with the MDM – A GEEK'S POINT OF VIEW blog hosted at mdmgeek.com. The blog is run by data management expert Prash Chandramohan and covers topics including master data management, data quality, data governance, cloud, marketing, and leadership. It also offers free email subscriptions for new blog posts.
The Data Engineering Show is a podcast for data engineering and BI practitioners. It features discussions with tech influencers about practical day-to-day data challenges and solutions. Episodes are available on platforms including Apple Podcasts, Spotify and Pocket Casts.
ADS-B Exchange offers live flight APIs and historical datasets of aircraft data for research, analytics and integration. Live positions refresh every 250 milliseconds, with update frequency options of 5s, 500ms or 250ms. Daily positions provide a record of global aircraft positions refreshed every 24 hours, and daily operations deliver completed flight events. Data is available via API, streaming and data feeds.
Apache Zeppelin is a web-based notebook for data-driven, interactive data analytics and collaborative documents with SQL, Scala, Python, R and more. It uses interpreters to plug in language and data-processing backends, including built-in Apache Spark integration, and includes basic charts, pivot charts, dynamic forms and paragraph publishing to embed results in websites.
ArtiVC is a command-line tool for data versioning on cloud storage. It snapshots data and switches between versions, supporting commit history, commit messages, version tags, diffing commits, and pulling data from a specific version. Backends include local filesystem, remote filesystem over SSH, AWS S3, Google Cloud Storage, and Azure Blob Storage, with more through Rclone. No additional server is required.
Data Mania Blog, also known as the Convergence Blog, is a resource hub published by Data-Mania, LLC for technology startup leaders. It features content covering topics such as AI search visibility, AI marketing tools, and startup growth strategies.
