Directory
AI data and analytics covers tools that use machine learning to query, analyse or visualise data. Entries include analytics platforms, notebook environments, data-cleaning utilities, charting tools and assistants that help write queries or summarise results. Some are general business tools, and others are research projects applying AI to a specific kind of data. Before uploading anything, check where your data is stored, what export options exist and how the tool handles uncertainty. These tools often handle private information, so read the terms on the source first, and verify generated numbers against the original data.
Dot is described as an AI data analyst that answers data questions, with chat, root cause analysis, automated reports and a context agent. Users can ask through Slack, Teams, email or the app, and answers show their queries and sources. A free tier offers 300 one-time credits.
dplyr is an R package providing a grammar of data manipulation with a consistent set of verbs, including mutate(), select(), filter(), summarise() and arrange(), which combine with group_by(). It is designed to abstract over how data is stored, so the same R code works with local data frames and remote database tables via the dbplyr package.
A Java scientific and numerical library written by Michael Thomas Flanagan to support his research and undergraduate programming courses. It is distributed as the flanagan.jar package and includes general classes, example programs and arbitrary precision methods. The author has retired and states it will be updated less frequently. Commercial use, public listing of source codes and redistribution are not permitted.
Open-source project that applies AI to data analysis, extraction, visualization, or business intelligence.
DrivenData hosts online machine learning competitions with social impact and works with mission-driven organizations on data science and engineering projects. It also maintains open-source projects for the data science community and shares prize-winning solutions from past competitions on GitHub. Areas of work include public health, conservation and international development.
dtreeviz is a Python library for decision tree visualization and model interpretation. It supports scikit-learn, XGBoost, Spark MLlib, LightGBM and TensorFlow, and uses an adaptor object obtained from dtreeviz.model() to extract model information for visualization.
DuckDB is an analytical in-process SQL database management system. It is a high-performance analytical database system designed to be fast, reliable, portable and easy to use, with a rich SQL dialect supporting nested correlated subqueries, window functions, collations and complex types. It is available as a standalone CLI application with clients for Python, R, Java and Wasm.
Data Version Control - Git for Data & Models - ML Experiments Management.
dygraphs is a fast, flexible open source JavaScript charting library that allows users to explore and interpret dense data sets. Charts are interactive, with zoom, pan and mouseover available by default, and the library handles very large data sets. It works in all recent browsers.
Framework to create ChatGPT like bots over your dataset.
Functions and data dependencies for loading various word embeddings.
The Python ensemble sampling toolkit for affine-invariant MCMC.
Encyclopedia of Life applies AI to data analysis, extraction, visualization, or business intelligence.
Clojure Data Visualisation library, based on Statistiker and D3.
Excelmatic, offered by RowSpeak, is an AI-powered data analytics tool that processes messy Excel, CSV, PDF, and image tables. It uses AI to identify trends, explain data changes, generate charts, dashboards, and reports, cleanse data, and convert files between formats including images and PDFs to editable Excel spreadsheets.
A book by Brian Caffo, Roger D. Peng and Jeffrey Leek on assembling and leading a data science enterprise, based on the Johns Hopkins Executive Data Science Specialization. It covers a crash course in data science, recruiting and evaluating a team, and the structure of the data science pipeline. Available as PDF and EPUB; printed copies are sold through Lulu.
Exhibit is an open source publishing framework for creating data-rich interactive web pages. It provides advanced text search and filtering, along with interactive maps, timelines and other visualizations. The software is licensed under the BSD license and was originally sponsored partially by The Andrew W. Mellon Foundation as part of the SIMILE project.
FAOSTAT is a database that provides free access to food and agriculture data for over 245 countries and territories. It covers all FAO regional groupings and includes data from 1961 up to the most recent year available. The service enables users to explore and analyze agricultural statistics globally.
Open-source project that applies AI to data analysis, extraction, visualization, or business intelligence.
Analyzes structured data and helps produce queries, insights or visualizations.
Documentation - Financial Data API.
Firecrawl is a web data API designed for AI agents. It allows searching and scraping web content, returning data in formats such as JSON and Markdown. The service also provides access to Alexandria’s providers and specialized indexes. Firecrawl is open source, used by over 150,000 companies, and announced a $75 million Series B funding round.
Apache Flink is a distributed data processing engine for stateful computations over data streams. It offers exactly-once state consistency, event-time processing, layered APIs including SQL on stream and batch data, and flexible deployment with savepoints. Its stated use cases include event-driven applications, stream and batch analytics, and data pipelines and ETL.
FlowingData applies AI to data analysis, extraction, visualization, or business intelligence.
