Data Science

Intermediate

Data science is an interdisciplinary field that uses scientific methods, algorithms, and systems to extract meaningful knowledge and insights from structured and unstructured data. It sits at the intersection of statistics, computer science, and domain expertise, combining rigorous mathematical foundations with practical programming skills. Data scientists collect, clean, and analyze large datasets to uncover patterns, build predictive models, and inform decision-making across industries ranging from healthcare and finance to technology and government.

At its core, data science relies on statistical inference and machine learning to move beyond simple description toward prediction and prescription. Techniques such as regression analysis, classification, clustering, and natural language processing allow practitioners to model complex phenomena, segment populations, and automate intelligent systems. The field demands fluency in programming languages like Python and R, proficiency with libraries such as pandas, scikit-learn, and TensorFlow, and the ability to work with databases, cloud platforms, and distributed computing frameworks like Apache Spark.

The business impact of data science continues to grow as organizations recognize the competitive advantage of data-driven strategies. From recommendation engines that power streaming platforms to fraud detection systems in banking, data science applications touch nearly every sector of the modern economy. Effective data scientists not only build models but also communicate findings through compelling visualizations and narratives, bridging the gap between technical analysis and strategic business decisions.

Practice a little. See where you stand.

Part of:AP Statistics

Ready to practice?5 minutes. No pressure.

Take the Quiz Learn First

Quiz

Reveal what you know — and what needs work

Adaptive Learn

Responds to how you reason, with real-time hints

Start here

Flashcards

Build recall through spaced, active review

Cheat Sheet

The essentials at a glance — exam-ready

Glossary

Master the vocabulary that unlocks understanding

Learning Roadmap

A structured path from foundations to mastery

Book

Deep-dive guide with worked examples

Calculator

Run the numbers and build intuition

Role-play

Think like an expert — no grading

Key Concepts

The process of cleaning, transforming, and restructuring raw data into a usable format for analysis. Data wrangling often consumes the majority of a data scientist's time, as real-world data is messy, incomplete, and inconsistent.

Example

Converting date strings in multiple formats ('Jan 5, 2024', '2024-01-05', '01/05/24') into a single standardized datetime format, handling missing values, and merging datasets from different sources.

An approach to analyzing datasets by summarizing their main characteristics using statistical summaries and visualizations before applying formal modeling. EDA helps identify patterns, detect anomalies, and test assumptions about the data's structure.

Example

Using histograms, box plots, and correlation matrices on a housing dataset to discover that square footage, neighborhood, and number of bathrooms are the strongest predictors of sale price.

The process of drawing conclusions about a population based on a sample of data, using probability theory to quantify uncertainty. It includes hypothesis testing, confidence intervals, and estimation of parameters.

Example

A pharmaceutical company tests a new drug on 500 patients and uses a $t$-test to determine whether the observed improvement in symptoms is statistically significant or likely due to chance.

A supervised learning technique that models the relationship between a dependent variable and one or more independent variables to predict continuous outcomes. Linear regression is the simplest form, but variants include polynomial, ridge, lasso, and logistic regression.

Example

Predicting a home's sale price based on features like square footage, number of bedrooms, and location using a multiple linear regression model with an $R^2$ of 0.87.

A supervised learning task where the goal is to assign input data to predefined categories or labels. Common algorithms include logistic regression, decision trees, random forests, support vector machines, and neural networks.

Example

An email service uses a Naive Bayes classifier trained on labeled examples to automatically sort incoming messages into 'spam' or 'not spam' categories with 98% accuracy.

An unsupervised learning technique that groups similar data points together without predefined labels. The algorithm discovers natural groupings in the data based on similarity metrics such as Euclidean distance.

Example

A retailer applies $k$-means clustering to customer purchase history and identifies four distinct segments: bargain hunters, loyal brand buyers, seasonal shoppers, and premium customers.

The process of creating, selecting, and transforming input variables to improve a machine learning model's predictive performance. Good feature engineering often has a greater impact on results than choosing a more complex algorithm.

Example

For a flight delay prediction model, engineering features such as 'day of week,' 'holiday proximity,' 'historical delay rate for this route,' and 'weather severity index' from raw timestamp and airport data.

A resampling technique used to evaluate how well a model generalizes to unseen data by partitioning the dataset into complementary training and validation subsets. $k$-fold cross-validation splits data into $k$ groups, training on $k-1$ folds and testing on the remaining fold repeatedly.

Example

Using 5-fold cross-validation to evaluate a random forest classifier, producing accuracy scores of 0.91, 0.89, 0.92, 0.90, and 0.88 across folds, yielding a mean accuracy of 0.90.

A controlled experiment comparing two versions of a variable (A and B) to determine which performs better on a defined metric. It relies on random assignment and statistical hypothesis testing to establish causal relationships between changes and outcomes.

Example

An e-commerce company tests two checkout button colors (green vs. orange) with 50,000 users each, finding the orange button produces a statistically significant 3.2% increase in conversion rate ($p < 0.01$).

The graphical representation of data and information using charts, graphs, maps, and dashboards to communicate patterns, trends, and outliers effectively. Strong visualizations make complex analyses accessible to non-technical stakeholders.

Example

Creating an interactive Tableau dashboard that displays real-time sales metrics by region with drill-down capability, trend lines, and automated alerts when KPIs fall below thresholds.

One concept at a time.

Explore your way

Choose a different way to engage with this topic — no grading, just richer thinking.

Explore your way — choose one:

Explore with AI →

Curriculum alignment— Standards-aligned

Grade level

Grades 9-12College+Adult / Professional

Learning objectives

•Identify the stages of the data science lifecycle from problem formulation through deployment and monitoring
•Apply supervised and unsupervised machine learning algorithms to classify, cluster, and predict outcomes from data
•Analyze feature engineering and model selection tradeoffs to optimize predictive accuracy and interpretability
•Evaluate model performance using cross-validation, bias-variance analysis, and fairness metrics for real-world deployment

Recommended Resources

This page contains affiliate links. We may earn a commission at no extra cost to you.

Books

Python for Data Analysis

by Wes McKinney

An Introduction to Statistical Learning

by Gareth James, Daniela Witten, Trevor Hastie, Robert Tibshirani

The Hundred-Page Machine Learning Book

by Andriy Burkov

Storytelling with Data

by Cole Nussbaumer Knaflic

Courses

IBM Data Science Professional Certificate

CourseraEnroll

Data Scientist with Python Career Track

DataCampEnroll

My Progress Focus Mode

STEM & Engineering

Statistics

The science of collecting, analyzing, and interpreting data using descriptive measures, inferential methods, and probability theory to draw meaningful conclusions and inform decision-making.

Intermediate

Tech & Computing

Machine Learning

Machine learning is a subfield of artificial intelligence focused on building systems that learn from data to make predictions and decisions, encompassing techniques from simple regression models to complex deep neural networks.

Advanced

Interdisciplinary

Data Analytics

The practice of examining and modeling data to uncover patterns, inform decisions, and drive strategic action across organizations.

Intermediate

STEM & Engineering

Data Engineering

The discipline of designing, building, and maintaining data pipelines and infrastructure that collect, store, transform, and serve data at scale.

Intermediate

Tech & Computing

Artificial Intelligence

Artificial Intelligence is the field of computer science focused on building systems that can perform tasks requiring human-like intelligence, including learning, reasoning, perception, and decision-making.

Intermediate

Tech & Computing

Computer Science

The study of computation, algorithms, data structures, and the design of software systems, encompassing everything from theoretical foundations to artificial intelligence and software engineering.

Intermediate

Data Science

Quiz

Adaptive Learn

Flashcards

Cheat Sheet

Glossary

Learning Roadmap

Book

Calculator

Role-play

Key Concepts

Data Wrangling

Exploratory Data Analysis (EDA)

Statistical Inference

Regression

Classification

Clustering

Feature Engineering

Cross-Validation

A/B Testing

Data Visualization

Explore your way

Grade level

Learning objectives

Recommended Resources

Books

Python for Data Analysis

An Introduction to Statistical Learning

The Hundred-Page Machine Learning Book

Storytelling with Data

Courses

IBM Data Science Professional Certificate

Data Scientist with Python Career Track

Related Topics

Statistics

Machine Learning

Data Analytics

Data Engineering

Artificial Intelligence

Computer Science