Atlas · skill

Causal Inference

Causal inference estimates what would change if an intervention changed a treatment or policy. It combines a clearly defined causal question with assumptions about how data were generated. The skill is deciding whether an effect is identifiable, choosing an estimator and testing how sensitive the conclusion is to those assumptions.

conceptCausal Inference

What it is

A predictive association asks what outcomes accompany an observed variable; a causal effect asks what outcomes would follow an intervention. Potential-outcomes reasoning compares alternative outcomes for the same unit, while causal graphs describe relationships and possible confounding. Because both alternatives usually cannot be observed, identification depends on a design or assumptions such as exchangeability, overlap and a consistent treatment definition. Randomized experiments can support identification through assignment; observational studies require additional reasoning. Estimation then turns the identified quantity into a numerical result. A sophisticated regression or propensity model cannot, by itself, supply the missing causal assumptions.

What the work involves

Start by defining the intervention, outcome, target population and time horizon. Draw or document a causal model before deciding which variables to adjust for; controlling for a mediator or collider can change or bias the question. Assess whether treatment groups have comparable support and select an estimation strategy consistent with the design. Report uncertainty and examine alternative specifications, placebo tests and sensitivity to unmeasured confounding. The deliverable is an effect estimate with a defensible identification argument and limitations, rather than a coefficient labeled causal because it is statistically significant.

Illustrative example

Suppose, illustratively, an online service wants to know whether a reminder reduces abandoned registrations. People who receive reminders may already differ in engagement from those who do not. An analyst defines the intervention precisely, considers random assignment where feasible and specifies the outcome window before seeing results. If only observational records are available, the analyst models the assignment process, checks overlap and explains which unmeasured factors could still account for an apparent reduction in abandonment.

Limits and common mistakes

Causal conclusions can fail when key confounders are unmeasured, treatment groups lack overlap or one person's treatment affects another's outcome. Refutation tests can expose weaknesses, but passing them does not prove the graph or assumptions true. Average effects may conceal substantial variation, and results need not transport to another population. Causal inference is distinct from forecasting and feature importance: a variable useful for predicting an outcome is not necessarily an effective intervention target.

Prerequisites

  • Causal inference methods build directly on statistical estimation, hypothesis testing, and regression to move from correlation to causation

  • Treatment effect estimation, instrumental variables, and propensity scores are extensions of regression frameworks

  • Causal inference often addresses cases where controlled experiments are impossible — understanding what A/B tests do helps understand what causal inference replaces

Related skills

Sources and further reading

Last updated: 2026-10-10