A simple rule for choosing among difference‑in‑differences, matching, and hybrid estimates
This paper looks at a common practical problem in policy studies that use panel data. Researchers often must pick one headline estimate from three related approaches that use past outcomes differently. The authors show that a hybrid approach that both conditions on past outcomes and compares changes over time sits between the two simpler approaches in a wide set of cases. They then argue that this hybrid is a sensible default when a researcher must commit to one number but is unsure which assumptions hold.
The three approaches are easy to describe in plain terms. Difference-in-differences (DID) compares how treated and control groups change over time. Matching (M) conditions on past outcomes by finding control units that look similar to treated units on their histories. The hybrid (DIDM) does both: it matches on past outcomes and then compares changes. Each approach relies on a different assumption about how treatment and outcomes relate to past data. Those assumptions are not nested, so none is a strict special case of the others.
The authors give a theoretical result and accompanying examples. They show that under two economically plausible conditions—negative selection into treatment (meaning treated units would, on average, have had lower outcomes without treatment) and stable, non-explosive untreated outcome dynamics—the three estimands are ordered so that matching ≤ hybrid ≤ DID. That is, matching-type estimates tend to be lowest, DID estimates highest, and the hybrid lies in between. They illustrate this pattern in canonical job-training and education examples, including analyses related to the LaLonde National Supported Work dataset and related studies.
They use a decision‑theory idea called minimax regret to turn this ordering into a recommendation. Minimax regret means choosing the estimator that reduces the worst-case loss compared with the best estimator one would have picked with perfect knowledge. Under the same two conditions, the hybrid DIDM minimizes the largest possible regret across the three choices. Based on this finding the authors recommend reporting the DIDM estimate as the headline result, with matching and DID reported as lower and upper bounds.