Pith. sign in

REVIEW 4 cited by

Fine Stratification of Survey Experiments

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2111.08157 v3 pith:6OB4S7Q3 submitted 2021-11-16 econ.EM math.STstat.MEstat.TH

Fine Stratification of Survey Experiments

classification econ.EM math.STstat.MEstat.TH
keywords experimentsgainstreatmentalgorithmcovariatesdevelopeffectefficiency
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

This paper studies a two-stage model of experimentation, where the researcher first samples representative experimental participants from an eligible pool, then assigns each sampled unit to treatment or control, using matched $k$-tuples randomization at both stages. To implement such designs, we develop a fast new algorithm for matching units into $k$-tuples for any $k \ge 2$ and any dimension of covariates. By surveying 200 recent experimental working papers, we estimate that our algorithm newly enables multivariate fine stratification with provable match quality guarantees for about 44\% of experiments in economics. We show that finely stratified sampling and assignment both nonparametrically reduce the variance of treatment effect estimation, with the gains from stratified sampling increasing in the size of the eligible pool and how well covariates predict treatment effect heterogeneity. We develop new inference methods that fully exploit the efficiency gains from both design stages, allowing researchers to report smaller standard errors if they designed a representative experiment. An application to nine published experiments quantifies the efficiency gains.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Semiparametric Efficiency in Sequential Experiments: Characterization and Design via Average Propensity

    stat.ME 2026-06 unverdicted novelty 7.0

    Sequential experiments achieve the i.i.d. semiparametric efficiency bound when evaluated at the average propensity induced by the design, and two batched adaptive mechanisms approach this bound with few policy updates.

  2. Semiparametric Efficiency in Sequential Experiments: Characterization and Design via Average Propensity

    stat.ME 2026-06 unverdicted novelty 7.0

    Sequential experiments achieve i.i.d.-level semiparametric efficiency via an induced average propensity score, attained by batched designs using influence-function regression adjustment or adaptive covariate balancing.

  3. Asymptotic Efficiency Bounds for a Class of Experimental Designs

    stat.ME 2022-05 unverdicted novelty 7.0

    Derives asymptotic efficiency bounds for a broad class of sequential experimental designs showing no further first-order asymptotic efficiency gains are possible for ATE estimation beyond the Hahn (1998) bound achieve...

  4. Coupling Designs for Randomized Experiments with Complex Treatments

    econ.EM 2026-04 unverdicted novelty 6.0

    Coupling designs extend stratified randomization to complex treatment spaces by matching units into homogeneous groups and dispersing treatments within groups to improve efficiency proportional to dispersion and match...