RDD uses a sharp threshold for treatment assignment
Image: Johannes Vermeer, Public domain, via Wikimedia Commons
RDD uses a sharp threshold for treatment assignment
Regression discontinuity designs (RDD) rely on a sharp cutoff or threshold to assign treatments. Observations just above and below this threshold are compared to estimate the treatment effect. This method helps in situations where random assignment is not possible.
Example
In evaluating scholarship programs, students scoring just above or below a certain GPA threshold are assigned to receive scholarships or not, respectively. Researchers then compare outcomes of students near this cutoff to estimate the scholarship's impact.
RDD provides a way to infer causal effects in quasi-experimental settings, which is crucial for fields like economics and psychology where randomization is often impractical.
to standardize: when you need zero mean and unit variance for gradient-based optimization
Standardize when zero mean and unit variance are required for gradient-based optimization
to use random forests: when you want a strong baseline with minimal hyperparameter tuning
Random forests are ideal for robust baseline models with minimal hyperparameter tuning
the back-door criterion identifies: sufficient adjustment sets for causal estimation
The back-door criterion identifies sufficient adjustment sets for causal estimation
Rate-distortion theory: minimum bits to represent data within distortion D
Rate-distortion theory: minimum bits to represent data within distortion D = R(D)
Ridge regression uses L2 to shrink coefficients without eliminating them
Ridge regression minimizes the sum of squared residuals plus L2 penalty λ∑β²
LoRA (machine learning)
LoRA uses r << d for efficient adaptation
One email a day: 5 concepts + the 5 stories that matter →
Swipe through 100 ML concepts daily
Open TickerNews