calibration means: a model predicting 80% should be correct 80% of the time

expected calibration error (ECE) measures: gap between confidence and accuracy

Expected Calibration Error (ECE) measures the gap between predicted confidence levels and actual accuracy

eventual consistency means: all replicas converge to the same state given enough time

Eventual consistency: All replicas converge to the same state given enough time

word error rate (WER) measures: edit distance between predicted and reference transcriptions

Word Error Rate (WER) measures the edit distance between predicted and reference transcriptions

MAP (mean average precision) measures: area under the precision-recall curve averaged across queries

MAP measures the area under the precision-recall curve averaged across queries

P-value

A p-value < 0.05 means: if H₀ is true, this result has <5% probability

importance sampling does: reweights samples from proposal to estimate target expectation

Importance sampling reweights samples from a proposal distribution to estimate the expectation under a target distribution