Matthews correlation coefficient (MCC) measures balanced metric even with class imbalance
Image: NormanEinstein, CC BY-SA 3.0, via Wikimedia Commons
Phi coefficient
Matthews correlation coefficient (MCC) measures balanced metric even with class imbalance
The Matthews correlation coefficient (MCC) is a balanced metric that accounts for true and false positives and negatives, making it effective even when classes are imbalanced.
MCC considers all four combinations of the predicted and actual binary classifications: true positives, true negatives, false positives, and false negatives. This comprehensive approach ensures that the performance metric reflects the actual effectiveness of a binary classification model.
Unlike other metrics that may favor the majority class, MCC provides a balanced view of model performance across both classes. This makes it particularly useful for evaluating models in scenarios where class imbalance is present.
Example
In a binary classification problem with 100 positive cases and 900 negative cases, a model with an MCC of 0.7 indicates good balanced performance across both classes, regardless of the imbalance.
Understanding MCC helps in choosing the right metric for evaluating model performance in imbalanced datasets, ensuring accurate and fair assessment.
Related concepts
to use F1 score: when classes are imbalanced and both FP and FN matter
Use F1 score when classes are imbalanced and both FP and FN matter
Pearson correlation coefficient
Pearson correlation coefficient formula: r = Σ[(xi - x̄)(yi - ȳ)] / [√(Σ(xi - x̄)²) * √(Σ(yi - ȳ)²)]
NDCG measures: ranking quality with graded relevance scores
NDCG measures ranking quality with graded relevance scores
the condition number κ(A) measures: sensitivity of Ax=b to perturbations
The condition number κ(A) measures the sensitivity of Ax=b to perturbations
the dot product measures alignment: it equals |a||b|cos(θ)
Dot product measures alignment: it equals |a||b|cos(θ)
mel-frequency cepstral coefficients (MFCCs) capture: speech features on a perceptual scale
MFCCs capture speech features on a perceptual scale by mimicking human auditory perception
One email a day: 5 concepts + the 5 stories that matter →
Swipe through 100 ML concepts daily
Open TickerNews