A practitioner computes Cohen's Kappa = 0.72 for a 3-class text cla…

Question

A practitioner computes Cohen's Kappa = 0.72 for a 3-class text classifier. What does this value indicate according to the Landis and Koch scale?

Accepted Answer

Substantial agreement — the model achieves 72% more agreement than expected by chance — Here's the deal — b is correct because Cohen's Kappa measures agreement beyond chance. Kappa = 0.72 means 72% improvement over chance agreement, falling in the 'substantial agreement' range (0.61-0.80) per Landis and Koch.

Answer

The model correctly classifies 72% of all documents

Answer

Moderate agreement — Kappa between 0.60 and 0.80 falls in the moderate range

Answer

The model's macro-averaged F1 score is 0.72 across all three classes

A practitioner computes Cohen's Kappa = 0.72 for a 3-class text classifier. What does this value indicate according to the Landis and Koch scale?

Short Explanation and Infographic

Full Explanation