Cohens Kappa Two Rater
Calculator

Inputs

Observed agreement
0.78

Results

Observed agreement
0.78
Expected agreement by chance
0.5
Cohen's kappa (κ)
0.56

Academic results

Observed agreement0.78
Expected agreement by chance0.5
Cohen's kappa (κ)0.56

formula-map diagram

Observed agreement
0.78
Expected agreement by chance
0.5
Cohen's kappa (κ)
0.56

Formula breakdown

Formula

κ = (Pₒ − Pₑ) ÷ (1 − Pₑ)

= 0.78

Note

This is a simplified model. Grading rules, credit systems and statistical assumptions vary by institution and study design; check your syllabus, registrar or methods guide before relying on these figures.

Example: with the default inputs, calculator.academic.observed_agreement is 0.78.

More in Academic and research

See all →

Frequently asked questions

What does Cohen's kappa measure in this calculator?+

It measures agreement between two raters on a yes/no classification, corrected for the agreement expected by chance. The formula is κ = (Pₒ − Pₑ) ÷ (1 − Pₑ).

What inputs do I need?+

Four counts: cases both raters agreed on, total cases rated, Rater A's "yes" count and Rater B's "yes" count. The defaults are 78, 100, 55 and 50.

How are observed and expected agreement computed?+

Observed agreement is agreements divided by total ratings. Expected agreement is built from each rater's yes share: pA × pB + (1 − pA) × (1 − pB).

Does it work for more than two categories or raters?+

No. It is set up for two raters and a binary yes/no rating only.

How should I read the kappa value?+

Higher values mean agreement beyond chance, and a value near 0 means agreement no better than chance. This calculator does not apply any interpretation scale.