signifigance of kappa statisitic

Home > Statistics Every Writer Should Know > The Stats Board > Discusssion

signifigance of kappa statisitic
Message posted by Nancy Archibald on November 19, 1999 at 12:00 AM (ET)

I'm using STATA to calculate a weighted Kappa statistic. STATA provides a z-test and p-value for the kappa result. How do I interpret the significance of the result? For example, a kappa of 0.48 with z=3.57 and p=0.0002? I am not that familiar with Kappa statistics, but would think that a kappa of 0.48 wasn't very good?

READERS RESPOND:
(In chronological order. Most recent at the bottom.)

Re: signifigance of kappa statisitic
Message posted by JG on November 19, 1999 at 12:00 AM (ET)

I am not familiar with 'kappa' but the z value and associated p value tell you that the result is 'statistically' very significant.

Re: signifigance of kappa statisitic
Message posted by Bill on November 22, 1999 at 12:00 AM (ET)

Kappa is a chance corrected measure of agreement. A significant kappa means that the obtained agreement is significantly greater than would have been expected by chance alone.

Your $5 contribution helps cover part the $500 annual cost of keeping this site online.