This function fixes an issue in the kappam.fleiss function in the irr package. Specifically, the original function removes all missing values. However, many rating designs do not have all raters score all essays. This function will still calculate Fleiss' Kappa for those situations.

kappam.fleiss2(ratings, exact = FALSE, detail = FALSE)

Arguments

ratings

n*m matrix or dataframe, n subjecs of m raters.

exact

a logical indicating whether the exact Kappa (Conger, 1980) or the Kappa described by Fleiss (1971) should be computed.

detail

a logical indicating whether category-wise Kappas should be computed

Details

See irr::kappam.fleis for more information.