This package provides functions and a shiny application to simulate inter-rater reliability statistics based on various scoring and response models. The initial motivation for this package is to understand the relationship between percent rater agreement and intraclass correlation.

Documentation is available at

Slides for NCME 2019 talk are here:


The development version of IRRsim can be downloaded from Github using the devtools package:


Shiny App

Many of features of this package can be explored using the included shiny applications. The IRRsim_shiny() function will run the application.

IRRsim Shiny App