TWO RATERS
Delta (5.0)
Delta is a Windows-based application that implements the model Delta for evaluating the agreement between two raters on a nominal scale and the model delta for assessing the level of knowledge in a multiple-choice test. Also available in Digibug, the institutional repository of the University of Granada.
> Downloads: Application for Win-64 || Application for Win-32 || Web: html || Document: pdf

A web application implementing the Delta model to assess the agreement between two raters on a nominal scale. The app has been developed in HTML5 and PHP.
Go to the web app || Document: pdf

DeltaMAN stands for Delta Model of Agreement for Nominal data. It is an R package implementing the Delta model to assess the agreement between two raters on a nominal scale. Available at CRAN.
R package || Document: pdf

Shiny (RStudio) application based on the R-package DeltaMAN implementing the Delta model to assess the agreement between two raters on a nominal scale.

Additional resources and tools for Delta
Excel worksheet that implements the asymptotic measures of agreement between two raters on a nominal scale for tables 2×2.
> Downloads: Excel || Web: html

MCT_sim (1.0)
Resource for simulation of multiple choice tests. It allows to simulate of multiple-choice tests and evaluates the performance of the Delta model compared to other classic criteria.
> Downloads: Application for Win-32 || Web: html

MANY RATERS
Multi-rater Delta (1.3)
Álvarez Hernández, M.; Martín Andrés, A. (2021)
MULTI-RATER DELTA provides the delta, Hubert's kappa and Fleiss's kappa measures of agreement among many raters (categorical data).
> Downloads: Application for Win-32 || Document: pdf || Data example (without frequencies): txt || Data example (with frequencies): txt

Hubert Kappa (3.0)
Álvarez Hernández, M.; Martín Andrés, A. (2022)
KAPPA provides the measures of agreement (and the inferences about them) among many raters based on Hubert's kappa or Shuster and Smith's weighted kappa (DeMoivre or R-wise) for categorical or ordinal data, respectively.
> Downloads: Application for Win-32 || Document: pdf || Data example (Kappa): txt || Data example (Weighted Kappa): txt || Data example (Weighted Kappa linear and quadratic): txt