My recent lectures focus on Mokken Scale Analysis which is based on an item response model known as the monotone homogeneity model.
Mokken scale analysis can be seen as a hierarchical scaling method where we make the assumption that there exist an underlying latent trait that explain covariation between item responses. As in other IRT models, items are thought to be orderable by ‘difficulty’ such that any individual who endorses a particular item should endorse one with a lower difficulty (as in Guttman scaling, but perfectly ordered response patterns are rarely met in practice, especially in some fields of research). Individual scores are then computed as the rank of the highest endorsed item in this hierarchy, i.e. it is a simple total score (sum of positive responses). Unlike Guttman scaling, however, Mokken scaling relies on a probabilistic framework.^{1} The reproducibility of response patterns are typically assessed using a coefficient of reproducibility, a coefficient of scalability and/or Loevinger’s coefficient of homogeneity.^{(1)}
More discussion can be found in, e.g., Sijtsma and Verweij^{(2)} or Mokkan and Lewis.^{(3)} The use of Mokken scale analysis is largely found in patient outcome research, ranging from psychiatric or clinical research^{(4-6)} to health-related quality of life.^{(7,8)}
In practice, Mokken scaling is attracting because it is supposed to require lower sample size compare to traditional IRT model. This is perhaps discussed in Mokken’s book but I don’t have it and I was unable to find a single paper on sample size requirement for Mokken scale analysis.
Andries van der Ark has a lot of papers on this topic, including an upcoming paper for the Journal of Statistical Software: Van der Ark, L. A. (in press). New developments in Mokken scale analysis in R. Journal of Statistical Software.
I don’t have access to the preprint at the time I’m writing these notes, but I guess it is sort of a follow-up on his earlier paper, Mokken Scale Analysis in R (JSS 2007, 20(11)). There is even an on-line tutorial on Getting started with Mokken scale analysis in R (PDF).
Here are some other links to papers that I found useful (and mostly available as PDFs).
One paper that has attracted my attention is
Zijlstra, W.P. et al. Robust Mokken scale analysis by means of the forward search algorithm for outlier detection. Multivariate Behavioral Research, 46:58-89, 2011.
It deals with automated item selection and the use of the forward search algorithm^{(9,10)} to detect possible outliers, where outliers are defined as “observations that are inconsistent with the remainder of the data or have a disproportionate influence on interesting results such as parameter estimates, goodness-of-fit statistics, and significance tests.” The authors used the squared distance between item score and the corresponding item response function (IRF), summated over all items for each respondent, which define respondents’ residuals relative to the IRFs and the objective function for the forward search (FS) method. Briefly, a first FS serves to find a good partition of the items into unidimensional scales; then, FS is run on each sale separately and scalability coefficients are examined on-line.
As a sidenote, I was recently wondering if any research has been published that compares Mokken scaling for exploratory scale construction vs. Revelle’s item cluster analysis.^{(11)}
The same argument is often heard when one opposes classical test theory (which only ranks individuals based on their total scores, in the sample under consideration) and Rasch model (which uses a probabilistic model allowing to draw inference regarding different pool of respondents or items, but see specific objectivity). ↩︎