Sociological Methodology · 2004 · 100 citations · 36 references
Social SciencesBiostatisticsExperimental DesignMethod ValidationMetrologyExperimental EvaluationMeasurement ErrorMeasurement ValidityMethod ComparisonReliabilityTest ReliabilityInstrument ReliabilityInstrument ValidityStatistical Comparison Of Measurement Results
Measurement instruments are traditionally evaluated using either split‑ballot experiments, which assess method‑induced response distribution differences with independent random samples, or multitrait‑multimethod (MTMM) designs, which examine reliability and validity across methods. This paper proposes a new design that merges the strengths of split‑ballot and MTMM approaches. The new design not only replicates the split‑ballot ability to detect response distribution differences but also yields more detailed insights into the underlying causes.
Two distinctly different quantitative approaches are used to evaluate measurement instruments: the split-ballot experiment and the multitrait-multimethod (MTMM) approach. The first approach is typically used to indicate whether variation in the method causes differences in the response distribution; the second approach evaluates the reliability and validity of different methods. The new approach, suggested in this paper, combines the more attractive features of both methods. The strength of the split-ballot experiment is its use of independent random samples from the same population to provide information about differences in response distributions. This is also possible with the new approach, but this approach provides more detailed information about the reasons
36
Simultaneous Factor Analysis in Several Populations
Karl G. Jöreskog · Psychometrika · 1971 · 2K citations
Maximum Likelihood Estimation of the Polychoric Correlation Coefficient
Ulf Olsson · Psychometrika · 1979 · 1.1K citations