Alternatives to Multilevel Modeling for the Analysis of Clustered Data

Francis L. Huang

The Journal of Experimental Education · 2014 · 281 citations · 44 references

Concepts

TL;DR

Multilevel modeling is widely used to handle nonindependent observations in clustered data, but alternatives such as Taylor series linearization, design‑effect adjusted standard errors, and fixed‑effects modeling also exist. The author conducted 1,000 replications across 12 scenarios varying Level‑1 and Level‑2 sample sizes to compare parameter estimates, standard errors, and statistical significance of these alternative procedures. The study shows that several of these alternatives can be used alone or alongside multilevel modeling, with choice guided by the research question and number of clusters, and provides practical guidelines for applied researchers.

Abstract

Multilevel modeling has grown in use over the years as a way to deal with the nonindependent nature of observations found in clustered data. However, other alternatives to multilevel modeling are available that can account for observations nested within clusters, including the use of Taylor series linearization for variance estimation, the design effect adjusted standard errors approach, and fixed effects modeling. Using 1,000 replications of 12 conditions with varied Level 1 and Level 2 sample sizes, the author compared parameter estimates, standard errors, and statistical significance using various alternative procedures. Results indicate that several acceptable procedures can be used in lieu of or together with multilevel modeling, depending on the type of research question asked and the number of clusters under investigation. Guidelines for applied researchers are discussed.

References

44