The Journal of Experimental Education · 2014 · 281 citations · 44 references
Public HealthBiostatisticsEpidemiologic MethodsExperimental DesignStatistical ModelingClustered Data AnalysisFixed-effect ModelsMixed-effects ModelsMultilevel ModelingFixed Effects EstimationLinearizationMultilevel RegressionNested Multilevel ModelsStatistical Significance TestingVariance Estimation
Multilevel modeling is widely used to handle nonindependent observations in clustered data, but alternatives such as Taylor series linearization, design‑effect adjusted standard errors, and fixed‑effects modeling also exist. The author conducted 1,000 replications across 12 scenarios varying Level‑1 and Level‑2 sample sizes to compare parameter estimates, standard errors, and statistical significance of these alternative procedures. The study shows that several of these alternatives can be used alone or alongside multilevel modeling, with choice guided by the research question and number of clusters, and provides practical guidelines for applied researchers.
Multilevel modeling has grown in use over the years as a way to deal with the nonindependent nature of observations found in clustered data. However, other alternatives to multilevel modeling are available that can account for observations nested within clusters, including the use of Taylor series linearization for variance estimation, the design effect adjusted standard errors approach, and fixed effects modeling. Using 1,000 replications of 12 conditions with varied Level 1 and Level 2 sample sizes, the author compared parameter estimates, standard errors, and statistical significance using various alternative procedures. Results indicate that several acceptable procedures can be used in lieu of or together with multilevel modeling, depending on the type of research question asked and the number of clusters under investigation. Guidelines for applied researchers are discussed.
44
Choice Reviews Online · 1990 · 35.7K citations
Sufficient Sample Sizes for Multilevel Modeling
Cora J. M. Maas, Joop J. Hox · Methodology · 2005 · 3.4K citations
Analysis of Complex Survey Samples
Thomas Lumley · Journal of Statistical Software · 2004 · 2.3K citations · Full text