Bias Adjustment in Multilevel Meta-Analysis of Standardized Single-Case Experimental Data

Laleh Jamshidi, Lies Declercq, Belén Fernández-Castilla, John M. Ferron, Mariola Moeyaert, S. Natasha Beretvas, Wim Van den Noortgate

Research output: Contribution to journalArticle

Abstract

Previous research found bias in the estimate of the overall fixed effects and variance components using multilevel meta-analyses of standardized single-case data. Therefore, we evaluate two adjustments in an attempt to reduce the bias and improve the statistical properties of the parameter estimates. The results confirm the existence of bias when estimating an overall effect based on standardized data and bias when estimating variance components. The relative bias decreases as the number of measurement occasions increases. The results indicate that the between-case variance and, to a smaller degree, the between-study variance is overestimated, especially when measurement occasions per phase is only 10. In general, Hedges’s bias correction procedure led to better estimations of both fixed effects and variance components.

Original languageEnglish (US)
JournalJournal of Experimental Education
DOIs
StateAccepted/In press - Jan 1 2019

Fingerprint

Multilevel Analysis
Meta-Analysis
trend
Research

Keywords

  • Bias correction
  • multilevel meta-analysis
  • single-case experimental design (SCED)

ASJC Scopus subject areas

  • Education
  • Developmental and Educational Psychology

Cite this

Jamshidi, L., Declercq, L., Fernández-Castilla, B., Ferron, J. M., Moeyaert, M., Beretvas, S. N., & Van den Noortgate, W. (Accepted/In press). Bias Adjustment in Multilevel Meta-Analysis of Standardized Single-Case Experimental Data. Journal of Experimental Education. https://doi.org/10.1080/00220973.2019.1658568

Bias Adjustment in Multilevel Meta-Analysis of Standardized Single-Case Experimental Data. / Jamshidi, Laleh; Declercq, Lies; Fernández-Castilla, Belén; Ferron, John M.; Moeyaert, Mariola; Beretvas, S. Natasha; Van den Noortgate, Wim.

In: Journal of Experimental Education, 01.01.2019.

Research output: Contribution to journalArticle

Jamshidi, Laleh ; Declercq, Lies ; Fernández-Castilla, Belén ; Ferron, John M. ; Moeyaert, Mariola ; Beretvas, S. Natasha ; Van den Noortgate, Wim. / Bias Adjustment in Multilevel Meta-Analysis of Standardized Single-Case Experimental Data. In: Journal of Experimental Education. 2019.
@article{c4f4f4eef8524b66a6d56f6060dd0f17,
title = "Bias Adjustment in Multilevel Meta-Analysis of Standardized Single-Case Experimental Data",
abstract = "Previous research found bias in the estimate of the overall fixed effects and variance components using multilevel meta-analyses of standardized single-case data. Therefore, we evaluate two adjustments in an attempt to reduce the bias and improve the statistical properties of the parameter estimates. The results confirm the existence of bias when estimating an overall effect based on standardized data and bias when estimating variance components. The relative bias decreases as the number of measurement occasions increases. The results indicate that the between-case variance and, to a smaller degree, the between-study variance is overestimated, especially when measurement occasions per phase is only 10. In general, Hedges’s bias correction procedure led to better estimations of both fixed effects and variance components.",
keywords = "Bias correction, multilevel meta-analysis, single-case experimental design (SCED)",
author = "Laleh Jamshidi and Lies Declercq and Bel{\'e}n Fern{\'a}ndez-Castilla and Ferron, {John M.} and Mariola Moeyaert and Beretvas, {S. Natasha} and {Van den Noortgate}, Wim",
year = "2019",
month = "1",
day = "1",
doi = "10.1080/00220973.2019.1658568",
language = "English (US)",
journal = "Journal of Experimental Education",
issn = "0022-0973",
publisher = "Routledge",

}

TY - JOUR

T1 - Bias Adjustment in Multilevel Meta-Analysis of Standardized Single-Case Experimental Data

AU - Jamshidi, Laleh

AU - Declercq, Lies

AU - Fernández-Castilla, Belén

AU - Ferron, John M.

AU - Moeyaert, Mariola

AU - Beretvas, S. Natasha

AU - Van den Noortgate, Wim

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Previous research found bias in the estimate of the overall fixed effects and variance components using multilevel meta-analyses of standardized single-case data. Therefore, we evaluate two adjustments in an attempt to reduce the bias and improve the statistical properties of the parameter estimates. The results confirm the existence of bias when estimating an overall effect based on standardized data and bias when estimating variance components. The relative bias decreases as the number of measurement occasions increases. The results indicate that the between-case variance and, to a smaller degree, the between-study variance is overestimated, especially when measurement occasions per phase is only 10. In general, Hedges’s bias correction procedure led to better estimations of both fixed effects and variance components.

AB - Previous research found bias in the estimate of the overall fixed effects and variance components using multilevel meta-analyses of standardized single-case data. Therefore, we evaluate two adjustments in an attempt to reduce the bias and improve the statistical properties of the parameter estimates. The results confirm the existence of bias when estimating an overall effect based on standardized data and bias when estimating variance components. The relative bias decreases as the number of measurement occasions increases. The results indicate that the between-case variance and, to a smaller degree, the between-study variance is overestimated, especially when measurement occasions per phase is only 10. In general, Hedges’s bias correction procedure led to better estimations of both fixed effects and variance components.

KW - Bias correction

KW - multilevel meta-analysis

KW - single-case experimental design (SCED)

UR - http://www.scopus.com/inward/record.url?scp=85073803596&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073803596&partnerID=8YFLogxK

U2 - 10.1080/00220973.2019.1658568

DO - 10.1080/00220973.2019.1658568

M3 - Article

AN - SCOPUS:85073803596

JO - Journal of Experimental Education

JF - Journal of Experimental Education

SN - 0022-0973

ER -