Age and sex invariance of the International Cognitive Ability Resource (ICAR)

Stephanie Ruth Young, Timothy Z. Keith, Mark A. Bond

Research output: Contribution to journalArticle

Abstract

To encourage broader assessment of cognitive abilities in research across scientific fields, Condon and Revelle (2014) developed the first cognitive assessment in the public domain, the International Cognitive Ability Resource (ICAR). Despite initial support for its psychometric properties, little is known about the construct validity of the ICAR across distinct groups of individuals. In order to meaningfully interpret ICAR scores across diverse populations, measurement invariance must be established. To this end, a multiple group confirmatory factor analysis (MGCFA) was conducted on the full 60-item ICAR (ICAR60) and the 16-item Sample Test (ICAR16) to test for invariance across self-reported biological sex and age groups. A moderated nonlinear factor analysis (MNLFA) was conducted on the ICAR16 to test for differential item functioning (DIF) across linear age, age squared, sex, and their respective interaction terms. The baseline MGCFA models proposed by the test developers fit the data well for males and females and across age groups based on the fit indices Mc, CFI, TLI, and RMSEA. In the MCGFA, both forms demonstrated acceptable changes in the Mc (∆< .02) and CFI (∆< .01) in both loading- and threshold-constrained models for the sex and age group models. The MNLFA supported the weak and strong measurement invariance of the ICAR16 found in the MGCFA; no meaningful differences in item thresholds or factor-loadings were found across age, sex, or their interaction terms. Overall findings provide evidence that both forms measure the same constructs across sex and age, and the same strength of the relations exists among the first-order factors and the items. Despite these findings, the internal consistency of the subscales suggests only the total score of the ICAR16 be used for research; those interested in the subscales of the ICAR are advised to use the ICAR60.

Original languageEnglish (US)
Article number101399
JournalIntelligence
Volume77
DOIs
StatePublished - Nov 1 2019

Fingerprint

Aptitude
Statistical Factor Analysis
Age Groups
Public Sector
Research
Psychometrics
Resources
Invariance
Cognitive Ability
Population
Confirmatory Factor Analysis

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Developmental and Educational Psychology
  • Arts and Humanities (miscellaneous)

Cite this

Age and sex invariance of the International Cognitive Ability Resource (ICAR). / Young, Stephanie Ruth; Keith, Timothy Z.; Bond, Mark A.

In: Intelligence, Vol. 77, 101399, 01.11.2019.

Research output: Contribution to journalArticle

@article{69a211dc8d0240cebe9093fba16954ed,
title = "Age and sex invariance of the International Cognitive Ability Resource (ICAR)",
abstract = "To encourage broader assessment of cognitive abilities in research across scientific fields, Condon and Revelle (2014) developed the first cognitive assessment in the public domain, the International Cognitive Ability Resource (ICAR). Despite initial support for its psychometric properties, little is known about the construct validity of the ICAR across distinct groups of individuals. In order to meaningfully interpret ICAR scores across diverse populations, measurement invariance must be established. To this end, a multiple group confirmatory factor analysis (MGCFA) was conducted on the full 60-item ICAR (ICAR60) and the 16-item Sample Test (ICAR16) to test for invariance across self-reported biological sex and age groups. A moderated nonlinear factor analysis (MNLFA) was conducted on the ICAR16 to test for differential item functioning (DIF) across linear age, age squared, sex, and their respective interaction terms. The baseline MGCFA models proposed by the test developers fit the data well for males and females and across age groups based on the fit indices Mc, CFI, TLI, and RMSEA. In the MCGFA, both forms demonstrated acceptable changes in the Mc (∆< .02) and CFI (∆< .01) in both loading- and threshold-constrained models for the sex and age group models. The MNLFA supported the weak and strong measurement invariance of the ICAR16 found in the MGCFA; no meaningful differences in item thresholds or factor-loadings were found across age, sex, or their interaction terms. Overall findings provide evidence that both forms measure the same constructs across sex and age, and the same strength of the relations exists among the first-order factors and the items. Despite these findings, the internal consistency of the subscales suggests only the total score of the ICAR16 be used for research; those interested in the subscales of the ICAR are advised to use the ICAR60.",
author = "Young, {Stephanie Ruth} and Keith, {Timothy Z.} and Bond, {Mark A.}",
year = "2019",
month = "11",
day = "1",
doi = "10.1016/j.intell.2019.101399",
language = "English (US)",
volume = "77",
journal = "Intelligence",
issn = "0160-2896",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Age and sex invariance of the International Cognitive Ability Resource (ICAR)

AU - Young, Stephanie Ruth

AU - Keith, Timothy Z.

AU - Bond, Mark A.

PY - 2019/11/1

Y1 - 2019/11/1

N2 - To encourage broader assessment of cognitive abilities in research across scientific fields, Condon and Revelle (2014) developed the first cognitive assessment in the public domain, the International Cognitive Ability Resource (ICAR). Despite initial support for its psychometric properties, little is known about the construct validity of the ICAR across distinct groups of individuals. In order to meaningfully interpret ICAR scores across diverse populations, measurement invariance must be established. To this end, a multiple group confirmatory factor analysis (MGCFA) was conducted on the full 60-item ICAR (ICAR60) and the 16-item Sample Test (ICAR16) to test for invariance across self-reported biological sex and age groups. A moderated nonlinear factor analysis (MNLFA) was conducted on the ICAR16 to test for differential item functioning (DIF) across linear age, age squared, sex, and their respective interaction terms. The baseline MGCFA models proposed by the test developers fit the data well for males and females and across age groups based on the fit indices Mc, CFI, TLI, and RMSEA. In the MCGFA, both forms demonstrated acceptable changes in the Mc (∆< .02) and CFI (∆< .01) in both loading- and threshold-constrained models for the sex and age group models. The MNLFA supported the weak and strong measurement invariance of the ICAR16 found in the MGCFA; no meaningful differences in item thresholds or factor-loadings were found across age, sex, or their interaction terms. Overall findings provide evidence that both forms measure the same constructs across sex and age, and the same strength of the relations exists among the first-order factors and the items. Despite these findings, the internal consistency of the subscales suggests only the total score of the ICAR16 be used for research; those interested in the subscales of the ICAR are advised to use the ICAR60.

AB - To encourage broader assessment of cognitive abilities in research across scientific fields, Condon and Revelle (2014) developed the first cognitive assessment in the public domain, the International Cognitive Ability Resource (ICAR). Despite initial support for its psychometric properties, little is known about the construct validity of the ICAR across distinct groups of individuals. In order to meaningfully interpret ICAR scores across diverse populations, measurement invariance must be established. To this end, a multiple group confirmatory factor analysis (MGCFA) was conducted on the full 60-item ICAR (ICAR60) and the 16-item Sample Test (ICAR16) to test for invariance across self-reported biological sex and age groups. A moderated nonlinear factor analysis (MNLFA) was conducted on the ICAR16 to test for differential item functioning (DIF) across linear age, age squared, sex, and their respective interaction terms. The baseline MGCFA models proposed by the test developers fit the data well for males and females and across age groups based on the fit indices Mc, CFI, TLI, and RMSEA. In the MCGFA, both forms demonstrated acceptable changes in the Mc (∆< .02) and CFI (∆< .01) in both loading- and threshold-constrained models for the sex and age group models. The MNLFA supported the weak and strong measurement invariance of the ICAR16 found in the MGCFA; no meaningful differences in item thresholds or factor-loadings were found across age, sex, or their interaction terms. Overall findings provide evidence that both forms measure the same constructs across sex and age, and the same strength of the relations exists among the first-order factors and the items. Despite these findings, the internal consistency of the subscales suggests only the total score of the ICAR16 be used for research; those interested in the subscales of the ICAR are advised to use the ICAR60.

UR - http://www.scopus.com/inward/record.url?scp=85073671247&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073671247&partnerID=8YFLogxK

U2 - 10.1016/j.intell.2019.101399

DO - 10.1016/j.intell.2019.101399

M3 - Article

AN - SCOPUS:85073671247

VL - 77

JO - Intelligence

JF - Intelligence

SN - 0160-2896

M1 - 101399

ER -