Improving IQ measurement in intellectual disabilities using true deviation from population norms

Stephanie M. Sansone, Andrea Schneider, Erika Bickel, Elizabeth Berry-Kravis, Christina Prescott, David R Hessl

Research output: Contribution to journalArticle

21 Citations (Scopus)

Abstract

Background: Intellectual disability (ID) is characterized by global cognitive deficits, yet the very IQ tests used to assess ID have limited range and precision in this population, especially for more impaired individuals. Methods: We describe the development and validation of a method of raw z-score transformation (based on general population norms) that ameliorates floor effects and improves the precision of IQ measurement in ID using the Stanford Binet 5 (SB5) in fragile X syndrome (FXS; n = 106), the leading inherited cause of ID, and in individuals with idiopathic autism spectrum disorder (ASD; n = 205). We compared the distributional characteristics and Q-Q plots from the standardized scores with the deviation z-scores. Additionally, we examined the relationship between both scoring methods and multiple criterion measures. Results: We found evidence that substantial and meaningful variation in cognitive ability on standardized IQ tests among individuals with ID is lost when converting raw scores to standardized scaled, index and IQ scores. Use of the deviation z- score method rectifies this problem, and accounts for significant additional variance in criterion validation measures, above and beyond the usual IQ scores. Additionally, individual and group-level cognitive strengths and weaknesses are recovered using deviation scores. Conclusion: Traditional methods for generating IQ scores in lower functioning individuals with ID are inaccurate and inadequate, leading to erroneously flat profiles. However assessment of cognitive abilities is substantially improved by measuring true deviation in performance from standardization sample norms. This work has important implications for standardized test development, clinical assessment, and research for which IQ is an important measure of interest in individuals with neurodevelopmental disorders and other forms of cognitive impairment.

Original languageEnglish (US)
Article number16
JournalJournal of Neurodevelopmental Disorders
Volume6
Issue number1
DOIs
StatePublished - Jul 8 2014

Fingerprint

Intellectual Disability
Population
Aptitude
Fragile X Syndrome
Research Design
Research

Keywords

  • Autism spectrum disorder
  • Cognitive assessment
  • Fragile X syndrome
  • Intellectual disability
  • IQ

ASJC Scopus subject areas

  • Clinical Neurology
  • Pathology and Forensic Medicine
  • Cognitive Neuroscience
  • Pediatrics, Perinatology, and Child Health

Cite this

Improving IQ measurement in intellectual disabilities using true deviation from population norms. / Sansone, Stephanie M.; Schneider, Andrea; Bickel, Erika; Berry-Kravis, Elizabeth; Prescott, Christina; Hessl, David R.

In: Journal of Neurodevelopmental Disorders, Vol. 6, No. 1, 16, 08.07.2014.

Research output: Contribution to journalArticle

Sansone, Stephanie M. ; Schneider, Andrea ; Bickel, Erika ; Berry-Kravis, Elizabeth ; Prescott, Christina ; Hessl, David R. / Improving IQ measurement in intellectual disabilities using true deviation from population norms. In: Journal of Neurodevelopmental Disorders. 2014 ; Vol. 6, No. 1.
@article{6b0673ec361c444dbeb298dc127e557c,
title = "Improving IQ measurement in intellectual disabilities using true deviation from population norms",
abstract = "Background: Intellectual disability (ID) is characterized by global cognitive deficits, yet the very IQ tests used to assess ID have limited range and precision in this population, especially for more impaired individuals. Methods: We describe the development and validation of a method of raw z-score transformation (based on general population norms) that ameliorates floor effects and improves the precision of IQ measurement in ID using the Stanford Binet 5 (SB5) in fragile X syndrome (FXS; n = 106), the leading inherited cause of ID, and in individuals with idiopathic autism spectrum disorder (ASD; n = 205). We compared the distributional characteristics and Q-Q plots from the standardized scores with the deviation z-scores. Additionally, we examined the relationship between both scoring methods and multiple criterion measures. Results: We found evidence that substantial and meaningful variation in cognitive ability on standardized IQ tests among individuals with ID is lost when converting raw scores to standardized scaled, index and IQ scores. Use of the deviation z- score method rectifies this problem, and accounts for significant additional variance in criterion validation measures, above and beyond the usual IQ scores. Additionally, individual and group-level cognitive strengths and weaknesses are recovered using deviation scores. Conclusion: Traditional methods for generating IQ scores in lower functioning individuals with ID are inaccurate and inadequate, leading to erroneously flat profiles. However assessment of cognitive abilities is substantially improved by measuring true deviation in performance from standardization sample norms. This work has important implications for standardized test development, clinical assessment, and research for which IQ is an important measure of interest in individuals with neurodevelopmental disorders and other forms of cognitive impairment.",
keywords = "Autism spectrum disorder, Cognitive assessment, Fragile X syndrome, Intellectual disability, IQ",
author = "Sansone, {Stephanie M.} and Andrea Schneider and Erika Bickel and Elizabeth Berry-Kravis and Christina Prescott and Hessl, {David R}",
year = "2014",
month = "7",
day = "8",
doi = "10.1186/1866-1955-6-16",
language = "English (US)",
volume = "6",
journal = "Journal of Neurodevelopmental Disorders",
issn = "1866-1947",
publisher = "Springer New York",
number = "1",

}

TY - JOUR

T1 - Improving IQ measurement in intellectual disabilities using true deviation from population norms

AU - Sansone, Stephanie M.

AU - Schneider, Andrea

AU - Bickel, Erika

AU - Berry-Kravis, Elizabeth

AU - Prescott, Christina

AU - Hessl, David R

PY - 2014/7/8

Y1 - 2014/7/8

N2 - Background: Intellectual disability (ID) is characterized by global cognitive deficits, yet the very IQ tests used to assess ID have limited range and precision in this population, especially for more impaired individuals. Methods: We describe the development and validation of a method of raw z-score transformation (based on general population norms) that ameliorates floor effects and improves the precision of IQ measurement in ID using the Stanford Binet 5 (SB5) in fragile X syndrome (FXS; n = 106), the leading inherited cause of ID, and in individuals with idiopathic autism spectrum disorder (ASD; n = 205). We compared the distributional characteristics and Q-Q plots from the standardized scores with the deviation z-scores. Additionally, we examined the relationship between both scoring methods and multiple criterion measures. Results: We found evidence that substantial and meaningful variation in cognitive ability on standardized IQ tests among individuals with ID is lost when converting raw scores to standardized scaled, index and IQ scores. Use of the deviation z- score method rectifies this problem, and accounts for significant additional variance in criterion validation measures, above and beyond the usual IQ scores. Additionally, individual and group-level cognitive strengths and weaknesses are recovered using deviation scores. Conclusion: Traditional methods for generating IQ scores in lower functioning individuals with ID are inaccurate and inadequate, leading to erroneously flat profiles. However assessment of cognitive abilities is substantially improved by measuring true deviation in performance from standardization sample norms. This work has important implications for standardized test development, clinical assessment, and research for which IQ is an important measure of interest in individuals with neurodevelopmental disorders and other forms of cognitive impairment.

AB - Background: Intellectual disability (ID) is characterized by global cognitive deficits, yet the very IQ tests used to assess ID have limited range and precision in this population, especially for more impaired individuals. Methods: We describe the development and validation of a method of raw z-score transformation (based on general population norms) that ameliorates floor effects and improves the precision of IQ measurement in ID using the Stanford Binet 5 (SB5) in fragile X syndrome (FXS; n = 106), the leading inherited cause of ID, and in individuals with idiopathic autism spectrum disorder (ASD; n = 205). We compared the distributional characteristics and Q-Q plots from the standardized scores with the deviation z-scores. Additionally, we examined the relationship between both scoring methods and multiple criterion measures. Results: We found evidence that substantial and meaningful variation in cognitive ability on standardized IQ tests among individuals with ID is lost when converting raw scores to standardized scaled, index and IQ scores. Use of the deviation z- score method rectifies this problem, and accounts for significant additional variance in criterion validation measures, above and beyond the usual IQ scores. Additionally, individual and group-level cognitive strengths and weaknesses are recovered using deviation scores. Conclusion: Traditional methods for generating IQ scores in lower functioning individuals with ID are inaccurate and inadequate, leading to erroneously flat profiles. However assessment of cognitive abilities is substantially improved by measuring true deviation in performance from standardization sample norms. This work has important implications for standardized test development, clinical assessment, and research for which IQ is an important measure of interest in individuals with neurodevelopmental disorders and other forms of cognitive impairment.

KW - Autism spectrum disorder

KW - Cognitive assessment

KW - Fragile X syndrome

KW - Intellectual disability

KW - IQ

UR - http://www.scopus.com/inward/record.url?scp=84960106700&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84960106700&partnerID=8YFLogxK

U2 - 10.1186/1866-1955-6-16

DO - 10.1186/1866-1955-6-16

M3 - Article

AN - SCOPUS:84960106700

VL - 6

JO - Journal of Neurodevelopmental Disorders

JF - Journal of Neurodevelopmental Disorders

SN - 1866-1947

IS - 1

M1 - 16

ER -