The European Educational Researcher

Predicting GPAs with Executive Functioning Assessed by Teachers and by Adolescents Themselves

William Ellery Samuels 1 * ,
Nelly Tournaki 1,
Stanley Sacks 2,
JoAnn Sacks 2,
Sheldon Blackman 3,
Kenneth Byalin 3,
Christopher Zilinski 3
1 The City University of New York2 National Development and Research Institutes3 John W. Lavelle Preparatory Charter School* Corresponding Author
Download PDF
The European Educational Researcher, Volume 2, Issue 3, 2019, pp. 173-194
OPEN ACCESS VIEWS: 1208 DOWNLOADS: 494 Publication date: 15 Oct 2019
ABSTRACT
Executive functions (EFs) show promise as important mediators of adolescent academic performance. However, the expense of measuring EFs accurately has restricted most field-based research on them to smaller, non-longitudinal studies of homogeneous populations with specific diagnoses. We therefore monitored the development of 259 diverse, at-risk students’ EFs as they progressed from 6th through 12th grade. Teachers completed the Behavior Rating Inventory of Executive Function (BRIEF) for a random subset of their students. At that same time, those same students completed the Behavior Rating Inventory of Executive Function-Self Report (BRIEF-SR) about themselves; teachers generally reported stronger EFs in students than students reported in themselves. Results further indicated that both BRIEF and BRIEF-SR Global Executive Composite (GEC) scores—measures of overall executive functioning—significantly predicted overall GPAs more than was already predicted by students’ gender, IEP status, and eligibility for free/reduced school lunch. BRIEF (teacher) scores were better predictors and contributed more to predictive accuracy than the BRIEF-SR (student) scores; BRIEF scores even added additional predictiveness to a model already containing BRIEF-SR scores, while the reverse did not hold. This study provides evidence for valid use of BRIEF and BRIEF-SR GEC scores to predict middle and high school GPAs, thereby supporting practitioners use for this purpose within similar, diverse, at-risk populations. The study also illuminates some of the EF development for this population during adolescence.
KEYWORDS
Academic performance, adolescence, Behavior Rating Inventory of Executive Function, executive function, GPA, longitudinal, validity
CITATION (APA)
Samuels, W. E., Tournaki, N., Sacks, S., Sacks, J., Blackman, S., Byalin, K., & Zilinski, C. (2019). Predicting GPAs with Executive Functioning Assessed by Teachers and by Adolescents Themselves. The European Educational Researcher, 2(3), 173-194. https://doi.org/10.31757/euer.232
REFERENCES
  1. Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101(2), 213 – 232. doi: 10.1037/0033-2909.101.2.213
  2. Ahmed, S. F., Tang, S., Waters, N. E., & Davis-Kean, P. (2018). Executive function and academic achievement: Longitudinal relations from early childhood to adolescence Journal of Educational Psychology, 13 pp. doi: 10.1037/edu0000296
  3. Alloway, T. P., Gathercole, S. E., Adams, A.-M., & Willis, C. (2005). Working memory abilities in children with special educational needs. Educational and Child Psychology, 22(4), 56 – 67.
  4. Andersson, U. (2008). Working memory as a predictor of written arithmetical skills in children: The importance of central executive functions. British Journal of Educational Psychology, 78, 181 – 204.
  5. Baron, I. S. (2000). Test review: Behavior rating inventory of executive function. Child Neuropsychology, 6(3), 235 – 238. doi:10.1076/chin.6.3.235.3152
  6. Bierman, K. L., Torres, M. M., Domitrovich, C. E., Welsh, J. A., & Gest, S. D. (2009). Behavioral and cognitive readiness for school: Cross-domain associations for children attending Head Start. Social Development, 18, 305 – 323.
  7. Berlin, L. & Bohlin, G. (2002). Response inhibition, hyperactivity, and conduct problems among preschool children. Journal of Clinical Child & Adolescent Psychology, 31, 242 – 251.
  8. Best, J. R. & Miller, P. H. (2010). A developmental perspective on executive function. Child Development, 81(6), 1641 – 1660. doi: 10.1111/j.1467-8624.2010.01499.x
  9. Best, J. R., Miller, P. H., & Naglieri, J. A. (2011). Relations between executive function and academic achievement from ages 5 to 17 in a large, representative national sample. Learning and Individual Differences, 21(4), 327 – 336. doi: 10.1016/j.lindif.2011.01.007
  10. Blair, C. & Raver, C. C. (2012). Individual development and evolution: Experiential canalization of self-regulation. Developmental Psychology, 48(3), 647 – 657. doi: 10.1037/a0026472
  11. Boschloo, A., Krabbendam, L., Aben, A., de Groot, R., & Jolles, J. (2014). Sorting Test, Tower Test, and BRIEF-SR do not predict school performance of healthy adolescents in preuniversity education. Frontiers in Psychology, 5, 1 – 8 doi: 10.3389/fpsyg.2014.00287
  12. Brock, K. C. & Bohlin, G. (2004). Executive functions in children aged 6 to 13: A dimensional and developmental study. Developmental Neuropsychology, 26(2), 571 – 593.
  13. Buckner, J. C., Mezzacappa, E., & Beardslee, W. R. (2003). Characteristics of resilient youths living in poverty: The role of self-regulatory processes. Development and Psychopathology, 15, 139 – 162.
  14. Carlson, S. M. (2005). Developmentally sensitive measures of executive function in preschool children. Developmental Neuropsychology, 28, 595 – 616.
  15. Carlson, S. M. & Moses, L. J. (2001). Individual differences in inhibitory control and children’s theory of mind. Child Development, 72, 1032 – 1053.
  16. Chevignard, M. P., Soo, C., Galvin, J., Catroppa, C., & Eren, S. (2012). Ecological assessment of cognitive functions in children with acquired brain injury: A systematic review. Brain Injury, 26(9), 1033 – 1057. doi: 10.3109/02699052.2012.666366
  17. Clark, C. A. C., Pritchard, V. E., & Woodward, L. J. (2010). Preschool executive functioning abilities predict early mathematics achievement. Developmental Psychology, 46(5), 1176 – 1191. doi: 10.1037/a0019672
  18. Conklin, H. M., Luciana, M., Hooper, C. J., & Yarger, R. S. (2007). Working memory performance in typically developing children and adolescents: Behavioral evidence of protracted frontal lobe development. Developmental Neuropsychology, 31(1), 103 – 128.
  19. Prince, A. P., Weinberg, K. M., & Combs, M. D. (2009). Executive function performance and trauma exposure in a community sample of children. Child Abuse & Neglect, 33, 353 – 361.
  20. Diamantopoulou, S., Rydell, A.-M., Thorell, L. B., & Bohlin, G. (2007). Impact of executive functioning and symptoms of attention deficit hyperactivity disorder on children's peer relations and school performance. Developmental Neuropsychology, 32(1), 521 – 542. doi: 10.1080/87565640701360981
  21. Diamond, A. & Lee, K. (2011). Interventions shown to aid executive function development in children 4 to 12 years old. Science, 333, 959 – 964. doi: 10.1126/science.1204529
  22. Dilworth-Bart, J. E. (2012). Does executive function mediate SES and home quality associations with academic readiness? Early Childhood Research Quarterly, 27, 416 – 425.
  23. Donders, J., Denbraber, D., & Nos, L. (2010). Construct and criterion validity of the Behaviour Rating Inventory of Executive Function (BRIEF) in children referred for neuropsychological assessment after paediatric traumatic brain injury. Journal of Neuropsychology, 4(2), 197 – 209. doi: 10.1348/174866409X478970
  24. Dunn, J. R. (2010). Health behavior vs the stress of low socioeconomic status and health outcomes. Journal of the American Medical Association, 303, 1199 – 1200.
  25. Dunning, D., Johnson, K., Ehrlinger, J., & Kruger, J. (2003). Why people fail to recognize their own incompetence. Current Directions in Psychological Science, 12(3), 83 – 87. doi: 10.1111/1467-8721.01235
  26. Garon, N., Bryson, S. E., & Smith, I. M. (2008). Executive function in preschoolers: A review and integrative framework. Psychological Bulletin, 134, 31 – 60.
  27. Geiser, S. & Santelices, M. V. (2007). Validity of high-school grades in predicting student success beyond the freshman year: High-school record vs. standardized tests as indicators of four-year college outcomes. Research & Occasional Paper Series: CSHE.6.07.
  28. Gelman, A., Hill, J., & Yajima, M. (2012). Why we (usually) don’t have to worry about multiple comparisons. Journal of Research on Educational Effectiveness, 5, 189 – 211.
  29. Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L., (2000). Behavior Rating Inventory of Executive Function: Professional manual. Lutz, Florida: Psychological Assessment Resources.
  30. Gioia, G. A., Isquith, P. K., Kenworthy, L., & Baron, R. M. (2002). Profiles of everyday executive function in acquired and developmental disorders. Child Neuropsychology, 8, 121 – 137.
  31. Gioia, G. A., Isquith, P. K., Retzlaff, P. D., & Espy, K. A. (2002). Confirmatory factor analysis of the Behavior Rating Inventory of Executive Function (BRIEF) in a clinical sample. Child Neuropsychology (Neuropsychology, Development and Cognition: Section C), 8(4), 249 – 257. doi: 10.1076/chin.8.4.249.13513
  32. Goldstein, S. (2001). Test review: Behavior rating inventory of executive function. Applied Neuropsychology, 8(4), 255 – 261. doi: 10.1207/S15324826AN0804_10
  33. Guy, S. C., Isquith, P. K., & Gioia, G. A., (2004). Behavior Rating Inventory of Executive Function—Self-Report version: Professional manual. Lutz, Florida: Psychological Assessment Resources.
  34. Hostinar, C. E., Stellern, S. A., Schaefer, C., Carlson, S. M., & Gunnar, M. R. (2012). Associations between early life adversity and executive function in children adopted internationally from orphanages. PNAS Proceedings of the National Academy of Sciences of the United States of America, 109, 17208 – 17212.
  35. Hughes, C. (2011). Changes and challenges in 20 years of research into the development of executive functions. Infant and Child Development, 20, 251 – 271
  36. Hughes, D. M., Turkstra, L. S., & Wulfeck, B. B. (2009). Parent and self-ratings of executive function in adolescents with specific language impairment. International Journal of Language & Communication Disorders, 44(6), 901 – 916.
  37. Isquith, P. K., Gioia, G. A., & Espy, K. A. (2004). Executive function in preschool children: Examination through everyday behavior. Developmental Neuropsychology, 26, 403 – 422.
  38. Isquith, P. K., Roth, R. M., & Gioia, G. (2013). Contribution of rating scales to the assessment of executive functions. Applied Neuropsychology: Child, 2(2), 125 – 132. doi: 10.1080/21622965.2013.748389
  39. Isquith, P. K., Roth, R. M., Kenworthy, L., & Gioia, G. (2014). Contribution of rating scales to
  40. intervention for executive dysfunction. Applied Neuropsychology: Child, 3(3) 197 – 204. doi:10.1080/21622965.2013.870014
  41. Jacob, R. & Parkinson, J. (2015). The potential for school-based interventions that target executive function to improve academic achievement: A review. Review of Educational Research, 85(4), 512 – 552. doi: 10.3102/0034654314561338
  42. Jansen, B. R. J., De Lange, E., & Van der Molen, M. J. (2013). Math practice and its influence on math skills and executive functions in adolescents with mild to borderline intellectual disability. Research in Developmental Disabilities: A Multidisciplinary Journal, 34(5), 1815 – 1824. doi: 10.1016/j.ridd.2013.02.022
  43. Kotsopoulos, D. & Lee, J. (2012).A naturalistic study of executive function and mathematical problem-solving. The Journal of Mathematical Behavior, 31, 196 – 208.
  44. Langberg, J. M., Dvorsky, M. R., & Evans, S. W. (2013). What specific facets of executive function are associated with academic functioning in youth with Attention-Deficit/Hyperactivity Disorder? Journal of Abnormal Child Psychology, 41(7), 1145 – 1159. doi: 10.1007/s10802-013-9750-z
  45. Lee, K., Ng, E. L., & Ng, S. F. (2009). The contributions of working memory and executive functioning to problem representation and solution generation in algebraic word problems. Journal of Educational Psychology, 101, 373 – 387. doi: 10.1037/a0013843.
  46. Lemberger, M. E. & Clemens, E. V. (2012). Disconnectedness and self-regulation as constructs of the student success skills program in inner-city African American elementary school students. Journal of Counseling & Development, 90, 450 – 458.
  47. Locascio, G., Mahone, E. M., Eason, S. H., & Cutting, L. E. (2010). Executive dysfunction among children with reading comprehension deficits. Journal of Learning Disabilities, 43(5), 441 – 454. doi: 10.1177/0022219409355476
  48. Lohmeier, J. H. & Raad, J. (2012). The predictive value of selection criteria in an urban magnet school. Urban Education, 47(3), 612 – 624. doi: 10.1177/0042085911434569
  49. Mahone, E., Cirino, P. T., Cutting, L. E., Cerrone, P. M., Hagelthorn, K. M., Hiemenz, J. R., Singer, H. S., & Denckla, M. B. (2002). Validity of the behavior rating inventory of executive function in children with ADHD and/or Tourette syndrome. Archives of Clinical Neuropsychology, 17(7), 643 – 662. doi: 10.1016/S0887-6177(01)00168-8
  50. McDermott, J. M., Westerly, A., Zephaniah, C. H., Nelson, C. A., & Fox, N. A. (2012). Early adversity and neural correlates of executive function: Implications for academic adjustment. Developmental Cognitive Pseudoscience, 2, S59 – S66.
  51. Monette, S., Bigras, M., & Guay, M.-C. (2011). The role of the executive functions in school achievement at the end of Grade 1. Journal of Experimental Child Psychology, 109, 158 – 173. doi: 10.1016/j.jecp.2011.01.008.
  52. Naglieri, J. A., & Das, J. P. (1997). Cognitive assessment system. Austin, TX: ProEd.
  53. Nunnally, J. C. & Bernstein, I. H., (1994). Psychometric theory. New York: McGraw-Hill.
  54. Perkins, S. & Graham-Bermann, S. (2012). Violence exposure and the development of school-related functioning: Mental health, neurocognition, and learning. Aggression & Violent Behavior, 17, 89 – 98.
  55. Pinheiro, J., Bates, D., Deb Roy, S. Sarkar, D., & R Development Core Team (2013). nlme:
  56. Linear and Nonlinear Mixed Effects Models. R package version 3.1 – 113.
  57. R Core Team (2013).R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, Retrieved from http://www.R-project.org/ on August 1, 2019.
  58. Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25(1), 111 – 163.
  59. Reddy, L. A., Hale, J. B., & Brodzinsky, L. K. (2011). Discriminant validity of the Behavior Rating Inventory of Executive Function Parent Form for children with attention-deficit/hyperactivity disorder. School Psychology Quarterly, 26(1), 45 – 55. doi: 10.1037/a0022585
  60. Revelle, W. (2014) psych: Procedures for Personality and Psychological Research. Evanston, Illinois Northwestern University. Retrieved from http://cran.r-project.org/web/packages/psych/ on August 1, 2019.
  61. Rosenthal, M., Wallace, G. L., Lawson, R., Wills, M. C., Dixon, E., Yerys, B. E., & Kenworthy, L. (2013). Impairments in real-world executive function increase from childhood to adolescence in autism spectrum disorders. Neuropsychology, 27(1), 13 – 18. doi: 10.1037/a0031299
  62. Roth, R. M., Erdodi, L. A., Mcculloch, L. J., & Isquith, P. K. (2015). Much ado about norming: The behavior rating inventory of executive function. Child Neuropsychology, 21(2), 225 – 233.
  63. Roth, R. M., Isquith, P. K., & Gioia, G. A. (2014). Assessment of executive functioning using the behavior rating inventory of executive function (BRIEF). In S. Goldstein & J. A. Naglieri (Eds.), Handbook of Executive Functioning (2nd ed., pp. 301 – 331). New York, NY: Springer
  64. Samuels, W. E., Tournaki, N., Blackman, S., & Zilinski, C. (2016). Executive functioning predicts academic achievement in middle school: A 4-year longitudinal study. The Journal of Educational Research, 109(5), 478 – 490. doi: 10.1080/00220671.2014.979913
  65. Schuchardt, K., Bockmann, A.-K., Bornemann, G., & Maehler, C. (2013). Working memory functioning in children with learning disorders and specific language impairment. Topics in Language Disorders, 33(4), 298 – 312. doi: 10.1097/0 l.TLD.0000437943-41140.36
  66. Semrud-Clikeman, M., Fine, J. G., & Bledsoe, J. (2014). Comparison among children with children with autism spectrum disorder, nonverbal learning disorder and typically developing children on measures of executive functioning. Journal of Autism and Developmental Disorders, 44(2), 331 – 342. doi: 10.1007/s10803-013-1871-2
  67. Singer, J. D. & Willet, J. B., (2003). Applied longitudinal data analysis: Modeling change and event occurrence. New York: Oxford University Press.
  68. St. Clair-Thompson, H. & Gathercole, S. E. (2006). Executive functions and achievements in school: Shifting, updating, inhibition, and working memory. Quarterly Journal of Experimental Psychology, 59, 745 – 759.
  69. Strauss, E., Sherman, E. M. S., & Spreen, O. (2006). A compendium of neuropsychological tests (3rd ed.). New York, NY: Oxford University Press.
  70. Toplak, M. E., Bucciarelli, S. M., Jain, U., & Tannock, R. (2008). Executive functions: Performance-based measures and the Behavior Rating Inventory of Executive Function (BRIEF) in adolescents with attention-deficit/hyperactivity disorder. Child Neuropsychology, 15(1), 53 – 72. doi: 10.1080/09297040802070929
  71. Vriezen, E. R. & Pigott, S. E. (2002). The relationship between parental report on the BRIEF and performance-based measures of executive function in children with moderate to severe traumatic brain injury. Child Neuropsychology, 8(4), 296 – 303.
  72. Vuontela, V., Carlson, S., Troberg, A.-M., Fontell, T., Simola, P., Saarinen, S., & Aronen, E. T. (2013). Working memory, attention, inhibition, and their relation to adaptive functioning and behavioral/emotional symptoms in school-aged children. Child Psychiatry and Human Development, 44(1), 105 – 122. doi: 10.1007/s10578-012-0313-2
  73. Waber, D. P., Gerber, E. B., Turcios, V. Y., Wagner, E. R., & Forbes, P. W. (2006). Executive functions and performance on high-stakes testing in children from urban schools. Developmental Neuropsychology, 29(3), 459 – 477. doi: 10.1037/t15174-000
  74. Welsh, M., Pennington, B., & Groisser, D. (1991). A normative-developmental study of executive function: A window on prefrontal function in children. Developmental Neuropsychology, 7, 131 – 149.
  75. Wentzel, K. R. (1993). Does being good make the grade? Social behavior and academic competence in middle school. Journal of Educational Psychology, 85(2), 357 – 64.
  76. Wichstrøm, L. (1995). Harter's Self-Perception Profile for Adolescents: Reliability, Validity, and Evaluation of the Question Format. Journal of Personality Assessment, 65(1), 100.
  77. Wilson, K. R., Donders, J., & Nguyen, L. (2011). Self and parent ratings of executive functioning after adolescent traumatic brain injury. Rehabilitation Psychology, 56(2), 100-106. doi: 10.1037/a0023446
  78. Zelazo, P. D., Muller, U., Frye, D., & Marcovitch, S. (2003). The development of executive function in early childhood. Monographs of the Society for Research in Child Development, 68, (Serial No. 274).
LICENSE
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.