Citation

Miller FG, Johnson AH, Yu H, Chafouleas SM, McCoach DB, Riley-Tillman TC, Fabiano GA, Welsh ME. J. Sch. Psychol. 2018; 68: 53-72.

Affiliation

University of California - Davis, United States.

Copyright

(Copyright © 2018, Society for the Study of School Psychology, Publisher Elsevier Publishing)

DOI

10.1016/j.jsp.2018.01.002

PMID

29861031

Abstract

Reliable and valid data form the foundation for evidence-based practices, yet surprisingly few studies on school-based behavioral assessments have been conducted which implemented one of the most fundamental approaches to construct validation, the multitrait-multimethod matrix (MTMM). To this end, the current study examined the reliability and validity of data derived from three commonly utilized school-based behavioral assessment methods: Direct Behavior Rating - Single Item Scales, systematic direct observations, and behavior rating scales on three common constructs of interest: academically engaged, disruptive, and respectful behavior. Further, this study included data from different sources including student self-report, teacher report, and external observers. A total of 831 students in grades 3-8 and 129 teachers served as participants. Data were analyzed using bivariate correlations of the MTMM, as well as single and multi-level structural equation modeling.

RESULTS suggested the presence of strong methods effects for all the assessment methods utilized, as well as significant relations between constructs of interest. Implications for practice and future research are discussed.

Copyright © 2018 Society for the Study of School Psychology. Published by Elsevier Ltd. All rights reserved.

Language: en

Keywords

Assessment; Behavior; Direct Behavior Rating; MTMM; Rating scales; Systematic direct observation; Validity