TY - JOUR
T1 - Evidence for the interpretation of Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) scores
T2 - An argument-based approach to screener validation
AU - Kilgus, Stephen P.
AU - Bonifay, Wes E.
AU - von der Embse, Nathaniel P.
AU - Allen, Amanda N.
AU - Eklund, Katie
N1 - Funding Information:
Note: This project was funded through a University of Missouri Alumni Association , Richard Wallace Faculty Incentive Grant. The first and second authors have a financial conflict of interest due to receipt of royalties on net sales for one of the measures discussed.
Publisher Copyright:
© 2018 Society for the Study of School Psychology
PY - 2018/6
Y1 - 2018/6
N2 - In accordance with an argument-based approach to validation, the purpose of the current study was to yield evidence relating to Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) score interpretation. Bifactor item response theory analyses were performed to examine SAEBRS item functioning. Structural equation modeling (SEM) was used to simultaneously evaluate intra- and inter-scale relationships, expressed through (a) a measurement model specifying a bifactor structure to SAEBRS items, and (b) a structural model specifying convergent and discriminant relations with an outcome measure (i.e., Behavioral and Emotional Screening System [BESS]). Finally, hierarchical omega coefficients were calculated in evaluating the model-based internal reliability of each SAEBRS scale. IRT analyses supported the adequate fit of the bifactor model, indicating items adequately discriminated moderate and high-risk students. SEM results further supported the fit of the latent bifactor measurement model, yielding superior fit relative to alternative models (i.e., unidimensional and correlated factors). SEM analyses also indicated the latent SAEBRS-Total Behavior factor was a statistically significant predictor of all BESS subscales, the SAEBRS-Academic Behavior predicted BESS Adaptive Skills subscales, and the SAEBRS-Emotional Behavior predicted the BESS Internalizing Problems subscale. Hierarchical omega coefficients indicated the SAEBRS-Total Behavior factor was associated with adequate reliability. In contrast, after accounting for the total scale, each of the SAEBRS subscales was associated with somewhat limited reliability, suggesting variability in these scores is largely driven by the Total Behavior scale. Implications for practice and future research are discussed.
AB - In accordance with an argument-based approach to validation, the purpose of the current study was to yield evidence relating to Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) score interpretation. Bifactor item response theory analyses were performed to examine SAEBRS item functioning. Structural equation modeling (SEM) was used to simultaneously evaluate intra- and inter-scale relationships, expressed through (a) a measurement model specifying a bifactor structure to SAEBRS items, and (b) a structural model specifying convergent and discriminant relations with an outcome measure (i.e., Behavioral and Emotional Screening System [BESS]). Finally, hierarchical omega coefficients were calculated in evaluating the model-based internal reliability of each SAEBRS scale. IRT analyses supported the adequate fit of the bifactor model, indicating items adequately discriminated moderate and high-risk students. SEM results further supported the fit of the latent bifactor measurement model, yielding superior fit relative to alternative models (i.e., unidimensional and correlated factors). SEM analyses also indicated the latent SAEBRS-Total Behavior factor was a statistically significant predictor of all BESS subscales, the SAEBRS-Academic Behavior predicted BESS Adaptive Skills subscales, and the SAEBRS-Emotional Behavior predicted the BESS Internalizing Problems subscale. Hierarchical omega coefficients indicated the SAEBRS-Total Behavior factor was associated with adequate reliability. In contrast, after accounting for the total scale, each of the SAEBRS subscales was associated with somewhat limited reliability, suggesting variability in these scores is largely driven by the Total Behavior scale. Implications for practice and future research are discussed.
KW - Behavior assessment
KW - Item response theory
KW - Structural equation modeling
KW - Universal screening
UR - http://www.scopus.com/inward/record.url?scp=85044039271&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85044039271&partnerID=8YFLogxK
U2 - 10.1016/j.jsp.2018.03.002
DO - 10.1016/j.jsp.2018.03.002
M3 - Article
AN - SCOPUS:85044039271
SN - 0022-4405
VL - 68
SP - 129
EP - 141
JO - Journal of School Psychology
JF - Journal of School Psychology
ER -