Psychometric defensibility of the Intervention Selection Profile-Social Skills (ISP-SS) with students at risk for behavioral concerns

Stephen P. Kilgus; Katie Eklund; Nathaniel P. von der Embse

doi:10.1002/pits.22214

Psychometric defensibility of the Intervention Selection Profile-Social Skills (ISP-SS) with students at risk for behavioral concerns

Stephen P. Kilgus, Katie Eklund, Nathaniel P. von der Embse

Disability and Psychoeducation Studies

Research output: Contribution to journal › Article › peer-review

1 Scopus citations

Abstract

The purpose of the current study was to examine the validity and diagnostic accuracy of the Intervention Selection Profile—Social Skills (ISP-SS), a brief social skills assessment tool intended for use with students in need of Tier 2 intervention. Participants included 160 elementary and middle school students who had been identified through universal screening as at risk for behavioral concerns. Teacher participants (n = 71) rated each of these students using both the ISP-SS and the Social Skills Improvement System—Rating Scales (SSiS-RS), with the latter measure serving as the criterion within validity and diagnostic accuracy analyses. Confirmatory factor analysis supported ISP-SS structural validity, indicating ISP-SS items broadly conformed to a single “Social Skills” factor. Follow-up analyses suggested ISP-SS broad scale scores demonstrated adequate internal consistency reliability, with hierarchical omega coefficient equal to 0.86. Correlational analyses supported the concurrent validity of ISP-SS items, finding each ISP-SS item to be moderately or highly related to its corresponding SSiS-RS subscale. Finally, analyses indicated three of the seven ISP-SS items that demonstrated sufficient diagnostic accuracy; however, findings suggest additional revisions are needed if the ISP-SS is to be appropriate for use in schools. Implications for practice and future research are discussed.

Original language	English (US)
Pages (from-to)	526-538
Number of pages	13
Journal	Psychology in the Schools
Volume	56
Issue number	4
DOIs	https://doi.org/10.1002/pits.22214
State	Published - Apr 2019

Keywords

Tier 2
brief behavior rating scales
social skills assessment
social skills training

ASJC Scopus subject areas

Education
Developmental and Educational Psychology

Access to Document

10.1002/pits.22214

Cite this

@article{c4a886b7dcba4f24a5b677a8ec93ec63,

title = "Psychometric defensibility of the Intervention Selection Profile-Social Skills (ISP-SS) with students at risk for behavioral concerns",

abstract = "The purpose of the current study was to examine the validity and diagnostic accuracy of the Intervention Selection Profile—Social Skills (ISP-SS), a brief social skills assessment tool intended for use with students in need of Tier 2 intervention. Participants included 160 elementary and middle school students who had been identified through universal screening as at risk for behavioral concerns. Teacher participants (n = 71) rated each of these students using both the ISP-SS and the Social Skills Improvement System—Rating Scales (SSiS-RS), with the latter measure serving as the criterion within validity and diagnostic accuracy analyses. Confirmatory factor analysis supported ISP-SS structural validity, indicating ISP-SS items broadly conformed to a single “Social Skills” factor. Follow-up analyses suggested ISP-SS broad scale scores demonstrated adequate internal consistency reliability, with hierarchical omega coefficient equal to 0.86. Correlational analyses supported the concurrent validity of ISP-SS items, finding each ISP-SS item to be moderately or highly related to its corresponding SSiS-RS subscale. Finally, analyses indicated three of the seven ISP-SS items that demonstrated sufficient diagnostic accuracy; however, findings suggest additional revisions are needed if the ISP-SS is to be appropriate for use in schools. Implications for practice and future research are discussed.",

keywords = "Tier 2, brief behavior rating scales, social skills assessment, social skills training",

author = "Kilgus, {Stephen P.} and Katie Eklund and {von der Embse}, {Nathaniel P.}",

note = "Funding Information: The primary goal of the current study was to support continued validation of the ISP-SS, while also improving upon shortcomings of prior research. Most notably, the current study considered ISP-SS performance within a sample of students who are at risk for behavioral concerns, thus yielding a more accurate estimate of ISP-SS psychometric defensibility within its intended applied context. Taken together, CFA and reliability findings supported the structural validity of the ISP-SS, suggesting ISP-SS items might be reasonably interpreted as indicators of a single Social Skills factor. ISP-SS validity was further supported by correlational findings, which indicated ISP-SS items were correlated with their corresponding SSiS-RS subscale to a predominantly medium or large and statistically significant (p < 0.001) degree. Publisher Copyright: {\textcopyright} 2018 Wiley Periodicals, Inc.",

year = "2019",

month = apr,

doi = "10.1002/pits.22214",

language = "English (US)",

volume = "56",

pages = "526--538",

journal = "Psychology in the Schools",

issn = "0033-3085",

publisher = "Wiley-Liss Inc.",

number = "4",

}

TY - JOUR

T1 - Psychometric defensibility of the Intervention Selection Profile-Social Skills (ISP-SS) with students at risk for behavioral concerns

AU - Kilgus, Stephen P.

AU - Eklund, Katie

AU - von der Embse, Nathaniel P.

N1 - Funding Information: The primary goal of the current study was to support continued validation of the ISP-SS, while also improving upon shortcomings of prior research. Most notably, the current study considered ISP-SS performance within a sample of students who are at risk for behavioral concerns, thus yielding a more accurate estimate of ISP-SS psychometric defensibility within its intended applied context. Taken together, CFA and reliability findings supported the structural validity of the ISP-SS, suggesting ISP-SS items might be reasonably interpreted as indicators of a single Social Skills factor. ISP-SS validity was further supported by correlational findings, which indicated ISP-SS items were correlated with their corresponding SSiS-RS subscale to a predominantly medium or large and statistically significant (p < 0.001) degree. Publisher Copyright: © 2018 Wiley Periodicals, Inc.

PY - 2019/4

Y1 - 2019/4

N2 - The purpose of the current study was to examine the validity and diagnostic accuracy of the Intervention Selection Profile—Social Skills (ISP-SS), a brief social skills assessment tool intended for use with students in need of Tier 2 intervention. Participants included 160 elementary and middle school students who had been identified through universal screening as at risk for behavioral concerns. Teacher participants (n = 71) rated each of these students using both the ISP-SS and the Social Skills Improvement System—Rating Scales (SSiS-RS), with the latter measure serving as the criterion within validity and diagnostic accuracy analyses. Confirmatory factor analysis supported ISP-SS structural validity, indicating ISP-SS items broadly conformed to a single “Social Skills” factor. Follow-up analyses suggested ISP-SS broad scale scores demonstrated adequate internal consistency reliability, with hierarchical omega coefficient equal to 0.86. Correlational analyses supported the concurrent validity of ISP-SS items, finding each ISP-SS item to be moderately or highly related to its corresponding SSiS-RS subscale. Finally, analyses indicated three of the seven ISP-SS items that demonstrated sufficient diagnostic accuracy; however, findings suggest additional revisions are needed if the ISP-SS is to be appropriate for use in schools. Implications for practice and future research are discussed.

AB - The purpose of the current study was to examine the validity and diagnostic accuracy of the Intervention Selection Profile—Social Skills (ISP-SS), a brief social skills assessment tool intended for use with students in need of Tier 2 intervention. Participants included 160 elementary and middle school students who had been identified through universal screening as at risk for behavioral concerns. Teacher participants (n = 71) rated each of these students using both the ISP-SS and the Social Skills Improvement System—Rating Scales (SSiS-RS), with the latter measure serving as the criterion within validity and diagnostic accuracy analyses. Confirmatory factor analysis supported ISP-SS structural validity, indicating ISP-SS items broadly conformed to a single “Social Skills” factor. Follow-up analyses suggested ISP-SS broad scale scores demonstrated adequate internal consistency reliability, with hierarchical omega coefficient equal to 0.86. Correlational analyses supported the concurrent validity of ISP-SS items, finding each ISP-SS item to be moderately or highly related to its corresponding SSiS-RS subscale. Finally, analyses indicated three of the seven ISP-SS items that demonstrated sufficient diagnostic accuracy; however, findings suggest additional revisions are needed if the ISP-SS is to be appropriate for use in schools. Implications for practice and future research are discussed.

KW - Tier 2

KW - brief behavior rating scales

KW - social skills assessment

KW - social skills training

UR - http://www.scopus.com/inward/record.url?scp=85057801857&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057801857&partnerID=8YFLogxK

U2 - 10.1002/pits.22214

DO - 10.1002/pits.22214

M3 - Article

AN - SCOPUS:85057801857

SN - 0033-3085

VL - 56

SP - 526

EP - 538

JO - Psychology in the Schools

JF - Psychology in the Schools

IS - 4

ER -

Psychometric defensibility of the Intervention Selection Profile-Social Skills (ISP-SS) with students at risk for behavioral concerns

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this