TY - JOUR
T1 - Measuring the impact of an individual course on Students' success
AU - Mesa, Vilma
AU - Jaquette, Ozan
AU - Finelli, Cynthia J.
PY - 2009
Y1 - 2009
N2 - BACKGROUND: At the University of Michigan, qualified first-year students who place out of the first-semester calculus course may enroll in either the regular secondsemester calculus course or Applied Honors Calculus II. Students who enroll in Applied Honors Calculus II show higher academic performance than students enrolling in the Regular Calculus II. PURPOSE (HYPOTHESIS): The study addressed the question: does enrollment in Applied Honors Calculus II have a positive causal impact on subsequent academic performance for engineering students at the University of Michigan? DESIGN/METHOD: We acquired seven years of institutional data for engineering students who entered the University of Michigan from 1996 through 2003 and who qualified to enroll in Applied Honors Calculus II. Using regression analyses, we tested a causal model of impact of Applied Honors Calculus II on four measures of subsequent academic performance: grade in Physics II and average grade in all subsequent physics, mathematics, and engineering courses. RESULTS: After controlling for students' personal characteristics and prior academic achievement, the impact of Applied Honors Calculus II on students' academic performance was not statistically significant. In particular Advanced Placement scores accounted for the higher performance observed in Applied Honors Calculus II students. CONCLUSIONS: We recommend including Advanced Placement scores in models that predict academic performance. Future research should also include measures of socioeconomic status (SES) and explore interactions between SES and academic background. Finally, in evaluations of specific curricula, the treatment effect-measured as treatment group mean minus control group mean, after controlling for covariates-is unlikely to be large if the control group receives high quality instruction.
AB - BACKGROUND: At the University of Michigan, qualified first-year students who place out of the first-semester calculus course may enroll in either the regular secondsemester calculus course or Applied Honors Calculus II. Students who enroll in Applied Honors Calculus II show higher academic performance than students enrolling in the Regular Calculus II. PURPOSE (HYPOTHESIS): The study addressed the question: does enrollment in Applied Honors Calculus II have a positive causal impact on subsequent academic performance for engineering students at the University of Michigan? DESIGN/METHOD: We acquired seven years of institutional data for engineering students who entered the University of Michigan from 1996 through 2003 and who qualified to enroll in Applied Honors Calculus II. Using regression analyses, we tested a causal model of impact of Applied Honors Calculus II on four measures of subsequent academic performance: grade in Physics II and average grade in all subsequent physics, mathematics, and engineering courses. RESULTS: After controlling for students' personal characteristics and prior academic achievement, the impact of Applied Honors Calculus II on students' academic performance was not statistically significant. In particular Advanced Placement scores accounted for the higher performance observed in Applied Honors Calculus II students. CONCLUSIONS: We recommend including Advanced Placement scores in models that predict academic performance. Future research should also include measures of socioeconomic status (SES) and explore interactions between SES and academic background. Finally, in evaluations of specific curricula, the treatment effect-measured as treatment group mean minus control group mean, after controlling for covariates-is unlikely to be large if the control group receives high quality instruction.
KW - Academic performance
KW - Advanced placement
KW - Course impact
UR - http://www.scopus.com/inward/record.url?scp=70350627391&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=70350627391&partnerID=8YFLogxK
U2 - 10.1002/j.2168-9830.2009.tb01032.x
DO - 10.1002/j.2168-9830.2009.tb01032.x
M3 - Article
AN - SCOPUS:70350627391
SN - 1069-4730
VL - 98
SP - 349
EP - 359
JO - Journal of Engineering Education
JF - Journal of Engineering Education
IS - 4
ER -