Improving Course Completion and Success Rates Easily:

Leverage Summative Assessment for Formative Purposes Robert E. Vaden-Goad, PhD Southern Connecticut State University Student Motivation Results Two Examples •Effectance motivation – a belief that the goal is achievable •Valuation – a belief that the goal

Over 1000 mathematics students were involved in a study in which two degrees of retesting (quiz/test/exam vs. test/exam) were used with vs. without the replacement method. Degrees of retesting made no real difference but the replacement method raised course averages by ten percentage points. Only 3.7 of these percentage points can be attributed to the curving effect of the method. Course completion rates went from 69% to 92% with the replacement method.

A. Three units tests and a comprehensive final exam: The final exam provides three scores corresponding to the three units. If the score from the exam is higher than the score from the test, the exam score replaces the test score and the result is used in

is worth achieving

computing course average.

•Affective Factors – enjoyment of the task itself

Source: Pintrich, Paul R., and Elisabeth V. de Groot. 1990. Motivational and self-regulated learning components of classroom academic performance.

Journal of Educational Psychology

82, (1) (03): 33-40.

A 2 x 2 analysis of variance design (Averaging Method X Testing Frequency) is utilized to explore the effects of the two independent variables on student achievement. To explore group differences in frequency with regard to student retention, Chi-Square analyses are used. ANOVA results for the overall model clearly support the contention that, together, testing replacement schemes and testing frequency are related to student achievement (

F

(3, 1107) = 64.30,

p

<.001). Looking more closely, there is a main effect for averaging methods ( testing frequency (

F F

(1, 1107) = 74.96,

p

<.001) but no real effect for (1, 1107) = 3.36,

ns).

Students’ average scores in replacement sections were 78.73 (SD = 12.39), whereas their average scores in non replacement sections were 68.60 (SD = 12.02), an effect size of 10.05. The effects of replacement schemes also were significant with regard to student retention (χ2 1 = 103.41, p<.001). B. Five quizzes, two tests and a final exam As above, portions of the final exam replace the unit tests if higher. In addition, unit tests (or the result of replacing tests with the exam) replace quizzes if higher. Course average is computed using the replaced scores.

Suggestions to Enhance the Effect

•To keep abler but cynical students on board, the method could be modified to, for instance, a 70% replacement. The explanation might be that the quiz would still count like a homework assignment or the test would count like a quiz.

•Students must be reminded of the replacement practice, for instance, when tests are returned or whenever they are reminded of their course standing.

•Colleagues and administrators must be reminded that the replacement method is not a curve. Instead, it is a more accurate assessment of student learning for the course since it is based at the time when grades are submitted. Critics should compare it to an ordinary curve, the use of “filler” items on tests, credit for attendance, credit for effort, etc.

•Administrators should be prepared to deal with students who feel cheated by having stayed in the course, ultimately to fail.

•Spreadsheets are easily programmed (“=max(T,F)” in Excel)

Why it works How it works Caveats Contact

Of the three factors in student motivation, The method requires that material be tested more valuation and affective factors receive a great deal than once. The method itself simply compares of attention from publishers and professors. However, students know that their potential grade is reduced with each point missed. Further, it is considered good practice to keep students scores on comparable material and, provided it is higher, uses the later score in place of the earlier one. In order to encourage long-term learning that will serve the student in future courses, early informed of their standing. The unintended consequence is that students gradually lose scores do not replace later scores For example, with three unit tests and a comprehensive final whatever belief they may have had in their exam, each unit test is compared with the potential for success. The method presented here interferes with that process.

corresponding part of the exam. Each student walks into the final with a potential “A” for the course.

•Some abler students may see this as an opportunity to reduce effort on early tests, setting themselves up for failure and the professor for criticism.

Robert E. Vaden-Goad Department of Mathematics Southern Connecticut State University •Students must eventually demonstrate course competency.

•Without reminders, the pattern of grades rather than the potential grade may be the biggest factor in effectance motivation. New Haven, CT 06515 203-392-5578 [email protected]

•Students who persist, but ultimately fail will have invested additional effort for (in their opinion) no reward. •Faculty colleagues may interpret the method as lowered standards.

•At-risk students will still be in class for course evaluation. Their disproportionate tendency toward externalizing may adversely affect the evaluation.