Transcript Preliminary Analysis of Pre - Post Test Data

A Longitudinal Study of
Students’ Basic Skills
Barbara Perushek, Ph.D.
Cloquet Senior High School
[email protected]
218-879-3393, ext. 3102
Daniel Naslund
Cloquet Senior High School
[email protected]
218-879-3393, ext. 4102
William Fleischman, Ph.D.
University of Minnesota, Duluth
[email protected]
218-726-7557
Project Background
--Instituted as part of Communication Department Goals
--Developed a collaborative research partnership with University of
Minnesota Duluth Professor William Fleischman
--Received a grant from UMD’s Center for Community and
Regional Research
Project Goals
--Measure students’ knowledge of standard formal English
--Provide a measure of student progress over academic years
--Provide a tool to assess curricula and teaching strategies
Methodology
--Pre and Post Tests given each September and May
--100-question test (adapted from English Simplified, l999), designed
to measure basic skills including
--grammar
--punctuation
--mechanics
--spelling
--usage
--Computer-based analysis system provides for “feedback sheets” for
each teacher/each class
Sentence Error Scores - Cohort One
from 10th-12th Grade (Grad 2002)
10
Mean Scores Correct
9
8
6.97
6.95
1999 Pretest
2000 Post Test
7.48
7.6
2001 Post Test
2002 Post Test
7
6
5
4
3
2
1
0
Subject/Verb/Pronoun Agreement Cohort One from 10th-12th Grade (Grad 2002)
15
14
Mean Score Correct
13
12
11
10
9
8
7
6.03
6.27
1999 Pretest
2000 Post Test
6.53
6.75
2001 Post Test
2002 Post Test
6
5
4
3
2
1
0
Punctuation Errors - Cohort One
from 10th-12th Grade (Grad 2002)
24
Mean Score Correct
22
20
18
16
16.04
16.29
16.61
15.73
1999 Pretest
2000 Post Test
2001 Post Test
2002 Post Test
14
12
10
8
6
4
2
0
Mechanics Scores - Cohort One from 10th12th grade (Grad 2002) test
15
14
Mean Score Correct
13
12
11
10.88
10.81
10.99
10.81
1999 Pretest
2000 Post Test
2001 Post Test
2002 Post Test
10
9
8
7
6
5
4
3
2
1
0
Number Agreement Scores - Cohort One
from 10th-12th Grade (Grad 2002)
5
Mean Score Correct
4.5
4
3.5
3.09
3
2.78
2.84
2.9
1999 Pretest
2000 Post Test
2001 Post Test
2.5
2
1.5
1
0.5
0
2002 Post Test
Spelling Scores - Cohort One
from 10th-12th Grade (Grad 2002)
15
14
Mean Score Correct
13
12
11
10
9.03
9.4
9.88
9.92
2001 Post Test
2002 Post Test
9
8
7
6
5
4
3
2
1
0
1999 Pretest
2000 Post Test
Usage Scores - Cohort One
from 10th-12th Grade (Grad 2002)
15
14
Mean Score Correct
13
12
11
10
9
8.56
9.58
9.78
2001 Post Test
2002 Post Test
9.01
8
7
6
5
4
3
2
1
0
1999 Pretest
2000 Post Test
Grand Total Scores - Cohort One
from 10th-12th Grade (Grad 2002)
100
Mean Score Correct
90
80
70
59.92
61.17
1999 Pretest
2000 Post Test
63.65
64.56
2001 Post Test
2002 Post Test
60
50
40
30
20
10
0
Sentence Error Scores - Cohort Two
from 9th-11th Grade (Grad 2003)
10.0
Mean Score Correct
9.0
8.0
7.68
7.83
2001 P o st T est
2002 P o st T est
7.37
6.8
7.0
6.0
5.0
4.0
3.0
2.0
1.0
0.0
1999 P retest
2000 P o st T est
Subject/Verb/Pronoun Agreement Scores - Cohort
Two from 9th-11th Grade (Grad 2003)
15
14
Mean Score Correct
13
12
11
10
9
8
7
7
7.27
7.33
2001 P o st T est
2002 P o st T est
5.94
6
5
4
3
2
1
0
1999 P retest
2000 P o st T est
Punctuation Scores - Cohort Two
from 9th-11th Grade (Grad 2003)
24
Mean Score Correct
22
20
18
16
16.08
16.35
16.44
2000 P o st T est
2001 P o st T est
2002 P o st T est
14.96
14
12
10
8
6
4
2
0
1999 P retest
Mechanics Scores - Cohort Two
from 9th-11th Grade (Grad 2003)
15
14
Mean Score Correct
13
12
10.65
10.73
10.9
10.88
1999 P retest
2000 P o st T est
2001 P o st T est
2002 P o st T est
11
10
9
8
7
6
5
4
3
2
1
0
Number Agreement Scores - Cohort Two
from 9th-11th Grade (Grad 2003)
5
Mean Score Correct
4.5
4
3.5
3.04
3.15
3.09
2001 P o st T est
2002 P o st T est
3
2.5
2.36
2
1.5
1
0.5
0
1999 P retest
2000 P o st T est
Spelling Scores - Cohort Two
from 9th-11th Grade (Grad 2003)
15
14
Mean Score Correct
13
12
11
10
10.06
10.31
9.5
8.94
9
8
7
6
5
4
3
2
1
0
1999 P retest
2000 P o st T est
2001 P o st T est
2002 P o st T est
Usage Scores - Cohort Two
from 9th-11th Grade (Grad 2003)
15
14
13
Mean Score correct
12
11
9
9.97
9.85
2001 P o st T est
2002 P o st T est
9.53
10
8.27
8
7
6
5
4
3
2
1
0
1999 P retest
2000 P o st T est
Grand Total Scores - Cohort Two
from 9th-11th Grade (Grad 2003)
100
Mean Score Correct
90
80
70
63.13
65.37
65.73
2001 P o st T est
2002 P o st T est
57.91
60
50
40
30
20
10
0
1999 P retest
2000 P o st T est
Sentence Error Scores - Cohort Three
from 9th-10th Grade (Grad 2004)
10
Mean Score Corrrect
9
8
7.46
7.03
7
6.71
6
5
4
3
2
1
0
2000 Pretest
2001 Post Test
2002 Post Test
Subject/Verb/Pronoun Agreement Cohort Three from 9th-10th Grade (Grad 2004)
15
14
Mean Score Correct
13
12
11
10
9
8
7
6
6.68
6.84
2001 Post Test
2002 Post Test
5.7
5
4
3
2
1
0
2000 Pretest
Punctuation Scores - Cohort Three
from 9th-10th Grade (Grad 2004)
24
Mean Score Correct
22
20
18
16
15.95
15.55
2001 Post Test
2002 Post Test
15.09
14
12
10
8
6
4
2
0
2000 Pretest
Mechanics Scores - Cohort Three
from 9th-10th Grade (Grad 2004)
15
14
Mean Score Correct
13
12
11
11.12
11.14
2001 Post Test
2002 Post Test
10.6
10
9
8
7
6
5
4
3
2
1
0
2000 Pretest
Number Agreement Scores - Cohort Three from 9th-10th
Grade (Grad 2004)
5
Mean Score Correct
4.5
4
3.5
3.03
3
2.5
2.8
2.35
2
1.5
1
0.5
0
2000 Pretest
2001 Post Test
2002 Post Test
Spelling Scores - Cohort Three
from 9th-10th Grade (Grad 2004)
15
14
Mean Score Correct
13
12
11
10
9
9.34
9.48
2001 Post Test
2002 Post Test
9
8
7
6
5
4
3
2
1
0
2000 Pretest
Usage Scores - Cohort Three
from 9th-10th Grade (Grad 2004)
15
14
13
Mean Score Correct
12
11
10
9
9.02
9.06
2001 Post Test
2002 Post Test
8.31
8
7
6
5
4
3
2
1
0
2000 Pretest
Grand Total Scores - Cohort Three
from 9th-10th Grades (Grad 2004)
100
Mean Score Correct
90
80
70
60
62.17
62.34
2001 Post Test
2002 Post Test
57.76
50
40
30
20
10
0
2000 Pretest
Implications
--Measure students’ progress over academic years
--Identify specific strengths/weaknesses in individual
student performance
--Assessments used to evaluate the effectiveness of
department curricula and teaching strategies