Transcript Slide 1

Peter Hendry: CEM Consultant
Interpreting Feedback from Baseline Tests Whole School & Individual Student Data
Course: CEM Information Systems
for Beginners and New Users
Day 1 Session 2
Wednesday 17th October 2012
[email protected]
‘The goal is to transform
data into information, and
information into insight’
‘Everything should be
made as simple as
possible but not simpler’
‘Carly Fiorina’
Albert Einstein
Ex-president and Chair of
Hewlett-Packard
A well known person
Bands, percentiles, standardised scores…
C B
A
D
0
50
60
70
80
90
100
110
120
130
140
Standardised scores
Percentiles:
1
5
10
20
30 40 50 60 70
80
90
95
99
150
National Quartile Ability Bands
BANDS
BASELINE
D
C
B
A
ALIS: AV GCSE
<5.0
5.0-5.7
5.7-6.55
>6.55
Yellis %
>43
43-52
52-61
>61
STANDARDISED CABT
MidYIS, Yellis and Alis
<90
90-100
100-110
>110
IN ANY COHORT, 25% OF THE POPULATION WILL BE IN EACH BAND.
THE VALUES MAY VARY SLIGHTLY FROM YEAR TO YEAR
Alis: year 12 students, two baseline profiles
for the same school
Nationally, 25% in each band
Band Profile Graph: all MidYIS cohort
A school with a ‘completely average’ intake would
have 25% of pupils within each band.
Band D
Checking this graph each year will give you an
immediate overview of your intake.
Band A
Vocabulary: Percent in each Band
Year 7 MidYIS Test 2011/2012
100
90
90
80
80
70
70
60
60
Percent
Percent
100
50
37
40
20
25
35
26
30
20
17
21
20
10
17
10
0
0
D
C
B
A
Band D
D
Band A
90
80
80
70
70
60
60
Percent
90
40
33
35
30
A
Band A
50
40
30
29
21
20
B
Skills: Percent in each Band
Year 7 MidYIS Test 2011/2012
100
50
C
Band D
Non-Verbal: Percent in each Band
Year 7 MidYIS Test 2011/2012
100
Percent
50
40
30
Maths: Percent in each Band
Year 7 MidYIS Test 2011/2012
24
26
21
20
11
10
10
0
0
D
C
B
A
D
Comments?
C
B
A
Proof Reading: Percent in each Band
Year 7 MidYIS Test 2011/2012
100
90
80
70
Percent
60
Skills: Percent in each Band
Year 7 MidYIS Test 2011/2012
100
50
40
38
26
30
19
90
20
17
80
10
70
0
D
40
30
100
29
24
26
21
C
B
A
Perceptual Speed & Accuracy: Percent in each Band
Year 7 MidYIS Test 2011/2012
50
90
20
80
10
70
0
D
C
B
A
60
Percent
Percent
60
50
40
30
30
24
23
23
D
C
B
20
10
0
A
Scores Standardised On A Nationally Representative Sample of Schools
Standardised Scores
Sort Data By...
Mean Score: 100
Standard Deviation: 15
Average
100.6
95.9
105.3
99.2
98.1
St. error
1.1
1.1
1.1
1.1
1.1
Band
St. Score
MidYIS Score
Band
St. Score
Skills
Band
St. Score
Non Verbal
Band
Maths
St. Score
Band
St. Score
Vocabulary
On another day, with 95% certainty, the score of 100.6 (+/- 1.1 x 2)
• would not be higher than 100.6 + 2.2 = 102.8
• would not be lower than 100.6 – 2.2 = 98.4
100.6
95.9
105.3
99.2
98.1
93.7
102.2
1.1
1.1
1.1
1.1
1.1
1.1
1.1
134
95
99
93
116
93
92
102
A
C
C
C
A
C
C
B
119
97
104
94
99
95
83
102
A
C
B
C
C
C
D
B
116
88
112
120
118
120
112
112
A
D
A
A
A
A
A
A
87
85
110
91
84
113
94
108
D
D
B
C
D
A
C
B
130
95
101
93
109
93
87
102
A
C
B
C
B
C
D
B
101
76
97
80
102
119
80
106
B
D
C
D
B
A
D
B
83
93
114
99
78
107
102
107
Band
St. Score
Band
Proof Reading PSA
St. Score
Band
St. Score
MidYIS Score
Band
St. Score
Skills
Band
St. Score
Non Verbal
Band
Maths
St. Score
Band
St. Score
Vocabulary
D
C
A
C
D
B
B
B
Using national baseline test scores to
Identify Gifted Pupils
 Scores over 130 – top 2% nationally
 Scores over 126 – top 5% nationally
 Scores over 120 – top 10% nationally
 Scores over 110 – top 25% nationally
Year 7: the ‘top’ students
105.3
99.2
98.1
1.1
1.1
1.1
1.1
1.1
150
122
134
120
127
117
117
125
A
A
A
A
A
A
A
A
150
132
119
123
113
121
120
111
A
A
A
A
A
A
A
A
142
130
116
110
122
116
120
114
A
A
A
B
A
A
A
A
150
150
87
132
95
109
128
100
A
A
D
A
C
B
A
B
150
130
130
123
123
121
120
120
Perceptual speed
and accuracy
95.9
Proof reading
100.6
Band
St. Score
MidYIS Score
Band
St. Score
Skills
Band
St. Score
Non Verbal
Band
Maths
St. Score
Band
St. Score
Vocabulary
A
A
A
A
A
A
A
A
146
145
101
124
109
146
146
83
129
89
Stanine 1
2
4%
50
60
3
4
5
6
7
8
9
7% 12% 17% 20% 17% 12% 7%
70
80
90
100
110
120
Standardised Test Score
4%
130
140
150
Individual Pupil Record
Date Of Birth:
Sex:
75
Student Number:
Form:
24/12/97
F
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
Band
Stanine
Percentile
Standard
Score
B
5
53
101
B
5
52
101
C
5
46
98
C
5
46
99
B
5
52
101
Nationally Standardised Scores with 95% Confidence Band
Nationally Standardised Scores
150
140
130
120
110
100
90
80
70
60
Proof Reading PSA
106
B
96
C
50
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
A relatively lower vocabulary score might
indicate a difficulty which:
• could contribute to under-performance in
most, if not all subjects
• might lead to ‘stressful situations’
• may lead to further investigation and
subsequent pupil support
Individual Pupil Record
Date Of Birth:
Sex:
ZUHA OKARVI Individual Pupil Record
Student Number:
Form:
15/10/98
F
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
Date Of Birth:
8C Sex:
Band
Stanine
Percentile
Standard
Score
C
4
35
94
B
6
75
110
B
6
63
105
A
7
84
115
B
5
54
102
140
140
Nationally Standardised Scores
Nationally Standardised Scores
150
130
120
110
100
90
80
60
A
108
Band
Stanine
Percentile
Standard
Score
D
3
20
87
B
5
58
103
B
6
67
107
B
6
71
108
C
4
34
94
130
120
110
100
90
80
70
Proof Reading PSA
121
8E
Nationally Standardised Scores with 95% Confidence Band
150
70
M
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
Nationally Standardised Scores with 95% Confidence Band
RAWAD OKBI
Student Number:
Form:
29/08/99
60
B
50
Proof Reading PSA
88
D
118
A
50
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
A relatively low maths score might indicate
potential weaknesses in subject areas
which require:
• numerical skills
• logical thinking
• skills such as sequencing
CONVERSELY: a high maths score but a
low vocab/reading score…….
RACHEL STRONACH
Individual Pupil Record
Date Of Birth:
Sex:
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
Student Number:
Form:
13/1/99
F
8E
Band
Stanine
Percentile
Standard
Score
B
6
63
105
D
3
15
84
A
6
76
111
B
6
67
107
C
4
37
95
Date Of Birth:
Sex:
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
Nationally Standardised Scores with 95% Confidence Band
Student Number:
Form:
29/10/98
M
8E
Standard
Score
Band
Stanine
Percentile
C
5
45
98
A
9
99
135
C
4
39
96
B
6
74
110
A
7
87
117
Nationally Standardised Scores with 95% Confidence Band
150
150
140
140
Nationally Standardised Scores
Nationally Standardised Scores
CAMERON BALL
Individual Pupil Record
130
120
110
100
90
80
130
120
110
100
90
80
70
70
60
60
50
50
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
A relatively high non-verbal score might indicate potential
strengths in subject areas which require:
• 3d, and 3d into 2d, visualisation
• Spatial awareness
• Understanding images in 2d representing 3d
• Extracting information from visual images
• Science, D and T, Art, Geography……
and vice versa
Individual Pupil Record
Date Of Birth:
Sex:
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
SULAIMAN BAHELMI
Date Of Birth:
Sex:
Student Number:
Form:
23/2/99
M
Band
Stanine
Percentile
Standard
Score
A
7
81
113
B
6
66
106
D
3
18
86
B
6
68
107
A
7
77
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
111
150
140
140
Nationally Standardised Scores
Nationally Standardised Scores
150
130
120
110
100
90
80
Percentile
Standard
Score
C
4
32
93
C
4
34
94
A
8
91
120
C
4
28
91
C
4
31
93
110
100
90
80
60
60
50
50
Skills
Stanine
120
70
Non-Verbal
Band
130
70
Maths
7E
Nationally Standardised Scores with 95% Confidence Band
Nationally Standardised Scores with 95% Confidence Band
Vocabulary
Student Number:
Form:
M
MidYIS Score
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
A relatively low skills score might indicate
potential weaknesses such as:
• Speed of processing/working
• Potential underperformance in
test/examination conditions
• Poor written work (SPG etc.)
and vice versa
Date Of Birth:
Sex:
Student Number:
Form:
M
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
7Y Sex:
Band
Stanine
Percentile
Standard
Score
A
9
99
134
A
8
90
119
A
7
85
116
D
3
20
87
A
9
98
130
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
150
150
140
140
130
120
110
100
90
80
70
Band
Stanine
Percentile
Standard
Score
C
5
50
100
A
8
89
119
B
5
54
102
B
6
61
104
B
6
72
109
Nationally Standardised Scores with 95% Confidence Band
Nationally Standardised Scores
Nationally Standardised Scores
Nationally Standardised Scores with 95% Confidence Band
Proof Reading PSA
101
B
83
Form:
M
130
120
110
100
90
80
Proof Reading PSA
70
D
60
83
D
114
A
60
50
50
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
SEN use of MIDYIS test results
Analysis of baseline test individual skill profiles to
indicate potential areas of learning difficulties
e.g. If the two lowest scores are the vocabulary
and skills section and are, or close to being,
statistically significant (see IPR)
• Then the student might be dyslexic.......
• Follow-up with appropriate diagnostic tests…..
Sex:
Form:
F
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
7C
Band
Stanine
Percentile
Standard
Score
C
4
27
91
B
6
68
107
B
6
75
110
D
2
10
81
C
5
45
98
Nationally Standardised Scores with 95% Confidence Band
Nationally Standardised Scores
150
140
130
120
110
100
90
80
70
60
50
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
INSIGHT Pupil IPR
Speed Reading
Text Comprehension
Passage Comprehension
Overall Reading
Number & Algebra
Handling Data
Space, Shape & Measures
Overall Mathematics
Biology
Chemistry
Physics
Overall Science
Vocabulary
Non Verbal
Skills
Overall Ability
Standard
KS3
Score
Equivalent
Band
Stanine
Percentile
B
B
6
5
69
60
107
104
6c
5a
C
5
45
98
5b
B
5
59
103
5a
D
3
19
87
4a
B
D
6
4
61
23
104
89
6a
5c
C
4
31
93
5b
A
A
A
7
9
8
82
96
89
114
127
118
6a
7a
7c
A
8
93
122
7b
B
B
A
6
6
8
65
70
92
106
108
121
C
4
36
94
Overall Ability
Skills
Non Verbal
Vocabulary
Overall Science
Physics
Chemistry
Biology
Overall Mathematics
Space, Shape & Measures
Handling Data
Number & Algebra
Overall Reading
Passage Comprehension
Text Comprehension
Speed Reading
Standardised Scores
Standardised Scores With 95% Confidence Band
160
140
120
100
80
60
40
Overall Science
Physics
Chemistry
Biology
Overall Mathematics
Space, Shape & Measures
Handling Data
Number & Algebra
Overall Reading
Passage Comprehension
Text Comprehension
a
8b
c
a
7b
c
a
6b
c
a
5b
c
a
4b
c
a
3b
c
2a
N
Speed Reading
KS3 Level
IPRs in KS3 Levels
KS3 Equivalent Levels with 95% Confidence Band
NATIONAL AVERAGE