Transcript osi.dadeschools.net

Creating Actionable Data for Schools,
Part I, Plus
August 26 and 29, 2011
Dr. Yuwadee Wongbundhit
Curriculum and Instruction
Topics
Overview FCAT 2.0/EOC Scores,
School Performance Reports, and
Student Data Sources
Monitoring Tool for FCAT 2.0 Content
Assessed Benchmarks
Creating Actionable Data for Schools
Using “Pivot Table” to analyze data
Using Vlookup functions to merge
files
You...
are familiar with FCAT 2.0/EOC
assessments, school grade and AYP
are familiar with the District Interim
Assessments
have some experience looking at the data
and using Microsoft Excel applications
love, love, love data!!!
3
Listen to
others
Next, set
Engage
your
learning
into action
with the
ideas
presented
Reflect on
relevance
to you
Norms
Ask
questions
4
http://osi.dadeschools.net/actiondata
http://osi.dadeschools.net/actiondata
5
Monitoring Tool for FCAT 2.0 Content Assessed
Benchmark By Reporting Category
Monitoring Tool for FCAT 2.0 Content Assessed
Grades 3-5
Click on a subject/grade button below to go to that specific sheet.
Mathematics
Grade 3
Grade 4
Grade 5
Reading
Grade 3
Grade 4
Grade 5
Science
Grade 5
http://Curriculum.dadeschools.net
Move or Copy Worksheet
Right click on worksheet tab
Select “Move or Copy
Under To Book: Select the designated file
Select (Move to End)
Select Create a copy
Click OK
Overview of FCAT 2.0 Scores
Link to Understanding FCAT 2.0 Reports, Spring 2011
8
Sample of FCAT 2.0 Reading, Grade 4 Report
1
2
3
4
5
6
7
8
9
9
2011 FCAT 2.0 Scores
1
•FCAT Equivalent Scores
2
•Achievement Level
3
•Content Area Scores
10
2011 FCAT 2.0 Scores
2007 NGSSS
1996 SSS
Base scale of FCAT
Base scale of FCAT 2.0
New FCAT 2.0 Scale – 2012:
In January 2012, the new achievement-level cut scores for the
FCATFCAT
FCAT 2.0 willFCAT
be created for the FCAT 2.0 in reading (G3-10)
FCAT
19992001
FCAT 2.0
FCAT 2.0
and mathematics
(G3-8).
FCAT
2002
Equivalent
2.0 2012
2010
Scores
2011
11
Equipercentile Linking Example
• The black and green lines
represent scores on two
different assessments
• The lines show how the
raw score relates to the
percentile rank
• A “black” score of 260 and
a “green” score of 340 are
both at the 50th
percentile rank and are
“equivalent”
12
2011 FCAT 2.0 Scores (Reading)
Raw Score
Equivalent
Scale Score
V: Vocabulary
RA: Reading(100
Application
- 500)
LA: Literary Analysis
IR: Informational Text/Research
Process
Equivalent DSS
(86 to 3008)
Reading Content Scores
V
IR
Equivalent
Achievement
Level
(1 to 5)
Raw
Score
RA
LA
13
2011 FCAT 2.0 Scores (Science)
Raw Score
Equivalent
Scale Score
(100 - 500)
ES: Earth and Space Science
LS: Life Science
NS: Nature Equivalent
of Science
Achievement
PS: Physical
Science
Level
(1 to 5)
Science Content Scores
ES
PS
Raw
Score
LS
NS
14
Scale Score vs. Developmental Scale Score
G4
G3
100
86
Scale Score
100
500
500
G10
100
Developmental Scale Scores
Grade 3
500
3008
Grade 10
Achievement Levels for the FCAT Reading
Equivalent Scale Score
Grade
3
4
5
6
7
8
9
10
Ach. Level 1 Ach. Level 2 Ach. Level 3 Ach. Level 4 Ach. Level 5
100-258
259-283
284-331
332-393
394-500
100-274
275-298
299-338
339-385
386-500
100-255
256-285
286-330
331-383
384-500
100-264
265-295
296-338
339-386
387-500
100-266
267-299
300-343
344-388
389-500
100-270
271-309
310-349
350-393
394-500
100-284
285-321
322-353
354-381
382-500
100-286
287-326
327-354
355-371
372-500
Achievement Levels for the FCAT Reading
Equivalent Scale Score
Grade
Ach. Level 1 Ach. Level 2 Ach. Level 3 Ach. Level 4 Ach. Level 5
3
100-258
(158)
259-283
(24)
284-331
(47)
332-393
(61)
394-500
(106)
4
100-274
(174)
275-298
(23)
299-338
(39)
339-385
(46)
386-500
(114)
5
100-255
(155)
256-285
(29)
286-330
(44)
331-383
(53)
384-500
(116)
6
100-264
(164)
265-295
(30)
296-338
(42)
339-386
(47)
387-500
(113)
7
100-266
(166)
267-299
(32)
300-343
(43)
344-388
(44)
389-500
(111)
8
100-270
(170)
271-309
(38)
310-349
(39)
350-393
(43)
394-500
(106)
9
100-284
(184)
285-321
(36)
322-353
(31)
354-381
(27)
382-500
(118)
10
100-286
(186)
287-326
(39)
327-354
(27)
355-371
(16)
372-500
(128)
Achievement Levels for the FCAT Reading Equivalent DSS
Grade
3
4
5
6
7
8
9
10
Ach. Level
1
Ach. Level
2
Ach. Level
3
Ach. Level
4
Ach. Level
5
86-1045
1046-1197
1198-1488
1489-1865
1866-2514
295-1314
1315-1455
1456-1689
1690-1964
1965-2638
474-1341
1342-1509
1510-1761
1762-2058
2059-2713
539-1449
1450-1621
1622-1859
1860-2125
2126-2758
671-1541
1542-1714
1715-1944
1945-2180
2181-2767
886-1695
1696-1881
1882-2072
2073-2281
2282-2790
772-1771
1772-1971
1972-2145
2146-2297
2298-2943
844-1851
1852-2067
2068-2218
2219-2310
2311-3008
Achievement Levels for the FCAT Reading Equivalent DSS
Grade
Ach. Level
1
Ach. Level
2
Ach. Level
3
Ach. Level
4
Ach. Level
5
3
86-1045
(959)
1046-1197
(151)
1198-1488
(290)
1489-1865
(376)
1866-2514
(648)
4
295-1314
(1019)
1315-1455
(140)
1456-1689
(233)
1690-1964
(274)
1965-2638
(673)
5
474-1341
(867)
1342-1509
(167)
1510-1761
(251)
1762-2058
(296)
2059-2713
(654)
6
539-1449
(910)
1450-1621
(171)
1622-1859
(237)
1860-2125
(265)
2126-2758
(632)
7
671-1541
(870)
1542-1714
(172)
1715-1944
(229)
1945-2180
(235)
2181-2767
(586)
8
886-1695
(809)
1696-1881
(185)
1882-2072
(190)
2073-2281
(208)
2282-2790
(508)
9
772-1771
(999)
1772-1971
(199)
1972-214
(173)
2146-2297
(151)
2298-2943
(645)
10
844-1851
(1007)
1852-2067
(215)
2068-2218
(150)
2219-2310
(91)
2311-3008
(697)
Grade
Ach. Level
1
Ach. Level
2
Ach. Level
3
Ach. Level
4
Ach. Level
5
3
86-1045
(959)
1046-1197
(152)
1198-1488
(290)
1489-1865
(376)
1866-2514
(648)
2006
Raw
Scores
0-17
(0% - 38%)
18 – 23
(40% - 51%)
24 – 34
(53% - 76%)
35 – 43
(78% - 96%)
44 – 45
(98% - 100%)
4
295-1314
(1019)
1315-1455
(140)
1456-1689
(233)
1690-1964
(274)
1965-2638
(673)
2005
Raw
Scores
0-23
(0% - 45%)
24 – 29
(47% - 57%)
30 – 38
(59% - 75%)
39 – 45
(76% - 88%)
46 – 51
(90% - 100%)
5
474-1341
(867)
1342-1509
(167)
1510-1761
(251)
1762-2058
(296)
2059-2713
(654)
2007
Raw
Scores
0-15
(0% - 33%)
16 – 21
(36% - 47%)
22 – 31
(49% - 69%)
32 – 39
(71% - 87%)
40 – 45
(89% - 100%)
Grade
Ach. Level
1
Ach. Level
2
Ach. Level
3
Ach. Level
4
Ach. Level
5
6
539-1449
(910)
1450-1621
(171)
1622-1859
(237)
1860-2125
(265)
2126-2758
(632)
2007
Raw
Scores
0-16
(0% - 36%)
17 – 23
24 – 33
34 – 40
41 – 45
(38% - 51%)
(53% - 73%)
(76% - 89%)
(91% - 100%)
7
671-1541
(870)
1542-1714
(172)
1715-1944
(229)
1945-2180
(235)
2181-2767
(586)
2006
Raw
Scores
0-19
(0% - 42%)
20 – 28
29 – 37
38 – 42
43 – 45
(44% - 62%)
(64% - 82%)
(84% - 93%)
(96% - 100%)
8
886-1695
(809)
1696-1881
(185)
1882-2072
(190)
2073-2281
(208)
2282-2790
(508)
2005
Raw
Scores
0-24
(0% - 47%)
25 – 33
34 – 40
41 – 46
47 – 51
(49% - 65%)
(67% - 78%)
(80% - 90%)
(92% - 100%)
*Approximate Number of Correct Answers/Points Needed for Each Achievement Level
Grade
Ach. Level
1
Ach. Level
2
Ach. Level
3
Ach. Level
4
Ach. Level
5
9
772-1771
(999)
1772-1971
(199)
1972-214
(173)
2146-2297
(151)
2298-2943
(645)
2006
Raw
Scores
0-20
(0% - 44%)
21 – 30
31 – 37
38 – 41
42 – 45
(47% - 67%)
(69% - 82%)
(84% - 91%)
(93% - 100%)
10
844-1851
(1007)
1852-2067
(215)
2068-2218
(150)
2219-2310
(91)
2311-3008
(697)
2004
Raw
Scores
(Firsttime)
0-29
(0% - 57%)
30 – 37
38 – 40
41 – 44
45 – 51
(59% - 73%)
(75% - 78%)
(80% - 86%)
(88% - 100%)
*Approximate Number of Correct Answers/Points Needed for Each Achievement Level
Math DSS, Achievement Level, and Raw Scores*
Grade
Ach. Level 1
Ach. Level 2
Ach. Level 3
Ach. Level 4
Ach. Level 5
3
375-1078
1079-1268
1269-1508
1509-1749
1750-2225
2006
Raw
Scores
0-14
(0% - 35%)
4
581-1276
2005
Raw
Scores
0-14
(0% - 35%)
5
569-1451
3-2007
Raw
Scores
0-15
(0% - 25%)
15 – 20
21 – 29
30 – 36
(38% - 50%) (53% - 73%) (75% - 90%)
1277-1443
1444-1657
1658-1862
15 – 20
21 – 30
31 – 36
(38% - 50%) (53% - 75%) (78% - 90%)
1452-1631
1632-1768
1769-1956
16 – 25
26 – 35
36 – 47
(27% - 42%) (43% - 58%) (60% - 78%)
37 – 40
(93% - 100%)
1863-2330
37 – 40
(93% - 100%)
1957-2456
48 – 60
(80% - 100%)
*Approximate Number of Correct Answers/Points Needed for Each Achievement Level
Math DSS, Achievement Level, and Raw Scores*
Grade
Ach. Level 1
Ach. Level 2
Ach. Level 3
Ach. Level 4
Ach. Level 5
6
770-1553
1554-1691
1692-1859
1860-2018
2019-2492
2007
Raw Scores
0 - 13
(0% - 29%)
14 – 20
(32% - 45%)
21 – 28
(48% - 64%)
29 – 36
(66% - 82%)
37 – 44
(84% - 100%)
7
958-1660
1661-1785
1786-1938
1939-2079
2080-2572
2006
Raw Scores
0-14
(0% - 32%)
15 – 20
(34% - 45%)
21 – 31
(48% - 70%)
32 – 39
(73% - 89%)
40 – 44
(91% - 100%)
8
1025-1732
1733-1850
1851-1997
1998-2091
2092-2605
2005
Raw Scores
0-15
(0% - 25%)
16 – 24
(27% - 40%)
25 – 37
(42% - 62%)
38 – 46
(63% - 77%)
47 – 60
(78% - 100%)
*Approximate Number of Correct Answers/Points Needed for Each Achievement Level
Math DSS, Achievement Level, and Raw Scores*
Grade
Ach. Level 1
Ach. Level 2
Ach. Level 3
Ach. Level 4
Ach. Level 5
9
1238-1781
1782-1900
1901-2022
2023-2141
2142-2596
2006
Raw
Scores
0-11
(0% - 25%)
12 – 18
(27% - 41%)
19 – 28
(43% - 64%)
29 – 37
(66% - 84%)
38 – 44
(86% - 100%)
10
1068-1831
1832-1946
1947-2049
2050-2192
2193-2709
2004
Raw
Scores
0-15
(0% - 25%)
16 – 24
(27% - 40%)
25 – 34
(42% - 57%)
35 – 49
(58% - 82%)
50 – 60
(83% - 100%)
10
1068-1831
1832-1946
1947-2049
2050-2192
2193-2709
2006
Summer
Raw
Scores
0-14
(0% - 24%)
15 – 22
(26% - 38%)
23 – 32
(40% - 55%)
33 – 47
(57% - 81%)
48 – 58
(83% - 100%)
*Approximate Number of Correct Answers/Points Needed for Each Achievement Level
Overview of Algebra 1 EOC
Report
26
Algebra 1 EOC Scores
Raw Score
Algebra Content Scores
C1
EOC-Scale Scores
(20 to 80)
Raw
Score
C3
Achievement
Level
(1 to 5)
C2
Algebra End-of-Course
Reporting Category
C1
C2
C3
• Functions, Linear Equations, and
Inequalities
• Polynomials
• Rationals, Radicals, Quadratics,
and Discrete Mathematics
EOC-Scale Score
Test Form
Statewide
Comparison
1
2
Points Earned
by Content
Area
3
29
T Scores
Average
Score
30
2011 Algebra EOC Scale Distribution - Statewide
2011 Algebra EOC Distribution
Number of Students
9000
8000
7000
6000
5000
32% of Students at
the bottom third
(MDCPS: 40%)
35% of Students
at the top third
(MDCPS: 28%)
4000
3000
2000
1000
0
20212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465666768697071727374757677787980
EOC Scale Scores
• 210,004 Students tested
• Average Scale Score is 49.43;
• Average Raw Score is 21 out of 52(41% Correct)
31
2011 District Algebra EOC Results of
% of Students at Statewide Comparison by Thirds
% of Students
100
Low
Middle
High
65
50
323335
40
3228
26
9
59
31
10
65
58
51
33
32
26
15
65
10
9
21
14
0
State
MDCPS
Grade 7
Grade 8
Grade 9 Grade 10 Grade 11 Grade 12
Number of Students Tested
State M-DCPS
7
8
9
10
210,004 28,066* 2,048 6,180 18,286 940
11
12
299
263
32
* Does not include small numbers of students in Grade 6 and Adult Education Programs.
2011 Statewide Algebra EOC: Average % Correct by
Grade Level
Average % Correct
100
63
62
52
50
36
29
30
32
10
11
12
0
6
6
56
7
8
9
Grade Level
Number of Students Tested by Grade
7
8
9
10
11
12861 56405 114235 18900
5230
12
2238
33
School Level Data Sources
Curriculum
and
Instruction
Website
FLDOE
OADA Website
Website
School
Level
Data
Sources
Demographics
Reports
Report
Builder from
Edusoft
34
Updated School Performance Report on C & I Website
Benchmark
Analysis
Interim
Assessment by
Subgroups
Five-Year AYP
Year at a
Glance
Five-Year FCAT
35
http://curriculum.dadeschools.net/schoolperformancereports.asp
Average/
Mean
Score
Average
% Correct
Percent
Proficient
What is the difference?
Raw Score Distribution: Grade 3 Math of Fall IA, 2010-11
1600
P at 70% Cutoff
1200
1000
800
600
67% of Students
400
200
0
36% of Students
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
Number of Students
1400
Proficient at 50% Cutoff
Average Score is 17.7 or
Average % Correct of 59
Grade 3
1600
1400
1200
1000
800
600
400
200
0
3
7
10 13 17 20 23 27 30 33 37 40 43 47 50 53 57 60 63 67 70 73 77 80 83 87 90 93 97 100
1200
Grade 4
1000
800
600
400
200
100
98
95
93
90
88
85
83
80
78
75
73
70
68
65
63
60
58
55
53
50
48
45
43
40
38
35
33
30
28
25
23
20
18
15
13
10
8
5
3
0
NGSSS
Benchmark
Monitoring
Tools
http://Curriculum.dadeschools.net
39
Reasons for Analyzing Student Achievement
Assess the current and future needs of
students.
Decide what to change.
Determine if goals are being met.
Engage in continuous school
improvement.
Identify root causes of problems.
Provide differentiated instruction for
students.
Status
• Reading, math, science,
writing
Growth
• Reading and math
Continuous Instructional Improvement System
Status
Status
State Tests
Mar./April
Baseline
Assessment
Aug./Sept.
Interim
Assessment1
Oct./Nov.
School Year
Interim
Assessment2
Jan./Feb.
State Tests
Mar./April
District-wide Instructional Focus
District Interim
Assessment
Instructional
Focus
Calendars
District’s
Pacing
Guides
The District’s Pacing Guides and Instructional Focus Calendars are aligned with the
timing and content of the District Interim Assessment, working together to provide
both guidelines for instruction and tools for monitoring student progress throughout
the year.
Continuous Instructional Improvement System
Continuous
Assessment
Instruction
Meaningful
actionable data
Create meaningful data for administrators,
coaches, and teachers….
What did you see?
• 1. Who is the targeted students?
• 2. What is the overall performance of the
targeted group?
• 3. What is the content category of concerns?
Tips for Analyzing Data
 Formulate key questions
 Obtain data to answer them
 Find the storyline to bring it all together
 Determine priority areas for action
 Share the data with the staff
 Seek technical assistance if needed
 Celebrate your achievement results!
 Use the data to communicate, inform, provoke,
and persuade ... and
 Improve Your System!
Do you have …
• “disaggregated”
• “longitudinal”
• “cross-tabulated”
… data?
… for digging beneath the averages!
It would be very easy to get
“analysis paralysis” by spending
time pulling data together but not
spending time using the data.
Which students?
FCAT unedited: Include all students tested
FCAT, ALL TESTED
AYP
AYP
Include only students who are in
your school for a full academic year
(Oct. FTE and Feb. FTE) and who are
NOT the first year LEP students.
School Grade
Include only students who are in your
school for a full academic year
Criteria for meeting high standards only,
School
Grade
include students who are:
Standard curriculum
ESE:
Speech impaired (F)
Gifted (L)
Hospital homebound (M)
ELL who have been in an ESOL
program for more than two years
2007-2011 FCAT and Content Cluster Report
Reading
Math
Writing
Science
School Grade
AYP
2010-2011 District Baseline Assessment Results
School Name
Reading - Grade 5
Level of
Proficiency 2010 AYP Total # of
at 70% or
Met**
Students
above
% of
Students
Tested
All students
49
FCAT Level
1
Overall [44]
Vocabulary [7]
Reading Application [24]
Literary Analysis
Fiction/Nonfiction [8]
Informational Text/
Research Process [5]
Average
Score
% Proficient
Average
Score
% Proficient
Average
Score
% Proficient
Average
Score
% Proficient
Average
Score
% Proficient
98% (48)
19.9
8% (4)
4.4
27% (14)
11.1
10% (5)
2.9
8% (4)
2.4
24% (11)
17
94% (16)
12.7
0% (0)
2.2
14% (2)
6.9
0% (0)
1.9
0% (0)
1.6
6% (1)
FCAT Level
2
6
100% (6)
20.5
0% (0)
4.5
44% (2)
12.4
17% (1)
2.2
0% (0)
2.5
17% (1)
FCAT Level
3
18
100% (18)
24.9
17% (4)
4.4
49% (7)
14.1
17% (4)
4.5
11% (2)
4.1
44% (8)
FCAT Level
4
5
100% (5)
29.6
20% (1)
4.8
40% (2)
16.2
20% (1)
5.6
40% (2)
4.0
20% (1)
FCAT Level
5
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NO
White
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
Black
NO
44
100% (44)
19.9
7% (4)
4.5
26% (11)
11.1
9% (4)
2.9
9% (4)
2.5
24% (10)
Hispanic
NA
6
84% (5)
19.8
20% (1)
4.2
40% (2)
11.2
20% (1)
4.4
0% (0)
2.0
20% (1)
Asian
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
Am. Indian
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
ED
NO
47
100% (47)
19.7
9% (4)
4.4
26% (12)
11.0
11% (5)
2.9
6% (4)
2.4
21% (10)
ELL
NA
0
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
NA
SWD
NO
14
100% (14)
11.4
0% (0)
1.8
0% (0)
6.5
0% (0)
1.6
0% (0)
1.5
0% (0)
Selection of School Report
School and Subject Selection
Step 1. Select a school from the drop down list below.
List of Schools
Step 2. Click on a subject/grade button below to go to that specific sheet.
School Performance Reports
Grade 6
Grade 7
Grade 8
Benchmark List Description
Grade 6
Grade 7
Grade 8
School Performance Reports
Grade 6
Grade 7
Grade 8
Benchmark List Description
Grade 6
Grade 7
Grade 8
School Performance Reports
N/A
N/A
Grade 8
Benchmark List Description
N/A
N/A
Grade 8
Mathematics
Reading
Science
53
http://curriculum.dadeschools.net/schoolperformancereports.asp
School Accountability
School
Grade
•Meeting High Standards
•Learning Gains
AYP
•Meeting High Standards
•Total and Subgroups
School Grading Point Criteria
Grade
Points
Meeting high standards
(400 points)
A
525-800
Reading: %L3-5
B
495-524
Math: %L3-5
C
435-494
Science: %L3-5
D
395-434
F
0-394
Making learning gains
(400 points)
Writing: %L4-6
EDISON PARK ELEMENTARY*
WILLIAM J. BRYAN ELEMENTARY*
FLORIDA CITY ELEMENTARY*
WILLIAM H. TURNER TECHNICAL ARTS*
Reading
• % Making learning
gains for all
• % Making learning
gains for Low25%
Math
• % Making learning
gains for all
• % Making learning
gains for Low25%
AYP Point Criteria
39 Components Criteria (NA, No, Yes)
Group
Participation Met
(Tested 95%)
Proficiency Met
Other AYP
Criteria
Reading
Math
Reading
Math
TOTAL
1
1
1
1
WHITE
2
2
2
2
BLACK
3
3
3
3
HISP.
4
4
4
4
ASIAN
5
5
5
5
Am. Ind.
6
6
6
6
ED
7
7
7
7
ELL
8
8
8
8
School Grade
SWD
9
9
9
9
Total Group
Writing
Total Group
Graduation
Total Group
56
%Proficiency Targets
Year
Reading
Math
2008-09
65
68
2009-10
72
74
2010-11
79
80
2011-12
86
86
2012-13
93
93
2013-14
100
100
Do you know what your students should
know and be able to do each year in
math/reading/science/writing?
Can you identify the gap between where
students are right now in relation to high
standards?
What instructional strategies can you use
to accelerate students to attain high
standards?
How prepared are you to effectively use
assessment to determine ways to alter
instruction to meet high standards?
Do you have effective classroom-level
assessments to help you clearly determine
whether students are meeting high
standards?
Reporting Categories
Benchmark Analysis
Content Focus
Item Analysis
Student Response Analysis
Content Cluster Analysis
Benchmark Analysis
Content
Cluster
Benchmark
1
Benchmark
2
Content
Focus 1
Content
Focus 2
Content
Focus 1
Content
Focus 2
Items
Items
Items
Items
Item
Analysis
Identified Students
Digging into Data
Content Categories Analysis
Benchmark Analysis
Vocabulary
(45%)
LA.5.1.6.7
(49%)
LA.A.5.1.6.3
(48%)
LA.5.1.6.8
(41%)
Content Focus
Base Words
Root
Antonyms
Synonyms
Item
Analysis
Items: 2, 5, 6
55%, 20%,
45%
Items: 4, 10
70%, 40%
Items: 2, 7, 8,
11
Item 24
15%
Identified Students
Edusoft Reports
Performance
Band
Reports
• Overall performance and % proficient
• Benchmark analysis
• Content cluster analysis and % of
proficient
Item Analysis
Reports
• Performance by item
• Distractor Analysis
Item
Response
Reports
• Item Response Pattern by students
Protocols for Baseline/Interim Assessment
Based on the Performance Band Report, what patterns of strengths and
weaknesses emerge from the report?
Based on Item Analysis Report, which concept or content should the
department/ grade level /teacher focus on?
How will you group or regroup students based on Item Response Report?
Identify students needing intervention after conducting Item Analysis and
Item Response Reports.
How will you instruct to get different results?
What is the next learning target(s); which benchmarks?
How will you monitor and measure results?
2010-2012 Ideal Data File
2012 Interim
Assessments,
FAIR
2012 FCAT2.0
and EOC
Scores
2011 FCAT
Scores
2012
Demographics
Information
2012 Student
Academic
20102012
Data File
2011 & 2012
Student
Accountability
Information
66
Student Database
FCAT, FCAT2.0,
EOC scores
Course
Enrollments
Demographics
Information
Accountability
Information
Student
Database
Interim
Assessments,
FAIR
67
Student Data Sources
Student
Performance
Indicators
(SPI)
File
Download
Manager
Student
Data
Sources
Accountability
Reports on
Principal
Portal
Edusoft and
PMRN
PMRN – Progress Monitoring
Reporting Network
68
Accountability Reports on Principal Portal
69
Accountability Reports on Principal Portal
Lowest
25, 35, 45
Bubble
Gains
Regress
Reading
Reading
Reading
Reading
Math
Math
Math
Math
Accountability Report Data Elements
No.
Variable Name
No.
Variable Name
1
Student_ID
12
Most_Recent_FCAT_DSS_Score
2
Name
13
Prior_FCAT_Grade
3
Gain
14
Prior_FCAT_Level
4
Bubble
15
Prior_FCAT_Scale_Score
5
Regress
16
Prior_FCAT_DSS_Score
6
Sur2_Schl (October FTE)
17
AYP_Ethnic
7
Sur3_Schl (February FTE)
18
LEP_code
8
Rank (Based on DSS)
19
LF___2_YR
9
Most_Recent_FCAT_Grade
20
LEP_Entry_Date
10
Most_Recent_FCAT_Level
21
SPED_EXCP
11
Most_Recent_FCAT_Scale_Score
22
Lunch_Code
Other Reports on Principal Portal
Interim
Assessments
FCAT 1 2
Missing Intensive
Course
Others
Reading
Reading
Graduation
Math
Math
Dual Enrollment
Top 45 for Grade
11 Science
Accountability Reports on Principal Portal
73
Y
Gain
(Annual Learning
Gains)
N
Bubble
P
Possibility to be at
the next level
N
Neutral
R
Risk to decline the
level
• Maintain high
standards
• Demonstrate more
than one year’s
growth (using the
developmental scale
score gains) when
remaining in
achievement level 1
or 2 for both years.
2011 Achievement Level
• Improve achievement
Levels
5
    
4
    
3
    
2
1



1


  
   
2
3
4
5
2010 Achievement Level
and Reading
Grade
Annual
Learning Gains
for FCAT
Achievement
Levels 1 and 2
Reading
Math
3 to 4
231
163
4 to 5
167
120
5 to 6
134
96
6 to 7
111
79
(Do not use for
7 to 8
93
65
retained students)
8 to 9
78
NA
9 to 10
78
49
Mathematics FCAT Worksheet
Student
Student
Grade
Achievement
Developmental
Level
Scale Scores (DSS)
2009-10 2010-11 2009-10 2010-11 2009-10 2010-11 Change
1
6
7
2
2
1661
1676
15
2
6
7
4
3
1919
1926
7
3
6
7
1
1
1265
1502
237
4
6
7
1
3
1295
1853
558
5
7
7
1
1
1382
1502
120
6
6
7
3
2
1717
1748
31
7
6
7
1
1
1269
1382
113
8
7
7
2
2
1676
1748
72
9
6
7
4
4
1902
1939
37
10
6
7
1
1
1256
958
-298
11
6
7
2
3
1687
1930
243
12
6
7
3
3
1751
1870
119
1676
NA
1644
9
13
7
2
14
6
7
2
15
6
7
3
1
1635
1786
NA
2010-11 Meeting High
Standards for School
Grade
2010-11 Making
Annual Learning
Gains
2010-11 Meeting
AYP Standards
Yes/No
Yes/No
Yes/No
Mathematics FCAT Worksheet - Answer
Student
Student
Grade
Achievement
Developmental
Level
Scale Scores (DSS)
2009-10 2010-11 2009-10 2010-11 2009-10 2010-11 Change
1
6
7
2
2
1661
1676
15
2
6
7
4
3
1919
1926
7
3
6
7
1
1
1265
1502
237
4
6
7
1
3
1295
1853
558
5
7
7
1
1
1382
1502
120
6
6
7
3
2
1717
1748
31
7
6
7
1
1
1269
1382
113
8
7
7
2
2
1676
1748
72
9
6
7
4
4
1902
1939
37
10
6
7
1
1
1256
958
-298
11
6
7
2
3
1687
1930
243
12
6
7
3
3
1751
1870
119
1676
NA
1644
9
13
7
2
14
6
7
2
15
6
7
3
1
1635
1786
NA
2010-11 Meeting High
Standards for School
Grade
2010-11 Making
Annual Learning
Gains
2010-11 Meeting
AYP Standards
Yes/No
Yes/No
Yes/No
No
Yes
No
Yes
No
No
No
No
Yes
No
Yes
Yes
No
No
NA
No
No
Yes
Yes
No
No
Yes
No
Yes
No
Yes
Yes
NA
No
NA
No
Yes
No
Yes
No
No
No
No
Yes
No
Yes
Yes
No
No
NA
Y
Gain
(Annual Learning
Gains)
N
Bubble
P
Possibility to be at
the next level
N
Neutral
R
Risk to decline the
level
Ranking:
Percentile Ranking based on DSS
0-25
26-35
36-45
45-100
Accountability Report Data Elements
No.
Variable Name
No.
Variable Name
1
Student_ID
12
Most_Recent_FCAT_DSS_Score
2
Name
13
Prior_FCAT_Grade
3
Gain
14
Prior_FCAT_Level
4
Bubble
15
Prior_FCAT_Scale_Score
5
Regress
16
Prior_FCAT_DSS_Score
6
Sur2_Schl (October FTE)
17
AYP_Ethnic
7
Sur3_Schl (February FTE)
18
LEP_code
8
Rank (Based on DSS)
19
LF___2_YR
9
Most_Recent_FCAT_Grade
20
LEP_Entry_Date
10
Most_Recent_FCAT_Level
21
SPED_EXCP
11
Most_Recent_FCAT_Scale_Score
22
Lunch_Code
Export Accountability Report
Excel
Format
CSV Format
PDF Format
Principal Accountability Report
School
Grade
Export Data
Print
View Report
Using Pivot Table to Answer These Questions
1
Which students improved/regressed their FCAT levels
from 2010 to 2011?
What is the number of students achieving high
standards by each of the AYP subgroups?
At each achievement level, what are the numbers of
students made learning gains?
What is the number of students thay made learning
gains by AYP subgroups?
Which students are in the bottom/top quartile based
on 2011 DSS?
What is the average % correct of each reporting
category by achievement level/AYP subgroups?
Guiding Questions to Inform the Problem-Solving Process
What are the anticipated barriers to
increasing the percentage of students making
learning gains?
What strategies will be implemented to increasing
learning gains for Low25% and overall?
What are the anticipated barriers to increasing the
percentage of students meeting high standards for
each AYP subgroup and overall?
What are the anticipated barriers to increasing the
percentage of students maintaining proficiency or
moving above proficiency on 2012 FCAT 2.0/EOC?
Insert Pivot Table for Data Analysis (folder)
1. Click on Cell A2
2. On main menu, select “Insert”
3. Click on “Pivot Table” then select
“Pivot Table”
4. Create Pivot Table will appear.
5. Check Table/Range to make sure it is
correct. Then click OK.
6. Pivot Table appear with Pivot Table
Field List.
Continued
1. Click A3 and select “Options”
under “PivotTable Tools”.
2. Next click on “Options” under .
PivotTable Name. Next, select
“Options” under “PivotTable Tools”.
3. Select “Display” Tab
4. Check on Classic Pivot Table layout
Using Pivot Table to Create the following tables
2011 Achievement Level by 2010 Achievement Level
2011 Achievement Level by AYP Subgroups
2011 Achievement Level by Gains
2011 Achievement Level by Bubble Students
2011 Average % Correct of each reporting category by
achievement levels
2011 Average % Correct of each reporting category by
AYP Subgroups
Using Pivot Table to Create the following tables
2011 Achievement Level by 2010 Achievement Level
2011 Achievement Level by AYP Subgroups
2011 Achievement Level by Gains
2011 Achievement Level by Bubble Students
2011 Average % Correct of each reporting category by
achievement levels
2011 Average % Correct of each reporting category by
AYP Subgroups
Enable Macro for Excel
Student Performance Indicators (SPI)
92
SPI School Data Elements
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
24.
CLASS_SCHOOL
STUDENT_NAME
STUDENT_ID
STUDENT_STATUS_CODE
GENDER
STUDENT_ETHNICITY
STUDENT_GRADE
STUDENT_HOMEROOM
LEP_Entry_Date
LUNCH_CODE
Birthdate
ESE_INFO
LEP_INFO
FCAT_CURR_GROUP
FCAT_TEST_YEAR
FCAT_TEST_MONTH
FCAT_GRADE
FCAT_NRT_MATH_SCALE
FCAT_NRT_MATH_PERCENT
FCAT_NRT_MATH_STANINE
FCAT_NRT_READ_SCALE
FCAT_NRT_READ_PERCENT
FCAT_NRT_READ_STANINE
FCAT_SSS_MATH_SCORE
25.
26.
27.
28.
29.
30.
31.
32.
33.
34.
35.
36.
37.
38.
39.
40.
41.
42.
43.
44.
45.
46.
47.
48.
FCAT_SSS_MATH_LEVEL
FCAT_SSS_MATH_DEVELOP
FCAT_SSS_MATH_NS (Content 1)
FCAT_SSS_MATH_M (Content 2)
FCAT_SSS_MATH_GS (Content 3)
FCAT_SSS_MATH_AT (Content 4)
FCAT_SSS_MATH_DA
FCAT_SSS_READ_SCORE
FCAT_SSS_READ_LEVEL
FCAT_SSS_READ_DEVELOP
FCAT_SSS_READ_WP (Content 1)
FCAT_SSS_READ_MIP (Content 2)
FCAT_SSS_READ_C
(Content 3)
FCAT_SSS_READ_RR (Content 4)
FCAT_SSS_SCI_SCORE
FCAT_SSS_SCI_LEVEL
FCAT_SSS_SCI_PC
FCAT_SSS_SCI_ES
FCAT_SSS_SCI_LE
FCAT_SSS_SCI_ST
FCAT_SSS_WRITE_PT
FCAT_SSS_WRITE_SCORE
FCAT_READ_PASS_FAIL
FCAT_MATH_PASS_FAIL
VLOOKUP FUNCTION
=VLOOKUP(LOOKUP_VALUE, TABLE_ARRAY, COLUMN INDEX NUMBER, FALSE)
Lookup_Value:
What value are
you searching
for?
Excel will look for
a match to this
value in the
leftmost column
of the lookup
table
Table_Array:
Where do you
want to search?
Use absolute
references to
“lock” the range
by pressing F4
key
Col_index_num
Which column
contains the
search result?
Count over
from the first
column to
figure out what
this number
should be,
starting with 1.
FALSE
To force Excel
to lookup value
be exact match
Open
Excel
Practice
file
=VLOOKUP($A2,’Interim Assessment!$A$3:$R$103,3,FALSE)
VLOOKUP FUNCTION
SPI
Account
ability
Baseline
and Interim
Assessment
Master
File
File
Download
Manager
=VLOOKUP(LOOKUP_VALUE, TABLE_ARRAY, COLUMN INDEX NUMBER, FALSE)
Vlookup Function
S3
=vlookup($a3,'2010 Interim'!$A$5:$H$118,4,false)
T3
=vlookup($a3,'2010 Interim'!$A$5:$H$118,6,false)
U3
=vlookup($a3,'2010 Interim'!$A$5:$H$118,8,false)
Using Macro to Format and Merge
the Data Files into One
http://osi.dadeschools.net/actiondata
Download Data Files:
Download
Template
SPI
Accountability Report
Courses (File Download
Manager)
Click the button on the
template to format and
merge data files
97
File Download Manager
Demographic
Class
Academic
ESE
Download File
ESOL
Testing
98
File Download Manager
99
Students to be Tested in 2011-12
•
•
•
•
•
Algebra 1
1200310 - Algebra 1
1200320 - Algebra 1 Hon.
1200380 - Algebra 1B
1209810 - Pre-AICE
Mathematics 1
1200390 - IB Middle Years
Program – Algebra 1 Hon.
•
•
•
•
Geometry
1206310 - Geometry
1206320 - Geometry Hon.
1206810 - IB Middle Years
Program Geometry Hon.
1209820 - Pre-AICE
Mathematics 2
Biology
•
•
•
•
•
2000310
2000320
2000322
2000430
2000800
- Biology 1
• 2000850 - IB Middle Years
Program Biology Hon.
- Biology 1 Hon.
• 2002440 - Integrated Science 3
- Pre-AICE Biology
- Biology Technology • 2002450 - Integrated Science 3
Hon.
- Biology 1 PreIB
Independent Assignment
• Select one school, one grade, one subject area of
your choice.
• Download the template from the website.
• Complete the template with data of the selected
school.
• On the “Pivot Table Blank”, fill the blank pivot table
with data.
• Save the file as PD Sequence-Last Name-Work
Location, example: 0672-Wongbundhit-9629
• PD Sequence: 0672 for 8/26; 0673 for 8/29
• Send the file to [email protected]
102