Transcript Data Informed Decision Making that Improves Teaching and

Oakland County School Boards Association
September 21, 2005
Data Informed Decision Making
that Improves Teaching and
Learning
Michael Yocum
Larry Thomas
Tammy Evans
Joyce Sackleh
Ernie Bauer
Major Parts of Each System
SAS – Student Assessment System
Curriculum Framework
(GLCE’s)
Items
Tests
Administer tests
Score & Report
DAT – Data Analysis Tool
•
•
•
•
Interface with SIS
Import external tests
Import SAS tests
Select & Analyze
Groups
– Graphs
– Drill Down
Data analysis process
From Matt Stein. Making Sense of the Data: Overview of the K-12
Data Management and Analysis Market, Eduventures, Inc., Nov. 2003.
Project Planning Process
• Fall 2004 – Meetings with focus groups, create
RFP
• Oct 2004 – Meeting with Assessment,
Curriculum and Technology directors from
Oakland districts to discuss requirements,
including multiple “on ramps”
• Dec 2004 – RFP sent out to bid
• Jan 2005 – 10 responses received
• Feb 2005 – Committee meets to review
responses
Timeline continued
• March 2005 – Vendor demonstrations
• March 2005 – committee reviews, prioritizes
functionality
• March - April 2005 –reference checks
conducted
• April 2005 – final evaluation
• May 2005 – Customer site visit
• May 2005 – OCSA review
• May 2005 – Oakland School BOE approval
Oakland & LEA Members Only
(N = 15)
SAS-DAT Team -- Oakland only
Higher
St.
1.0
1.5
Disagree
Disa
2.0
gree 2.5
Not
3.0
Sure 3.5
Ag
4.0
ree
4.5
St. Agree
5.0
Usef ul reports f or teachers
Usef ul longitudinal reports f or administrators
Comprehensive data analysis tool
Usef ul reports f or administrators
Aligns to district curriculum
I
Sof tw are is user f riendly
m
Easy to create & manage tests
p
o
Usef ul item & test statistics f or administrators
r
t
Scanning & scoring is good
a
n Usef ul longitudinal student prof ile f or teachers
c
Allow s creation of multiple item types
e
Helps w ith collaboration on instruction
Provides item bank
SIS interf ace is good
Training model is good
Usef ul reports f or students & parents
Web based testing is good
Lower
Provides instructional resources
Items are arranged by “Importance” rating.)
Vendor A
Vendor B
Pearson
Measure, Manage and Maximize
Student Achievement
Benchmark Test Results
By Test
• This view displays one
or all tests that the
selected student
population has taken.
Student scores are
plotted across a
proficiency scale.
• The view displays the
percentage of students
who scored within the
range of each level on
the proficiency scale.
Benchmark Test Results
By Standard
• This view displays
each assessed standard
and graphs the
percentage of students
who mastered and did
not master the standard
on each assessment.
• Selecting a single test
displays detailed results
by standard for that test.
• Selecting all tests
displays student
performance on the
standards over time.
Benchmark Test Results
By Individual - View Mastery Details
• This view displays
all mastery records
for the given student,
sorted by standard.
• This represents a
detailed running
record of a student’s
mastery across all
benchmark tests.
Benchmark Test Results
Item Analysis
• Click on the question
number to see the
question itself.
• Click on the icon next
to the question number
to see a breakdown of
the item’s performance
by demographic
category.
Benchmark Test Results
Frequency Distribution
• This view plots a line-dot graph
based on the test frequency
distribution, and calculates the
range, mean, standard
deviation, and standard error.
• In addition to this baseline data,
you can choose to plot up to
four graphs for particular
demographic groups.
• The sample displays the
distribution of female scores
compared to the overall
baseline.
• The view also displays how the
• scores fall along the selected
• proficiency scale.
Pearson Benchmark
Pearson School Systems
*** School District
Self-Guided Product Tour

Please see comments in Notes Section, using
“Notes Page” view.
Principal’s Dashboard
Teacher’s Dashboard
Parent’s / Student’s Dashboard
Oakland Schools Support
• Models defined to support diverse
needs of districts and multiple onramps
• Monetary support
– Oakland Schools resources aligned
• Curriculum, Item Banks, and
Assessments delivered to all districts
Current Status
Pearson Benchmark & Inform
As of September 21, 2005
28
26
25
24
20
Number of Districts
20
16
15
12
8
4
0
Inform
Inform
Data Validation
(Completed, Scheduled,
or Planned)
Lite
Full
Benchmark