Transcript Document
Findings on Alignment of Instruction using Enacted Curriculum Data
Rolf K. Blank Director, Education Indicators [email protected]
AERA, April 2004 © 2004 CCSSO ALL RIGHTS RESERVED .
Surveys of Enacted Curriculum Data: Design, Multiple Uses
Rolf K. Blank Director, Education Indicators [email protected]
AERA, April 2004 © 2004 CCSSO ALL RIGHTS RESERVED .
Surveys of Enacted Curriculum
Now available, K-12: English Language Arts, Mathematics, Science © 2004 CCSSO ALL RIGHTS RESERVED .
SEC Collaborating Organizations
•Council of Chief State School Officers www.SECsurvey.org
•Wisconsin Center for Education Research www.SEConline.org
•Learning Point Associates/NCREL www.SECsupport.org
•TERC Regional Alliance DEC Project www.ra.terc.edu © 2004 CCSSO ALL RIGHTS RESERVED .
Key Question addressed by SEC Tool:
How can Educators obtain reliable, valid data to determine degree of alignment of instruction with state standards and assessments? Then, How can the Data inform strategies for improvement?
© 2004 CCSSO ALL RIGHTS RESERVED .
Rationale
Standards Curriculum © 2004 CCSSO ALL RIGHTS RESERVED .
Assessment
SEC Instructional Content
Uses a multi- dimensional la nguage for describing instructional content
Topics
by
Cognitive Demand
.
Content Maps
State J Grade 8 Mathematics Instruction
0.1
0.08
0.06
0.04
0.02
0
Memorize Communicate Perform Connect Conjecture Number Sense Operations Measurement Algebraic Concepts Geometric Concepts Data Analysis Instructional Technology
© 2004 CCSSO ALL RIGHTS RESERVED .
Memorize Communicate Perform Connect Conjecture
Curriculum Analysis
: Enacted Intended
What teachers teach What standards require
© 2004 CCSSO ALL RIGHTS RESERVED .
SEC Content Topics Math, Science, ELA
The SEC provides a neutral, research based language to describe content of English language arts, mathematics, and science. NCLB anyone?
© 2004 CCSSO ALL RIGHTS RESERVED .
Expectations (Cognitive Demand) for Students
Expectations for Students in Mathematics Memorize Facts/ Definitions/ Formulas
Recite basic mathematics facts Recall mathematics terms & definitions Recall formulas and computational procedures
Perform Procedures
Use numbers to count, order, denote Do computational procedures or algorithms Follow procedures/instructions Solve equations/formulas/routine word problems Organize or display data Read or produce graphs and tables Execute geometric constructions
Demonstrate Understanding of Mathematical Ideas
Communicate mathematical ideas Use representations to model mathematical ideas Explain findings and results from data analysis strategies Develop/explain relationships between concepts Show or explain relationships between models, diagrams, and/or other representations
Conjecture/ Generalize/ Prove
Determine the truth of a mathematical pattern or proposition Write formal or informal proofs Recognize, generate or create patterns Find a mathematical rule to generate a pattern or number sequence Make and investigate mathematical conjectures Identify faulty arguments or misrepresentations of data Reason inductively or deductively
Solve Non-routine Problems/ Make Connections
Apply and adapt a variety of appropriate strategies to solve non-routine problems Apply mathematics in contexts outside of mathematics Analyze data, recognize patterns Synthesize content and ideas from several .
Descriptive results can be reported using a variety of graphic displays
© 2004 CCSSO ALL RIGHTS RESERVED .
Survey Sections
• School & Class Description • Instructional Activities • • • •
General Problem Solving Activities
•
Pairs & Small Group Work Use of Hands-on Materials Use of Calculators/Computers & other Ed. Tech.
• Assessment Use • Instructional Influences • Instructional Readiness • Teacher Opinions • Professional Development •
Types
• •
Content Focus Active Learning
• •
Collegial Participation Coherence
•
Time
Span • Teacher Characteristics • Instructional Content © 2004 CCSSO ALL RIGHTS RESERVED .
© 2004 CCSSO ALL RIGHTS RESERVED .
© 2004 CCSSO ALL RIGHTS RESERVED .
Survey Versions
Mathematics Science English, Language Arts & Reading Grades K-8 & High School Paper & Web-based © 2004 CCSSO ALL RIGHTS RESERVED .
SEC Applications--NCLB
Alignment analysis (instruction, standards, assessments) Instructional improvement in schools Needs assessment/ Evaluation Indicators – monitoring change over time © 2004 CCSSO ALL RIGHTS RESERVED .
Data on Enacted Curriculum PROJECT DESIGN Five Urban Districts—40 Mid. Schools Standards Assessment Curriculum Science/Math Initiatives Professional Development Teacher & School Data Reports Assist Schools/ Professional Development
© 2004 CCSSO ALL RIGHTS RESERVED .
Teacher Data Measure Change Assist Schools/ Professional Development Improved Student Achievement
To view Surveys, Reporting, Methods
www.SECsurvey.org
at CCSSO
www.Online.org
web-based Survey at WCER
www.SECsupport.org
Point/NCREL at Learning © 2004 CCSSO ALL RIGHTS RESERVED .
Surveys of Enacted Curriculum
The intended curriculum: State content standards— What students should learn A neutral content grid The assessed curriculum: State (and other) assessments— tested learning with cognitive demand The enacted curriculum: What teachers teach The learned curriculum: Student outcomes based on school learning © 2004 CCSSO ALL RIGHTS RESERVED .
Intended— standards
SEC Alignment Analysis
Enacted— taught Assessed— state tests GRADE 8 STATE MATH TEST SCHOOL averages compared to STATE averages
-10 -5 0 5 10 15 20 1 2 3 4 5 © 2004 CCSSO ALL RIGHTS RESERVED .
Analysis Objectives
Purpose: Use by District, Schools, TA providers What Topics, Expectations are taught, as compared to Standards, Assessments? To what extent?
Which are NOT taught? How does Instructional content relate to Achievement?
Analysis Methods: A) Descriptive -- Content Maps % Instructional time by Emphasis of Standards/Assessments B) Correlation -- Alignment Index © 2004 CCSSO ALL RIGHTS RESERVED .
Results from 2 Districts/States
Miami-Dade: 12 Middle Schools (6-8) 219 Teachers Y1, 171 Y3 (Math,Sci) Winston-Salem: 10 Middle Schools 136 Teachers Y1 (Math,Sci) © 2004 CCSSO ALL RIGHTS RESERVED .
Alignment Analysis
Topic Differences in Alignment School Differences 2 State Standards by Instruction Change over time: Year 1 to Year 3 © 2004 CCSSO ALL RIGHTS RESERVED .
Alignment Level
Alignment index (0 to 1): Miami, Math, 6-8 Gr 6 FL Standards x Instr = .19
Gr 8 FL Assessment x Instr. = .22
School Level, Gr. 6 Stands = .20 to .17
School level, Gr. 8 Assess = .22 to .24
© 2004 CCSSO ALL RIGHTS RESERVED .