Transcript An Orientation of the Surveys of the Enacted Curriculum

An Orientation of the Surveys of
the Enacted Curriculum Ohio ELL
Project
Carolyn Karatzas
Technical Assistance Provider
SEC ELL Grant
Questions that will be addressed…
• What are the Survey of Enacted Curriculum
tools?
• Why are SEC data useful to educators?
• How are data collected, analyzed,
reported?
What are the Surveys of Enacted
Curriculum and why do educators
use them?
Survey- Defined
1 a: to examine as to condition, situation, or value : appraise b: to query
(someone) in order to collect data for the analysis of some aspect of a group or
area
www.merriam-webster.com
1.to examine for some specific purpose; inspect or consider
carefully; review in detail2.to look at or consider, esp. in a
general or comprehensive way; view
www.yourdictionary.com
The Surveys of Enacted
Curriculum-Defined
• An educational tool to examine, inspect or consider the
instructional content and practices used by teachers
• The data or information from the SEC provides a vehicle for
discussion among teachers about their collective instruction
• Provides the individual teacher with information about their
specific instruction to state standards
The Surveys of Enacted Curriculum are
•
a research-based, data analysis tool for analyzing the
content of state standards and assessments
•
online, web-based surveys that collect teacher reported
information about what content they teach and what
instructional practices they use in one class
•
graphed reports representing the data collected from
teacher surveys and coding.
How many educators are using the
Surveys of Enacted Curriculum?
10,393 teachers took a Survey of Enacted
Curriculum in the 2006-07 school year
4674 Math
1993 Science
3646 ELAR
80 Soc Stud
131 standards and assessments were coded.
How many educators in OHIO are using
the Surveys of Enacted Curriculum?
1,612 teachers took a Survey of Enacted Curriculum in
the 2006-2007school year
239 Math
41 Science
1327 ELAR
5 Soc Stud
So far about 800 teachers this school year!
Why are educators using the
Surveys of Enacted Curriculum?
Could you improve student achievement
if you had answers to these questions?
• How do I know that what teachers are teaching is aligned with
•
•
•
•
what students are expected to learn as identified by state
standards?
How do I know that teachers are spending instructional time
on the right things?
What do I know about our instructional program in a low
performing area?
Are our instructional practices consistent with research on
effective practices?
What professional development do my teachers need?
Could you improve student achievement
if you had answers to these questions?
• Am I teaching what students are expected to learn?
•
Am I spending my instructional time on the right things?
• Are my instructional practices consistent with research on
effective practices?
•
What professional development do I need?
Enacted (3rd Grade Teacher Reports)
Intended (3rd Grade Math Indicators)
Enacted (9th Grade Teacher Reports)
Intended (9th Grade Indicators)
Enacted (3rd Grade Teacher Reports)
Intended (3rd Grade Math Indicators)
SEC Online
reports instructional
content using tile
charts.
Drop-down menus
allow you to select
grade-specific and
course-specific
results for your
school, district and
state, in addition to
reports of your own
results.
A teacher’s
own results.
How do the surveys work?
• Content specialists code the standards and
assessments
• Teachers take an online survey about what
they teach, how they teach it and what
professional development they have had
Teacher
Reports
SEC
Taxonomy
Content
Descriptions
Needs
Assessment
Curriculum
Management
Alignment
Analyses
Monitoring
Change
Content
Analyses
Content
Descriptions
Program
Evaluation
Ohio is one of nine states to
participate in the SEC - ELL Grant, an
enhanced assessment grant awarded
by the U.S. Department of Education
to CCSSO and a consortium of states
to better understand and support the
achievement of English Language
Learners.
In too many schools, English Language
Learners are a subgroup whose performance
is not meeting the AYP targets. Schools,
districts, and states across the country are
trying to find answers to how to best provide
access to and support ELL students in
attaining state standards and NCLB targets.
This SEC ELL Study is addressing the
following questions:
• To what extent do ELL’s have opportunity to learn
academic content and skills in state standards?
• What is relationship of state ELD standards and
assessments to state academic standards?
• What instructional practices/strategies are used to teach
English language skills across content areas?
• What is relationship of alignment of instruction (to
standards) with student achievement?
What can Ohio educators gain
from participating
in the Surveys?
School and district leaders can…
•
•
•
Identify the extent to which instruction is aligned
to state standards and assessments
Understand what instructional activities and
strategies are being used in classrooms
Compare the strategies used in classrooms with
ELL students to strategies used in classrooms
without ELL students.
School and district leaders can…
• Identify the extent to which language proficiency
•
•
standards are aligned to language proficiency
assessments
Identify alignment of language complexity and
demand in content standards
Identify priority needs for professional development
Teachers can…
• Identify the extent to which what they teach is
•
•
•
•
aligned with state standards and assessments
Better understand what they need to be teaching
more or less
See how their instructional practices compare to
other teachers in their school or district
Identify the language complexity and demand of the
standards they teach
Identify priority needs for professional development
What is your role in this project?
What is the state’s role?
The State’s Role …
• To participate in a nine state collaborative with CCSSO (Council
•
•
for Chief State School Officers) and WCER (Wisconsin Center
for Educational Research) to identify study questions, implement
the survey in their respective states, and analyze the results.
To identify which districts will participate in taking the survey, the
target number of participants and content areas and grade
levels that will be included in the project.
To coordinate the coding of selected state content standards
and the language proficiency standards for their state and send
content and linguistic specialists to participate in the coding
workshops.
Your role …
• participate in taking the survey and the timeframe for
completion
• Attend an orientation presentation
• Take the survey
• Attend training on how to read and interpret the data
results from the survey
• Have discussions using your data results
Administering the Surveys:
What is involved?
Online Survey Administration
www.seconline.org
• Approximately 90-120 minutes to complete
(depending on which surveys)
• May be completed in multiple sittings
• Data is saved as each section is completed
• Teachers may use their planning book or calendar
Reporting Instructional Content
Step 1: Report time spent on topics taught
Review the list of topics
presented for the
current Content Area.
For each topic in the list
that is taught to the
target class, select a
radio button
corresponding to 1,2, or
3 based on the
following definitions:
0 = Not covered
1 = Less than 1 lesson
2 = 1-5 lessons
3 = more than 5 lessons
Reporting Instructional Content
Step 2: Set expectations for students for each topic taught.
Focus on target class &
reporting period.
For each topic selected
from the previous
screen set the cognitive
expectations for
students for each of 5
categories of cognitive
demand, using the
following definitions
0 = No emphasis
1 = Slight emphasis
2 = Moderate emphasis
3 = Sustained emphasis
ELL-Reporting Instructional Content
Survey Completion
Editing Results
Completed survey sections may be reviewed/edited until:
1) The survey completion window has closed
2) You review results for a given survey section
To review/edit responses:
Check the box on the Survey Menu Screen next to the
section you want to review/edit. (Completed sections will
be identified by green text.)
Reviewing Results
Online Report Generator
Results are available for review immediately upon completion of required survey sections.
ELL data will be
available Early Fall
While results are available immediately, you may want to wait until all teachers from
your group have completed the survey before reviewing results.
What do you need to know about
taking the survey?
• What do you need to know to be able to do a
good job taking the survey?
• Where and when will you take the survey?
• What do you need to bring?
• What data will you receive after they take the
survey?
• How will your confidentiality be protected?
• Are there any additional incentives for your
participation?
Who should you contact for additional
information?
At the state….
Dan Fleck
[email protected]
Sue Mash
[email protected]
Christopher Woolard
[email protected]
At CCSSO …
Carolyn Karatzas, Technical Assistant