Transcript Student Learning Objectives (SLO)
Student Learning Objectives (SLO)
Anthony Conti [email protected]
Dr. Cathleen Cubelic [email protected]
Our Objectives
Define an SLO Design, Build, and Review an SLO Interpret the SLO Template Consider Assessment Quality and Purpose View online tools Plan for implementation
LEA Responsibilities
1.
To select a minimum group of 6-10 teachers, with aligned principals, to implement the SLO process (to receive training from the IU, using the PDE materials, to design, build and review a minimum of one SLO that is prepared using the online template, and follow the implementation process through the administrative review, monitor and final evaluation stages. THE RESULTS OF EVALUATION ARE NOT EXPECTEDTO BE USED AS A PART OF THE TEACHER EVALUATION.)
LEA Responsibilities
2.
To assign an implementation team to be trained by the IU and to subsequently train the teachers and principals involved in the pilot, or train the entire staff in preparation for next year. Implementation team members should include, at minimum, but not limited to: a.
One administrator, preferably at the curriculum level b.
c.
One principal, preferably one involved in the pilot process Two teachers, preferably two involved in the pilot process
LEA Responsibilities
3.
To allot one day for representatives from the implementation team to meet with the authors of the SLO process. (Substitute and travel expenses would be provided by PDE.) 4.
To provide information, in the form of surveys and interviews, to a researcher who will evaluate the SLO process.
Teacher Effectiveness System in Act 82 of 2012 Teacher Observation & Practice Effective 2013-2014 SY
Danielson Framework Domains 1. Planning and Preparation 2. Classroom Environment 3. Instruction 4. Professional Responsibilities
Building Level Data/School Performance Profile Effective 2013-2014 SY
Indicators of Academic Achievement Indicators of Closing the Achievement Gap, All Students Indicators of Closing the Achievement Gap, Subgroups Academic Growth PVAAS Other Academic Indicators Credit for Advanced Achievement
Building Level Data, 15% Teacher Specific Data, 15% Teacher Specific Data
PVAAS / Growth 3 Year Rolling Average 1. 2013-2014 SY 2. 2014-2015 SY 3. 2015-2016 SY Other data as provided in Act 82
Observation/ Practice, 50% Elective Data, 20% Elective Data/SLOs Optional 2013-2014 SY Effective 2014-2015 SY
District Designed Measures and Examinations Nationally Recognized Standardized Tests Industry Certification Examinations Student Projects Pursuant to Local Requirements Student Portfolios Pursuant to Local Requirements 6
Teacher Effectiveness System in Act 82 of 2012 Teacher Observation & Practice Effective 2013-2014
Danielson Framework Domains 1. Planning and Preparation 2. Classroom Environment 3. Instruction 4. Professional Responsibilities
Building Level Data/School Performance Profile Effective 2013-2014 SY
Indicators of Academic Achievement Indicators of Closing the Achievement Gap, All Students Indicators of Closing the Achievement Gap, Subgroups Academic Growth PVAAS Other Academic Indicators Credit for Advanced Achievement
Observation/ Practice, 50% Building Level Data, 15% Elective Data, 35% Elective Data/SLOs Optional 2013-2014 SY Effective 2014-2015 SY
District Designed Measures and Examinations Nationally Recognized Standardized Tests Industry Certification Examinations Student Projects Pursuant to Local Requirements Student Portfolios Pursuant to Local Requirements 7
The Rating Tool
[for teacher with Eligible PVAAS Data]
The SLO in PA is written in relationship to a specific teacher and a specific class/course/content area for which that teacher provides instruction.
“The PSSA test doesn’t completely measure my effectiveness.”
≠
SLO Definition
A process document to a measure of educator effectiveness based on student achievement of content standards
.
SLO Process Components
The SLO process contains three (3) action components:
1.
Design (ing): thinking,
conceptualizing, organizing, discussing, researching
2.
Build (ing): selecting, developing,
sharing, completing
3.
Review (ing): refining, checking,
updating, editing, testing, finalizing 12
• • • •
SLO Process Components DESIGN
Thinking about what content
standards to measure
Organizing standards and measures Discussing with colleagues
collective goals
Researching what is needed for a
high quality SLO 13
• • • • •
SLO Process Components BUILD
Selecting the performance measure(s) Developing targets and expectations Completing the template Sharing the draft materials with other colleagues
Developing/Documenting
performance task(s) 14
• • • • • 15
SLO Process Components REVIEW
Checking the drafted SLO (including the performance measures for quality Refining measures and targets Editing text and preparing discussion points/highlights for principal Finalizing materials Updating completed SLOs with performance data
Activity Count off by 6 at your table. Each one take an “SLO should……” statement. [next slide] Produce an “educator friendly” version of that statement.
Share within your group.
The SLO Should….
1. Represent student performance taught by educator.
in a specific course/content area 2. Reflect the diversity of students as learners.
3. Align to a target set of selected academic content standards that represent the depth and breadth of the goal statement.
4. Use metrics based upon multiple events/data collection periods to measure defined levels of student growth or “mastery”.
5. Be supported by verifiable data that can be collected and scored in a standardized manner.
6. Include a set of independent performance measures directly linked to the established goal.
Design
What is a Goal Statement?
Definition:
• Narrative articulating the “big idea” upon which the SLO is built under which content standards are directly aligned.
Characteristics:
• Encompasses the “enduring understanding” of the standard • Central to the content area • 19 Foundational concepts for later subjects/courses
Goal Statement Example
• “Students will apply the concepts and the competencies of nutrition, eating habits, and safe food preparation techniques to overall health and wellness throughout the life cycle at individual, family and societal levels.” 20
21
SLO Goal
(Template #1)
Goal Statement addresses:
• • • WHAT the “big idea” is in the standards
Standards
HOW the skills and knowledge support future learning
Rationale Statement:
WHY the “big idea” is a central, enduring concept http://pdesas.org/standard/PACore
More Considerations for Goal Statements Do you have previous data to help guide your goal?
What does your growth and achievement look like?
Is there a building/district-wide goal?
Activity: Goal Statement (Template #1) Within your team, choose a discipline in which you’d like to focus. Preferably, choose a discipline that is taught by one amongst you.
Complete “Template #1 Goal Statement” We will post them for the entire group.
Build
Template Section 1
Goal
Goal statement should articulate an appropriate “ big idea ”. http://pdesas.org/standard/PACore Standards should be the appropriate Focus Standards supporting the goal.
Rationale statement should be class/course. reasons the Goal statement and the aligned Standards address important concepts for this why
Template Section 2
Performance Indicator
Definition: a description of the expected level of student growth or achievement based on the performance measure Answers two questions……….
1) Does the indicator define student success?
2) What is the specific measure linked to the indicator?
Examples of Performance Indicator Targets Students will achieve Advanced or Proficient on all four criteria of the Data Analysis Project rubric.
Students will score an average of 3 or better on five different constructed response questions regarding linear modeling according to the general description of scoring guidelines.( http://static.pdesas.org/Content/Documents/Keysto ne%20Scoring%20Guidelines%20-%20Algebra%20I.pdf
) Students will improve a minimum of 10% points from pre- to post-test for material in each semester. Students will show “significant improvement” in the Domain of Measurement on the Classroom Diagnostic Tools Mathematics Grade 7 assessment from the first to the last administration.
Performance Indicator – Focus student group A description of the expected level of achievement for each student in a subset of the SLO population (1F) based on the scoring tools used for each performance measure (4A).
Subset populations can be identified through prior student achievement data or through content-specific pretest data.
Examples of Performance Indicator Targets: Focused Student Group Students who scored below the 30 benchmark AIMSweb R-CBM probe will score above the 30 th percentile by the end of the school year using the national norms.
th percentile on their Students who scored below a 2 on the pre-test will improve a minimum of one level on the post-test.
Goal Focus Standards Performance Indicator(s) and Measure(s)
Activity: Growth and Mastery
What assessments may be used as growth, mastery or both?
What are the characteristics of a quality assessment?
Write (3).
Report out the summary from your table.
Good assessments have……
A specific and defined purpose A mixture of question types Items/tasks with appropriate DOK levels Items/tasks that are Standards Aligned A quality rubric A standardized scoring method Academic Rigor A reasonable time limit for completion An appropriate readability level Multiple methods of student demonstration Validity and reliability Well-written directions and administration guidelines Cut scores for performance categories
Academic Rigor 1.
Standards-Aligned 2.
Developmentally Appropriate 3.
Focused on Higher-Order Thinking
Weighting, Linking, or Otherwise
1.
Standard
You may consider each Performance Indicator equal in importance.
2.
Linked
You may link multiple Performance Indicators, if you like. Do this for “pass before moving on” assessments.
3. Weighted You may weight multiple Performance Indicators, if you like. Do this when you believe one or more PI’s are more complex or more important than others.
Standard Scenario PI 1 PI 2 P1 3 Name Building a Bridge Project Roller Coaster Design Egg Parachute Student Proportion Met Target 68 80 56 80 40 80 68 + 56 + 40 𝑇𝑜𝑡𝑎𝑙 = 100 + 100 + 100 = 164 300 = 54.7%
Weighting Scenario Physics Class with (3) PI targets: Name Weight PI 1 PI 2 P1 3 Building a Bridge Project Roller Coaster Design Egg Parachute 50% 25% 25% Student Proportion Met Target 68 80 Points Acquired 42.5
56 40 80 80 17.5
12.5
Total Score = 72.5%
Template Section 3
Goal-Indicator-Measure Goal Standards SLO Goal (Big Idea) Indicator Indicator #1 Indicator #2 Performance Measures Assessment #1a Assessment #1b Assessment #2
Goal-Indicator-Measure Goal Standards Indicator Performance Measures SLO Goal (Big Idea) Indicator #1 Indicator #2 Assessment #1 Assessment #2
Performance Measure - Descriptions
State the name of the assessment(s).
List the type of measure.
Explain the purpose, state what Measure should measure.
the Performance Identify the timeline and occurrence(s) Scoring Tools should indicate the solution key, rubric, checklist , etc. that is being used to score the PM.
Administration & Scoring Personnel should contain who is giving the test and who is scoring it.
Performance Reporting should state how others will know which students met the Performance Indicator(s).
Template Section 4
Expectations PI Targets Teacher Expectations
Teacher Expectations Definition: identifies each level (Failing, Needs Improvement, Proficient, Distinguished) students are meeting the Performance Indicator Targets.
These reflect the continuum established by the teacher prior to the evaluation period.
Each level is populated with a percentage range so that there is distribution of performance across levels.
Based on the actual performance across all identified Performance Indicators, the evaluator will determine one of the four levels for the SLO.
Template Section 5
Review
Tools for Review
SLO Coherency Rubric School Leader’s SLO Checklist Assessment QA Checklist
Now you are an expert.
Take 10-15 minutes to review this SLO example given for a Family and Consumer Science Class.
Please make notes on the document where you question or disagree with what is stated and where you think needs clarification. Also, note what suggestions may be given to this instructor for improvement and questions you would ask prior to approving this SLO for the teacher.
Please take the first 5 minutes to do this silently on your own. We will review each section and share with the group. Be ready to discuss your thoughts.
The Online Tool http://www.pdesas.org/ Use the Homeroom link at bottom right Click the RIA Homeroom site link in the top paragraph Register and log in.
Scavenger Hunt 1.
Find the online and Word templates we use to complete the SLO writing process.
2.
Find the Performance Task Framework Template.
3.
Find the handout that helps us define our goal and rationale.
4.
Find the Art Grade 8 SLO model SLO.
5.
Find the PDF Power Point that discusses Reviewing SLOs 6.
Find the Help Desk: Section 1 document
Homework Your group return with one SLO written having at least one Performance Indicator/Measure.
Complete the template using the MS WORD template and email it to [email protected]
We plan to use these as exemplars at our December 12 meeting.
Next Time Assessment Literacy Vetting of Initial SLOs Planning