TEACHER EFFECTIVENESS IN PA: From Compliance to Quality

PIL Institute 2012

Tracy Hinish, Sunny Minelli Weiland and Cristine Wagner-Deitch

Welcome

… 

Housekeeping Items –

 Post-It Notes: Parking Lot  Policy  Legislation  Specific Domain/Rubric

Learning Intentions: Participants will learn. . .

 Requirements for pilot schools  How their thinking about good teaching compares to the research about good teaching  That the Framework represents good common sense, and much that we already know, about teaching  The form and content of Domains 1, 2, 3 and 4

5 “Best Practices” for Teacher Evaluation 1.

Defensible definition of teaching 2.

Differentiation of evaluative processes 3.

Evidence-driven process 4.

The role of teacher learning 5.

Transparency

QUALITIES OF GOOD TEACHING Worksheet #1 Wisdom of Good Practice Qualities of Good Teaching Tied to Student Learning

Directions  Independently, on the left side of your paper, please respond to the following question:  What are the qualities of teaching most tightly tied to student learning?  At the cue, Pair-Share your list with an elbow partner  Debrief

CONNECTIONS TO THE DOMAINS 1.

Planning and Preparation 2.

The Classroom Environment 3.

Instruction 4.

Professional Responsibilities

REFLECTING ON PAST PRACTICE

 Think about feedback that you have given to a teacher on an observation report or feedback you have received as a teacher.

 With a partner, share 2 examples and the impact the feedback had on you or the teacher.

Evaluation Assumptions…

 That telling a teacher what we think of their teaching will change it  That NOT telling them what we think will change it  That telling them what to do will cause it to happen  That one or few conversations will work  That our “superstars” don’t need real feedback

Agreed Upon Areas of Focus Opportunities to Implement Changes Pre Observation Domains 1 and 4 Domains 1, 2 and 3 Observation Domains 1, 2, 3, and 4 Post Conference Collaborative Assessment Preparing for Post Observation conference Domains 1, 2, 3, and 4

Best Practice…

Start with a defensible definition of good teaching that is studied, and understood, by all stakeholders.

Best Practice…



Let evidence , not opinion, anchor the process.

Evidence…

 is a factual reporting of events  may include teacher and student actions and behaviors  may also include artifacts students or others prepared by the teacher,  is selected using professional judgment observer and/or the teacher by the  is NOT clouded with personal opinion or biases

TYPES OF OBSERVATION EVIDENCE

 Verbatim scripting of teacher or student comments: “

Could one person from each table collect materials?”

 Descriptions of observed teacher or student behavior:

The teacher stands by the door, greeting students as they enter.

 Numeric information about time, student participation, resource use, etc.:

Three students of the eighteen offer nearly all of the comments during discussion.

 An observed aspect of the

roll is taken.

environment :

The assignment is on the board for students to do while

Statements of Evaluation…

 Mr. Clean is extremely organized.

 Ms. Oscar’s interactions with students are inappropriate.

 Mr. Pedagogy demonstrated smooth transition between instructional activities.  Miss Iquotient knows a lot about what she is teaching.

 Mr. Deadline is unaware of time constraints when it comes to paperwork.

THE DOMAINS

 Domain 1: Planning and Preparation  Domain 2: The Classroom Environment  Domain 3: Instruction  Domain 4: Professional Responsibilities

A FRAMEWORK FOR TEACHING: COMPONENTS OF PROFESSIONAL PRACTICE

Domain 1: Planning and Preparation

•Demonstrating Knowledge of Content and Pedagogy •Demonstrating Knowledge of Students •Selecting Instruction Goals •Demonstrating Knowledge of Resources •Designing Coherent Instruction •Assessing Student Learning

Domain 4: Professional Responsibilities

•Reflecting on Teaching •Maintaining Accurate Records •Communicating with Families •Contributing to the School and District •Growing and Developing Professionally •Showing Professionalism

Domain 2: The Classroom Environment

•Creating an Environment of Respect and Rapport •Establishing a Culture for Learning •Managing Classroom Procedures •Managing Student Behavior •Organizing Physical Space

Domain 3: Instruction

•Communicating Clearly and Accurately •Using Questioning and Discussion Techniques •Engaging Students in Learning •Using Assessment in Instruction •Demonstrating Flexibility and Responsiveness

IDENTIFYING THE DOMAIN AND COMPONENTS WORKSHEET

Worksheet #2 Identifying the Domain and Components

A. _____ Students are greeted at the door by Ms. G as they enter the room.

B._____ Mr. J asks students, as part of the lesson, to brainstorm examples of primitive tools.

Scavenger Hunt  At your table, please read each of the scenarios  As a table team, please decide which Domain and with which Domain, Component and Element the scenario best aligns. For those of you who have had Domain training, this will serve as a good refresher, and for those of you who have not had training, it will serve as a good introduction to navigate the framework.

Scenario #1…

Ms. C. has organized the new unit of study on the water cycle around the science content standards and the scope and sequence outlined in the pacing guide.

Scenario #1…

 Domain 1: Planning and Preparation  1e: Designing Coherent Instruction  Element: Lesson and Unit Structure

Scenario #2…

Following a series of lessons on the Bill of Rights, Mr. L. distributes a quiz to his grade 8 social studies class. The worksheet contains 25 multiple choice questions about the topic. The students are given 10 minutes to complete the quiz and then correct their own papers. In groups, students discuss the reasons for correct answers; Mr. L. circulates to offer assistance.

Scenario #2…

 Domain 3: Instruction  3d: Using Assessment in Instruction  Element: Student Self-Assessment and Monitoring of Instruction

Scenario #3…

After his first hour geography class, Mr. M. concluded that the lesson was successful because everyone received an “A” on the quiz.

Scenario #3…

 Domain 4: Professional Responsibilities  4a: Reflecting on Teaching  Element: Accuracy

Scenario #4…

The desks in Mr. T.’s second grade classroom are arranged in groups of four. A couch and beanbag chair are provided for students in the reading corner.

Scenario #4…



Domain 2: Classroom Environment

 2 e: Organizing Physical Space  Element: Arrangement of Furniture and Use of Physical Space

DEFENSIBLE DEFINITION

“Best” definitions of good teaching include more than that which we can see, making observation important but insufficient in teacher evaluation.

“Best” definitions must be research-based, inclusive and exclusive

Agreed Upon Areas of Focus Opportunities to Implement Changes Pre Observation Domains 1 and 4 Domains 1, 2 and 3 Observation Domains 1, 2, 3, and 4 Post Conference Collaborative Assessment Preparing for Post Observation conference Domains 1, 2, 3, and 4

PRE-CONFERENCE VIDEO 1.

2.

3.

4.

5.

Review the Pennsylvania Form for Domain 1 The teacher will be asked to complete this form before the pre-observation conference What evidence will the teacher be providing for the pre-observation conference? Reflect on what clarifying and probing questions you might ask At the cue, Pair-Share

DOING THE OBSERVATION 1.

2.

3.

Review the Pennsylvania Form for Domain 2 & 3 What evidence will you be collecting during the observation? At the cue, Pair-Share

POST-CONFERENCE DEMONSTRATION

INDIVIDUALLY:

 What were your overall impressions of the conference?

 What suggestions/feedback did the observer make to the teacher?

 How did the teacher respond?

DEBRIEF AS A GROUP:

 What suggestions/feedback did the observer make to the teacher?

 How did the teacher respond?

 What changes in Teacher Practice might you expect to see as a result of this conference?

 How would you know?

OBSERVER SUGGESTIONS/FEEDBACK

 Try calling on genders more equally.

 Make sure all students are paying attention.

 Make sure your assessment actually matches the learning goals  Aim for posing more higher-order questions.

 Make sure your feedback is substantive, accurate, constructive, timely, and specific.

Language for the Post-Observation: Words NOT to Use  Defend  Prove  Argue  Convince  Avoid language that suggests opposition  Avoid language that might bring about a defensive response 4/25/2020 PBevan, D.ED

Language for the Post-Observation Conference         Say more about. . . Tell me about the evidence for. . .

Let ’ s look at the rubric for. . . What is the best match for. . .

Could you share background about… Could you share any professional development that contributed to… In what ways have you reflected on… In your reflection, could you share what you might change about… 4/25/2020 PBevan, D.ED

SUGGESTIONS - QUESTIONS Using Page 5 of

Participant Materials

, individually reframe the suggestions as questions.

SUGGESTIONS - QUESTIONS



With your group:



Discuss the questions created



Which ones might elicit the most teacher reflection? Why?

“This takes too much time.”

 Reflect for a moment –  How many hours on average do you spend on a complete “ cycle ” of teacher evaluation?

 Estimate the total number of written evaluations you have done X hours = hours you have devoted  What impact has this had on improving teaching practice?

Wrap-Up…

 A few thoughts from Charlotte Danielson’s

Enhancing Professional Practice: A Framework for Teaching…



Teaching is highly complex work…



The higher level of performance in the framework for teaching represent both greater experience and increased expertise…



Levels are levels of performance of teaching, not of teachers…

Of all the approaches available to educators to promote teacher learning, the most powerful is that of professional conversation.

Talk About Teaching!

Charlotte Danielson 2009, Corwin Press

Phase II Requirements

 Pre-Observation Conference  Priority component: 1e

(Designing Coherent Instruction)

 Observation  Priority components: 3c, 3d

(Engaging Students in Learning, Using Assessment in Instruction)

 Post-Observation Conference  Walkthrough

Next Steps…

 Participation Options for TE:  Teacher Evaluation Phase III  SIG Districts implementing a Transformational Model  Race to the Top Recipients  Principal Effectiveness is Coming As Well

PHASE III VOLUNTEERS    Number of participants your choice:  Teachers/Buildings/Administrators IU Provides 2 days of Training for Administrators  Complete    1 Formal Observation 1 Walk through Report all Data Share reflections on the process

SIG TRANSFORMATIONAL SCHOOLS  Required to Participate  10% of teachers in 2012-13  IU to train Administrators (2 days)  Complete   1 Formal Observation 1 Walk through  Report all Data  Share reflections on the process

RACE TO THE TOP DISTRICTS  District wide – not school wide  IU Provides 2 days of Training for Administrators   Complete   1 Formal Observation 1 Walk through Report all Data  Share reflections on the process  Must have 100% of all buildings and all teachers by the end of 3 years  Must Participate in Principal Effectiveness Training

DOMAINS FOR PRINCIPAL EFFECTIVENESS  Strategic/Cultural Leadership  Managerial Leadership  Leadership for Learning  School and Community Leadership

Before STEP # 1: PRE-OBSERVATION ( FO C U S ED O N D O M AI NS 1 & 4 )  Teacher completes Step #1: Lesson Plan in advance and sends to evaluator two days in advance of planning conference  Teacher and Evaluator meet to discuss the upcoming lesson framed around the following:    Question Stems:     1 a. What i s t he c o ntent bei ng t aug ht? What pr er equisite fo r l ear ning i s r equired? 1 b. Tell me about t he c omposition of your c l ass. How w i ll you modify t hi s l esson for g ro ups o r i ndiv idual st udents? 1 c . What do yo u want st udent s to l ear n during t hi s l esso n? 1 d. What r eso urces wer e c o nsider ed fo r t hi s l esson and r ej ected? Why ? What r eso urces w i ll be used? Why ? 1 e. Li st ver y br iefly t he steps o f t he l esson. 1 f. How w i ll you measure t he g oal s ar t i culated i n 1 c ? What does suc cess l ook l i ke? E v i dence i s added to t he l esso n pl an do c ument t hat em er ges fro m t he pr e -obser vation c o nference.

During STEP # 2: OBSERVATION ( FO C U S ED O N D O M AI NS 1 , 2 , & 3 )  Evaluator arrives 5 minutes prior to beginning of lesson to ‘walk the walls’ (D2)  Types of Observation Evidence:     Scripting of Teacher or Student comments Descriptions of Teacher and Student behaviors Numeric information Environment Remember:     C o llect ev i dence fro m S t udents – “ What ar e yo u l ear ning?; Is w hat yo u ’re do i ng har d i n a g o o d way ?

No n -neg otiable - Rec ord o bser vation o n st andard fo rm Opt ional – M ay use T-c har ts, seat i ng c har t s, o r si milar tem plates to r ec o rd r el at ive num eric dat a (t al ly m arks) E val uator do es N OT r et y pe o bser vation

After STEP # 3: PREPARING FOR THE POST-CONFERENCE ( FO C U S ED O N D O M AI NS 1 , 2 , 3 , & 4 )  Teacher and Evaluator do not need to meet during Step #3.

 With prerequisite training, the Teacher can engage in Step #3 independently or with the support of a coach.  Evaluator provides Teacher with completed observation form from Step #2.  Teacher is provided with an opportunity to add evidence to the observation form that may have been overlooked by Evaluator  Teacher returns the observation form to Evaluator with their additions  Teacher completes the self-assessment rubric (he/she may highlight phrases in multiple levels of the same component) and returns back to Evaluator prior to the post teaching conference  Evaluator highlights or checks ONLY he/she agrees the areas on the self-assessment with which

After STEP # 4: POST-TEACHING COLLABORATIVE ASSESSMENT ( FO C U S ED O N D O M AI NS 1 , 2 , 3 , & 4 )  Teacher meets with Evaluator to reflect on lesson - Evidence not required for each D4 component for this one lesson  Evaluator notes components of agreement and then invites teacher to take the lead in discussing the other components.  Components are collaboratively rated. Evaluator is the “rater of record” in the event of non-agreement. Evidence is the basis. Conver sation Stems:    C o mment o n t he ev i dence fo r . . .

Let ’s l o o k at t he r ubric fo r . . .

Tel l m e m o r e abo ut … .   What ’s t he bac kstor y fo r . . .

Let ’s l o o k at t he l ang uage t hat was hi g hlighted her e… t alk abo ut t he ev i dence fo r t hat i n t hi s l esso n

After STEP # 5: WALK-THROUGH ( FO C U S ED O N AGREED U P O N AREA O F C O NC ENT RAT I O N)  During the Post Observation Conference – an area of focus is determined  Plan of action determined  Walkthrough is conducted to monitor and provide feedback on the actions being taken to reach goals.

 Teacher given a copy of the evidence by the end of the day

Thinking Ahead…

 How can you tie what you learned today into your existing PIL course?

 Ticket out the door!

 Reflect on this process. Please document connections to Pennsylvania Inspired Leadership Initiative and how you might facilitate this! Turn to a partner and share.