Transcript Slide 1
Tennessee Teacher Evaluation Technical Advisory Group Orientation Meeting May 12, 2011 Agenda Welcome and Introductions Understanding Tennessee’s Evaluation Development Process Review the Technical Advisory Group’s Roles and Responsibilities Defining “Comparable” Analyze the Criteria for Review Review • • • • • 7/16/2015 of Recommendation Process Accessing Recommendations – Hope Street Group Portal Using the Criteria Method for Responding to Recommendations Adding Additional Recommendations Timeline 2 Tennessee Educator Acceleration Model An Overview Tennessee Educator Acceleration Model The Vision: Accountability: valid, reliable, defensible 7/16/2015 Professional growth: collegial and collaborative 4 First to the Top Act, January 2010 50% based on quantitative student data: 35% student growth, 15% approved student achievement measures 50% based on qualitative instrument/process Authorizes teacher effect data to be shared with approved teacher preparation programs if the data does not personally identify particular teachers Requires annual evaluation of all teachers and principals and that evaluations be a factor in personnel decisions, including promotion, retention, tenure, and compensation. 7/16/2015 5 Teacher Evaluation: An Overview Effectiveness Ratings Evaluations will differentiate teachers and principals into five effectiveness groups: 7/16/2015 7 35% Growth Measures TVAAS Scores where available Groups of 8 –12 educators in each of the non‐tested subject and grade groupings have met to recommend measures. The TDOE and a technical advisory group of state and national experts will review the recommendations of the Development Teams to determine the list of approved measures. 7/16/2015 1. Pre-kindergarten-Grade 3 2. Fine Arts 3. Computer Technology 4. Educators with Caseloads 5. Librarian/Media Specialist 6. Physical Education / Health / Wellness 7. Career Technical Education 8. World Languages 9. English Language Learners 10. Special Education 11. High School Courses in English, Math, Science, and Social Studies without state tests 12. Academic Interventionists 8 15% Other Achievement Measures To develop options for the 15% achievement portion of the teacher evaluation, the Teacher Evaluation Advisory Committee (TEAC) recommended a menu of options, approved by the State Board, from which teachers may choose, in cooperation with their administrator, for use in their evaluation. The chosen measures should reflect the educator’s primary responsibility as directly as possible. Measures are under review currently for appropriateness and scalability. 7/16/2015 9 Guidelines for 50% Qualitative Component Qualitative appraisal instruments must address the following domains: – Planning – Environment – Professionalism – Instruction Observation rubric shared and available to all teachers; teachers should be trained TDOE to provide user-friendly, manageable forms to document observations and personal conferences Feedback from observation visits provided within one week Minimum of 4 observations for non-apprentice teachers Minimum of 6 observations for apprentice teachers 7/16/2015 10 Required Observations Professional Teachers-Four Observations Annually 1. 15-minute observation covering 3 indicators 2. Lesson-length observation covering 12 indicators 3. 15-minute observation covering 4 indicators 4. Lesson-length observation covering 12 indicators 7/16/2015 Apprentice Teachers—Six Observations Annually 1. 15-minute observation covering 3 indicators 2. Lesson-length observation covering 12 indicators 3. 15-minute observation covering 4 indicators 4. Lesson-length observation covering 12 indicators 5. 15-minute observation covering 7 indicators 6. Lesson-length observation covering 12 indicators 11 Selection of the TAP Rubric Research – Nearly 2 decades of research and refinement, with large-scale implementations – Research has shown positive correlation between TAP rubric ratings and student growth. – TN CRED survey results have been positive. Resources – TAP Training Portal with extensive videos and other instructional resources – TAP has capacity to train all observers and evaluators; not train-the-trainer – TAP prepared to administer certification tests for all observers Meaningful, but Manageable 7/16/2015 12 Technical Advisory Group Roles and Responsibilities Roles and Responsibilities The Technical Advisory Group will be responsible for the following: Finalizing a set of criteria to use when evaluating the recommendations from the Development Teams Reviewing and commenting on recommendations from the Development Teams Determining if the recommendations are appropriate instruments for measuring teacher effectiveness by applying standardized criteria Advising the TDOE on other instruments that could be used for teacher evaluations in the 12 educator categories 7/16/2015 14 Roles and Responsibilities The Technical Advisory Group will be responsible for the following: Making final instrument recommendations to the TDOE Making recommendations to TDOE on a year’s growth for each measure as initially recommended to the TDOE (In some cases, the group may recommend the actual baseline and growth levels; in others, the group will identify a clear process involving psychometricians and educators to determine expected growth levels.) 7/16/2015 15 FTTT Statute & Defining Comparable FTTT Statutory language Tennessee Code Annotated, Section 49-1-302(d)(1) and (2) Thirty-five percent (35%) of the evaluation criteria shall be student achievement data based on student growth data as represented by the TVAAS, developed pursuant to Tennessee Code Annotated, Title 49, Chapter 1, Part 6, or some other comparable measure of student growth, if no such TVAAS data is available. ‘Comparable’ ‘Comparable’ is not defined in statute – Where terms in statute are not defined, courts will reference a standard dictionary definition Random House Dictionary, © Random House, Inc. 2011. com·pa·ra·ble –adjective 1. capable of being compared; having features in common with something else to permit or suggest comparison: He considered the Roman and British empires to be comparable. 2. worthy of comparison: shops comparable to those on Fifth Avenue. 3. usable for comparison; similar: We have no comparable data on Russian farming. Development Team Recommendations Review Criteria & Process Educator Group Categories Educator Groups – Development Teams PreK-3 HS Core non-tested CTE Caseloads ELL Fine Arts Library Media Specialists Special Education World Languages Academic Interventionists Computer Technology PE/Health Non-Tested Subject and Grades Assessment Overall Criteria The assessments match the curriculum standards. The assessments are free of bias. The achievement levels are appropriate. The assessment administration is standardized. There is consistency of scoring and reporting. Review Criteria Category 1 High-quality, appropriate measure of academic growth Reliable – similar results and secure administration Would yield a similar distribution of scores to TVAAS Valid - sufficiently aligned with curriculum Transparent Fiscally responsible* • PreK-3 • HS Core non-tested Review Criteria Category 2 Appropriate measure of student growth Credible Would yield distribution of scores Valid - sufficiently aligned with curriculum Transparent Fiscally responsible* • CTE ELL Library Media Specialists World Languages Computer Technology - Caseloads Fine Arts Special Education Academic Interventionists PE/Health Decision Rubric Met – Assessment met all five criteria. Met With Comment – Assessment met four of the five criteria with comment as appropriate on the criteria not met. Not Met With Comment – Assessment met fewer than four of the criteria. Recommendations Review Process Accessing recommendations and other useful information Hope Street Group Portal Catherine Cullen, Education Analyst (301) 922-3755; [email protected] Finalizing and using the criteria Method for responding to the recommendations – feedback form Adding additional recommendations – planning document posted Timeline Purpose Welcome and process orientation Deadline for responses from the Technical Advisory Group 7/16/2015 Date/Time May 12: 90 min conference call June 6 25 Thank You!