Office of Measurement Services (OMS) Student Evaluation of Teaching June 2003

Student Evaluation of Teaching (SET)

 Policy approved May 19, 1992 by University Senate   Protocols approved April 1, 1993 by University Senate First administration of SETs – Fall Quarter 1993

OMS Role in Student Evaluation of Teaching

     Design/Print/Distribute scanable SET forms for Departments Analyze results and retain numerical data (1993 2003) Provide instructor and department chair with a summary of the data; original questionnaires returned to instructor SET data which has “student release” permission is given to ONESTOP to be placed on the web for viewing Summary data is posted on OMS website at: www.ucs.umn.edu/oms/setstats.html

SET Standard Questionnaire Forms

    Form C – contains 5 required questions, student background info, space for six additional questions Form D – contains the same content as Form C plus 10 additional rated items, and a 12-item checklist on aspects of the course to be used for course improvement Form E – contains the same content as Form C but has 48, rather than six response spaces. The form is intended for use with a separate questionnaire.

Form F – customized form contain required questions plus additional information requested by department

Required Questions (on all forms)

   How would you rate the instructor’s overall teaching ability?

How would you rate the instructor’s knowledge of the subject matter?

How would you rate the instructor’s respect and concern for students?

 How much would you say you learned in this course?

 How would you rate the physical environment in which you take this class, especially the classroom facilities, including your ability to see, hear, concentrate, and participate?

Ten Rating Items on Form D

          Instructor’s clarity in presenting or discussing course materials.

Instructor’s rapport with you as a student.

Instructor’s use of technology to enhance your learning experience in the course.

Instructor’s success in getting you to think.

Instructor’s attention to what helps you learn.

Instructor’s respect for students’ individual differences.

Overall quality of text(s) and handouts.

Helpfulness of feedback given you about your performance.

Degree to which exams and quizzes (or other evaluation procedures) measured your knowledge and understanding.

Instructor’s encouragement of students to express their views.

Student Release Items

          The instructor provided a (Minimally/Moderately/Highly) structured learning environment.

The instructor emphasized: a) covering fewer course topics in depth b) balancing breath and depth in course topics covered c) covering many course topics rather than a few The course Guide and course syllabus accurately described the learning activities that occurred during the term.

Instructor stimulated me to think critically about the course material.

Instructor set high expectations for student performance in the course.

Instructor used a variety of teaching and learning strategies in the course.

Instructor provided me with timely and helpful feedback about my performance.

In-class learning activities contributed to my learning.

I attended almost all the class sessions during the term.

I would take another course with this instructor.

Administering SET Questionnaires

 University policy specifies that each course taught by a given instructor is to be evaluated at least once each year in which it is taught.

 Questionnaires are to be administered during the last two weeks of the term, without the instructor present.

 Questionnaires are returned directly to the department office for logging and transmission to the Office of Measurement Services.

SET Reports

   The class summary for the instructor contains frequencies and percentages of responses to all items, and means, medians, and standard deviations for all evaluation ratings. Bar diagrams show the results graphically.

The class summary for the department contains the same information as the instructor’s summary for the required evaluation and student background items. With instructor approval, the complete class summary can be provided to the department in place of the abbreviated summary.

The class summary, with instructor approval, provided on ONESTOP for students contains the 10 student release items.

Pilot test of web-based SET

 In Spring 2003, several departments were invited to participate using Online SETs  The School of Nursing, the School of Public Health, and the Department of Physics agreed to participate.

 An evaluation of the success of the Online SET process is being completed in summer 2003.