UCF Academic Program Review Orientation
Download
Report
Transcript UCF Academic Program Review Orientation
UCF Academic Program Review
Orientation
Class of 2013-14
Office of Academic Affairs
Spring 2013
Topics to Cover
2
background
academic program review process overview
content of the reviews
programs undergoing review in 2013-14
consultant information
getting started
contacts
questions
Background: Program Reviews
in Florida
3
legislatively mandated
required every seven years for all academic programs
(exceptions may be negotiated to align with a specialized
accreditation cycle)
based on internal evaluation with appropriate input from
external experts
beginning in 2000, university-defined processes that comply
with state requirements
Florida Board of Governors (FBOG)
maintains seven-year schedule for reviews
approves university APR policies and procedures
requires university submission of APR results
uses university APR information to inform state-level
decision making
Academic Program Review
Process Overview
Purposes:
4
to examine the quality and productivity of
academic programs
to develop recommendations leading to program
improvement
APR Process Overview:
Program Elements Evaluated
centrality
comparative advantage
cost
demand
quality
*Refer to APR Process handout for additional details
5
APR Process Overview:
Sources that Inform Review
6
institutional trend data (provided by Office of Institutional
Research (IR)) – see handout for overview
program and department self-studies (including Contributing
Faculty Activity Worksheet supplement)
department/unit statements of good teaching
qualifications practices (“discipline descriptions”)
http://afia.ucf.edu/fq/fqteaching/dd/
graduate faculty members and scholars review
supplemental review materials
external consultant reports
APR Process Overview:
Sources that Inform Review…continued
Supplemental Review Materials:
university, college, and unit strategic plans
program curriculum materials
institutional effectiveness results and plans
undergraduate academic learning compacts (ALCs)
http://www.oeas.ucf.edu/alc/academic_learning_compacts.htm
program handbook(s), if applicable
current faculty CVs
unit’s faculty workload policy
faculty annual evaluation standards and procedures
7
APR Process Overview:
Sources that Inform Review…continued
Supplemental Review Materials continued:
faculty promotion and tenure standards and procedures
most recent program accreditation or certification results and
recommendations, if applicable
representative sample of undergraduate and graduate theses and
dissertations
UCF instructional faculty mix report (% SCH taught by FT & PT faculty)
department/unit E&G budget summary
average 9-month faculty salaries by rank, department, and college
other appropriate supplemental review materials
* See
handout for greater detail and who provides which pieces
Content of the Review
Strengths, weaknesses, opportunities, and threats are
considered with regard to the following areas:
General
alignment of program to department, college, university,
and BOG strategic plans
Program
curriculum
sufficiency of course offerings
benchmarking
partnerships, research, and other engagement
opportunities
9
Content of the Review…(continued)
Faculty
number and balance of faculty types
qualifications
scholarly and creative activity (number of peer-reviewed
publications, exhibitions, and/or funding by year for the
past four years)
assignments (teaching, research, and service)
teaching loads (numbers of classes by program and
numbers of students served)
thesis and dissertations supervised over the past
four years
faculty development and mentoring
10
Content of the Review…(continued)
Resources
space (instructional, laboratory, office)
equipment and facilities
staff
Students
quality of incoming students
evidence of quality education (placement, licensure pass
rates, awards)
retention, progression, and completion
satisfaction
11
APR Process Overview:
Parties Involved in the Process
APR is a collaborative process involving the:
12
provost
Program Review Committee (PRC)
college dean
department chairs and school directors
program faculty members, staff members, and students
external consultant(s)
other stakeholders, as appropriate
APR Process Overview:
Program Review Committee
PRC Charge:
to advise provost on program strengths, weaknesses, and
recommendations for improvement
PRC Tasks:
selects external consultants
reviews self-studies and APR data (e.g., IR trend data)
meets with consultants
reviews consultant reports
develops recommendations for program improvement in
concert with provost and dean
13
APR Process Overview:
Program Review Committee…(continued)
PRC Members
Dr. Diane Chase (chair), executive vice provost, Office of
Academic Affairs
Dr. Ross Hinkle, interim vice provost and dean, College of
Graduate Studies
Dr. Elliott Vittes, interim vice provost and dean, Office of
Undergraduate Studies
Dr. Stephen Kuebler, interim assistant vice president, Office
of Research and Commercialization
Dr. Paige Borden, assistant vice president, Office of
Institutional Knowledge Management
Ms. Heidi Watt (ex-officio), associate director of accreditation
and program review, Office of Academic Affairs
14
APR Process Overview:
General Process Overview
15
consultant nomination, selection, & procurement
programs complete self-studies; provide last review
recommendations’ status update; identify major program
changes since last review; compile supplemental review
materials
consultant site visit – usually two days on campus
consultant written report(s) submitted to academic affairs
approximately two weeks after site visit
college meets with program to review consultant reports and
prepare for dean’s meeting with PRC
APR Process Overview:
General Process Overview…(continued)
16
PRC and dean (and dean’s guests) meet to develop lists of
program strengths, weaknesses, and recommendations
PRC finalizes lists for provost’s approval
dean reviews lists with provost (usually at standing meeting)
summary review results provided to UCF Board of Trustees
(BOT) Educational Programs Committee (EPC)
summary review results provided to Florida Board
of Governors
dean provides APR recommendation implementation update to
BOT, EPC
APR Process Overview:
UCF and FL SUS Reports
17
Contents of APR Report to UCF Board of Trustees EPC
includes summary of:
actions taken based on recommendations from previous
program review
current program strengths and weaknesses
action recommendations for program improvement
Contents of APR Report to Florida Board of Governors
includes summary of:
major changes made since previous program review
current program strengths and weaknesses
action recommendations for program improvement
APR Class of 2012-13
All 36 active College of Education degree programs
spanning nine thematic areas
10 bachelor’s programs
20 master’s programs
3 specialist programs
3 doctoral programs
18
Tentative Program Groupings
Elementary Education, Early Childhood Development
and Education, and Reading
19
Early Childhood Development & Education, B.S. & M.S.
Elementary Education, B.S., M.A., & M.Ed.
Reading Education, M.Ed.
Education, Ph.D. – Elementary Education Track
Education, Ph.D. – Reading Education Track
Education, Ph.D. – Early Childhood Track
Tentative Program Groupings…(continued)
Secondary Education
20
Applied Learning and Instruction, M.A.
Art Education, B.S.
English Language Arts Education, B.S.
Mathematics Education, B.S.
Science Education, B.S.
Social Science Education, B.S.
World Languages Education, B.S.
K-8 Mathematics and Science Education, M.Ed.
Teacher Education, M.A.T.
Teacher Leadership, M.Ed.
Education, Ph.D. – Mathematics Education Track
Education, Ph.D. – Science Education Track
Education, Ph.D. – Social Science Education Track
Education, Ph.D. - TESOL Track
Tentative Program Groupings…(continued)
Career and Technical Education
Career and Technical Education, M.A.
Technical Education and Industry Training, B.S.
Instructional Design & Technology
21
Instructional Design and Technology: Educational Technology,
M.A.
Instructional Design and Technology: e-Learning, M.A.
Instructional Design and Technology: Instructional Systems, M.A.
Education, Ph.D. – Instructional Technology Track
Tentative Program Groupings …(continued)
Counselor Education, School Psychology
and Marriage and Family Therapy
Counselor Education, M.A. & M.Ed.
Marriage and Family Therapy, M.A.
Education, Ed.S. – School Counseling Track
School Psychology, Ed.S.
Education, Ph.D. – Counselor Education Track
Exceptional Student Education
22
Exceptional Student Education, M.Ed.
Exceptional Student Education K-12/ESOL Endorsement, M.A.
Education, Ph.D. – Exceptional Education Track
Tentative Program Groupings…(continued)
Education Specialist and Doctoral General
Education, Ed.S. (base, non-track component only)
Education, Ed.D.
Educational Leadership
Educational Leadership, Ed.D., Ed.S., M.Ed., & M.A.
Education, Ph.D. – Higher Education Track
Sport and Exercise Science
23
Sport and Exercise Science, B.S. & M.S.
Education, Ph.D. – Exercise Physiology Track
Education, Ph.D. – Methodology, Measurement, and Analysis Track
Consultant Information:
External Consultant Criteria
24
discipline expert from outside Florida
terminal degree in discipline
strong academic credentials
strong administrative experience (e.g., chair,
dean, or provost) preferred
experience at comparable institution (reasonably
large public, not private, institution; consider peer
or aspirational peer institutions
http://uaps.ucf.edu/peer_institutions.html)
experience conducting academic program reviews
Consultant Information:
Site Visit Distribution of Duties
Task
Responsible Office
send invitation to serve as external consultant to
selected candidate
AA
schedule dates of site visit (typically two days on
campus)
AA
make consultant travel arrangements*
college or dept./unit
schedule Phase 1 site visit meetings
AA
schedule Phase 2 site visit meetings
college or dept./unit
process and disseminate consultant honorarium*
(typically $2,000 per two-day visit) immediately
following receipt of final report(s)
college or dept./unit
*college or program is responsible for all travel expenses and
honoraria as well as all associated processing
25
Getting Started:
What you should do now…
26
review the Class of 2013-14 APR Cycle and Tentative
Schedule handout
develop internal (college and program) timeline (e.g., deadlines
for submitting items to college for review)
identify department and program-level team and
assign roles
identify potential external consultants (see consultant criteria on
handout) and complete nomination form (forthcoming from AA)
determine if a two-day site visit will be sufficient for consultants
to meet with appropriate stakeholders and appropriate
honoraria amount
Getting Started:
What you should do now…(continued)
27
begin compiling supplemental review materials (refer to handout)
begin collecting information needed to (re-)nominate graduate
faculty members and scholars (form available at
http://www.admin.graduate.ucf.edu/formsnfiles/)
Note: all existing graduate faculty members and scholars must be
re-nominated at time of seven-year program review
begin compiling the information needed to complete the
Contributing Faculty Activity Worksheet (forthcoming from AA; refer
to handout for worksheet contents)
determine distribution of consultant site visit duties between
college and program (consult External Consultant Arrangements –
Distribution of Duties handout)
Additional Information Available
Visit our Web site for copies of orientation handouts and
to view self-study and consultant report template
samples*
http://afia.ucf.edu/academic-program-review/
*AA will disseminate templates to programs for completion
28
Contacts: Office of Academic Affairs
Dr. Diane Chase, executive vice provost
[email protected]
Ms. Heidi Watt, associate director for accreditation and program review
[email protected]
Ms. Susan Foisy, senior administrative assistant to Dr. Chase
[email protected]
Ms. Coral Rojas, accreditation and program review assistant
[email protected]
29
Contacts: College-level
Dr. Grant Hayes, associate dean
[email protected]
Dr. Roanne Brice, director for assessment, accreditation, and data
management
[email protected]
Ms. Lana Smeir, coordinator for assessment, accreditation, and data
management
[email protected]
30
Contacts: Other
College of Graduate Studies
contact with questions regarding the (re-)nomination of graduate
faculty members and scholars
Dr. Michael Stern, associate dean, [email protected]
Office of Academic, Faculty, and International Affairs
contact with questions regarding faculty teaching certifications
Ms. Heidi Watt, associate director of accreditation and program
review, [email protected]
Ms. Coral Rojas, Faculty Qualifications Management System
(FQMS) administration, [email protected]
31
Contacts: Other…(continued)
Office of Institutional Research
contact with questions regarding institutional trend data
Ms. Pat Ramsey, associate director, [email protected]
Office of Operational Excellence and Assessment
Support
contact with questions regarding academic learning compacts and
institutional effectiveness assessment
Dr. Pat Lancey, director, [email protected]
Dr. Divya Bhati, associate director [email protected]
32
Questions
???
33