Transcript UCF Academic Program Review Orientation

UCF Academic Program Review
Orientation
Class of 2013-14
Office of Academic Affairs
Spring 2013
Topics to Cover
2

background

academic program review process overview

content of the reviews

programs undergoing review in 2013-14

consultant information

getting started

contacts

questions
Background: Program Reviews
in Florida
3

legislatively mandated

required every seven years for all academic programs
(exceptions may be negotiated to align with a specialized
accreditation cycle)

based on internal evaluation with appropriate input from
external experts

beginning in 2000, university-defined processes that comply
with state requirements
Florida Board of Governors (FBOG)
 maintains seven-year schedule for reviews
 approves university APR policies and procedures
 requires university submission of APR results
 uses university APR information to inform state-level
decision making
Academic Program Review
Process Overview
Purposes:
4

to examine the quality and productivity of
academic programs

to develop recommendations leading to program
improvement
APR Process Overview:
Program Elements Evaluated
 centrality
 comparative advantage
 cost
 demand
 quality
*Refer to APR Process handout for additional details
5
APR Process Overview:
Sources that Inform Review
6

institutional trend data (provided by Office of Institutional
Research (IR)) – see handout for overview

program and department self-studies (including Contributing
Faculty Activity Worksheet supplement)

department/unit statements of good teaching
qualifications practices (“discipline descriptions”)
http://afia.ucf.edu/fq/fqteaching/dd/

graduate faculty members and scholars review

supplemental review materials

external consultant reports
APR Process Overview:
Sources that Inform Review…continued
Supplemental Review Materials:
 university, college, and unit strategic plans
 program curriculum materials
 institutional effectiveness results and plans
 undergraduate academic learning compacts (ALCs)
http://www.oeas.ucf.edu/alc/academic_learning_compacts.htm
 program handbook(s), if applicable
 current faculty CVs
 unit’s faculty workload policy
 faculty annual evaluation standards and procedures
7
APR Process Overview:
Sources that Inform Review…continued
Supplemental Review Materials continued:
 faculty promotion and tenure standards and procedures
 most recent program accreditation or certification results and
recommendations, if applicable
 representative sample of undergraduate and graduate theses and
dissertations
 UCF instructional faculty mix report (% SCH taught by FT & PT faculty)
 department/unit E&G budget summary
 average 9-month faculty salaries by rank, department, and college
 other appropriate supplemental review materials
* See
handout for greater detail and who provides which pieces
Content of the Review
Strengths, weaknesses, opportunities, and threats are
considered with regard to the following areas:
General
 alignment of program to department, college, university,
and BOG strategic plans
Program
 curriculum
 sufficiency of course offerings
 benchmarking
 partnerships, research, and other engagement
opportunities
9
Content of the Review…(continued)
Faculty
 number and balance of faculty types
 qualifications
 scholarly and creative activity (number of peer-reviewed
publications, exhibitions, and/or funding by year for the
past four years)
 assignments (teaching, research, and service)
 teaching loads (numbers of classes by program and
numbers of students served)
 thesis and dissertations supervised over the past
four years
 faculty development and mentoring
10
Content of the Review…(continued)
Resources
 space (instructional, laboratory, office)
 equipment and facilities
 staff
Students
 quality of incoming students
 evidence of quality education (placement, licensure pass
rates, awards)
 retention, progression, and completion
 satisfaction
11
APR Process Overview:
Parties Involved in the Process
APR is a collaborative process involving the:
12

provost

Program Review Committee (PRC)

college dean

department chairs and school directors

program faculty members, staff members, and students

external consultant(s)

other stakeholders, as appropriate
APR Process Overview:
Program Review Committee
PRC Charge:
to advise provost on program strengths, weaknesses, and
recommendations for improvement
PRC Tasks:
 selects external consultants
 reviews self-studies and APR data (e.g., IR trend data)
 meets with consultants
 reviews consultant reports
 develops recommendations for program improvement in
concert with provost and dean
13
APR Process Overview:
Program Review Committee…(continued)
PRC Members
 Dr. Diane Chase (chair), executive vice provost, Office of
Academic Affairs
 Dr. Ross Hinkle, interim vice provost and dean, College of
Graduate Studies
 Dr. Elliott Vittes, interim vice provost and dean, Office of
Undergraduate Studies
 Dr. Stephen Kuebler, interim assistant vice president, Office
of Research and Commercialization
 Dr. Paige Borden, assistant vice president, Office of
Institutional Knowledge Management
 Ms. Heidi Watt (ex-officio), associate director of accreditation
and program review, Office of Academic Affairs
14
APR Process Overview:
General Process Overview
15

consultant nomination, selection, & procurement

programs complete self-studies; provide last review
recommendations’ status update; identify major program
changes since last review; compile supplemental review
materials

consultant site visit – usually two days on campus

consultant written report(s) submitted to academic affairs
approximately two weeks after site visit

college meets with program to review consultant reports and
prepare for dean’s meeting with PRC
APR Process Overview:
General Process Overview…(continued)
16

PRC and dean (and dean’s guests) meet to develop lists of
program strengths, weaknesses, and recommendations

PRC finalizes lists for provost’s approval

dean reviews lists with provost (usually at standing meeting)

summary review results provided to UCF Board of Trustees
(BOT) Educational Programs Committee (EPC)

summary review results provided to Florida Board
of Governors

dean provides APR recommendation implementation update to
BOT, EPC
APR Process Overview:
UCF and FL SUS Reports
17

Contents of APR Report to UCF Board of Trustees EPC
includes summary of:
 actions taken based on recommendations from previous
program review
 current program strengths and weaknesses
 action recommendations for program improvement

Contents of APR Report to Florida Board of Governors
includes summary of:
 major changes made since previous program review
 current program strengths and weaknesses
 action recommendations for program improvement
APR Class of 2012-13
All 36 active College of Education degree programs
spanning nine thematic areas
 10 bachelor’s programs
 20 master’s programs
 3 specialist programs
 3 doctoral programs
18
Tentative Program Groupings
Elementary Education, Early Childhood Development
and Education, and Reading






19
Early Childhood Development & Education, B.S. & M.S.
Elementary Education, B.S., M.A., & M.Ed.
Reading Education, M.Ed.
Education, Ph.D. – Elementary Education Track
Education, Ph.D. – Reading Education Track
Education, Ph.D. – Early Childhood Track
Tentative Program Groupings…(continued)
Secondary Education














20
Applied Learning and Instruction, M.A.
Art Education, B.S.
English Language Arts Education, B.S.
Mathematics Education, B.S.
Science Education, B.S.
Social Science Education, B.S.
World Languages Education, B.S.
K-8 Mathematics and Science Education, M.Ed.
Teacher Education, M.A.T.
Teacher Leadership, M.Ed.
Education, Ph.D. – Mathematics Education Track
Education, Ph.D. – Science Education Track
Education, Ph.D. – Social Science Education Track
Education, Ph.D. - TESOL Track
Tentative Program Groupings…(continued)
Career and Technical Education


Career and Technical Education, M.A.
Technical Education and Industry Training, B.S.
Instructional Design & Technology




21
Instructional Design and Technology: Educational Technology,
M.A.
Instructional Design and Technology: e-Learning, M.A.
Instructional Design and Technology: Instructional Systems, M.A.
Education, Ph.D. – Instructional Technology Track
Tentative Program Groupings …(continued)
Counselor Education, School Psychology
and Marriage and Family Therapy





Counselor Education, M.A. & M.Ed.
Marriage and Family Therapy, M.A.
Education, Ed.S. – School Counseling Track
School Psychology, Ed.S.
Education, Ph.D. – Counselor Education Track
Exceptional Student Education



22
Exceptional Student Education, M.Ed.
Exceptional Student Education K-12/ESOL Endorsement, M.A.
Education, Ph.D. – Exceptional Education Track
Tentative Program Groupings…(continued)
Education Specialist and Doctoral General


Education, Ed.S. (base, non-track component only)
Education, Ed.D.
Educational Leadership


Educational Leadership, Ed.D., Ed.S., M.Ed., & M.A.
Education, Ph.D. – Higher Education Track
Sport and Exercise Science



23
Sport and Exercise Science, B.S. & M.S.
Education, Ph.D. – Exercise Physiology Track
Education, Ph.D. – Methodology, Measurement, and Analysis Track
Consultant Information:
External Consultant Criteria
24

discipline expert from outside Florida

terminal degree in discipline

strong academic credentials

strong administrative experience (e.g., chair,
dean, or provost) preferred

experience at comparable institution (reasonably
large public, not private, institution; consider peer
or aspirational peer institutions
http://uaps.ucf.edu/peer_institutions.html)

experience conducting academic program reviews
Consultant Information:
Site Visit Distribution of Duties
Task
Responsible Office
send invitation to serve as external consultant to
selected candidate
AA
schedule dates of site visit (typically two days on
campus)
AA
make consultant travel arrangements*
college or dept./unit
schedule Phase 1 site visit meetings
AA
schedule Phase 2 site visit meetings
college or dept./unit
process and disseminate consultant honorarium*
(typically $2,000 per two-day visit) immediately
following receipt of final report(s)
college or dept./unit
*college or program is responsible for all travel expenses and
honoraria as well as all associated processing
25
Getting Started:
What you should do now…
26

review the Class of 2013-14 APR Cycle and Tentative
Schedule handout

develop internal (college and program) timeline (e.g., deadlines
for submitting items to college for review)

identify department and program-level team and
assign roles

identify potential external consultants (see consultant criteria on
handout) and complete nomination form (forthcoming from AA)

determine if a two-day site visit will be sufficient for consultants
to meet with appropriate stakeholders and appropriate
honoraria amount
Getting Started:
What you should do now…(continued)
27

begin compiling supplemental review materials (refer to handout)

begin collecting information needed to (re-)nominate graduate
faculty members and scholars (form available at
http://www.admin.graduate.ucf.edu/formsnfiles/)
Note: all existing graduate faculty members and scholars must be
re-nominated at time of seven-year program review

begin compiling the information needed to complete the
Contributing Faculty Activity Worksheet (forthcoming from AA; refer
to handout for worksheet contents)

determine distribution of consultant site visit duties between
college and program (consult External Consultant Arrangements –
Distribution of Duties handout)
Additional Information Available
Visit our Web site for copies of orientation handouts and
to view self-study and consultant report template
samples*
http://afia.ucf.edu/academic-program-review/
*AA will disseminate templates to programs for completion
28
Contacts: Office of Academic Affairs

Dr. Diane Chase, executive vice provost
[email protected]

Ms. Heidi Watt, associate director for accreditation and program review
[email protected]

Ms. Susan Foisy, senior administrative assistant to Dr. Chase
[email protected]

Ms. Coral Rojas, accreditation and program review assistant
[email protected]
29
Contacts: College-level

Dr. Grant Hayes, associate dean
[email protected]

Dr. Roanne Brice, director for assessment, accreditation, and data
management
[email protected]

Ms. Lana Smeir, coordinator for assessment, accreditation, and data
management
[email protected]
30
Contacts: Other
College of Graduate Studies
contact with questions regarding the (re-)nomination of graduate
faculty members and scholars
 Dr. Michael Stern, associate dean, [email protected]
Office of Academic, Faculty, and International Affairs
contact with questions regarding faculty teaching certifications
 Ms. Heidi Watt, associate director of accreditation and program
review, [email protected]
 Ms. Coral Rojas, Faculty Qualifications Management System
(FQMS) administration, [email protected]
31
Contacts: Other…(continued)
Office of Institutional Research
contact with questions regarding institutional trend data
 Ms. Pat Ramsey, associate director, [email protected]
Office of Operational Excellence and Assessment
Support
contact with questions regarding academic learning compacts and
institutional effectiveness assessment
 Dr. Pat Lancey, director, [email protected]
 Dr. Divya Bhati, associate director [email protected]
32
Questions
???
33