Transcript Slide 1
Institutional Accountability, Assessment, and AQIP
UNO Strategic Planning Advance May 8, 2006 Sheri Rogers Marsha Watson Neal Topp
Overview
2
Continuous Improvement Process Plan (1998 – present) • Chancellor Belck led revitalization of Strategic Planning process • Revise Academic and Student Affairs Strategic Plan (student learning-centered) • Revise/Create College Strategic Plans • Student learning assessment plans and analysis reports required by Academic Affairs (North Central’s Higher Learning Commission )
3
Continuous Improvement Process Collect (2000-present) • Traditional student learning assessment plans reorganized for AQIP (Academic Quality Improvement Program) http://www.aqip.org/ – North Central’s Higher Learning Commission has two paths to campus accreditation • AQIP (Academic Quality Improvement Program) – Strong Strategic Plan and History of Measurement – Requires External Evaluation and Commitment to Continuous Improvement – Requires Three to Four Action Projects with Yearly Updates • PEAQ (Program to Evaluate and Advance Quality)
4
Continuous Improvement Process Collect (2000-present) • AQIP acceptance 2004 • AQIP Strategy Forum May 2005 – Led by Chancellor Belck – Regent Ferlic – Action Project One: myMAPP ™/faculty
5
Current UNO ePortfolios
http://mymapp.org
myMAPP™/campus myMAPP™/faculty myMAPP™/student myMAPP™/staff myMAPP™/department myMAPP™/college
6
Continuous Improvement Process Improve (2000 – present) Board of Regents Center designation for ePortfolio Based Assessment (CeBA) • Director of CeBA - Sheri Rogers • CeBA will: – Be a major contributor in the field of ePortfolio development and research – Bring together creative faculty, student, and staff researchers and practitioners with common interests in assessment and ePortfolios – Produce innovative collaborative research – Develop partnerships with local, regional, national, and international educational systems
7
Continuous Improvement Process Improve (2000 – present) Academic and Student Affairs (ASA) identifies/adopts direct and indirect measures aligned with Quality Indicators Direct: • Aggregate data from nested ePortfolio tools (myMAPP ™) • Collegiate Learning Assessment (CLA)
8
Continuous Improvement Process Improve (2000 – present) Academic and Student Affairs (ASA) identifies/adopts direct and indirect measures aligned with Quality Indicators Indirect: • • • • • • National Survey of Student Engagement (NSSE) Faculty Survey of Student Engagement (FSSE) Your First College Year (YFCY) PK-16 alignment of survey questions (local questions on YFCY, NSSE) Graduation Survey (PK-12 questions) Cooperative Institutional Research Program (CIRP)
9
Continuous Improvement Process Improve (2000 – present) ASA redesigned Academic Assessment • Assessment Coordinator (Marsha Watson) provides consultative service to departments • • Mini-grants Workshops • Development of Assessment Mentors • Assessment Coordinator and Associate Vice Chancellor for Academic Affairs trained/serve as NCA/HLC External Evaluators • Assessment Website http://www.unomaha.edu/assessment
10
Continuous Improvement Process
11
Continuous Improvement Process
12
Direct Measures
Council for Higher Education Accreditation (CHEA) Statement of Mutual Responsibilities for Student Learning Outcomes “Institutions and programs share responsibility with accrediting organizations for providing clear and credible information to constituents about what students learn.”
13
Direct Measures
• Should not rely on any single measure for complete picture • Performance-based assessments: – Measure content knowledge + skill sets – “What students know and what they can do with what they know.” – Collegiate Learning Assessment (CLA)
14
Accreditation Focus:
from Inputs to Outputs • Direct Assessments of Student Learning – Look at learning outputs – Reveal value-added for education
15
Future Plans
• Generate assessment plans for units/ departments/colleges from templates designed by units/departments/colleges with assessment coordinator • Workshops • Facilitate and support course, department, and college direct assessment initiatives
16
myMAPP
TM
/campus
myMAPP™/campus http://unoportfolio.unomaha.edu/ • Designed to measure and communicate progress towards the Strategic Plan goals • Aligns with UNO Strategic Plan and University of Nebraska Strategic Framework • Provide AQIP data
17
myMAPP
TM
/campus
18
myMAPP
TM
/campus
19
myMAPP
TM
/campus
20
myMAPP ™ Team
Faculty and Students myMAPP ™ Consultants Neal Topp
Professor Teacher Education - COE
Marsha Watson
Assistant Professor English - A&S
Karen Hein
Assistant Professor - Library
Paul Clark
Coordinator/Web Master - COE
Tracy Bridgeford
Assistant Professor English - A&S
James Rolfsen
Student
OPS Early Entry Students
21
myMAPP ™ Team
Administrators myMAPP ™ Administrative Leaders Sheri Rogers
Associate Vice Chancellor Academic and Student Affairs
John Fiene Associate Vice Chancellor Academic and Student Affairs Steve Shorb
Dean of the University Library
22
myMAPP ™ Team
Information Technology Services Technical Bret Blackman
Director, Administrative Information Services
Matt Morton
Senior Web Architect
Brandon Keepers
Web Application Developer II
Todd Nelson
Web Application Developer II
Dan Kenny
Senior Web Architect
Mi Un Criffield
System Administrator II
Mike Zimmerman
System Administrator II
23
myMAPP ™ Team
Information Technology Services Communication/Customer Support/Marketing Lanyce Keel
Director, Distant Education and Academic Partnership Initiative
Shelley Schafer
Manager, Distance Education, Training and Marketing
Pat Dargantes
Coordinator, Education & Communication
Erin King
Technical Support Specialist
Project Manager Joyce Crockett
Director of Project Management
24
AQIP Action Projects
• • • •
AQIP Liaison
Sheri Rogers
myMAPP TM /faculty
Neal Topp, Team Coordinator
Assessment Exchange
Marsha Watson, Team Coordinator
Civic Participation
Jody Neathery-Castro, Team Coordinator •
Academic Transitions
Deb Smith-Howell, Team Coordinator
25
myMAPP
TM
/faculty
myMAPP ™/faculty • Help faculty understand the advantage of ePortfolios by gaining experience populating their own portfolios • Ability to link with artifacts of student learning within myMAPP ™/student to demonstrate effect of teaching on student learning
26
myMAPP
TM
/faculty
• Used by faculty for Annual Review • Used by new faculty for Reappointment, Promotion, and Tenure (RPT) • Adopted by professional schools for accreditation purposes • Aggregate data for
myMAPP™/campus
• Generates Customized Reports
27
Advantages for Faculty
myMAPP ™/faculty • Focuses on accomplishments and impact • Different views with same entries • Helps to understand ePortfolio process • Standardization of process (fairer) • Multimedia • Reflection is important • Process is more transparent
28
myMAPP
TM
/faculty
29
myMAPP
TM
/faculty
30
myMAPP
TM
/faculty
31
myMAPP
TM
/faculty
32
myMAPP
TM
/faculty
33
Student
myMAPP ™/student • Student Learning Outcomes — Identify what students know and are able to do with what they know • Identify artifacts to measure Student Learning Outcomes • • Aggregate data for assessment reports Aggregate data for myMAPP ™/campus • Provides accountability for student learning to all constituencies, including students
34
myMAPP
TM
/student
35
myMAPP
TM
/student
36
myMAPP
TM
/student
37
myMAPP
TM
/student
38
Future Plans
• Continue on the AQIP path – Writing Systems Portfolio Summer 2006 • AQIP Systems Portfolio Writing Team • Aggregate data from all faculty, staff and student ePortfolios (UNO Datamart) • Provide aggregate views for myMAPP™/campus of student learning achievements and faculty and staff contributions to strategic planning goals and improved student learning outcomes • Continuous improvement of the myMAPP™ tool
39
Exercise
What are UNO’s key collaborative relationships? • • Address specific relationships with educational organizations, businesses, and other organizations. Also address the nature of the relationship (existing or emerging, feeder or receiver, community support, outsource, etc.). External collaborative partners might include organizations that are the sources of entering students (high schools, community colleges, places of work); organizations that are the destination of exiting students (four-year institutions, graduate schools, places of work); suppliers such as food services, book suppliers, and student recruiting services; external agencies such as state coordinating boards or state, local, or national governments; religious organizations; and other institutions or consortia of institutions.
Exercise
In what ways do these collaborative relationships reinforce UNO’s institutional mission?
• If applicable, how do the relationships support changes in UNO’s direction?
How does UNO create, prioritize, and build relationships with the following?
• Educational institutions and other organizations from which UNO receives students • Educational institutions and employers that depend on a supply of UNO students and graduates who meet their requirements • Organizations that provide services to UNO students • Education associations, external agencies, consortia partners, and the general community with which UNO interacts
Web Sites
UNO myMAPP ™ http://mymapp.unomaha.edu
UNO myMAPP™/campus http://unoportfolio.unomaha.edu/ UNO myMAPP ™/faculty http://mymapp.unomaha.edu/demo.php
UNO Assessment http://www.unomaha.edu/assessment AQIP (Academic Quality Improvement Program) http://www.aqip.org/
42
Email questions
Sheri Rogers [email protected]
Deb Smith-Howell [email protected]
Marsha Watson [email protected]
Neal Topp [email protected]
Jody Neathery-Castro [email protected]
43