Assessment Workshop SUNY Oneonta April 24, 2012

Patty Francis Associate Provost for Institutional Assessment & Effectiveness

      Development of College’s Action Plan for Planning and Assessment (Spring 2008) ◦ Endorsement by College Senate (12/2008) ◦ Approval by President’s Cabinet (Spring 2009) Formation of Institutional Assessment Committee (IAC) (Spring 2009) Development of assessment guidelines by IAC and approval by President’s Cabinet (11/2009) Distribution of guidelines in 12/2009, with first plans due June 1, 2010 Revision of guidelines by IAC in June 2011 Submission of first assessment reports in June 2011, with second reports due June 2012

    

Establishing congruence among institutional mission and goals, programmatic and unit objectives, unit activities, and assessments Linking goals and objectives to outcomes through action plan Assessment as an ongoing, iterative process Using a variety of meaningful measures, both quantitative and qualitative, in search of convergence Using existing data sources as much as possible



Done correctly, assessment:

◦ ◦ ◦ ◦ ◦ Serves to align mission, goals, objectives, and assessments across all levels of the institution Initiates a “never-ending” dialogue among staff members regarding programmatic priorities, objectives and effectiveness Offers multiple, rich opportunities for professional interaction and development Provides (mostly) affirming data in support of existing programs and services Provides a systematic, focused direction for change and future activities

 Goals ->Objectives ->Outcomes = More General (and Less Measurable)->More Specific (and More Measurable)  Goals: ◦ Statements about general intentions/purposes that are broad and more long-range in scope and not directly measurable ◦ May come directly out of unit mission statement ◦ Usually developed at programmatic or divisional level and often are in the form of a “process” statement (i.e., begin with verbs like “establish,” “provide,” “enhance”)



Objectives:

◦ More specific than goals ◦ Typically there are multiple objectives for each goal ◦ Usually developed at the unit level to reflect “upper-level” goals



Outcomes:

◦ Very specific statements that “translate” into assessable measures ◦ Process- vs. results-oriented statements ◦ Two kinds, depending on assessment stage   “Expected outcome” refers to anticipated results of assessment – should include criterion to be used in determining success “Actual outcome” refers to actual results of assessment

Goal

Develop and implement processes that deliver value to the institution and campus community.

Objective

To identify and carry out strategies that result in the strategic allocation of resources.

Expected Outcome

During 2011-12, the total funds expended on institutional priorities will increase by 20%.



Outcomes often include:

◦ ◦ ◦ ◦ ◦ ◦ Institutional effectiveness performance indicators (especially System-wide as appropriate) Documentation of all services and programs offered Tracking of use of services (and by whom) Constituent satisfaction with services/programs Direct impact of services/programs on constituents (including student learning if appropriate) Comparisons with comparable units at other institutions as appropriate (i.e., benchmarking)

 ◦ ◦ ◦ ◦ ◦

To determine whether or not the unit is meeting its objectives

Requires a priori identification of appropriate measures for each objective and statement of expected outcome (i.e., what is the unit aiming for?) Utilization of services/programs (i.e., quantity) Performance measures (i.e., quality) Satisfaction surveys Comparisons with other units (i.e., benchmarking)

     Develop a detailed action plan linking objectives to outcomes, specifying strategies/actions intended to accomplish each objective and, for each action, a timeline, person/persons responsible, resources required, measures to be used, expected outcomes, and actual outcomes once assessments have been conducted Use a wide variety of information sources, including existing data as much as possible Develop and administer satisfaction surveys to internal and external constituent groups Establish criteria for unit effectiveness through comparisons with information provided by similar units at other institutions or other relevant sources (e.g., certification agencies, national organizations) Units whose functions are evaluated through SUNY-wide measures (e.g., the Student Opinion Survey, the National Survey of Student Engagement) should include these measures as performance indicators in their assessment plan

   ◦ ◦ ◦ ◦ ◦

Goals and Objectives for Unit Strategies or Actions Intended to Accomplish Goals and Objectives For Each Action:

Timeline Person/Persons Responsible Resources Required Expected Outcomes Actual Outcomes (Once Actions are Complete)

Goal: Plan and deliver integrated information services to enable members of the campus community to access information when and where they need it.

1.

Objective

Develop and implement a strong foundation of IT infrastructure and sound fiscal planning.

A.

B.

Actions/Strategies

Build life-cycle replacement funding into planning at every level of investment in IT.

Budget standard amount each year per FTE to support replacement of faculty/staff desktop computers.

B.

A.

Target Completion Date

01/01/10 01/01/10 B.

A.

Resources Required

$150,000 annually A.

Person(s) Responsible

AVPIT, VPFM A.

$175,000 annually B.

AVPIT, VPFM B.

Expected Outcome

20% of all IT replacement needs (except laptops) are funded every 5 years 1/3 of faculty/staff desktops are replaced every 3 years

Actual Outcome

2.

Provide faculty, staff, and students with reliable access to computing, information, and network services, both on- and off campus.

A.

B.

C.

Ensure that core production services are available and accessible during scheduled hours of operation.

Expand student residential network bandwidth.

A.

B.

Ensure that wireless network is reliable and accessible.

C.

Ongoing 01/01/10 10/01/09 A.

B.

C.

$150,000 annually A.

$100,000 B.

$50,000 annually C.

CIO CIO, VPSA A.

B.

Average daily availability exceeds 99% Bandwidth is increased to 64 mbs AVPIT, CIO C.

Average uptime is 99% during campus on-hours and 95% during off-hours

Goal: To facilitate development of new degree programs and the revision of existing programs at the graduate level and to ensure their ongoing quality.

Objective

C.

To develop and implement mechanisms that and maximize program quality accountability.

1.

2.

3.

4.

5.

Actions/Strategies

Create Graduate Program Assessment Committee (GPAC) with members from all programs 1.

Target Completion Date

09/15/10 1.

Resources Required

N/A 10/15/10 2.

$1,000 Review existing program review and process and update as necessary to assure all programs are assessed every five years (or as meets accreditation standards 2.

Review all program reviews from last round and provide feedback (non-accredited programs only) 3.

01/30/11 3.

N/A Develop updated guidelines to assist programs in next round (non-accredited programs only) 4.

Hire consultants to assist programs as needed (accredited programs only) 5.

12/15/10 4.

11/01/10 5.

N/A $20,000 (max.) 1.

Person(s) Responsible

Director, Deans 1.

Expected Outcome

GPAC formed and operational 2.

3.

4.

5.

GPAC GPAC GAC 2.

3.

4.

Director, Deans 5.

Program review schedule in place All reviews evaluated Guidelines developed, distributed Consultants hired/visit campus

Goal: To provide support services to faculty and staff for the promotion and development of sponsored programs.

Objective

A.

To enhance in terdisciplinary/ collaborative research and community engagement.

1.

2.

Actions/Strategies

Develop and implement recognition award program for faculty/student engagement with regional communities 1.

Target Completion Date

10/15/10 and annually 1.

Resources Required

$3,000 Develop and offer workshops on identifying and applying for community-based research and development grants 2.

09/15/10 2.

$1,000 1.

Person(s) Responsible

Assoc. Director 1.

Expected Outcome

Program in place/5 faculty, 5 students recognized each year 2.

Asst. Director 2.

2 workshops offered each semester/20 attendees/90% satisfaction 3.

Identify and publicize best practices to internal and external constituencies 3.

10/15/10 and annually 3.

N/A 3.

Assoc., Asst. Director 3.

Practices identified/in duded in monthly newsletter Overall: 20% increase in service grant submissions compared to 2009-10; 80% success rate