Transcript Document
Developing the Self-Study Document Using Integrated Assessment Briefs Millersville University of Pennsylvania Presented by: Dr. Thomas Burns, Associate Provost Dr. Lisa Shibley, Assistant Vice President Dr. Helena Tuleya-Payne, Chair and Professor, Psychology Session Overview • Background • Process and Timeline • The Assessment Brief Template • Sample Briefs • What we wish we had known…. • Integration into the University’s assessment and planning processes • Questions? Pennsylvania State System of Higher Education • Located in Southeastern Pennsylvania • Faculty Collective Bargaining Agreement • A comprehensive, public masters level • Over 8700 students enrolled (headcount) • More than 55 baccalaureate • About 87% undergraduates degree programs and over 25 • 51 credits required for general master’s degree programs education Background • Site Visit—Spring 2010 • Began planning in summer 2007 • A data rich environment • Perceived, growing culture of assessment • Unique planning process Structure Provost & Cabinet Coordinating Team Steering Committee Group1 Communication & Morale Working 10 Working Groups on Standards Self-Study Phases Spring 2008 Fall 2008 March 2009 May 2009 June to August 2009 • Establish Working Groups • Develop Research Questions • Develop Research Protocols • Assess, Review Data • Submit Assessment Briefs • Submit Reports on Standards • Write 1st selfstudy draft Research Questions • Provided justification that linked research question to: • Tell Millersville’s Story (Self- Study Outcomes) • Fundamental Elements • University Mission Statement • Established data needs • Existing Information • New Information Spring 2008 • Identified Timeline • Establish Working Groups • Develop Research Questions Conducting the Research • Designed Protocols • Encouraged to use existing evidence • Coached in new information sources • Interviews, focus groups, surveys • Clarifying findings from existing information Fall 2008 March 2009 • Develop Research Protocols • Assess, Review Data • Submit Assessment Briefs Developing Assessment Briefs • Connect back to justification: • Tell Millersville’s Story (Self- Study Outcomes)** • MSCHE Standards and Fundamental Elements • University Mission Statement** • Clarify data used • Source • Sample Fall 2008 March 2009 • Provide results • Develop Research Protocols • Assess, Review Data • Submit Assessment Briefs • Develop conclusions** Working Group Reports • Matrix to organize information from Briefs • Connected information data to conclusions to fundamental elements by Standard • Used more than one research question to fundamental element • Report on Standard • Used narrative from assessment brief to identify major findings for Standard May 2009 •Submit Reports on Standards Writing the Self Study • Coordinating Team used Matrices and Reports to identify information for the chapters. • Assessment Briefs • Integral to developing self-study chapters • Provided data for Tables, Figures • Served as Appendices June to August 2009 • Write 1st self-study draft Writing the Self Study • Copy editor to identify style guide • Sought to write document in one voice narrative • Used “writing circle” concept June to August 2009 • Write 1st self-study draft Sample Briefs • Coordinating Team Brief • Sample Discussed with Steering Committee • Steering Committee members reviewed Assessment Briefs and provided comments • Exemplar Briefs What we wish we had known….. • Link to Strategic Directions early on • Strengthen implications sections within Assessment Briefs Use in Assessment & Planning • Faculty Senate Academic Outcomes Assessment Committee (AOAC) – Assessment Briefs on General Education Competencies • Special Analyses (triangulation of data) – Wabash National Study of Liberal Arts Education – NSSE / FSSE / BCSSE / HERI Faculty Data • University Planning Council – Report on Progress towards achieving Strategic Directions Questions? Contact Dr. Lisa R Shibley Assistant Vice President, Institutional Assessment and Planning Millersville University of Pennsylvania 717-871-2390 [email protected]