University of Colorado at Boulder

  

Academic Review and Planning

and

Institutional Research Involvement

  Lou McClelland – CAPIR – April 6 2009 Unit profiles: http://www.colorado.edu/pba/depts/arp/index.html

4/30/2020 1

Basics

     Run by Faculty Affairs with committee of faculty Focus is on academic units: Departments, schools/colleges, research institutes Reviews consider programs, teaching, research, hiring, personnel – everything Units are reviewed every 7 years (8-12/yr) Elements: Self study, validation by campus team, external reviewers, recommendations 4/30/2020 2

Revised for 2008-09

     Integrate better with strategic planning, budget, and college decisions Streamline so process is less than a year  Review like units in the same year

Major change! From random draw to 08-09 arts and humanities

Rely standard set of data for each unit New name: Academic Review and Planning (ARP) 4/30/2020 3

Determining standard set of data

     Faculty Affairs hired a sociology prof with administrative experience to synthesize What IA had already posted, ready What departments said about proposed metrics What was used in past reviews  Result: Word doc with mocked-up tables and 50+ footnotes Meet with IA, drop some, add some, modify some 4/30/2020 4

Goal: For each measure

     The quantity now and 5 years prior Plus “per-TTT faculty” for many Pct change over 5 years  Comparison to all AAU publics Not available by discipline for many measures  Rank among all units, and among units under review this year And must show N ranked on every measure because it varies 4/30/2020 5

Initial IA work

    Identify source; settle time points Operational definitions  Fall census, must count second majors, faculty with multiple appointments . . . Would the measures mean anything – modifications Already in place: Standard method to assemble students, courses, faculty, staff, research money by academic unit 4/30/2020 6

Organizing the data

      Long skinny dataset where row is unit * time point * measure name * level with 1 quantity per row and dataset and variable name E.g., Chem engineering, FY08, N of degrees, master’s – 33

Did not quite achieve this – Started out with short fat datasets – the more we moved to long skinny the easier it got

4/30/2020 7

Delivery - Goals

      Understandable to chairs, faculty, external reviewers, in any discipline Documentation, context right there with the numbers Standard format for all topics List much backup info – e.g., all faculty Auto process covering all units Posted and retrievable 4/30/2020 8

IA process, simplified

     Get datasets in order Maintain Word doc with introductions, appendices, format, & calls to table creation Convert Word doc to HTML    SAS programs Read HTML doc Generate tables and rankings Output an RTF file for each unit Create PDFs from RTFs; post both 4/30/2020 9

2/16/2009

ARP Profile Generation Flowchart

(must use SAS 9.2 to generate!) = Starting point +Multiple _thin SAS datasets, generated & maintained by Jeff, Blake, Abby, Robert, Lou, Fanchon +Hoho.doc

Make modifications to hoho.doc

Hoho.doc (updated) +Convert hoho.doc to filterd html version hoho-filtered.htm

+Initialize macro variables, SAS formats, etc.

(init.sas) +Convert filtered html to tidied html via UltraEdit +hoho-filtered tidied.htm

rptMasterCntlFile.sas

+Concatenate _ thin’s and compute ranks and pcts for profiled units Concat’d _thins with ranking data Concat’d _thins with ranking and table info +Read hoho-filtered tidied.htm to create SAS driver files Ranking tables SAS driver file ARP profile generation SAS driver file TOC SAS driver file Ranking tables driver SAS dataset Identify which units to generate profiles for TOC SAS dataset +cycle SAS dataset arpfacdb.ttt

denoms Cyclelist SAS temp dataset %fmtmake $grantt +ARP-related SAS macros Generate unit profile as RTF ARP SAS style +Create ARP specific SAS style Other non-_thin SAS datasets (e.g, tttaffilsarp) ARP Profile(s) as RTF Generate another RTF profile?

Yes Generate PDF from RTF ARP profile(s) using Acrobat 9 ARP Profile(s) as PDF Copy to SAS server Copy of cycle SAS dataset misclib.ARPunit

_links.sas in J:\misc +Selected ARP profile (RTF or PDF) Select ARP profile (RTF or PDF) 4/30/2020 L:\datalib\Depts\ARP\Reporting\docs\_arpReporting.vsd

Index.html

in W:\ Post profiles and other web-related files to IA website via SSH/spot Index.html 10 on Web ChangesInProfiles.doc

Result – Unit profiles

      http://www.colorado.edu/pba/depts/arp/index.html

 Short intro, posting record, The list – Each unit, grouped by review year Link to PDF Link to RTF (for easier use/editing by units) Link to section from catalog 64 unit profiles in 6 review cycles, 7-15 per year 4/30/2020 11

Top of the list

4/30/2020 12

Unit profiles -- Sections

4/30/2020 13

Sample table (English)

4/30/2020 14

Sources

          Enrollment, degrees, SCH Faculty and affiliations; other employees Student surveys and evaluations of courses Research contracts and grants Faculty reports of publications, books, etc.

Academic offerings AAU faculty salaries by discipline Dissertation committee records Space Catalog 4/30/2020 15

Use

    Posted October. Some revision based on questions, requests of departments Departments cited in self-studies – but we just got these A few more questions when external reviewers came We know even arts/humanities chairs understand the importance of the denominator! 4/30/2020 16

Who did it?

   Fanchon Finucane – Programming Blake Redabaugh, Robert Stubbs, Jeff Schiel – Datasets

Thanks to all, especially Fanchon!

  PBA: L:\datalib\Depts\ARP\Academic_Review_Planning_CU-Boulder.ppt

Posted from http://www.colorado.edu/pba/depts/arp/index.html

4/30/2020 17