Transcript Partner-Enhanced Assessment 7th Canadian Learning Commons Conference Bishop’s University, Sherbrooke, Quebec June 11, 2014 Kathryn W.

Partner-Enhanced Assessment
7th Canadian Learning Commons Conference
Bishop’s University, Sherbrooke, Quebec
June 11, 2014
Kathryn W. Boone
Learning Commons Operations Manager
Old Dominion University
• Norfolk VA
• Enrollment
– 19,612 undergraduate, 5,058 graduate, 1,092 international
• Colleges
–
–
–
–
–
–
Arts & Letters
Business & Public Administration
Education
Engineering & Technology
Health Sciences
Sciences
• Degree Programs
– 70 bachelor’s, 54 master’s, 42 doctoral
Planning Background
• 2008 - Presentations
• 2010 - 5th Canadian Learning Commons Conference
• 2011 - Opened the Learning Commons @ Perry Library
–
–
–
–
–
Approx. 50,000 sq. ft. (renovation plus 8,000 sq. ft. addition)
First floor and 2nd floor loft
24/5 hours during fall and spring semesters
114 computers (PC, Mac, Wyse Zero Clients)
consolidated help desk
Partnerships
• Three original areas
– University Libraries
– Information Technology Services (ITS)
– Academic Enhancement
• Added two more academic support areas
prior to opening
– Math & Science Resource Center
(College of Sciences)
– Writing Center
(College of Arts & Letters-English Dept.)
University Libraries
• Reference staff for help desk
– Chat reference and consultations
– Library instruction (228 in FY13) & workshops
• Established Operations Manager position
• Fund 4 overnight hourly positions
• Loaner equipment
– 259 items
• Technical support
Information Technology Services
•
•
•
•
•
Computers & software
Scanning & printing
Technical support
Student hiring & training
Help desk staffing
Academic Enhancement
• Peer Educator Program
– Tutoring ~40 classes
– Mentoring
– Supplemental instruction
• Student success workshops
• Technology consultations
Learning Commons
Governance Team - 2010
• Original team
– Help Desk services
– Training
– Technology
– Security
– Marketing
• Used Microsoft SharePoint for documents
• Student Government Association (SGA)
representatives
Learning Commons /Student
Success Governance Team - 2012
• Faculty representative from
each of the six Colleges
• Five subcommittees
– Learning Commons Operations
& Technology Team – SGA representatives
– Academic Support Services Operation &
Technology Team
– Student Success Learning Team
– Advising Center Development & Support Team
– Graduate Student Services Team
Assessment Plan - 2011
• Director of Assessment and Associate
University Librarian for Information
Services
• 3 year plan
• Reported annually
as part of university
assessment required
for accreditation
(WEAVE)
Assessment Objectives
1. The Learning Commons (LC) provides a full
menu of operations, products, services….
2. LC supports student academic and technology
learning.
3. Faculty attend programs…., incorporate LC
capabilities into class assignments, share
student projects…..
4. LC partner staffing supports its mission.
5. LC partners provide & use resources to achieve
its mission.
Assessment Measures
Year 1
o Focus on descriptions and usage of services,
programs, facility
Year 2
o Focus on satisfaction surveys
Year 3
o Review data and implement enhancements
o Communicate changes to users and
stakeholders
Measurement Issues
• Reference transactions at
Help Desk
• Pop-up surveys on
computers
• Staff surveys
• Faculty using LC resources
for student assignments
Data Gathering Process
• Schedule for system generated data
collection – Jul-Dec, FY Jul-Jun
• List of contacts
• Send email 1 week in advance
• Data sent to Information Services
Administrative Assistant for reporting
• Unique IDs sent to Office of Assessment
for demographic data
Gate Counts
• System:
• Partner: ITS,
now University
Libraries, Head
of Access
Services
• Demographic
data during card
swipe hours
Computer Logins
• System:
• Partner: ITS, Lab & Student
Employment Manager
• Demographic data
Software Usage
• by product
• by user
Wireless Logins
• System:
• Partner: ITS
• Demographic data
Room Reservations
• System:
• Partner: ITS, Lead
Developer for Elearning
• Demographic data
Equipment Loans
• System:
• Partner: University
Libraries, Head of
Access Services
• Demographic data
from loan agreement
form
Tutoring
• System:
• Partners
Fall 2013
# Appointments
# Students Served
# of Hours
# Students-Supplemental
Instruction (special review)
Peer Educator
ProgramTutoring
Writing
Center
Math &
Science
Resource
Center
1815
517
2169
na
2056
981
1723
na
1711
472
na
203
– Academic
Enhancement, Peer
Educator Program
– College of Arts &
Letters, English Dept.
– College of Sciences,
Math & Science
Resource Center
Programs
Surveys
Focus Groups 2012-13
Group Study
Spaces
Spring 2012
Important Services
Fall 2013
Multimedia Lab
Spring 2013
Student Feedback
Fri/Sat, finals,
holidays, weather
Self-checkout
Library Instruction
Room
Room reservation
kiosk
Reference book relocation
But are they learning?
• Peer Educator Tutoring program
– Use TutorTrac to report on frequency of student
visitations
• In general results show significant correlation between
frequency of visits and course grades
– Student surveys to reflect on level of confidence
• Math & Science Resource Center
– Compare average GPA for students who attend
tutoring and those who do not
• GPA significantly higher for
students who attended tutoring
What’s next?
•
•
•
•
•
•
Partners and proprietary data
Developing new assessment plan
Improving observational data collection
Qualtrics surveys of student user experiences
Enhancing partnerships – SGA
New partnerships
– Institute of Humanities
“ODU Writes a Book”
Lessons Learned
Keep talking!
Find common ground!
Show appreciation!
Questions?
Kathryn W. Boone
Learning Commons Operations Manager - Perry Library
Old Dominion University
Norfolk VA 23529-0256
757.683.4472
[email protected]