Assessment for the Rest of Us: Informal Techniques You Can Use Sponsored by the LLAMA Measurement, Assessment & Evaluation Section, Data Collection for Library.
Download ReportTranscript Assessment for the Rest of Us: Informal Techniques You Can Use Sponsored by the LLAMA Measurement, Assessment & Evaluation Section, Data Collection for Library.
Assessment for the Rest of Us: Informal Techniques You Can Use Sponsored by the LLAMA Measurement, Assessment & Evaluation Section, Data Collection for Library Managers Committee Program Co-chairs: • Jeanne Brown, Assessment Librarian, University of Nevada, Las Vegas • Jan Lewis, Associate Director, East Carolina University LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Our Student Scholars Said What??? A 12-Question survey followed by an informal focus group luncheon were fairly easy techniques for discerning what a group of undergraduate student scholars know and think about the library. Oklahoma State University Karen Neurohr, Associate Professor, Assessment Librarian Jennifer Paustenbaugh, Ph.D., Associate Dean for Planning and Assessment LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Student Scholars and the Library Oklahoma State University- Land-grant; ARL Library, serving 22,845 students Assessment activity: Survey and Informal Focus Group Population: Undergraduate research scholars Time Commitment: 4 hours Findings: Several interesting discrepancies between survey results and comments LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Let them try it before you buy it Conducting demonstrations and trials can help libraries get the biggest bang for their buck. Students test, evaluate, and recommend products and libraries make informed purchases. Louise L. Lowe, Assistant Professor Public Services Librarian Judith D. Brook, Associate Professor Associate Dean of University Libraries and Director Mercer University, Atlanta LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Let them try it before you buy it Who we are… Mercer University, Atlanta Campus Approximately 2,500 graduate and professional students Approximately 4,000 library visitors per week What we did… Conducted trials or demonstrations; allowed 1 - 2 weeks for feedback Tested equipment like netbooks, adjustable monitors and keyboards, etc. Taste test for new coffee vending What we learned… ‘Good value’ is important to student Students are willing to make compromises Students want to be involved LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Unobtrusive User Observation as Assessment Technique: What are Students Doing in the Library After Hours Study of User Behavior in Uris Library, open 24/7 Kornelia Tancheva, Director of John M. Olin Library and Uris Library, Cornell University LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Student Behavior in the Library After Hours Cornell U Library; Uris: former “undergraduate library” Unobtrusive observation Survey population: undergraduate students Moderate Time Commitment Findings: use of spaces, use of technology; service requirements LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Why Isn’t Our Chat Reference Service Used More Often? Exploring patron attitudes and behavior through focus groups Sharon Naylor and Bruce Stoffel Education Librarian and Reference Coordinator Illinois State University LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Why Isn’t Our Chat Reference Service Used More Often? Who we are... 21,184 students (87% undergraduates) 1.6 million volumes, 43,000 annual patron transactions What we did... Conducted 7 focus groups, August-December 2005 Involved 45 sophomores, juniors, seniors Each group discussion lasted about 90 minutes What we learned... • Desire for reference services that are personalized • Support for a variety of reference venues not just IM/chat • Preference for familiar, reliable technology LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us The CalArts’ Student Behaviors and Habits (CASBAH) Project Poster surveys were used to generate a wealth of instant and practical feedback with minimal effort. Jeff Gatten, Dean of Library and Information Resources at California Institute of the Arts LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us The CalArts’ Student Behaviors and Habits (CASBAH) Project Arts college (BFA, MFA, DMA) 1,399 Students ◦ 60% undergrad. & 40% grad. ◦ 51% female & 49% male Poster surveys in the Library 3-4 hours to compile & organize data Findings: Most desired = easy changes to environment LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Challenging Assumptions: Chatting with Patrons The information gathered challenged many of the assumptions held about undergraduate students. Rachel Besara, Assessment Librarian Kirsten Kinsley, Assessment Librarian Florida State University Libraries LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Challenging Assumptions: Chatting with Patrons Florida State University (Carnegie Foundation Rated Doctoral/Research Extensive University) Short Survey/Interviews 167 Undergraduate Students on & off campus One Month Discovered nuanced student study habits LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Assessing Community Users in an Academic Library The Ottenheimer Library recently conducted a quantitative/qualitative assessment of its unaffiliated library users. Wanda V. Dole, Dean Ottenheimer Library, University of Arkansas at Little Rock J. B. Hill, Director of Public Services Ottenheimer Library, University of Arkansas at Little Rock LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Assessing Community Users University of Arkansas at Little Rock ◦ Metropolitan university with 13,000 students ◦ Carnegie Research Extensive University Quantitative Data ◦ Analysis of Millennium and Uniprint patron records Qualitative Data ◦ Survey of unaffiliated library users registered for circulation of Internet privileges Limited Time Commitment - ~80 hours Findings ◦ ◦ ◦ ◦ Two distinct user populations – behaviors & needs Casual affiliations with university Privileges created good will toward university Result in review of unaffiliated user policies/services LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us “Flip” the Library Video Assessment at Georgia Tech Library Ameet Doshi User Engagement Librarian and Assessment Coordinator Georgia Institute of Technology Library LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Flip Camera Assessment: Fast, Cheap, Easy Georgia Tech Student Culture: Hands-on, interactive LibQUAL 2010: 88% of Undergrads use facility regularly Video Assessment of Library Facility Student Library Advisory Board 1 hour (prep/shooting/recap) and 2-4 hours editing Useful to… ◦ ◦ ◦ ◦ View experience from user perspective Assess completed or discuss proposed renovations Discover emerging problems Web usability LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us MIT Libraries’ Book(cart)mobile: Assessing its Value The MIT Libraries’ Humanities and Music Libraries surveyed users and staff to determine if the benefits of undertaking a monthly bookmobile outweighed its staffing costs. Lisa R. Horowitz, Assessment Librarian, Massachusetts Institute of Technology LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us MIT Libraries’ Book(cart)mobile MIT: 10,000 students; 10,000 faculty and staff Five main libraries – Bookmobile is specific to Humanities and its branch, Music Two survey instruments: user survey and staff interviews Data gathered over two and half months, March to May 2009 LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Observation and Mapping Observing student behavior helped us achieve a better balance between high and low use study spaces Kathy Ray University Librarian American University of Sharjah LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us Observation and Mapping AUS – 5,000 students primarily undergrad Coed environment new for majority Incredibly active/high traffic zone in the middle of preferred high use study space Observations over 5 week period 30 minutes 3 times per week Reconfigured mix of carrels, tables, browsing collections & displays for better balance of quiet and active zones LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us