LibGuides or Bust? Usability Testing Platforms for Research Guides
DOI:
https://doi.org/10.18438/eblip30808Abstract
Objective – The purpose of this study was to compare student use of two library research guides, one created in Springshare’s LibGuides platform with a multi-page layout and one created using a single-page Adobe Express website. The researchers sought to explore how LibGuides’ library-first design and embedded features would enable successful student navigation versus Adobe Express’ simpler, website-style layout that might be more familiar to users yet lacks the ability to integrate fully with the broader library Web presence.
Methods – The study used a qualitative usability test to answer the research questions. Two groups of six users each were assigned to complete tasks using one of the two platforms. Researchers designed test guides for the study mirroring real-world content and layout, following best practices of design and institutional guidelines within each system. During test sessions, users followed a “think-aloud” protocol, allowing researchers to transcribe and code comments to identify patterns in students’ feedback. Pretest and posttest questionnaires were also used to assess participants’ prior experience and subsequent perceptions.
Results – Users’ posttest responses indicated they found both guides easy to use. However, there were a few differences between their use of LibGuides and Adobe Express during the sessions. Users of Adobe Express commented favorably on its clean aesthetic, though users appreciated both guides’ collation of resources. Adobe Express users experienced higher rates of task success, fewer instances of confusion, and a clearer differentiation between the guide and broader library resources. Many themes that surfaced in sessions related to user behaviour overlapped between the two platforms, such as a preference for searching over browsing, gravitation toward familiar tools, and not reading all content.
Conclusion – Neither guide fully enabled universal task success, and each brought its own set of challenges for users. Moreover, users in both test groups failed to fully engage with all content. Librarians designing research guides should consider the context and purpose of creation, as well as users’ existing information literacy skills and mental models, when selecting platforms, layouts, and designs.
Downloads
References
Adobe. (2020). Digital literacy in higher education: Now more than ever. https://landing.adobe.com/content/dam/landing/uploads/2020/na/EDU/Digital_Literacy_in_Higher_Edu_More_Now_than_Ever.pdf
Adobe. (2025, August 20). Design webpages. https://helpx.adobe.com/content/help/en/express/web/create-and-edit-documents-and-webpages/create-webpages/design-webpage.html
Almeida, N., & Tidal, J. (2017). Mixed methods not mixed messages: Improving LibGuides with student usability data. Evidence Based Library and Information Practice, 12(4), 62–77. https://doi.org/10.18438/B8CD4T
Auburn University. (2024). Core curriculum and general education outcomes. Auburn Bulletin 2024-2025. https://bulletin.auburn.edu/Policies/Academic/thecorecurriculum/
Baird, C., & Soares, T. (2018). A method of improving library information literacy teaching with usability testing data. Weave: Journal of Library User Experience, 1(8). https://doi.org/10.3998/weave.12535642.0001.802
Baker, R. L. (2014). Designing LibGuides as instructional tools for critical thinking and effective online learning. Journal of Library & Information Services in Distance Learning, 8(3/4), 107–117. https://doi.org/10.1080/1533290X.2014.944423
Barker, A., & Hoffman, A. (2021). Student-centered design: Creating LibGuides students can actually use. College & Research Libraries, 82(1), 75–91. https://doi.org/10.5860/crl.82.1.75
Bausman, M., & Ward, S. L. (2015). Library awareness and use among graduate social work students: An assessment and action research project. Behavioral & Social Sciences Librarian, 34(1), 16–36. https://doi.org/10.1080/01639269.2015.1003498
Benway, J. P. (1998). Banner blindness: The irony of attention grabbing on the World Wide Web. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 42(5), 463–467. https://doi.org/10.1177/154193129804200504
Bergstrom-Lynch, Y. (2019). LibGuides by design: Using instructional design principles and user-centered studies to develop best practices. Public Services Quarterly, 15(3), 205–223. https://doi.org/10.1080/15228959.2019.1632245
Blocksidge, K., & Primeau, H. (2023). Adapting and evolving: Generation Z’s information beliefs. The Journal of Academic Librarianship, 49(3), 102686. https://doi.org/10.1016/j.acalib.2023.102686
Bohmholdt, S. (2023, December 14). Auburn University builds students’ digital skills with Adobe Express. Adobe Blog. https://blog.adobe.com/en/publish/2023/12/14/auburn-university-builds-students-digital-skills-with-adobe-express
Bowen, A. (2014). LibGuides and web-based library guides in comparison: Is there a pedagogical advantage? Journal of Web Librarianship, 8(2), 147–171. https://doi.org/10.1080/19322909.2014.903709
Budiu, R. (2017, October 1). Quantitative vs. qualitative usability testing. Nielsen Norman Group. https://www.nngroup.com/articles/quant-vs-qual/
Budiu, R. (2023, July 10). Between-subjects vs. within-subjects study design. Nielsen Norman Group. https://www.nngroup.com/articles/between-within-subjects/
Burchfield, J., & Possinger, M. (2023). Managing your library’s LibGuides: Conducting a usability study to determine student preference for LibGuide design. Information Technology and Libraries, 42(4). https://doi.org/10.5860/ital.v42i4.16473
Campbell, L. B., & Kester, B. (2023). Centering students with disabilities: An accessible user experience study of a library research guide. Weave: Journal of Library User Experience, 6(1). https://doi.org/10.3998/weaveux.1067
Carey, J., Pathak, A., & Johnson, S. C. (2020). Use, perceptions, and awareness of LibGuides among undergraduate and graduate health professions students. Evidence Based Library and Information Practice, 15(3), 157–172. https://doi.org/10.18438/eblip29653
Castro-Gessner, G. C., Chandler, A., & Wilcox, W. S. (2015). Are you reaching your audience?: The intersection between LibGuide authors and LibGuide users. Reference Services Review, 43(3), 491–508. https://doi.org/10.1108/RSR-02-2015-0010
Chan, C., Gu, J., & Lei, C. (2019). Redesigning subject guides with usability testing: A case study. Journal of Web Librarianship, 13(3), 260–279. https://doi.org/10.1080/19322909.2019.1638337
Chee, M., & Weaver, K. D. (2021). Meeting a higher standard: A case study of accessibility compliance in LibGuides upon the adoption of WCAG 2.0 Guidelines. Journal of Web Librarianship, 15(2), 69–89. https://doi.org/10.1080/19322909.2021.1907267
Chen, Y.-H., Germain, C. A., & Rorissa, A. (2023). Web usability practice at ARL academic libraries. portal: Libraries and the Academy, 23(3), 537–570. https://doi.org/10.1353/pla.2023.a901567
Cobus-Kuo, L., Gilmour, R., & Dickson, P. (2013). Bringing in the experts: Library research guide usability testing in a computer science class. Evidence Based Library and Information Practice, 8(4), 43–59. https://doi.org/10.18438/B8GP5W
Conerton, K., & Goldenstein, C. (2017). Making LibGuides work: Student interviews and usability tests. Internet Reference Services Quarterly, 22(1), 43–54. https://doi.org/10.1080/10875301.2017.1290002
Conrad, S., & Stevens, C. (2019). “Am I on the library website?”: A LibGuides usability study. Information Technology and Libraries, 38(3), 49–81. https://doi.org/10.6017/ital.v38i3.10977
Coombs, B. (2015). LibGuides 2. Journal of the Medical Library Association: JMLA, 103(1), 64–65. https://doi.org/10.3163/1536-5050.103.1.020
Dalton, M., & Pan, R. (2014). Snakes or ladders? Evaluating a LibGuides pilot at UCD Library. The Journal of Academic Librarianship, 40(5), 515–520. https://doi.org/10.1016/j.acalib.2014.05.006
DeFrain, E. L., Sult, L., & Pagowsky, N. (2025). Effectiveness of academic library research guides for building college students’ information literacy skills: A scoping review. College & Research Libraries, 86(5), 817–849. https://doi.org/10.5860/crl.86.5.817
Del Bosque, D., & Morris, S. E. (2021). LibGuide standards: Loose regulations and lax enforcement. The Reference Librarian, 62(1), 1–22. https://doi.org/10.1080/02763877.2020.1862022
Duncan, V., Lucky, S., & McLean, J. (2015). Implementing LibGuides 2: An academic case study. Journal of Electronic Resources Librarianship, 27(4), 248–258. https://doi.org/10.1080/1941126X.2015.1092351
Emanuel, J. (2013). A short history of library guides and their usefulness to librarians and patrons. In A. W. Dobbs, R. L. Sittler, & D. Cook (Eds.), Using LibGuides to enhance library services (pp. 3–19). ALA TechSource.
Fazelian, J., & Vetter, M. (2016). To the left, to the left: Implementing and using side navigation and tabbed boxes in LibGuides. In A. W. Dobbs & R. L. Sittler (Eds.), Integrating LibGuides into library websites (pp. 127–138). Rowman & Littlefield.
Gardner, S., Ostermiller, H., Price, E., Vess, D., & Young, A. (2021). Recommendations without results: What we learned about our organization through subject guide usability studies. Virginia Libraries, 65(1), 1–7. https://doi.org/10.21061/valib.v65i1.624
German, E., Grassain, E., & LeMire, S. (2017). LibGuides for instruction: A service design point of view from an academic library. Reference & User Services Quarterly, 56(3), 162–167.
Gonzalez, A. C., & Westbrock, T. (2010). Reaching out with LibGuides: Establishing a working set of best practices. Journal of Library Administration, 50(5–6), 638–656. https://doi.org/10.1080/01930826.2010.488941
Goodsett, M., Miles, M., & Nawalaniec, T. (2020). Reimagining research guidance: Using a comprehensive literature review to establish best practices for developing LibGuides. Evidence Based Library and Information Practice, 15(1), 218–225. https://doi.org/10.18438/eblip29679
Grays, L. J., Del Bosque, D., & Costello, K. (2008). Building a better M.I.C.E. trap: Using virtual focus groups to assess subject guides for distance education students. Journal of Library Administration, 48(3–4), 431–453. https://doi.org/10.1080/01930820802289482
Greene, K. (2020). Accessibility nuts and bolts: A case study of how a health sciences library boosted its LibGuide accessibility score from 60% to 96%. Serials Review, 46(2), 125–136. https://doi.org/10.1080/00987913.2020.1782628
Griffin, M., & Taylor, T. I. (2018). Employing analytics to guide a data-driven review of LibGuides. Journal of Web Librarianship, 12(3), 147–159. https://doi.org/10.1080/19322909.2018.1487191
Hennesy, C., & Adams, A. L. (2021). Measuring actual practices: A computational analysis of LibGuides in academic libraries. Journal of Web Librarianship, 15(4), 219–242. https://doi.org/10.1080/19322909.2021.1964014
Hicks, A., Nicholson, K. P., & Seale, M. (2022). Make me think!: Exploring library user experience through the lens of (critical) information literacy. The Library Quarterly, 92(2), 109–128. https://doi.org/10.1086/718597
Hill, J. (2022, November 29). Adobe Creative Space offering workshop for faculty and instructors in January 2023 with Auburn Center. Office of Communications and Marketing. https://ocm.auburn.edu/newsroom/campus_notices/2022/11/291329-adobe-creative-space.php
Hintz, K., Farrar, P., Eshghi, S., Sobol, B., Naslund, J.-A., Lee, T., Stephens, T., & McCauley, A. (2010). Letting students take the lead: A user-centred approach to evaluating subject guides. Evidence Based Library and Information Practice, 5(4), 39–52. https://doi.org/10.18438/B87C94
Hooper, C., & Lasley, J. (2022, April 1). Campus-wide digital literacy initiative empowers hybrid learning [Individual paper/presentation]. Georgia International Conference on Information Literacy, Virtual. https://digitalcommons.georgiasouthern.edu/gaintlit/2022/2022/38
Hopper, T. L. (2021). Accessibility and LibGuides in academic libraries. The Southeastern Librarian, 68(4), 12–28. https://doi.org/10.62915/0038-3686.1904
Jackson, R., & Stacy-Bates, K. K. (2016). The enduring landscape of online subject research guides. Reference & User Services Quarterly, 55(3), 219–229. https://doi.org/10.5860/rusq.55n3.219
Kehoe, L., & Bierlein, I. (2024). LibGuides and Universal Design for Learning: A case study for improving the accessibility of research guides. In D. Skaggs & R. M. McMullin (Eds.), Universal Design for Learning in libraries: Theory into practice (pp. 123–162). Association of College and Research Libraries.
Kerrigan, C. E. (2016). Thinking like a student: Subject guides in small academic libraries. Journal of Web Librarianship, 10(4), 364–374. https://doi.org/10.1080/19322909.2016.1198743
Lee, Y. Y., & Lowe, M. S. (2018). Building positive learning experiences through pedagogical research guide design. Journal of Web Librarianship, 12(4), 205–231. https://doi.org./10.1080/19322909.2018.1499453
Little, J. J. (2010). Cognitive load theory and library research guides. Internet Reference Services Quarterly, 15(1), 53–63. https://doi.org/10.1080/10875300903530199
Logan, J., & Spence, M. (2021). Content strategy in LibGuides: An exploratory study. The Journal of Academic Librarianship, 47(1), 102282. https://doi.org/10.1016/j.acalib.2020.102282
Matas, E. (2023, June 25). Undergraduate students experience cognitive complexity in basic elements of library research. ASEE Annual Conference and Exposition, Conference Proceedings. https://doi.org/10.18260/1-2--44532
McCavitt, K. (2020, May 19). Auburn University starts a legacy of digital literacy for tomorrow’s students. Adobe Blog. https://blog.adobe.com/en/publish/2020/05/19/auburn-university-starts-a-legacy-of-digital-literacy-for-tomorrows-students
McCloskey, M. (2014, January 12). Task scenarios for usability testing. Nielsen Norman Group. https://www.nngroup.com/articles/task-scenarios-usability-testing/
Michell, G., & Dewdney, P. (1998). Mental models theory: Applications for library and information science. Journal of Education for Library and Information Science, 39(4), 275–281. https://doi.org/10.2307/40324303
Moran, K. (2019, December 1). Usability (user) testing 101. Nielsen Norman Group. https://www.nngroup.com/articles/usability-testing-101/
Morris, S. E., & Bosque, D. D. (2010). Forgotten resources: Subject guides in the era of Web 2.0. Technical Services Quarterly, 27(2), 178–193. https://doi.org/10.1080/07317130903547592
Moukhliss, S., & McCowan, T. (2024, June 5). Using a proposed library guide assessment standards rubric and a peer review process to pedagogically improve library guides: A case study. In the Library with the Lead Pipe. https://www.inthelibrarywiththeleadpipe.org/2024/proposed-library-guide-assessment-standards/
Murphy, S. A., & Black, E. L. (2013). Embedding guides where students learn: Do design choices and librarian behavior make a difference? The Journal of Academic Librarianship, 39(6), 528–534. https://doi.org/10.1016/j.acalib.2013.06.007
Neuhaus, C., Cox, A., Gruber, A. M., Kelly, J., Koh, H., Bowling, C., & Bunz, G. (2021). Ubiquitous LibGuides: Variations in presence, production, application, and convention. Journal of Web Librarianship, 15(3), 107–127. https://doi.org/10.1080/19322909.2021.1946457
Newton, V. W., & Silberger, K. (2007). Simplifying complexity through a single federated search box. Online, 31(4), 19–22.
Nielsen, J. (2012a, January 3). Usability 101: Introduction to usability. Nielsen Norman Group. https://www.nngroup.com/articles/usability-101-introduction-to-usability/
Nielsen, J. (2012b, June 3). How many test users in a usability study? Nielsen Norman Group. https://www.nngroup.com/articles/how-many-test-users/
Nielsen, J., & Budiu, R. (2001, February 17). Success rate: The simplest usability metric. Nielsen Norman Group. https://www.nngroup.com/articles/success-rate-the-simplest-usability-metric/
Office of Communications and Marketing. (2018, August 13). Auburn University becomes first Adobe Creative campus in the SEC. Auburn University. https://ocm.auburn.edu/newsroom/news_articles/2018/08/130936-adobe-creative-cloud.php
O’Neill, B. (2021). Do they know it when they see it?: Natural language preferences of undergraduate students for library resources. College & Undergraduate Libraries, 28(2), 219–242. https://doi.org/10.1080/10691316.2021.1920535
Ouellette, D. (2011). Subject guides in academic libraries: A user-centred study of uses and perceptions/Les guides par sujets dans les bibliothèques académiques: une étude des utilisations et des perceptions centrée sur l’utilisateur. Canadian Journal of Information and Library Science, 35(4), 436–451. https://doi.org/10.1353/ils.2011.0024
Pew Research Center. (2019, February 8). Defining our six generations. https://pew.org/3IP4ItN
Pickens, K. E. (2017). Applying cognitive load theory principles to library instructional guidance. Journal of Library & Information Services in Distance Learning, 11(1–2), 50–58. https://doi.org/10.1080/1533290X.2016.1226576
Pionke, J. J., & and Manson, J. (2018). Creating disability LibGuides with accessibility in mind. Journal of Web Librarianship, 12(1), 63–79. https://doi.org/10.1080/19322909.2017.1396277
Pittsley, K., & Memmott, S. (2012). Improving independent student navigation of complex educational web sites: An analysis of two navigation design changes in LibGuides. Information Technology and Libraries, 31(3), 52–64. https://doi.org/10.6017/ital.v31i3.1880
Quintel, D. F. (2016). LibGuides and usability: What our users want. Computers in Libraries, 36(1), 4–8.
Ray, T. A. (2025). Usability, visibility, and style: LibGuides usability testing to support students’ needs. The Southeastern Librarian, 72(4), 47-60. https://doi.org/10.62915/0038-3686.2108
Reeb, B., & Gibbons, S. L. (2004). Students, librarians, and subject guides: Improving a poor rate of return. portal: Libraries and the Academy, 4(1), 123–130. https://doi.org/10.1353/pla.2004.0020
Salubi, O. G., Ondari-Okemwa, E., & Nekhwevha, F. (2018). Utilisation of library information resources among Generation Z students: Facts and fiction. Publications, 6(2), 16. https://doi.org/10.3390/publications6020016
Seemiller, C., & Grace, M. (2017). Generation Z: Educating and engaging the next generation of students. About Campus, 22(3), 21–26. https://doi.org/10.1002/abc.21293
Sharma, M. (2021, December 13). Introducing Adobe Express. Adobe Blog. https://www.adobe.com/express/learn/blog/introducing-creative-cloud-express
Sinkinson, C., Alexander, S., Hicks, A., & Kahn, M. (2012). Guiding design: Exposing librarian and student mental models of research guides. portal: Libraries and the Academy, 12(1), 63–84. https://doi.org/10.1353/pla.2012.0008
Skaggs, D. (2016). Making LibGuides accessible to all. In A. W. Dobbs & R. L. Sittler (Eds.), Integrating LibGuides into library websites (pp. 139–155). Rowman & Littlefield.
Smith, E. S., Koziura, A., Meinke, E., & Meszaros, E. (2023). Designing and implementing an instructional triptych for a digital future. The Journal of Academic Librarianship, 49(2), 102672. https://doi.org/10.1016/j.acalib.2023.102672
Smith, M. M. (2008). 21st century readers’ aids: Past history and future directions. Journal of Web Librarianship, 2(4), 511–523. https://doi.org/10.1080/19322900802473886
Sonsteby, A., & DeJonghe, J. (2013). Usability testing, user-centered design, and LibGuides subject guides: A case study. Journal of Web Librarianship, 7(1), 83–94. https://doi.org/10.1080/19322909.2013.747366
Springshare. (n.d.). LibGuides community. Retrieved April 25, 2025, from https://community.libguides.com/
Stevens, C. H., Canfield, M. P., & Gardner, J. J. (1973). Library pathfinders: A new possibility for cooperative reference service. College & Research Libraries, 34(1), 40–46. https://doi.org/10.5860/crl_34_01_40
Stitz, T., & Blundell, S. (2018). Evaluating the accessibility of online library guides at an academic library. Journal of Accessibility and Design for All, 8(1), 33–79. https://doi.org/10.17411/jacces.v8i1.145
Stone, S. M., Sara Lowe, M., & Maxson, B. K. (2018). Does course guide design impact student learning? College & Undergraduate Libraries, 25(3), 280–296. https://doi.org/10.1080/10691316.2018.1482808
Swanson, T. A., & Green, J. (2011). Why we are not Google: Lessons from a library web site usability study. The Journal of Academic Librarianship, 37(3), 222–229. https://doi.org/10.1016/j.acalib.2011.02.014
Thorngate, S., & Hoden, A. (2017). Exploratory usability testing of user interface options in LibGuides 2. College & Research Libraries, 78(6), 844–861. https://doi.org/10.5860/crl.78.6.844
Turner, J. M., & Belanger, F. P. (1996). Escaping from Babel: Improving the terminology of mental models in the literature of human-computer interaction. Canadian Journal of Information and Library Science, 21, 35–58.
Veldof, J., & Beavers, K. (2001). Going mental: Tackling mental models for the online library tutorial. Research Strategies, 18(1), 3–20. https://doi.org/10.1016/S0734-3310(01)00064-7
Vileno, L. (2007). From paper to electronic, the evolution of pathfinders: A review of the literature. Reference Services Review, 35(3), 434–451. https://doi.org/10.1108/00907320710774300
Wan, S. (2021). Not only reading but also watching, playing, and interacting with a LibGuide. Public Services Quarterly, 17(4), 286–291. https://doi.org/10.1080/15228959.2021.1977211
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Abigail E. Higgins, Piper L. Cumbo
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
The Creative Commons-Attribution-Noncommercial-Share Alike License 4.0 International applies to all works published by Evidence Based Library and Information Practice. Authors will retain copyright of the work.
