Using UX Testing to Optimize Discoverability of Non-traditional Resources
DOI:
https://doi.org/10.18438/eblip30594Abstract
Objective – The accessibility of non-traditional resources presents ongoing challenges for users and librarians. This study investigates methods for optimizing metadata and the placement of search results to enhance the discoverability of these resources within library systems. Researchers conducted A/B testing to compare two features of Ex Libris Primo: the Resource Recommender and Discovery Import Profiles. The objective was to enhance user access to a broader range of informational assets beyond conventional collections. This study posed the research question: Is inclusion in the results list (Discovery Import Profiles) or are visually appealing advertisement-style cards above results (Resource Recommender) a more effective method for discovery of non-traditional library resources?
Methods – Researchers identified four key resource types for testing: librarians, frequently asked questions (FAQs), databases, and research guides. An A/B test was conducted with each resource presented in the Discovery Import Profiles and Resource Recommender formats. Following the A/B test, a combined C test was conducted to validate findings.
Results – The ad-style cards achieved higher engagement rates, particularly for databases and FAQs, while research guides performed better when embedded directly in search results. This study highlights the strengths and limitations of each method. Databases and FAQs benefited from the visual prominence of the ad-style cards, while research guides were more discoverable within search results. However, minimal engagement with librarians as a resource type across both methods suggests the need for improved tagging and metadata strategies.
Conclusion – Findings underscore the importance of institution-specific research and localized assessments to ensure effective implementation of discovery strategies. This study provides a useful method for libraries aiming to enhance the discoverability of their non-traditional resources, ultimately improving user access and satisfaction.
Downloads
References
Bar-Ilan, J., Zhitomirsky-Geffet, M., Miller, Y., & Shoham, S. (2012). Tag-based retrieval of images through different interfaces: A user study. Online Information Review, 36(5), 739-757. https://doi.org/10.1108/14684521211276019
Bossaller, J. S., & Sandy, H. M. (2017). Documenting the conversation: A systematic review of library discovery layers. College & Research Libraries, 78(5), 602–619. https://doi.org/10.5860/crl.78.5.602
Broder, A. (2002). A taxonomy of web search. SIGIR Forum, 36(2), 3–10. https://doi.org/10.1145/792550.792552
Chow, A. S., Bridges, M., & Commander, P. (2014). The website design and usability of US academic and public libraries. Reference & User Services Quarterly, 53(3), 253–265. https://doi.org/10.5860/rusq.53n3.253
Ex Libris. (2024a). Configuring the ranking of search results in Primo VE. ExLibris Knowledge Center. https://knowledge.exlibrisgroup.com/Primo/Product_Documentation/020Primo_VE/Primo_VE_(English)/040Search_Configurations/Configuring_the_Ranking_of_Search_Results_in_Primo_VE
Ex Libris. (2024b). Resource Recommender for Primo VE. ExLibris Knowledge Center. https://knowledge.exlibrisgroup.com/Primo/Product_Documentation/020Primo_VE/Primo_VE_(English)/120Other_Configurations/010Resource_Recommender_for_Primo_VE
Griffith, J. (2021, June 14-18). Using generic XML to create a discovery import profile in Primo VE [Paper presentation]. eBUG Annual Conference 2021, virtual. https://documents.el-una.org/id/eprint/2033/
Holvoet, K., Jeffery, K., & Nowicki, R. (2020, June 24). Building better discovery: Using data to optimize the user experience with mediated search results [Poster presentation]. American Library Association Annual Conference and Exhibition, virtual. http://hdl.handle.net/20.500.12680/rx913x43k
Kelly, D., & Teevan, J. (2003). Implicit feedback for inferring user preference: A bibliography. SIGIR Forum, 37(2), 18–28. https://doi.org/10.1145/959258.959260
Khazaei, T., & Hoeber, O. (2017). Supporting academic search tasks through citation visualization and exploration. International Journal on Digital Libraries, 18(1), 59-72. https://doi.org/10.1007/s00799-016-0170-x
Kules, B., & Capra, R. (2010). The influence of search stage on gaze behavior in a faceted search interface. Proceedings of the ASIS Annual Meeting, 47(1), 1–2. https://doi.org/10.1002/meet.14504701398
Niu, X., Fan, X., & Zhang, T. (2019). Understanding faceted search from data science and human factor perspectives. ACM Transactions on Information Systems, 37(2), Article 14. https://doi.org/10.1145/3284101
Pirolli, P. (2007). Information foraging theory: Adaptive interaction with information. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195173321.001.0001
Saracevic, T. (2007). Relevance: A review of the literature and a framework for thinking on the notion in information science. Part III: Behavior and effects of relevance. Journal of the American Society for Information Science and Technology, 58(13), 2126–2144. https://doi.org/10.1002/asi.20681
Tella, A. (2020). Interactivity, usability and aesthetic as predictors of undergraduates’ preference for university library websites. South African Journal of Libraries & Information Science, 86(2), 16–25. https://doi.org/10.7553/86-2-1905
Zavalina, O., & Vassilieva, E. V. (2014). Understanding the information needs of large-scale digital library users: Comparative analysis of user searching. Library Resources & Technical Services, 58(2), 84-99. https://doi.org/10.5860/lrts.58n2.84
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Lucy Campbell, Keven Jeffery

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
The Creative Commons-Attribution-Noncommercial-Share Alike License 4.0 International applies to all works published by Evidence Based Library and Information Practice. Authors will retain copyright of the work.