Chat Transcripts in the Context of the COVID-19 Pandemic: Analysis of Chats from the AskAway Consortia
DOI:
https://doi.org/10.18438/eblip30291Abstract
Objective – During the COVID-19 pandemic, the majority of post-secondary institutions in British Columbia remained closed for a prolonged period, and volume on the provincial consortia chat service, AskAway, increased significantly. This study was designed to evaluate the content of AskAway transcripts for the 2019-2020 and 2020-2021 academic years to determine if the content of questions varied during the pandemic.
Methods – The following programs were used to evaluate the dataset of more than 70,000 transcripts: R, Python (pandas), Voyant Tools and Linguistic Inquiry and Word Count (LIWC).
Results – Our findings indicate that the content of questions remained largely unchanged despite the COVID-19 pandemic and the related increase in volume of questions on the AskAway chat service.
Conclusion – These findings suggest that the academic libraries covered by this study were well-poised to provide continued support of patrons through the AskAway chat service, despite an unprecedented closure of physical libraries, a significant increase in chat volume, and a time of global uncertainty.
Downloads
References
AskAway. (2022). Tags. https://askaway.org/staff/tags
BC Stats. (2018). College regions: Detailed wall map. https://www2.gov.bc.ca/assets/gov/data/geographic/land-use/administrative-boundaries/college-regions/map_wall_college_regions_2018nov18.pdf
British Columbia Electronic Library Network. (2021). AskAway actions and achievements 2021 [Accessible version]. https://bceln.ca/sites/default/files/reports/AA_Actions_Achievements_2021_Accessible.pdf
British Columbia Electronic Library Network. (2022a). Participating institutions. https://bceln.ca/services/learning-support/askaway/participating-institutions
British Columbia Electronic Library Network. (2022b). Partner libraries: FTE information. https://www.bceln.ca/partner-libraries/fte
Chen, X., & Wang, H. (2019). Automated chat transcript analysis using topic modeling for library reference services. Proceedings of the Association for Information Science and Technology, 56(1), 368-371. https://doi.org/10.1002/pra2.31 DOI: https://doi.org/10.1002/pra2.31
De Groote, S. and Scoulas, J.M. (2021). Impact of COVID-19 on the use of the academic library. Reference Services Review, 49(3/4), 281-301. https://doi.org/10.1108/RSR-07-2021-0043 DOI: https://doi.org/10.1108/RSR-07-2021-0043
Francoeur, S. (2001). An analytical survey of chat reference services. Reference Services Review, 29(3), 189-204. https://doi.org/10.1108/00907320110399547 DOI: https://doi.org/10.1108/00907320110399547
Grabarek Roper, K., & Sobel, K. (2012). Anonymity versus perceived patron identity in virtual reference transcripts. Public Services Quarterly, 8(4), 297-315. https://doi.org/10.1080/15228959.2012.730396 DOI: https://doi.org/10.1080/15228959.2012.730396
Graewingholt, M., Coslett, C., Cornforth, J., Palmquist, D., Greene, C.R., & Karkhoff, E. (2022). Chatting into the void: Scaling and assessing chat reference services for effectiveness. In M. Chakraborty, S. Harlow, & H. Moorefield-Lang (Eds.), Sustainable online library services and resources: Learning from the pandemic (pp. 19-34). Libraries Unlimited. DOI: https://doi.org/10.5040/9798216184935.ch-002
Harlow, S. (2021). Beyond reference data: A qualitative analysis of nursing library chats to improve research health science services. Evidence Based Library and Information Practice, 16(1), 46-59. https://doi.org/10.18438/eblip29828 DOI: https://doi.org/10.18438/eblip29828
Hervieux, S. (2021). Is the library open? How the pandemic has changed the provision of virtual reference services. Reference Services Review, 49(3/4), 267–280. https://doi.org/10.1108/RSR-04-2021-0014 DOI: https://doi.org/10.1108/RSR-04-2021-0014
Jordan, K. N., Sterling, J., Pennebaker, J. W., & Boyd, R. L. (2019). Examining long-term trends in politics and culture through language of political leaders and cultural institutions. Proceedings of the National Academy of Sciences, 116(9), 3476–3481. https://doi.org/10.1073/pnas.1811987116 DOI: https://doi.org/10.1073/pnas.1811987116
Kacewicz, E., Pennebaker, J. W., Davis, M., Jeon, M., & Graesser, A. C. (2014). Pronoun use reflects standings in social hierarchies. Journal of Language and Social Psychology, 33(2), 125–143. https://doi.org/10.1177/0261927X13502654 DOI: https://doi.org/10.1177/0261927X13502654
Kalichman, S. C., & Smyth, J. M. (2021). “And you don’t like, don’t like the way I talk”: Authenticity in the language of Bruce Springsteen. Psychology of Aesthetics, Creativity, and the Arts. https://doi.org/10.1037/aca0000402 DOI: https://doi.org/10.1037/aca0000402
Kathuria, S. (2021). Library support in times of crisis: An analysis of chat transcripts during COVID. Internet Reference Services Quarterly, 25(3), 107–119. https://doi.org/10.1080/10875301.2021.1960669 DOI: https://doi.org/10.1080/10875301.2021.1960669
Lapidus, M. (2022). Reinventing virtual reference services during a period of crisis: Decisions that help us move forward. Medical Reference Services Quarterly, 41(1), 41-53. https://doi.org/10.1080/02763869.2022.2021033 DOI: https://doi.org/10.1080/02763869.2022.2021033
LIWC. (n.d.). Understanding LIWC summary measures. https://www.liwc.app/help/liwc#Summary-Measures
Logan, J. & Barrett, K. (2018). How important is communication style in chat reference? Internet Reference Services Quarterly, 23(1-2), 41–57. https://doi.org/10.1080/10875301.2019.1628157 DOI: https://doi.org/10.1080/10875301.2019.1628157
Logan, J., Barrett, K., & Pagotto, S. (2019). Dissatisfaction in chat reference users: A transcript analysis study. College & Research Libraries, 80(7), 925–944. DOI: https://doi.org/10.5860/crl.80.7.925
Mawhinney, T., & Hervieux, S. (2022). Dissonance between perceptions and use of virtual reference methods. College & Research Libraries, 83(3), 503. https://doi.org/10.5860/crl.83.3.503 DOI: https://doi.org/10.5860/crl.83.3.503
Mungin, M. (2017). Stats don’t tell the whole story: Using qualitative data analysis of chat reference transcripts to assess and improve services. Journal of Library & Information Services in Distance Learning, 11(1/2), 25–36. https://doi.org/10.1080/1533290X.2016.1223965 DOI: https://doi.org/10.1080/1533290X.2016.1223965
Oracle. (2022). Java documentation: About the BreakIterator class. https://docs.oracle.com/javase/tutorial/i18n/text/about.html
Ozeran, M., & Martin, P. (2019). “Good night, good day, good luck”: Applying topic modeling to chat reference transcripts. Information Technology and Libraries, 38(2), 59-67. https://doi.org/10.6017/ital.v38i2.10921 DOI: https://doi.org/10.6017/ital.v38i2.10921
Radford, M., Costello, L., & Montague, K. (2021). Surging virtual reference services: COVID-19 a game changer. College & Research Libraries News, 82(3), 106–113. https://doi.org/10.5860/crln.82.3.106 DOI: https://doi.org/10.5860/crln.82.3.106
Reference and User Services Association. (2017). Guidelines for implementing and maintaining virtual reference services. https://www.ala.org/rusa/sites/ala.org.rusa/files/content/GuidelinesVirtualReference_2017.pdf
Sharma, A., Barrett, K., & Stapelfeldt, K. (2022). Natural language processing for virtual reference analysis. Evidence Based Library and Information Practice, 17(1), 78-93. https://doi.org/10.18438/eblip30014 DOI: https://doi.org/10.18438/eblip30014
Schiller, S. Z. (2016). CHAT for chat: Mediated learning in online chat virtual reference service. Computers in Human Behavior, 65, 651-665. https://doi.org/10.1016/j.chb.2016.06.053 DOI: https://doi.org/10.1016/j.chb.2016.06.053
Sinclair, S. & Rockwell, G. (2022). Voyant Tools (Version 2.6.1). [Text analysis app]. https://voyant-tools.org/
Sloan, B. (1998). Electronic reference services: Some suggested guidelines. Reference and User Services Quarterly, 38(1), 77-81.
Smith, M., Conte, J., & Guss, S. (2016). Understanding academic patrons’ data needs through virtual reference transcripts: Preliminary findings from New York University Libraries. IASSIST Quarterly, 40(1), 20–26. https://doi.org/10.29173/iq624 DOI: https://doi.org/10.29173/iq624
Statistics Canada. (2020, May 12). Impacts of the COVID-19 pandemic on postsecondary students. The Daily. https://www150.statcan.gc.ca/n1/daily-quotidien/200512/dq200512a-eng.htm
Tausczik, Y. R., & Pennebaker, J. W. (2010). The psychological meaning of words: LIWC and computerized text analysis methods. Journal of Language and Social Psychology, 29(1), 24–54. https://doi.org/10.1177/0261927X09351676 DOI: https://doi.org/10.1177/0261927X09351676
Walker, J. & Coleman, J. (2021). Using machine learning to predict chat difficulty. College & Research Libraries 82(4), 683-707. https://doi.org/10.5860/crl.82.5.683 DOI: https://doi.org/10.5860/crl.82.5.683
Wang, Y. (2022). Using machine learning and natural language processing to analyze library chat reference transcripts. Information Technology and Libraries, 41(3), 1-10. https://doi.org/10.6017/ital.v41i3.14967 DOI: https://doi.org/10.6017/ital.v41i3.14967
Watson, A. P. (2023). Pandemic chat: A comparison of pandemic-era and pre-pandemic online chat questions at the University of Mississippi Libraries. Internet Reference Services Quarterly, 27(1), 25-36. https://doi.org/10.1080/10875301.2022.2117757 DOI: https://doi.org/10.1080/10875301.2022.2117757
World Health Organization. (2023). Coronavirus disease: COVID-19 pandemic. https://www.who.int/europe/emergencies/situations/covid-19
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Barbara Sobol, Aline Goncalves, Mathew Vis-Dunbar, Sajni Lacey, Shannon Moist, Leanna Jantzi, Aditi Gupta, Jessica Mussell, Patricia L. Foster, Kathleen James
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
The Creative Commons-Attribution-Noncommercial-Share Alike License 4.0 International applies to all works published by Evidence Based Library and Information Practice. Authors will retain copyright of the work.
