Abstract
This article investigates the application of Critical AI Literacy in research strategies in the field of humanities, exemplified by a case study of CNKI SMART, an AI-driven feature in one of the leading databases for Chinese Studies, the China National Knowledge Infrastructure (CNKI). As GenAI transforms information access, libraries and librarians bear increasing responsibility for fostering AI Literacy and Critical AI Literacy among patrons to support thoughtful engagement with GenAI-generated content. Addressing this critical gap, we propose a Critical AI Literacy evaluation practice—the RACBAC Standard—combining seven Critical AI Literacy Skills to assist researchers in humanities and potentially other disciplines. The RACBAC Standard evaluates GenAI outputs based on Relevance, Accuracy, Coverage, Bias, Authority, and Currency. Through a case study evaluating CNKI SMART’s responses to a given research question, we demonstrate the application of our proposed RACBAC Standards. Findings highlight the necessity of librarians’ role in assisting researchers to cross-reference and critically examine GenAI-assisted research using the proposed six standards. This article contributes to the emerging discourse on AI Literacy and Critical AI Literacy by advancing strategies that promote responsible use of GenAI tools across academic fields.
References
American Library Association. (1989, January 10). Presidential committee on information literacy: Final report. https://www.ala.org/acrl/publications/whitepapers/presidential
American Library Association. (2015, February 9). Framework for information literacy for higher education. https://www.ala.org/acrl/standards/ilframework
Bao, K. 鲍昆. (2004). “Snow, Moon, Wind, and Flowers for Nearly a Hundred Years” [雪月风花近百年]. Arts Criticism [艺术评论], 6, 37–45.
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big?. Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 610–623. https://doi.org/10.1145/3442188.3445922
Blakeslee, S. (2004). The CRAAP test. LOEX Quarterly, 31 (3), 6–7. https://commons.emich.edu/loexquarterly/vol31/iss3/4
Brown, L. X. Z., Shetty, R., Scherer, M., & Crawford, A. (2022, May 24). Ableism and
disability discrimination in new surveillance technologies: How new surveillance technologies in education, policing, health care, and the workplace disproportionately harm disabled people. Center for Democracy and Technology. https://cdt.org/insights/ableism-and-disability-discrimination-in-new-surveillance-technologies-how-new-surveillance-technologies-in-education-policing-health-care-and-the-workplace-disproportionately-harm-disabled-people/
Caulfield, M. (2019, June 19). SIFT (The Four Moves). Hapgood. https://hapgood.us/2019/06/19/sift-the-four-moves/
Chen, J. 陈璟. (2013). Thoughts on “Lang of South and Zhang of North” [“南郎北张”之思考.] [Master’s thesis, Nanjing Normal University].
Chen, P. C. 陳葆真. (2003). The extension of literati painting―Lang Jingshan’s photographic art [文人畫的延伸——郎靜山的攝影藝術]. The National Palace Museum Monthly of Chinese Art [故宮文物月刊], 20 (10), 42–57.
Chu, K. W. (2021). “Ruptured Shanshui: Landscape composite photography from Lang Jingshan to Yang Yongliang.” Photographies, 14 (1), 3–14.
Fitch, S. (2024, March 8). The surprising power of next word prediction: Large language models explained, Part 1. Center for Security and Emerging Technology. https://cset.georgetown.edu/article/the-surprising-power-of-next-word-prediction-large-language-models-explained-part-1/
Flinders, M., & Smalley, I. (2024, June 3). What is data sovereignty? IBM. https://www.ibm.com/think/topics/data-sovereignty
Giustini, D., & Dastyar, V. (2024). Critical AI literacy for interpreting in the age of AI. Interpreting and Society, 4(2), 196–213. https://doi.org/10.1177/27523810241247259
Goddard, K., Roudsari, A., & Wyatt, J. C. (2011). Automation bias - a hidden issue for clinical decision support system use. Studies in Health Technology and Informatics, 164, 17–22. https://doi.org/10.3233/978-1-60750-709-3-17
Kampen, K. V. (n.d.). Library guides: Evaluating resources and misinformation: The SMART check. Retrieved November 6, 2024, from https://guides.lib.uchicago.edu/c.php?g=1241077&p=9082345
Kent, R. K. (2013). Early twentieth-century art photography in China: Adopting, domesticating, and embracing the foreign.” Trans Asia Photography, 3(2).
Kong, B. 孔斌. (2024). Applied research on composite photography based on the perspective of deconstructionism [基于解构主义视角下的集锦摄影创作实践研究]. [Master’s thesis, Qilu University of Technology].
Kong, L. L. 孔令俐. (2020). Beyond pictorialism: Media, identity and modernity in art photography (1912–1937). [Doctoral dissertation, Nanyang Technological University].
Kupfer, C., Prassl, R., Fleiß, J., Malin, C., Thalmann, S., & Kubicek, B. (2023). Check the box! How to deal with automation bias in AI-based personnel selection. Frontiers in Psychology, 14, 1118723. https://doi.org/10.3389/fpsyg.2023.1118723
Lai, K. E. 黎健強. (2000). The life and art photography of Lang Jingshan (1892–1995). [Doctoral dissertation, University of Hong Kong].
Laupichler, M. C., Aster, A., Schirch, J., & Raupach, T. (2022). Artificial intelligence literacy in higher and adult education: A scoping literature review. Computers and Education: Artificial Intelligence, 3, 100101.https://doi.org/10.1016/j.caeai.2022.100101
Lehrbaum, S. (2022, Mar 30). Casual ableism in the digital age: From cyberbullying to hiring discrimination. University Wire.
Li, H. N. 李寒凝. (2016). Chinese Photographic Society in the 1920s and 1930s [20世纪二三十年代的中华摄影学社研究] [Master’s thesis, The Central Academy of Fine Arts].
Liu, Mia Yinxing. (2015). The ‘Emulative’ portraits: Lang Jingshan’s photography of Zhang Daqian. Trans Asia Photography, 6 (1).
Long, D., & Magerko, B. (2020). What is AI literacy? Competencies and design
considerations. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–16. https://doi.org/10.1145/3313831.3376727
MacCallum, K., Parsons, D., & Mohaghegh, M. (2023). Identifying the components of foundational Artificial Intelligence (AI) literacy—Early results from a Delphi study. ASCILITE Publications, 157–166. https://doi.org/10.14742/apubs.2023.672
Mandalios, J. (2013). RADAR: An approach for helping students evaluate Internet sources. Journal of Information Science, 39(4), 470–478. https://doi.org/10.1177/0165551513478889
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2, 100041. https://doi.org/10.1016/j.caeai.2021.100041
Perrigo, B. (2023, January 18). Exclusive: The $2 per hour workers who made ChatGPT safer. TIME. https://time.com/6247678/openai-chatgpt-kenya-workers/
Rana, V. (2024). Indigenous data sovereignty: A catalyst for ethical AI in business. Business & Society, 00076503241271143. https://doi.org/10.1177/00076503241271143
Ross, A. (2024). AI and the expert; A blueprint for the ethical use of opaque AI. AI & SOCIETY,
(3), 925–936. https://doi.org/10.1007/s00146-022-01564-2
Strauß, S. (2021). “Don’t let me be misunderstood”: Critical AI literacy for the constructive use of AI technology. TATuP - Zeitschrift Für Technikfolgenabschätzung in Theorie Und Praxis, 30 (3), 44–49. https://doi.org/10.14512/tatup.30.3.44
Tang, W. 唐卫. (2014). On the Chinese aesthetics of Lang Jingshan’s ‘composite photography’ —Misreading the ‘six principles’; Art should start with ‘specific art theory’ [论郎静山“集锦摄影”的中国美学——“六法”失读,谈艺应从“具体艺理”开始.]” Study of Art [艺术学研究], 8, 415–29.
Williams, A. (2022). The exploited labor behind artificial intelligence. https://www.noemamag.com/the-exploited-labor-behind-artificial-intelligence
Worth, S., Snaith, B., Das, A., Thuermer, G., & Simperl, E. (2024). AI data transparency: An exploration through the lens of AI incidents (arXiv:2409.03307). arXiv. http://arxiv.org/abs/2409.03307
Zhou, X., & Schofield, L. (2024). Developing a conceptual framework for Artificial Intelligence (AI) literacy in higher education. Journal of Learning Development in Higher Education, 31. https://doi.org/10.47408/jldhe.vi31.1354
Zurkowski, P. (1975). The information service environment relationships and priorities. National Commission on Libraries and Information Science.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) 2025 International Journal of Librarianship