From Rubric to Reality

Reflections on Norming and Scoring Information Literacy at Scale

Authors

DOI:

https://doi.org/10.23974/ijol.2025.vol10.4.516

Abstract

This case study examines the development and implementation of a campus-wide assessment of the Information Literacy (IL) Core Competency at California State University, Fresno, during the 2023-2024 academic year. A cross-disciplinary faculty committee evaluated 153 upper-division General Education student papers using a rubric adapted from the Association of American Colleges and Universities (AAC&U) VALUE rubric and aligned with the Association of College and Research Libraries (ACRL) Framework for Information Literacy. Through norming sessions, rubric revision, and collaborative scoring, the project revealed key challenges in evaluating IL across disciplines, particularly in achieving interrater consistency and interpreting student work in the absence of assignment context. The study explores how faculty from different academic fields interpreted IL criteria and how librarians contributed a focused lens on information behaviors. Reflections from the assessment process offer practical recommendations for improving rubric design, fostering interdisciplinary dialogue, and supporting institution-wide assessment practices. The findings underscore how shared assessment efforts can strengthen institutional understanding of IL and inform both instruction and faculty development.

Downloads

Download data is not yet available.

Author Biography

  • Shuyi Liu, California State University, Fresno

    Shuyi Liu is the Health Sciences Librarian and a faculty member at California State University, Fresno. She specializes in health informatics and teaches in the College of Health and Human Services. Her course, certified by the Medical Library Association, prepares students with the Consumer Health Information Specialization (CHIS) certification. Her research focuses on leveraging information technology and interactive media to advance health education and health literacy. She holds an MLIS from the University of Illinois Urbana-Champaign.

References

Association of American Colleges and Universities. (2013). Information literacy VALUE rubric. https://www.aacu.org/initiatives/value-initiative/value-rubrics/value-rubrics-information-literacy

Association of College and Research Libraries. (2016). Framework for information literacy for higher education. American Library Association. https://www.ala.org/acrl/standards/ilframework

Buljung, B., Vuletich, S., & Dunn, L. (2023). Aligning information literacy terminology to STEM disciplinary language used in the scientific method. Education for Information, 39(3), 269-286. https://doi.org/10.3233/efi-230036

Burns, A., De Bruyn, L. L., & Wilson, S. (2023). A rubric approach to assessing information literacy competency in tertiary curricula. Journal of University Teaching and Learning Practice, 20(1). https://doi.org/10.53761/1.20.01.19

Dahlen, S. P. C. (2023). Assessing synthesis of information from sources. In A. Pappalardo (Ed.), Proceedings of the 2022 Library Assessment Conference: Building Effective, Sustainable, Practical Assessment. Association of Research Libraries. https://www.libraryassessment.org/wp-content/uploads/2023/03/168-Dahlen-Assessing-Synthesis-of-Information.pdf

Delmond, A. R., Weber, E. M., & Busch, H. S. (2024). An interdisciplinary assessment of information literacy instruction. The Journal of Academic Librarianship, 50(5). https://doi.org/10.1016/j.acalib.2024.102944

Hammons, J. (2024). Academic librarians as educational developers: Overview, case study, and discussion. To Improve the Academy: A Journal of Educational Development, 43(1), 5. https://doi.org/10.3998/tia.4263

Julien, H., Gross, M., & Latham, D. (2018). Survey of information literacy instructional practices in U.S. academic libraries. College & Research Libraries, 79(2), 179-199. https://doi.org/10.5860/crl.79.2.179

Saunders, L. (2012). Faculty perspectives on information literacy as a student learning outcome. The Journal of Academic Librarianship, 38(4), 226-236. https://doi.org/10.1016/j.acalib.2012.06.001

Smyser, B. M., & Bolognese, J. (2023, June). A rubric-based assessment of information literacy in graduate course term papers. 2023 ASEE Annual Conference & Exposition, Baltimore, Maryland, United States. https://doi.org/10.18260/1-2--42493

Turbow, D. J., & Evener, J. (2016). Norming a VALUE rubric to assess graduate information literacy skills. Journal of the Medical Library Association JMLA, 104(3). https://doi.org/10.5195/jmla.2016.13

University Information Literacy Core Competency Assessment Committee. (2024). 2023-24 information literacy core competency assessment report. California State University, Fresno. https://library.fresnostate.edu/assessment

Downloads

Published

2025-12-16

Issue

Section

Featured Articles

How to Cite

From Rubric to Reality: Reflections on Norming and Scoring Information Literacy at Scale. (2025). International Journal of Librarianship, 10(4), 71-82. https://doi.org/10.23974/ijol.2025.vol10.4.516