The Research and Assessment Cycle Toolkit is a resource for library assessment practitioners to access information about assessment processes in libraries. The toolkit includes 23 training videos and supporting materials that:
- Review the principles and practices of library assessment
- Enable library workers to develop the skills necessary to assess library programs, services, resources, and spaces
- Support the launch of assessment projects from the development of the research question through to the conclusion, including action on findings
- Are modular, accessible to newcomers to library assessment, and easy to follow
- Can be self-paced or used as training materials for collaborative efforts
- Are supportive of a community of learning
The toolkit is not intended to be comprehensive and covers information that can be used by library workers at all levels of assessment experience.
A team of library assessment experts led by Megan Oakleaf (Syracuse University) and supported by Emily Daly (Duke University) and Becky Croxton (The University of North Carolina at Charlotte) developed the training modules. ARL staff Kevin Borden, Angela Pappalardo, and Anam Mian also contributed to the project.
Toolkit Training Modules
1. Overview
This video provides an overview for the modules to follow, defines basic terms, and introduces the assessment cycle for library assessment projects.
Additional helpful materials:
Please leave your feedback on this session
2. Identify
This module focuses on identifying the needs, context, and goals of library assessment projects.
Close
Show More
Discovering What You Need to Know
This video describes motivations for library assessment projects including responding to imposed questions, connecting values and practices, responding to changing trends, reallocating resources, closing gaps, better understanding users, and aligning strategic priorities.
Additional helpful materials:
- Discerning Institutional Areas of Interest, Priority, or Concern [Word document worksheet]
- Discovering What You Need to Know Slide Deck
Example from the RLIF Project:
Please leave your feedback on this session
Articulating Why You Need to Know It
This video describes key purposes and timeframes for library assessment and identifies possible obstacles to effective assessment.
Additional helpful materials:
- If We Knew More, What More Good Could We Do? [Word document worksheet]
- Single, Double, and Triple Loop Learning
- Articulating Why You Need to Know It Slide Deck
Please leave your feedback on this session
Anticipating How Knowing Will Lead to Action
This video describes strategies for beginning library assessment projects “with the end in mind” to increase the likelihood of actionable results that lead to positive outcomes and impact.
Additional helpful materials:
- Considering Active, Rather than Passive, Library Services, Resources, and Spaces [Word document worksheet]
- Goldman, K. D., and Schmalz, K. J. (2006). Logic Models: The Picture Worth Ten Thousand Words. Health Promotion Practice 7 (1), 8–12. https://doi.org/10.1177/1524839905283230.
- Logic Model Template [Google document] and Logic Model Template [Word document]
- Anticipating How Knowing Will Lead to Action Slide Deck
3. Articulate
This module focuses on articulating the focus of a library assessment project.
Close
Show More
Identifying Research Questions
This video describes strategies for structuring research questions for library assessment projects.
Additional helpful materials:
- Building Research Questions [Word document worksheet]
- Research Library Impact Framework Research Questions
- Identifying Research Questions Slide Deck
Examples from the RLIF Project:
- Research Question at UT Austin [Practice Brief]
- Research Questions at University of Illinois Chicago [Report]
Please leave your feedback on this session
Constructing User Stories
This video describes strategies for structuring user stories for library assessment projects.
Additional helpful materials:
- Developing User Stories [Word document worksheet]
- Constructing User Stories Slide Deck
Please leave your feedback on this session
Composing Hypotheses
This video describes strategies for structuring hypotheses for library assessment projects.
Additional helpful materials:
4. Collect
This module focuses on collecting data, evidence, input, or other information for library assessment projects.
Close
Show More
Identifying Potential Data, Evidence, and/or Input
This video describes strategies for identifying possible data, evidence, or other inputs needed for library assessment projects, including existing information, information found in professional literature, and new information that must be collected for the project at hand.
Additional helpful materials:
- Library Data Audit [Word document worksheet]
- Research Process by Leedy
- Judging the Feasibility of a Research Project by Leedy and Ormrod [page 126–128]
- Symonds, P. M. (1956). A research checklist in educational psychology. Journal of Educational Psychology, 47(2), 100–109. [print only]
- Identifying Potential Data, Evidence, and Input Slide Deck
Please leave your feedback on this session
Considering Your (Methods) Options
This video describes a variety of methods that can be used to collect information for library assessment projects.
Additional helpful materials:
- Ethical Principles for Social Research [Word document]
- Considering Your (Methods) Options Slide Deck
Examples from the RLIF Project:
- Mixed Methods at the University of Washington [Practice Brief] and Outreach Toolkit Overview [Google doc]
Please leave your feedback on this session
Considering Your Sample
This video describes populations and sampling for library assessment projects including sample sizes and types.
Additional helpful materials:
- A Million Random Digits
- How to Use a Random Number Table
- Determining Sample Size (Krejcie and Morgan, 1970)
- Considering Your Sample Slide Deck
Please leave your feedback on this session
Conducting Interviews
This video describes interview methods for library assessment projects including interview types, preparation, and question strategies.
Additional helpful materials:
- Researcher Guidance for the Use of Zoom in Data Collection
- In-depth Interview Method Workshop by Margaret Roller [YouTube video]
- In-depth Interview Method Workshop Slides
- Example Interview Guide
- Conducting Interviews Slide Deck
Examples from the RLIF Project:
- Interviews at Johns Hopkins University [Practice Brief]
- Interviews at Temple University [Practice Brief]
- Interviews at Syracuse University [Report]
- Interviews at the University of Washington [Report]
Please leave your feedback on this session
Conducting Focus Groups
This video describes focus group methods for library assessment projects including focus group structures and preparation.
Additional helpful materials:
- In-depth Focus Group Workshop by Margaret Roller [YouTube video]
- In-depth Focus Group Workshop Slides
- Example In-Person Discussion Guide
- Example Asynchronous Discussion Guide
- Conducting Focus Groups Slide Deck
Please leave your feedback on this session
Conducting Participatory Research
This video describes participatory research methods, including examples of community-based participatory research and user-centered design research. It covers techniques for conducting card sorts and photovoice studies as well as tips for analyzing findings.
Additional helpful materials:
- Participatory Research Methods—Choice Points in the Research Process (Vaughn and Jacquez, 2020)
- Card Sorting: Designing Usable Categories, Chapter Four (Spencer, 2009)
- How to Analyze Qualitative Data from UX Research: Thematic Analysis
- Understanding the Experiences and Needs of Black Students at Duke: Report from a study that utilized the photovoice method; includes sample recruitment emails and discussion guides
- Conducting Participatory Research Slide Deck
Please leave your feedback on this session
Conducting Observational Research
This video describes observational research methods, including techniques for conducting online and in-person observations and analyzing findings from this type of study.
Additional helpful materials:
Please leave your feedback on this session
Conducting Surveys
This video describes survey methods for library assessment projects including question types and overall design.
Additional helpful materials:
- Web Survey Design Workshop by Kevin Fomalont [YouTube video]
- Web Survey Design Workshop Slides
- Conducting Surveys Slide Deck
Examples from the RLIF Project:
5. Organize and Analyze
This module focuses on organizing and analyzing data, evidence, input, or other information for library assessment projects.
Close
Show More
Cleaning and Organizing Quantitative Data
This video describes how to clean and organize your raw dataset so that it will be ready for analysis and visualization.
Additional helpful materials:
- Student Engagement [Excel file]
- Student Information [Excel file]
- Cleaning and Organizing Quantitative Data Slide Deck
Please leave your feedback on this session
Analyzing Quantitative Data
This video describes common strategies for analyzing quantitative data, particularly descriptive statistics, using Excel and Google Sheets.
Additional helpful materials:
- Sample Data for Analysis [Excel file]
- In-Depth Quantitative Data Analysis by Kevin Fomalont [YouTube video]
- In-Depth Quantitative Data Analysis Slides
- Analyzing Quantitative Data Slide Deck
Please leave your feedback on this session
Using Excel and Google Sheets to Visualize Data
This video describes and demonstrates how to create charts and graphs using Excel and Google Sheets and includes a discussion of matching chart types to data.
Additional helpful materials:
- Using Excel and Google Sheets to Visualize Data_Sample [Excel file]
- Using Excel and Google Sheets to Visualize Data Slide Deck
Please leave your feedback on this session
Using Tableau to Visualize Data
This video provides a basic overview of Tableau, what it is and how it can help explore trends and nuances in a dataset and includes a demonstration of how to connect data, create simple visualizations with filters, and then combine visualizations into interactive dashboards that can be shared with others.
Additional helpful materials:
6. Act
This module focuses on reflecting, communicating, and acting on the results of library assessment projects.
Close
Show More
Reflecting on Results
This video describes practices for reflecting on the results of library assessment projects.
Additional helpful materials:
Please leave your feedback on this session
Communicating Results: Identifying Audiences & Messages
This video describes strategies for identifying audiences and crafting messages to communicate results of library assessment projects.
Additional helpful materials:
- Identifying Audiences and Messages [Word document worksheet]
- Communicating Results: Identifying Audiences & Messages Slide Deck
Please leave your feedback on this session
Communicating Results: Sharing Results with Stakeholders
This video describes purposes of and techniques for communicating the results of library assessment projects to stakeholders.
Additional helpful materials:
- Inclusive Language, 18F Content Guide and Inclusive Language Guidelines, American Psychological Association
- In-Depth Reporting Qualitative Research Workshop with Margaret Roller [YouTube video]
- In-Depth Reporting Qualitative Research Workshop Slides
- In-Depth Survey Reporting Workshop with Kevin Fomalont [YouTube video]
- In-Depth Survey Reporting Workshop Slides
- Communicating Results: Sharing Results with Stakeholders Slide Deck
Please leave your feedback on this session
Realizing Outcomes of Assessment: Decision-Making and Action Taking
This video describes possible outcomes of the overall assessment process.
Additional helpful materials:
This project (LG-18-19-0092) was made possible in part by the Institute of Museum and Library Services. The views, findings, conclusions, or recommendations expressed in this project do not necessarily represent those of the Institute of Museum and Library Services.
The Institute of Museum and Library Services is the primary source of federal support for the nation’s libraries and museums. We advance, support, and empower America’s museums, libraries, and related organizations through grantmaking, research, and policy development. Our vision is a nation where museums and libraries work together to transform the lives of individuals and communities. To learn more, visit www.imls.gov and follow us on Facebook and Twitter.
