STEP 1.a Defining Outcome-Based Evaluation

Introduction

An understanding of the following terms will provide a foundation as you begin the process of conducting an outcome-based evaluation for your library program or service. To gain a more in-depth understanding of outcome-based evaluation, see the Understanding Outcome-Based Evaluation (1.b) section.

Outcomes - Sometimes referred to as "indicators of impact" or "impact indicators," outcomes are the benefits to people as a result of your programs and services: specifically, achievements or changes in skill, knowledge, attitude, behavior, condition, or life status for program participants.

Outputs -Outputs quantify the work done (i.e., number of books circulated, number of reference questions answered, etc.).

Inputs - The resources that your library has available and can contribute to provide services. The raw materials of a library program (i.e., money, space, collection, equipment, staff, etc.).

For more in-depth definitions, visit the following sites.
United Way of America - Measuring Program Outcomes: A Practical Approach: Provides definitions of evaluation terminology.
Institute of Museum and Library Services Museum Services: Introduction to Outcome-Oriented Evaluation:Provides a good list of resources
Counting on Results: New Tools for Outcome-Based Evaluation of Public Libraries

Patterns of Outcomes

Specific outcomes arise from the service and its context. Below we show very broad groups of outcomes.

Outcomes that result from interactions with library services can be seen in individuals and can extend more to encompass their families, friends, and neighborhood. These are the kinds of broad outcome patterns that are being identified from the perspective of individuals can be seen as changes in:

• Attitudes (e.g., negative to positive)
• Personal efficacy (e.g. self esteem, confidence building, a changed outlook on life and future prospects, feelings of accomplishment and hope)
• Skill levels (e.g., increased technological literacy, communication and social skills, etc.)
• Learning gains (e.g., increased interest in learning, active participation in learning, etc.)
• Knowledge gains (e.g. wide ranging, individually focused, including knowledge of the community, knowledge needed to pass the GED, etc.)
• Progress toward a goal
• Social networks (e.g., increased social and community connections)
• Status changes (e.g., decide to return to school, got a job, become a citizen, increased participation as a citizen)
• Increased access to information
• Time (e.g., time saved)

Outcome gained from using specific library services designed to increase access to community information (I & R services and community networks) can also be seen in organizations, and through them to their clientele and the larger community. The outcome gains reported by organizations include:

• Increased knowledge of the community resulting in better understanding of how various organizations work.
• An enhanced ability to share information with other organizations and the community.
• Increased opportunity to collaborate with other organizations
• Improved service delivery
• A sense that the community is better because of the above.

For examples of outcomes discovered through our research, use the links below:

Austin, TX and Flint, MI Public Libraries - Our project studied after-school community technology programs in Austin, Texas and Flint, Michigan to discover how such public library programs impact participants.

Austin Public Library Outcomes
Flint Public Library Outcomes

Peninsula Library System, CA - This project studied the impact of the library's Community Information Program on area residents.
Peninsula Library System Outcomes

To gain a more in-depth understanding of impact evaluation see the Understanding Outcome-Based Evaluation (1.b) section.

To begin your own impact evaluation project, see the Preparing Your Own Evaluation (1.c).