|Table of Contents||Previous Issues||Subscribe Now!|
|VOLUME 26 • NUMBER 5 • September/October 2002|
Conducting User Surveys:
An Ongoing Information Imperative
by George R. Plosker
surveys are often mentioned wheninformation professionals strategize on
expanding the reach and recognition of library services. However, user
surveys tend to "slide off the plate" as information professionals go about
their busy schedules. Yet remaining relevant to users is critical to library
survival. What better way both to ascertain what users desire and to inform
them of capabilities they are unaware of or don't use? Practical tips and
suggestions on how to go about doing such a survey will hopefully whet
your appetite for doing user surveys. Ideas on relating survey efforts
to the business or academic planning cycle, working with functional departments
on goal setting and project work, and segmenting the user base should make
the process more palatable.
Given the new vernacular in libraryland—browsers, Web-speed, spidering, search engines, and Web directories—Internet concepts have become relevant to all front line information professionals. More importantly, user behavior and expectations have gone through extensive changes due to the altered information environment. Users expect 24/7 availability and the convenience of access from their own homes or offices.
TURNING AWAY FROM LIBRARIES
In ARL libraries, according to Scott Carlson's article "The Deserted Library," published in the November 2001 issue of The Chronicle of Higher Education (pp. A35-A38), actual visits to the reference desk are clearly on a downward trend, while remote access to library subscription databases has increased. The old model of one at a time queries, usually at or through the reference desk, leading to one-off needs fulfillment, is no longer adequate. With more than 175 million people on the Web and reference traffic declining, librarians should be determining what percent of their users come to the reference desk. How can populations of potential users be reached and made aware of the added-value services the library provides?
Understanding how these trends impact library users and the impact on library environments comes from collecting relevant and accurate data. While it is possible to intuit changes in user needs and expectations via simple observations of trends and behavior, is always preferable to take a more scientific approach to the key issue of determining the needs of users, both existing library users and potential groups of users who are not currently using library services. Remember, if you can't measure it, you can't improve it!
INCORPORATING SURVEY QUESTIONS INTO REFERENCE INTERVIEWS
Several strategies are available to information professionals to determine key needs and obtain input on preferred solutions. The reference interview remains a valid avenue to determine what a user needs. Librarians might ask additional questions at the conclusion of the traditional reference interview to see if key users have ideas on enhancing and extending user services. Do they, or would they, use online databases if remote access were provided? Would e-mail reference service be useful? What about chat technologies—would patrons use a chat function to communicate with professional reference staff remotely?
Many tactics can be utilized to get closer to your user base. A classic approach is to segment your users. This should be a comfortable exercise for information professionals, as you are really "cataloging" your patrons into groups that share similar perspectives, motivations for using information, and, therefore, needs. Once these patrons are defined into groups, work to understand each constituencies' goals and interests thoroughly. You can accomplish this by joining project and/or community teams made up of these groups. Investigate their planning cycles, volunteer to consult on needs related to a key initiative, determine what their "hot buttons" are. Once you are closer to the overview perspective provided by being closer to the group and their objectives, you can even move to proactively anticipate needs by using alerting strategies. Surveys and audits become increasingly effective if targeted to smaller groups, becoming more focused, more precise, and elevate the dialogue to actionable specifics.
Suzan A. Brown, in her forward-thinking article, "Marketing the Corporate Information Center for Success" (ONLINE, July/August 1997, pp. 74-79) provides specific illustrations of this approach in a corporate library environment. Brown segments her corporate users into administrative management, R&D practitioners, and scientists and engineers. Administrative management is concerned with the organization's overall productivity and viability, which means they may be interested in competitor activities, new business opportunities, and regulatory requirements. The R&D staff is concerned with recent scientific developments and technical information and is likely to have a special interest in patents. Scientists and engineers will be primarily interested in project-related information that is narrowly focused on previous research, but they will be open to serendipity.
SEGMENTING ACADEMIC AND PUBLIC LIBRARY USERS
In a public or academic environment, you can divide your users vertically by academic discipline or horizontally by grade or age level. Administrative units can be considered a separate segment, especially in the public library world where administrative units are often the funding body. Other public library constituencies include student populations, adult and distance learners, children and young adults, or ESL populations.
All professionals know that getting and staying close to your users/clients takes effort and time. While all of the tactics listed above are viable, the use of surveys and information audits will provide a framework and foundation for all other approaches. Why conduct surveys and audits? The survey or audit will do all of the following:
Brown also stresses the outreach aspects of doing a survey. "Although information needs and current customer satisfaction can be assessed on a one-on-one basis as customers visit the information center, this method omits all those potential customers who never think about consulting the information center. To reach potential customers, information centers may consider conducting a survey by mail, e-mail, or through an employee newsletter. The questionnaire can be designed to assess the needs of both current and potential customers and should address such issues as satisfaction with current services, other outside services used, perceived needs for other kinds of information, and how the information center can provide better service in general."
BEGINNING THE SURVEY PROCESS
Hopefully you are now convinced that doing a user survey or information audit is a good idea. How do you get started? Here are several simple steps that will guide you in obtaining the information needed to improve the effectiveness of your library.
First, determine what topics need surveying. Perhaps you have recently implemented a new service and want to check on user reaction to the new database. A targeted approach is often preferable to attempting to survey all aspects of library service. This will keep the survey shorter and more manageable. It will also begin to orient your users to the idea of satisfaction surveys that can be built upon. Doing a 20-page survey with hundreds of questions is probably not a good place to start!
Once the topic(s) of the survey are defined, it is useful to do an informal gathering of information. Pre-test your survey questions by interviewing several core library users to see what they think. This interaction will bring forth the specifics of what the users are or might be interested in and will lead directly to the creation of the survey questions.
In addition to working with individual library users, you should conduct small "focus groups"/brainstorming sessions with key constituencies. During these sessions, you may wish to focus on these types of issues:
REVIEWING AND CLASSIFYING DATA
At this point, you can move to a complete review of your informal data. It is useful to classify the data to help focus on the issues. Classification by source or constituency, by aspects of library operation, and by trends and impressions will help shape your survey questions.
User surveys can utilize several methods of data collection. There are essentially two ways to go: verbal or written surveys.
Verbal surveys can be done over the phone and often make use of trained interviewers. These are particularly well suited for in-depth input and can provide data quickly. If you are looking for feedback on specific programs, publications, or events, the quick phone survey will work.
Written surveys can also take many forms. Written surveys range from the mini-survey or "one pagers" consisting of a few easily answered questions, up to comprehensive, multiple-issue surveys. Your approach should be based on what are you trying to accomplish. What information would you like to obtain? Reviewing your informal data will point you in the right direction. Remember that staying in touch with your users is an ongoing process. You can start with a simple, single-issue survey and move on to more comprehensive surveys over time.
MECHANICS AND LOGISTICS
The first design
step is to determine the mechanics and logistics of the survey. You want
to answer questions such as these:
On the other hand, I have also seen a 15-page survey designed by an outside consulting organization that covered virtually all library issues and services. The issues of length and time to complete are important ones. Generally, needing more than 30 minutes to complete the survey is a negative, regardless of nuances in your environment.
QUESTIONNAIRE DESIGN ELEMENTS
Designing the questionnaire is the next step. Keeping your target audience in mind, how can you encourage users to complete and return? (Hint: Food works.) How can you insure that the questions are answered properly? A carefully stated cover sheet can help here. The cover sheet should explain what is expected, provide an overview of content, and describe the style of the questions.
To get at both simple and more complex issues, use open- and close-ended questions. Open-ended questions are essay types that allow the user to express more in-depth input as well as allow for opinions and views.
However, open-ended questions require more time and effort to formulate. They certainly take more time to answer and can overburden your audience. Open-ended questions are also more difficult to quantify or tabulate. It is recommended that no more than 10 percent of total survey questions be open-ended. Put open-ended questions towards the end of your survey instrument.
Close-ended questions are "multiple choice." They are easy to answer and to tabulate. However, close-ended questions limit input and do not allow for probing into causes of problems or potential solutions.
Finally, the form should be pleasing to the eye and uncluttered. It is always a good idea to test your survey form with a small group and evaluate their comments and results. Make revisions based on their feedback.
While your process will shape and identify the specific questions you will ask, there are typical components of user surveys. There is often a demographic component that adds value by defining context. These questions typically include:
As is often mentioned in today's budget-conscious era, measuring value is the key issue in evaluating libraryservices. While it is difficult to quantify the impact of library services, it is becoming increasing important to do so. Some of the best measures that have been seen to date include attempt to determine if library use or access to information helped to:
Assuming that your survey has been a success, it is now time for tabulating your data. It is recommended that you use focused time and a quiet place to tabulate. This is "head-down" work and you certainly don't want to lose those valuable survey forms! Once tabulated, checkmark each completed survey clearly. Always, review calculations with a colleague to make sure you have not made any mathematical errors.
When reporting and distributing your data, which is recommended, provide both raw data and percentages such as response rates overall and by question. Composing charts and graphs will also add to the impact and readability of the results. You can report open-ended questions with excerpts and number of similar comments.
Work your results into your strategic plans. You can utilize the data as a management tool in terms of defining approaches to meet defined needs. Use the data for marketing and public relations purposes, including briefings to senior management or local governing bodies. Consider releasing the results of your survey to local media, especially for public libraries. Write about your experience for the professional literature. Let others in the profession learn from what you've done.
George Plosker [firstname.lastname@example.org] is vice president, Content Support and Training, for Thomson-Gale.
Comments? E-mail letters to the editor to email@example.com.