(IFLA Publications - 120 - 121) Trine Kolderup Flaten (Editor) - Management, Marketing and Promotion of Library Services Based On Statistics, Analyses and Evaluation-K. G. Saur (2006)
(IFLA Publications - 120 - 121) Trine Kolderup Flaten (Editor) - Management, Marketing and Promotion of Library Services Based On Statistics, Analyses and Evaluation-K. G. Saur (2006)
IFLA (The International Federation of Library Associations and Institutions) is the lead-
ing international body representing the interests of library and information services and
their users. It is the global voice of the library and information profession.
IFLA provides information specialists throughout the world with a forum for exchanging
ideas and promoting international cooperation, research, and development in all fields
of library activity and information service. IFLA is one of the means through which
libraries, information centres, and information professionals worldwide can formulate
their goals, exert their influence as a group, protect their interests, and find solutions to
global problems.
IFLA’s aims, objectives, and professional programme can only be fulfilled with the co-
operation and active involvement of its members and affiliates. Currently, over 1,700
associations, institutions and individuals, from widely divergent cultural backgrounds,
are working together to further the goals of the Federation and to promote librarianship
on a global level. Through its formal membership, IFLA directly or indirectly represents
some 500,000 library and information professionals worldwide.
IFLA pursues its aims through a variety of channels, including the publication of a major
journal, as well as guidelines, reports and monographs on a wide range of topics. IFLA
organizes workshops and seminars around the world to enhance professional practice
and increase awareness of the growing importance of libraries in the digital age. All this
is done in collaboration with a number of other non-governmental organizations, funding
bodies and international agencies such as UNESCO and WIPO. IFLANET, the Federa-
tion’s website, is a prime source of information about IFLA, its policies and activities:
www.ifla.org
Library and information professionals gather annually at the IFLA World Library and
Information Congress, held in August each year in cities around the world.
Edited by
Trine Kolderup Flaten
ISBN 3-598-21848-6
U
Printed on permanent paper
The paper used in this publication meets the minimum requirements of
American National Standard – Permanence of Paper
for Publications and Documents in Libraries and Archives
ANSI/NISO Z39.48-1992 (R1997)
Quality Standards
Louise Guillemette-Labory and Pierre Meunier, Canada ................................ 80
5
Coordination of higher educational institutions and professional library
associations – the key to training quality rise of librarians of XXI century
Natalia Gendina, Russia .............................................................................................. 169
6
Statistical indicators on reading and literacy for the
“Information Society” versus the ITU’s “technisist” indices
Ksibi Ahmed, Tunesia .................................................................................................. 342
7
Preface
In connection with the World Library and Information Congress in Oslo,
Norway, from 14th – 18th of August 2005, IFLA’s Management & Marketing
Section arranged a Satellite Meeting in Bergen city, Norway, from Tuesday 9th
to Thursday 11th of August. A call for papers was published in September 2004:
C A L L F O R PA P E R S
IFLA Management & Marketing Section
Co-sponsors:
Public Libraries Section and Library Theory and Research Section
Theme:
“Management, marketing, evaluation and promotion of library services,
based on statistics, analyses and evaluation in your own library”.
Language:
The main conference language will be English. If the necessary financial
support is gained, we hope to be able to offer translation facilities for
French, and Spanish presentations.
Theme:
The conference aims to:
9
Subjects for papers may include case studies, research, projects, best-
practice development, and proposed models related to statistics and evalu-
ation practices, including discussion of research methods and data collec-
tion and analysis.
The proposals should include the name, contact information and institu-
tional affiliation of the author; and a summary of the content to be pre-
sented.
All proposals will be evaluated by a committee with representatives
appointed by the three sections:
Management & Marketing Section: Daisy McAdam, Angels Massísimo,
Christie Koontz
Coordinator: Trine Kolderup Flaten,
Library Theory and Research Section: Ragnar Audunson, Beverly Lynch
Public Library Section: Torny Kjekstad, Gunilla Konradsson
The evaluating committee received more than 50 papers by 63 authors for evaluation.
40 papers were accepted, and at the end 31 presentations were given at the conference
in Bergen, by 38 authors from 4 continents and 14 different countries.
The need for simultaneous translation could not be solved due to the high costs for
such services. Instead adequate handouts, some of them in two languages, of all the
presentations were made and distributed to the participants.
10
Local co-sponsors for the arrangements in Bergen were:
University Library of Bergen, Bergen University College and Hordaland County
Library.
After the pre-conference a special tour was arranged in order to bring participants
and accompanying persons from Bergen via fiords and mountains to the IFLA
congress in Oslo.
It must be said that a successful “Call for papers” creates a tremendous amount of
work. But the Call for papers has proved to be an excellent way to gather very
interesting speakers for the pre-conference.
11
Program
World Library and Information Congress, 71st IFLA General Conference and
Council, from 14th – 18th of August 2005 in Oslo, Norway
IFLA Management & Marketing Section
Satellite meeting 2005
Programme
T U E S D AY 9 / 8 T E R M I N U S H A L L , AT G R A N D H O T E L T E R M I N U S :
14.00 O P E N I N G : Monica Mæland, Chief Commisioner, City of Bergen
14.10 – 15.20 P L E N A RY S E S S I O N
Moderator: Trine Kolderup Flaten/ Daisy McAdam
15.35 – 17.15 P L E N A RY S E S S I O N
Moderator: Ragnar Audunson
EVENING PROGRAMME:
19.00 Departure by bus from outside Grand Hotel Terminus, for the
Edvard Grieg Museum, Troldhaugen
12
19.30 Guided tour with a small Consert.
Reception by the Mayor of Bergen. Buffet
21.45 Departure by bus from Edvard Grieg Museum, Troldhaugen
W E D N E S D AY 1 0 / 8 B E R G E N U N I V E R S I T Y C O L L E G E
Quality standards
Louise Guillemette-Labory and Pierre Meunier, Montreal, Canada
SESSION 1
THEME: NATIONAL/LOCAL STATISTICS AND ANALYSIS – TOOLS/METHODES
Moderator: Christie Koontz
SESSION 2
THEME: STAFF/ORGANIZATION DEVELOPMENT
Moderator: Daisy McAdam
13
Coordination of higher educational institutions and professional library
associations – the key to training quality rise of librarians of XXI century
Natalia Gendina, Russia
T H E M E : P O L I C Y - S T R AT E G I C DECISIONS
SESSION 3
THEME: NEW ORIENTATION AND MARKETING BASED ON ANALYSES OF
PERFORMANCE, USERS’ BEHAVIOUR/SATISFACTION
Moderator: Ragnar Audunson
14
SESSION 4
THEME: DEVELOPE SUITABLE INDICATORS FOR LIBRARY AND INFORMATION
WORK . S URVEYS OR OBSERVATIONS . S TANDARDS
Moderator: Angels Massisimo
Evening programme:
19.00 – 21.00 Reception at the University Library, Bergen
T H U R S D AY 1 1 / 8 T E R M I N U S H A L L , AT G R A N D H O T E L T E R M I N U S :
Break
15
10.30 – 11.45 Plenary session
Moderator: John Lake
Break
16
Taking A Measured Approach to Library
Management: Performance Evidence
Applications and Culture
J. Eric Davies
J. Eric Davies,
Director: LISU, Research School of Informatics,
Loughborough University, Loughborough. Leics.
England. LE11 3TU
Co-author: Claire Creaser, Deputy Director
and Senior Statistician, LISU
Introduction
This paper outlines the general context of managing through performance evi-
dence and draws on experience acquired by LISU, firstly to discuss how a culture
of managing with performance evidence may be developed in an organisation
and, secondly to describe, with examples, the scope for applying performance
evidence to service development.
Context
Information and library services facilitate access to information, they provide
space and opportunities for the community to engage individually or collective-
ly with information and they offer stimulus through a range of formal activities.
Information and library services serve as many faceted agencies because their
user community draws upon them for learning, leisure, work and living. These
represent a formidable array of functions and demands. Importantly, informati-
on and library services involve a considerable investment by the sponsoring orga-
nisation or community in capital and revenue and it is vital that these resources
are husbanded carefully and applied to greatest advantage. The varied resources
available have to be used as economically, efficiently and effectively as possible.
Rarely, if ever, do such services operate in a climate of plenty.
17
The Challenge of Management
Managers of library and information services are confronted by an ever increasing
range of demands to provide appropriate services of acceptable quality at optimal
cost to meet the strategic objectives set by the community, whether it be a public
authority, an academic institution or a corporate body. The modern manager’s role
is complex and intensive; at the same time delivering what is needed today, reflec-
ting on yesterday’s achievements (and setbacks) and anticipating tomorrow’s
needs. The range of managerial activity is formidable and includes: assembling,
organising and deploying resources, prioritising demands, delegating and sharing
activity, motivating and mentoring colleagues, assessing current and future needs,
planning and initiating new development, undertaking advocacy for funding,
and communicating with a variety of people within and outside the organisation.
18
as separate items, in practice they are highly interrelated and need to be viewed, and,
more importantly, used as a coherent set of facts and figures that underpin manage-
ment decision making.
LISU’s work on many projects has demonstrated the value of qualitative as well
as quantitative evidence. Numbers [especially reliable numbers] remain important,
however, qualitative evidence in the form of case studies, anecdotal accounts, user
feedback and structured notes on user perceptions offers a very useful basis for
evaluating services and can be persuasive in terms of advocacy. The softer social
indicators that are growing in importance and relevance also contribute to an
understanding of the way services contribute.
Inputs describe the resources that are applied to providing a service and will
contain financial and other data. Inputs include; how much money is spent on the
service as a whole and on different parts of it, the numbers and grades of staff
employed, the accommodation that is available, opening hours of service points,
a description of the collections made available (including electronic sources that
may be virtual) and the equipment, including workstations, deployed. Though
many are quantitative measures, some qualitative dimensions are also relevant,
for example collections can be described in terms of their quality by applying very
sophisticated evaluation criteria such as CONSPECTUS1 in academic research libraries.
Outputs describe what the user gets directly out of the service. They cover
quantities, qualities and values of what the service delivers. Quantitative outputs
include; visits made to a service, items loaned, requested and reserved items ful-
filled, documents or photocopies supplied, items consulted within a library,
enquiries received and answered, search sessions performed and end user training
events arranged. Qualitative indicators of output may relate, for example, to the
relevance of documents supplied, or the reliability and accuracy of information
provided and in many cases they are more difficult to establish. Some quantitative
output indicators can be refined to yield information on the quality of the service.
For example, the number of enquiries answered inside a specified target time, or the
percentage of reservations fulfilled within a specified waiting time can be calculated.
Outcomes describe the contribution that a service makes to the activities of
the user whether they are related to work, learning or leisure. They represent the
interaction between user and service. Service penetration, that is, the level of
active members of a service offers an indication of outcome as does the amount
of repeat use of a service. Another quantitative outcome is the needs/fill rate
which measures how often the user gets what he, or she wanted. More detailed
exploration can reveal whether a user found information supplied useful and
usable, and add to the qualitative assessment of outcome. Discovering user sat-
isfaction with particular aspects of the service can also indicate outcomes.
19
Impacts describe the broader influence that the service has on a community or
organisation. Impact may be interpreted as; what difference, in the long run, has the
service made? Put more directly the question can be redefined in the following
ways - in a community public service, how does it add to social and cultural life as
well as economic prosperity; in an educational environment, how does it support
learning and research; in a commercial organisation, how does it contribute to
profitability and growth? Recently published public library impact standards
developed in the UK relate to key areas of social development in the community. In
this construct, they have a dimension that makes them inseparable from the
overarching political agenda and, as such, are a reminder that the priorities and
preoccupations may alter with the political climate.2 3
Service domain data relate to the context in which a service is operating. Such
information describes the size and characteristics of the population to be served
and therefore comprises actual, as well as potential, users. In addition to geo-
graphic data on a population and its distribution, more detailed information on
special groups of users, and potential users, can be gathered. Such knowledge is
important for designing services that properly match user needs. Community
profiling, undertaken in partnership with the constituent members of a community,
takes analysis of the service domain even further and, enables a clear picture of the
nature, needs and resources of a community to be established.4
The interpretation of what is meant by the service domain may be extended
further to include data relating to the information environment in which a service
is operating. Therefore data on types of information need, as well as on the magni-
tude and pattern of information generation and distribution can be taken into
account in assembling a complete description. Evidence on this aspect leads to a
better understanding of how information need can be met, as well as to whom.
An example of such evidence gathering is featured in a study of the scholarly
communication environment which was undertaken by LISU under a commission
from the Joint Information Systems Committee (JISC). The full report was published
in 2002 and a summary of selected results published later.5 6
It is a fact that cannot be repeated too often, nor emphasised too strongly, that
users are at the centre of services. Their attitudes, perceptions and, most of all,
actions determine in a real sense the ultimate success of services. Whether and how
people use services stands as the ultimate arbiter of success in the eyes of all stake-
holders -managers, paymasters and the community. What they think of the range
and quality of services on offer is equally significant. Gathering information from
users regarding the nature and quality of current services as well as their opinions
about planned future development is therefore an important part of assembling
appropriate management evidence. A refined technique for establishing a wide
20
array of user responses to academic library services entitled LibQual 7 has been
developed by the Association of Research Libraries in the USA, and it is now
widely used in the UK. Public Libraries in the UK regularly employ the formal
Public Library User Survey (PLUS ) to ascertain levels of satisfaction which feed
into government performance standards. There is also an equivalent Children’s
PLUS exercise.8
It is worth noting that input from lapsed users and non-users cannot be omitted
from consideration either. Ascertaining latent need and demand from these groups
can inform innovative service development that extends the user base and takes the
service to new levels of provision.
There is a growing interest in mapping the way in which various public services
and projects bring about social change in the community, whether it be in reducing
the effects of poverty or in increasing health and wellbeing, for example. Soft’ or
‘social’ indicators are used to assess the broad effects of a project, or service on
individuals and the wider community. They seek to describe how lives are
changed in terms of the ‘distance travelled’ in personal development and in com-
munity cohesion and empowerment. There is scope to explore these issues in
relation to the social and cultural influence of public library services, and in
some cases academic libraries, through the broad area of social informatics. In
the long term these approaches offer a coherent [and bottom up] approach to
impact assessment which is well worth exploring.9
A recent study of lifelong learning progression undertaken by LISU on behalf of
the North East Museums, Libraries and Archives Council (NEMLAC) revealed a
range of socially important benefits accruing from projects being undertaken within
libraries, archives and museums.10 What was also apparent was that not all the
institutions involved were assembling sufficient performance data, nor exploiting
them fully.
21
much evidence has still to be acquired and reported with human intervention. If
there is an appreciation of the importance of that information, then it is more
likely to be handled more carefully, and those involved will be more assiduous
regarding data accuracy and reliability. In short, an organisation with a culture
of using evidence from top to bottom reaps many benefits; and those benefits
ultimately accrue to the users.
22
We were particularly keen to explore more cost-effective evidence gathering
methods and to find ways of simplifying the range of data needed. The latter aim
is less easily accomplished than might be imagined because data that may be
redundant locally maybe demanded by external agencies.
It was recognised that if the EBM way of working was to be embraced rap-
idly throughout the Service in a systematic and consistent way there was a need
to consult, to inform, to train and to enthuse at all levels. A series of Workshops
were delivered over the lifetime of the Project to disseminate knowledge and
inculcate skills. The early Workshops covered the foundations of data gathering,
analysis and use with the main input from LISU specialists. Later Workshops fea-
tured increasingly case studies of local EBM applications in the Service. One
measure of the success of the Project, over time, is the extent to which the initia-
tive in Workshops gradually shifted from LISU to the staff in the Service as they
became more adept at identifying and acting upon the potential of EBM. Outlines
of two early workshops are appended.
As the Project evolved, work was undertaken on developing a formalised
approach to evidence gathering and dissemination that would inform policy and
practice in the Service and support those applying EBM. The initial conception of
creating a Performance Manual gave way to the development of a Performance
Resource which was launched as an electronic resource linking practical guidance
with data sources on the organisation’s Intranet to form a ‘one stop’ resource
that is accessible to all members of the service. The landscape of EBM is ever
changing so this will evolve as tool and work will continue for some time. The
ready availability of the Performance Resource as a working tool reinforces the
development of an EBM culture.
Another important component of the Project, and one which LISU is frequently
asked to undertake, featured an assessment of service performance with reference to
recognised standards, specified organisational objectives or comparator services.
During each year of the Project LISU statisticians have performed such an evalu-
ation or ‘health check’ using the Service’s performance metrics. These have proved
informative in tracking the progress of the service and in supporting the EBM
initiative. The emphasis has changed over time from simply comparing performance
against standards to assessing the contribution that the Service makes to defined
community goals.
The figure on the next page shows just one example of how the analysis is present-
ed. In this instance it charts the service level improvement over time in meeting book
requests and it demonstrates how performance now exceeds the national standard.
The Evidence Based Management in Action project drew to a close a few
months ago. The undoubted success of the Project is apparent in the way that,
23
Percentage of requests met in 7,15 & 30 days.
over time, and as envisaged, the initiative for development and innovation had
transferred from LISU to Lancashire where the evidence based culture is now
well embedded.
24
agencies through the theme of books and reading and, in turn, new audiences
and venues for reading inspired creativity would emerge. In the event the Project
proved quite successful; so much so, that a second series of events was undertaken.
The Books Connect Project comprised 13 individual events or initiatives that
took place in nine public authorities in the East Midlands. These individual events
were very varied; involving different art forms, venues and partnerships, and fea-
turing workshops, displays and performances.
LISU’s contribution to the evaluation presented interesting challenges and
opportunities. The diverse character of the activities featured had to be taken into
account and in addition to measuring the basic inputs and outputs of the initiatives,
the impact of cultural participation and creative activity needed to be explored.
The evaluation also had to focus on the experiences of the different groups
involved including; the audiences for events, participating artists and performers, as
well as the staff of libraries and other cultural agencies organising the initiatives.
One of the most important aspects of the work was that the evaluation could be
designed into the project at an early stage.
For the Project, LISU developed a purpose built evaluation toolkit that was
suitable for the entire series of activities being arranged. A toolkit approach
ensured that both quantitative and qualitative data were recorded consistently
across the region. It comprised a set of audience questionnaires and interview
schedules, as well as templates to gather reviews from initiative co-ordinators
and accounts of artists and partners’ experience of events. It included guidance
as to how the collection of project evaluation material should be undertaken.
The toolkit and full evaluation report12 are published.
It was important that the toolkit was flexible and adaptable in order to suit
the individual nature of each of the events. Not all of the toolkit had to be used in
each case. On the other hand, sufficient data needed to be gathered to render
comparisons possible. At the same time the toolkit avoided being over-prescriptive
and it allowed room for the individual organisers to use their initiative in the
evaluation, particularly in terms of soft indicators. In practice, some additional
means were used to collect qualitative feedback and to gain an insight into how
the Project enriched the lives of those involved. These included sketchbooks,
photographs and audience evaluation forms tailored to specific events. Another
important aspect related to the cost, in terms of staff time and material, of using
the toolkit. The ease with which it could be employed was also a factor - it was not
intended to be applied by professional evaluators.
The toolkit was designed in consultation with a Project Steering Group as well
as those directly involved in organising the events. It was essential that evaluation
was built into the planning stages of the Project, as this ensured that all the
25
required information was collected from the outset. A one-day workshop was
held at the start of the Project to begin the process by raising awareness of the
importance of evaluation, and to gather ideas and views about how this could be
most usefully achieved. This featured a presentations from LISU staff on the
basics of quantitative and qualitative evaluation and was followed by a brain-
storming session, in which participants completed various exercises involving
evidence gathering and use. The Workshop not only enable the approach to eval-
uation to be refined, but also encouraged those involved to ‘buy into’ the idea of
project evaluation.
All of the participating local authorities used the toolkit to collect evaluation
material. In the event, an encouraging amount of positive feedback and data was
received. This was supplemented with contextual information supplied by the
Project Manager.
The success of the evaluation exercise owed a great deal to the cordial work-
ing relationship established between LISU as contractor and those responsible
for managing the Books Connect Project as clients. We wish particularly to
thank Debbie Hicks of the Reading Agency for her cooperation.
Evidence in Benchmarking
Benchmarking using appropriate performance evidence enables useful compar-
isons to be made within and between services. Comparative benchmarking,
depending on the context, enables the manager to:-
• evaluate the performance of various services, or service points within
an organisation
• evaluate the overall level of organisational performance
• compare service performance over time
• compare with other similar institutions
• compare against recognised standards.
26
also be made against the national mean values. The results can often reveal
aspects of the service that are comparatively strong and which exhibit excellence.
At the same time they can reveal areas in need of investment and development.
They equip the manager with evidence to undertake strategic planning and
strengthen the arguments for resources. The data rarely offer ready made solu-
tions, but they do point to areas for scrutiny and suggest questions that should
be asked. The manager retains the initiative.
Operational benchmarking entails sharing and comparing detailed cost and
performance information on quite specific operations and processes within a
group of institutions. The outcomes can be used to identify relative best practice
and from the knowledge gained local operations can be reviewed and processes
re-designed. Since much of the data needed may be sensitive, this level of bench-
marking relies heavily on the cooperation and trust of those participating, and a
degree of confidentiality within the group, if the necessary level of transparency in
describing activities and costs is to be achieved. The potential benefits of partici-
pating in such activity are, however, considerable in terms of improved services and
methods, as well as increased awareness of practices. LISU has, for some time,
maintained a fruitful association with a benchmarking consortium of academic
libraries in England and recently published on their behalf, a comprehensive
report on their activities.13 Aspects covered include: off-campus services, shelving
processes; advice desk activities and short loan collection operations.
Conclusion
This paper has sought to demonstrate the importance of performance evidence to
successful service design and delivery. It has also emphasised that using performance
evidence should permeate the culture of a service and has shown how this may be
achieved. There is growing use of such information, and in some parts of the public
sector a requirement to report it which clearly acts as a stimulus. However, there
is scope for development both in the nature of evidence gathered, and in the way it
is used. There remains much work to be done in refining methods and techniques
and managers need to become even more active in anticipating the need for, and
using appropriate performance evidence. Taking a measured approach to library
management yields substantial benefits that must be grasped.
Notes
1 Olson, Georgine N. and Barbara McFadden Allen (eds.)
Cooperative collection management: the conspectus approach.
New York, London, Neal-Schuman, 1994.
27
2 Great Britain. Department for Culture, Media and Sport.
Libraries and communities: Impact standards. 2005.
http://www.culture.gov.uk/libraries_and_communities/impct_ms.htm
3 Great Britain. Museums, Libraries and Archives Council.
Improving performance. 2005.
http://www.mla.gov.uk/action/framework/framework_04a.asp
4 Great Britain. Museums, Libraries and Archives Council.
Improving performance. 2005.
http://www.mla.gov.uk/action/framework/framework_04a.asp
5 LISU. Trends in scholarly communication: Output, access and use issues.
Loughborough, LISU, 2002
Available as a pdf at|: http://www.jisc.ac.uk/uploaded_documents/lisu.pdf
6 Davies, J. E. and H. R. Greenwood. Scholarly communication trends –
voices from the vortex: A summary of specialist opinion.
Learned Publishing 17, 2004. pp. 157 –167.
7 Association of Research Libraries. LibQual Homepage. 2005
http://www.libqual.org/
8 Institute for Public Finance. CIPFA PLUS Homepage. 2005.
http://www.ipf.co.uk/plus/
9 Dawson, S., J. Eccles, N.D. Tackey and A. Jackson. Measuring soft outcomes
and distance travelled: A review of current practice.
London, Department for Education and Employment, 2000.
10 Lockyer, S. and J. Eric Davies. Ladder to learning and employment.
Newcastle upon Tyne, NEMLAC, 2005.
11 Greenwood, H. and J. Eric Davies. Designing tools to fill the void: A case study
in developing evaluation for reading promotion projects. Performance
Measurement and Metrics 5 (3) 2004. pp. 106 – 111.
[Also published in: Library measures to fill the void: Assessing the outcomes -
Proceedings of the 5th Northumbria International Conference on Performance
Measurement in Libraries and Information Services: Durham 2003.)
Bradford, Emerald, 2004. pp.187 - 192.
12 Greenwood, H. and J. Eric Davies. Books Connect project evaluation.
Loughborough, LISU, 2002.
Available as a pdf at: http://www.artsandlibraries.org.uk/bc/report.pdf
13 Creaser, C. (ed.) As others see us: Benchmarking in practice.
Loughborough, LISU, 2003.
Available as a pdf at:
http://www.lboro.ac.uk/departments/dils/lisu/downloads/OP33.pdf
28
Appendix A
Discussion
Evaluation of data
What analyses do you do?
How do these analyses relate to service delivery?
Are there any analyses you would like to have?
Are there any statistics you collect at present which you feel are not necessary?
Next Steps
Evaluation of this project.
Looking forward to the workshops
4pm Finish
29
Appendix B
The workshop will comprise a linked series of short presentations and ‘workshop style’
exercises.
30
Summary
Performance evidence plays an important role in the management of modern
information and library services. Managers seek to achieve an array of objectives
and undertake a whole range of activities. How well they manage is influenced
by access to appropriate and reliable supporting evidence and their capacity to
utilise it intelligently. This paper outlines the general context of managing through
performance evidence and draws on experience acquired by LISU, firstly to dis-
cuss how a culture of managing with performance evidence may be developed in
an organisation and, secondly to describe, with examples from different organi-
sations, the scope for applying performance evidence to service development.
Information and library services facilitate access to information, they provide
space for the community to engage individually or collectively with information and
they offer stimulus through a range of formal activities. Information and library
services serve as many faceted agencies because their user community draws upon
them for learning, leisure, work and living. These represent a formidable array
of functions and demands. Performance evidence, built on a solid foundation of
service goals, has an important contribution to make to their management. The
portfolio of performance data is vast and varied and ranges from hard quantitative
data to the softer social indicators that are growing in importance and relevance.
The successful application of performance metrics to managing services relies on
an awareness of their potential coupled with the skills to apply them. LISU has
worked with one library and information service on an extensive programme to
develop an evidence based management culture at all levels in the organisation. The
project has entailed an analysis of strategies and operations, an examination of evi-
dence gathering and use, and it has featured training workshops and service
assessment health checks performed by LISU. The outcomes are encouraging in
terms of the utilisation of performance evidence and service quality as the examples
in the paper illustrate.
Performance Health Checks offer a tangible way of assessing the position of a
service in relation to internal targets as well as national standards. Extracts from
LISU’s work in this area are presented to illustrate specific service improvement
and development over a time frame.
Performance metrics also enable the overall performance of specific projects
and initiatives to be assessed. LISU was engaged in the development of a toolkit
to support the evaluation of a series of reader promotion activities in the UK.
The evaluation covered a whole range of factors including inputs and outputs as
well as impact assessment through data regarding user reactions. Examples indica-
te how the evidence identified the success of the activities and facilitated advocacy
to support for further work.
31
Benchmarking using appropriate performance evidence enables useful com-
parisons to be made with similar organisations. The challenge is to identify suitable
comparators which are similar in size, character and culture. Strategic bench-
marking explores a series of key service parameters are to assess overall perfor-
mance. Process benchmarking compares and reviews the detailed aspects of specific
activities and methods in organisations and it implies a level of collaborative
exchange of data. Both approaches offer considerable scope for identifying areas
for development and improvement as well as evidence for advocacy, as examples
illustrate.
The paper concludes with an observation that managers need to become even
more active in anticipating the need for, and using appropriate performance evidence.
32
Statistics and Strategy:
Statistics and Performance Measurement
as a Social Process
Ulla Wimmer
Library Network of Expertise
at the German Library Association,
Berlin, Germany
The aim of this paper is to point out some thoughts on the strategic use we can
make of Statistics and Performance Measurement. The key issue is the assump-
tion that statistics and performance measurement should make a contribution to
strengthen the position of libraries - or a single library - within their funding
bodies and the social field they are set in. If we can agree that this is an aim of
working with numbers, the question arises: what is necessary in order to realize
the full strategic potential of statistics and performance measurement – and not get
trapped in the pitfalls? In my opinion, it is much easier to use the strategic potential
of statistics and performance measurement if you look at them as a social process.
This is what I am trying to do in this paper.
A side effect of this way of looking at statistics and performance measure-
ment is, that it can give a positive twist to some of the arguments that are often
held against statistics and performance measurement. This refers especially to the
common thoughts that “numbers never tell the whole story” and that “numbers can
be turned this way and that”.
In order to make my points, I would like to talk about 4 theses and their con-
sequences:
33
Some of the thoughts may seem obvious from the point of view of information
science and mathematics. But from the point of view of the practice of doing
library statistics (at least in Germany) they are not obvious at all.
I would like to start with a small but fundamental misunderstanding, that I find
very often when talking to people about statistics. The common view is: statistics
and performance measurement generate new information about the library. They
tell us things we didn’t know before.
This is true. But if you look at statistics from the point of view of systems
theory, you find that statistics and performance measurement actually reduce
information about the library in a very efficient way. Reducing complexity -
making things simple - is necessary in order to be able to act and make decisions
about the library.
This may seem strange at first, because we do gather information and data
that we did’t have before. But if you look at a simple statistical number like the
number of staff, it turns out that, in order to get this number, you have to aggregate
a long range of variables into one single number:
professional staff
non-professional staff
posts planned
posts occupied
percentage of sick leave /absentism
volunteers
apprentices/trainees
cooperations
So the number of staff is in reality a crude simplification of the real situation within
in the library.
Other simplifications occur all the time when doing statistics, e.g. when you
draw a line where there is actually a gradual transition (this applies e.g. when you
categorize libraries according to size or other categories). Simplification occurs
even when you just set a deadline: this means you tell “the truth” about a certain
point in time, and this excludes developments or corrections after a certain date.
You have to do this, though, in order to create fixed information that people can
refer to (e.g. in citations or in planning papers). If you apply statistics, you systema-
tically exclude innumerable details from the picture.
34
The consequences are: statistics and performance measurement make things
simpler. This is usually painful for some parties involved in the statistical process,
because a feature they find important is not included in the picture. And it is
bound to do some party or some library wrong, because their special situation is
likewise not reflected in the statistics. (E.g.: a library would be better off if it fell
into the next higher category of size.)
This is one of the arguments held most often against statistics and performance
measurement. I would estimate that 80 % of all fights over statistics are about some-
thing that is left out of the measurement. But still, this simplification is NOT a short-
coming, but a strength! It is the reason why we measure in the first place.
If you don’t realize this, it is possible that you get stuck on the search for the
perfect statistics tool. This pitfall works like this: if we only try a little harder, if we
improve this definition, if we make that rule more precise, if we include this indi-
cator – we will get the full picture that shows everything and does nobody wrong.
You have to realize, however, that this is, by definition, impossible. The aim of
statistics is to reduce the amount of information.
If you don’t realize this in time, the search will go on for ever. This is not only
useless but dangerous, because the time spent on the quest for “the perfect” sta-
tistics and performance measurement-tool is time lost for interpretation and
communication of results to the funding bodies.
This, in turn, is important, because the inevitable loss of information created by
statistics and performance measurement must be compensated by interpretation
and negotiation with the people who read the statistics in the end. It therefore is
necessary to see the point from which you have to stop working on tools and start
working on the results – even if some aspects of the real situation are not suffi-
ciently reflected in the measurement.
This, of course, does not mean that you might as well be negligent or careless
when creating numbers. It is necessary to be as precise and exact as possible when
creating a questionnaire or gathering data. But the gathering of data is not an aim
in itself. It is the first step in the process and you must make sure to have enough
time left for the other steps.
2. Statistics and performance measurement are about Agreement, they create Truth
My second thesis is, that statistics and performance measurement do not work
like a machine that is set once and for all and can’t be influenced. A common
idea is that you use a certain statistics or performance measurement tool, and in
the end you find the scientific truth about a library. This is only half of the pic-
ture. What is actually fixed by the current state of science (and even that changes
over time), is the framework for statistics and measurement:
35
How to do cost analysis is defined by business administration
How to properly create survey data is defined by empirical social science
How to deal with that data is defined by mathematics
How to measure library specifics is defined by library science
But within this framework, when you create a statistic or a measurement tool, you
still have innumerable choices and options on how to count and what to calculate.
And they are, to a certain extent, arbitrary. You can settle them this way or that
way. These options are negotiated between all parties involved. (This is one of
the things that critics of statistics and performance measurement usually point out
as a prove of the “unreliability” of statistics. In my point of view, it is one of its
greatest strengths: statistics can be used and adopted to many different issues and
purposes. This is why they are so useful.).
Just one example: if you set out to calculate the cost of one loan in a library,
you have several options:
1. You use the total library budget and divide it by the number of loans, e.g.:
4 mil Euros : 200.000 loans = 20 Euros/loan
2. You use the acquisitions and media processing budget and divide it by
the number of loans, e.g.: 400.000 Euros : 200.000 loans = 2 Euros/loan
3. You use the cost of check-out and re-shelving and divide it by the number
of loans, e.g.: 40.000 Euros : 200.000 loans = 0,20 Euros/loan
The point is, that each of these calculations is correct. Each of them creates a dif-
ferent view on (a different “truth”) about the library. Which option you choose
depends on what the parties involved in the measurement want to achieve or to
find out. You have a choice which method to use, but you can’t choose on your
own. And, this goes without saying, once you have chosen the method, you have
to execute it with the utmost care and scientific precision.
So I strongly believe that statistics and performance measurement are about
objectivity and truth. They are the only way of finding out knowledge beyond
your own personal perception. But they don’t find the one and only truth, they
create a specific truth, and this truth is a common view on the library that all
parties involved have agreed upon. To agree on a common option is done within
a political process, a process of negotiation. The parties involved may be:
library management
funding institution
library staff
state agencies / general public
36
If the funding body of a library does not agree with option 3, then the measurement
of the library is useless, because it won’t be accepted by the recipient of the sta-
tistics. If the library staff do not agree with option 2, there is also the danger that
the measurement will be useless, e.g. because data is not being gathered properly.
So in this respect, statistics and performance measurement are as much a social
and communicative process as a mathematical or methodological process. The
view on statistics changes significantly if you regard the negotiation process that
creates it as a central issue, and not a side effect or even a disturbance variable
that should be ignored or excluded from statistics as far as possible.
And even more important: if you realize that there is a creative choice when
measuring, this offers various opportunities: when working with statistics, it is
necessary to know and use all sorts of methods, data and sources. Why not combine
cost analysis with the critical incident technique? Or compare library performance
indicators to data from banks, football stadiums or public transport? Use all possible
options for the development of tools.
This is an opportunity, but also a challenge. You have the choice of methods,
but which ever you choose, you must be able to execute properly and according to
the scientific standards. This requires a very broad and firm knowledge of a variety
of social science and business administration tools.
The most surprising consequence, however, is that people who work with statistics
should bring along a lot of creativity and inventiveness - apart from methodological
knowledge. Currently, these are not the main requirements when choosing or allo-
cating staff to statistic tasks, but they definitely should be.
Another practical consequence for those who work for libraries (not in a library)
might be to give advice not only on one method to use, but on the variety of methods
available. Also, they should make libraries sensitive towards the importance of
negotiation, communication and interpretation when working with statistics.
This is as important as giving instructions on how to count and how to calculate.
37
numbers seems obvious to us, but it is not, if someone from outside the library
looks at the same numbers. It is quite surprising, what strange meanings people can
give to numbers that seem to have quite an obvious meaning.
It is important to realize that, if this happens, it is (usually) not the fault of a
badly designed statistics tool. (This idea leads directly into the pitfall “search for
the perfect statistics tool”). No matter how well the tools are defined, the results of
statistics and performance measurement can be interpreted in different ways and
therefore need to be “enriched” with meaning (interpretation) by the library itself.
This, also, is not a shortcoming, but an advantage of statistics and performance
measurement, because it offers plenty of opportunities. To determine what a num-
ber means, is also a matter of negotiation and communication with the recipients
of the results. This is even more the case than when creating a tool. Here are two
easy examples:
1. A high stock turnover in a public library could mean
a) good stock, good acquisitions policy or
b) not enough stock per capita, people borrow everything they can get hold of
2. Very low staff expenditure could mean:
a) a lean, efficient library or
b) a low standard of service.
Even more options are available for the interpretation of a library ranking:
1. No. 23 out of 40 in a library ranking means:
a) Library has a solid, healthy middle position
b) Library is just average
2. No. 1 out of 40 in a library ranking means:
a) super library, good investment
b) library could do well enough with less resources
3. No. 38 out of 40 in a library ranking means:
a) library should be closed down
b) library needs significant investment (new building).
38
The second consequence is very obvious for every one: You have to put as
much time and effort into data analysis and interpretation as into definitions,
methods and data gathering. To realize this in practice, we could e.g. try to put
analysis and interpretation at the top of the agenda - not at the bottom. This might
not be that easy, because for many it seems illogical to work „backwards to for-
wards“. But remember that each social research project (not to talk about market
research) usually starts with a definition of what should be the outcome of the
project and what kind of answers should be available in the end (what kind of
answers – not the answers themselves!).
Another strategy would be to create, in a way, “mixed” working groups, that include
people with different roles:
a) one group who look at tools and methods in detail and
b) the other group who stick to a broad strategic view on negotiations
and interpretations.
I have tried to explain, that statistics and performance measurement are much
more a communicative issue than we traditionally think. It is important, however,
to be aware, that discussions on statistics and performance measurement can be
either helpful or rather destructive. Helpful and necessary is work that creates new
methods, comparisons and meanings. Also, the strategic negotiation of tools and
interpretations is useful. On the other side, endless discussions on “the perfect
measurement tool” can be a waste of time, as well as the repetitive re-discussion of
arbitrary rules and definitions, just because no-one remembers, why a definition was
agreed upon this way years ago. You can reduce this kind of work by personal
continuity in working groups or by a good documentation, that records not only the
options taken, but also the options not taken, and why they were rejected. The
aim here is to raise awareness of the danger that we focus on details and forget
the big picture. In reality, it is often difficult to decide, which is which.
4. Statistics and performance measurement are about Knowledge and about Politics
The last thesis is in some way a conclusion of the previous three. It says that sta-
tistics and performance measurement are as much a matter of creating knowledge
on the library as doing politics. By doing statistics or performance measurement,
we want to describe the library as good as possible, create a true image of the
library that goes beyond our personal perception. This numeric image should be
39
free from special interests as far as possible. At the same time, all parties involved
in doing statistics – library management, funding bodies, staff, library users –
want to use that data to prove their points, to realize certain aims and to make
decisions about the library. This is the reason for taking the trouble of measuring in
the first place. Alain Desrosieres, who wrote one of the most important recent books
on the history of statistics1, describes statistics as “a link between description and
management”. This means that statistics always have an epistemological aim –
“finding out the truth” – but also, at the same time, have always had the purpose
to deliver a basis for decision-making – and this is a political issue.
40
back through the back door. They are not disturbances or side-effects, but an
integral part of doing statistics.
The opposing attitude says: if we use statistics and performance measurement, the
results will speak for themselves. They will prove without doubt, that our library
is well used or in need of a new building or understaffed. The numbers will speak for
themselves and we won’t have to speak for ourselves, i.e. do advocacy or lobbying
for the library. This is the “use statistics as management tool” – point of view.
This might be dangerous, because it might tempt you to leave the scientific frame-
work that defines the rules for data gathering. It is also not useful because numbers
are an instrument in the management and advocacy process, but they can’t replace it.
Abstract
The strategic dimensions of performance measurement
Traditionally, discussions about performance measurement, data analysis and
statistics circle around the question which features of library work should be
counted, and how. Often, these discussions tend to be very excited and are keenly
and suspiciously watched by the library community. Also, if you follow the dis-
cussions over a longer period of time, you notice, that the discussions are never
finished; e.g. the questions of how to count library users, loans, stock, expenses
etc. tend to repeat themselves over and over again.
41
That experience in mind, the paper will try to explain, why it is, that perfor-
mance measurement is such a “hot issue”, and what is actually at stake when
librarians argue e.g. about whether or not janitors should be included when coun-
ting library staff. If you look at performance measurement from a more distant
angle, you can see the strategic functions of counting and measuring that are invi-
sible if you just stick to the numbers. This helps to explain, how discussions
about performance measurement work, and why performance measurement is
such an important playground for games of power between the library and its
funding bodies (and other stakeholders).
42
Comparing libraries: from official
statistics to effective strategies
Tord Høivik
Associate professor at the Faculty of Journalism,
Library and Information Science,
Oslo University College, Norway
43
1. In Europe, the European Commission is investing heavily in cross-national
projects. The LibEcon (Millennium) study published in 2001 (see Bibliography)
represents a great advance in standardizing and comparing library statistics
between countries.
2. In Great Britain, the Department of Information Science at Loughborough
University runs an outstanding research and information centre (LISU) that con-
centrates on library and information statistics. They publish a wide range of pub-
lications. The two volumes called Perspectives of public library use (1995, 1999)
are particularly valuable. These books gather information from widely scattered
sources and present it within a common framework.
3. In Norway, funding of higher education is increasingly based on results. Since
the results must be measured, we now have much stronger systems for collecting
data on students and on outputs from research. This means we can monitor the flow
of library students (1) and of library related publications (2) much more closely than
before.
44
We find more longitudinal data, where people or institutions are studied over long
time periods. In Norway, we can mention StudData - a massive study of students
in twenty different professions - including librarians. The project uses a cohort
approach (3). It will run for ten years and provide a vast amount of data on edu-
cational choices and career experiences.
45
somewhat divorced from real work. Our children were educated before they
started working - and adults enjoyed culture as a form of recreation outside
working hours. A skilled worker was skilled for the rest of his life.
In knowledge societies, production is based on constant learning and continuous
innovation. Technologies and markets change rapidly and need organizations - as
well as individuals - that are able to adapt, learn and develop. Culture and leisure are
becoming major economic sectors in their own right. Highly educated people try to
fill their lives with rich, intense, and meaningful experiences - both at work and in
their spare time. This is a challenge to public libraries.
Libraries are funded by the government, national or local. They depend, in
the long run, on the willing support of the electorate. Their role in industrial
society was well defined and widely accepted. Politicians and voters understood
the value of library services and were willing to pay for them. But their role in
knowledge societies looks less evident. The traditional arguments have lost much
of their force. Politicians often seem less committed: their hearts are not engaged.
If voters follow their lead, public libraries will loose their broad political support.
In several European countries, we believe, this is starting to happen.
46
Counting librarians
To the average user, librarians are people who work in libraries. A librarian is
somebody who takes care of books, who answers questions and who keeps the
library in order. They are essentially defined by the work they do. In libraries, users
care about competence and service, not about formal degrees.
To the sociologist or economist, librarian is an occupational category. In STYRK
- the Norwegian system for classifying occupations - we find fourteen different types
of librarians (4). Norwegian library statistics use another approach. A librarian is a
person who is legally qualified to direct a Norwegian public library. This definition
has a political background. In Norway, librarian is not a protected title. There is
no roster of registered librarians. But all heads of public libraries are supposed
to have a recognized library degree. Librarian is an educational category.
A recognized librarian was, till recently, defined as a person who had com-
pleted a first degree in librarianship at the School of Librarianship in Oslo - or
its equivalent. People with library training from other schools could apply for
recognition. But approval was not a formality. In Norway, an American with a mas-
ter degree in library and information science was not automatically qualified to run
a small municipal library. The person would also need the right mix of academic
subjects.
There is an additional complication. Norway has about four hundred munici-
palities. Many of these are quite small. Forty percent have less than three thousand
inhabitants. In most of the small communities, libraries are run on a part-time
basis. Even the part-time directors are supposed to have a professional qualification.
The outcome is not surprising: the law must bow to reality. Recognized librarians
stay away. They are not attracted by part-time positions in remote areas. When no
qualified person is available, exemptions are granted. The part-time libraries are
mostly headed by people with some formal training - and lots of practical experi-
ence - but without recognized degrees. They are librarians in an occupational,
but not in an educational sense.
47
The moment we want to compare Norway with other countries, difficulties mul-
tiply. The conclusion is clear: statistics should not be taken at face value. To
understand what the number of librarians means, we must know a bit about the
way libraries and library training are organized. In order to compare countries,
we must study the library systems behind the numbers as well as the numbers
themselves. Let us apply this rule to our main entity: the Library.
Counting libraries
In a superficial sense, Norway has more than four thousand library units - and
less than three thousand qualified librarians. But saying that Norway has four
thousand libraries – or one library per thousand inhabitants – would give a mis-
leading picture of the landscape. Most of these library collections belong to primary
schools with no qualified library staff.
Norway has three thousand primary schools - with a total stock of nine million
books. If you pick a Norwegian library, at random, for inspection, you would most
often end up with a single room, in a primary school, containing a few thousand
books. We also have four hundred secondary schools, with a joint stock of 2.5
million items. In secondary school, libraries are bigger and better staffed. But they are
still small. In terms of size, the average secondary school library corresponds to a tiny
municipal library – for a community with about twelve hundred people.
Before we count, we need to define meaningful categories. I suggest three groups:
public libraries, specialized libraries and school libraries. We have said something
about school libraries. But how many public libraries and how many specialized
libraries (academic + special) does Norway have?
Public libraries
Every local authority has its own public library headed by a library director. Since
Norway has 433 municipal units, we should have 433 independent library organi-
zations as well. There is a small catch: municipalities are allowed to set up joint
public library systems. So far only two local authorities - Tønsberg and Nøtterøy -
have taken this opportunity. We therefore have 432 public library units.
There is a bigger catch. We also have eighteen county libraries. In Norway, the
county libraries are not open to the general public. They function as regional resource
centers. They assist municipal libraries with inter-library lending, with deposit
collections, with training and with technical support. The county libraries are part
of the public library sector, but their statistics are published separately, in a different
format and with less detail.
Thus, we end up with 450 public library organizations. This is, statistically
speaking, our population of public libraries in the year 2004. The number was
48
larger in the past, when the country had more than seven hundred municipalities. It
will be smaller in the future. A few years from now the municipal map will probably
be redrawn, creating fewer, larger and stronger units. It is also likely that more
municipalities will choose the joint library option. At the county level, a regional
reform is looming. Most probably, Norway will be divided into seven (or five or
nine …) regions, each with their own regional library unit. How executive power
then will be divided between the municipalities, the new regions and the state in the
future, is quite uncertain, however. But at the moment Norway is characterized by
a large number of small libraries. In terms of population, the average local authority
has ten thousand inhabitants - and is served by a library with two librarians and two
supporting staff.
Specialized libraries
The moment we turn from public to specialized libraries, we are in for a surprise.
In 2004, Norway had four universities - but fifty-five university libraries! The
statistics also show that Norway has three national libraries (5). The answer is
simple: in our statistics, each physical branch is counted as a separate library unit.
Standardization is never easy. Before 2002, statistics on public and statistics on
specialized libraries used to be collected by two different institutions. They were not
always the best of friends - and chose different ways of presenting their data.
The population of specialized libraries is much more heterogeneous than the
population of public libraries. All municipal libraries have the same mission and
serve the same type of constituency. For many purposes they can be treated as a set
of actors with similar interests and concerns. To understand the political dynamics
of the specialized libraries it is better to divide them further, into three meaningful
subgroups: academic libraries, special libraries and the one and only National Library.
Today, Norway has about sixty academic libraries. In the past, they might lead
quiet lives inside their mother institutions. Today, everything is in flux. Their fate is
totally dependent on the future of Norwegian universities and colleges. Every aca-
demic institution has a library. This will still be the case in five or ten years. But the
size, the role and the future significance of the libraries in higher education is
uncertain.
Throughout Europe, higher education is changing. The Bologna process is only
the first step towards an open European market for higher education - and lifelong
learning. Academic libraries must earn their position in new and unfamiliar settings.
Current library statistics hardly touch on such issues, however. The indicators that
are collected reflect the stable world of the past rather than the turbulent changes in
our future.
49
Counting special libraries is rather more difficult. As we descend the size ladder,
from full scale libraries towards smaller units, professional staff disappears. The
libraries themselves dwindle into book collections. But there is no clear cut-off.
Current statistics include about 150 library entities. Most of these are small - the
average number of staff is below two. Many special librarians work alone. They
have their own network of single staff libraries (6) - with about sixty registered
members in the summer of 2005.
The National Library has a social role of its own. It is the biggest library
institution in Norway, with a staff of about 350 persons. It has the greatest con-
centration of professional and technical expertise in the country. Its collections are
unique in size, depth and permanence. The mountain vaults in Rana, near the Arctic
Circle, are aimed at the distant future. The documents will still be readable when a
small European country called Norway has become a distant memory.
Typical entities
In daily life, we are accustomed to populations that are bunched in the middle.
Statisticians describe them as bell curves. Take dogs. Some are tiny like the chi-
huahua. Some are massive like the Grand Danois. But the dogs we most often meet
are medium-sized like terriers, rottweilers, Irish collies. These are our normal or
typical dogs - the breeds we have in mind when we speak about dogs in general
(Lakoff, 1987).
With libraries the same reasoning applies. Whenever we speak about books, or
users, or librarians, we refer to mental images. Images hover in the back of our
minds and guide our thinking - often quite unconsciously. People tend to under-
stand each other if their images overlap. They start to misinterpret each other if
they diverge. The words they use may be identical. But if the internal pictures differ
too much, communication suffers.
Bell curves assist communication. Since bell-shaped distributions have clear
midpoints, it is easier for images to converge. Some books are thick and some are thin,
but most run to a couple of hundred pages. There are library patrons that borrow
fifty or a hundred books a year. A few never take a book home. But the typical
user lies in the middle – in Norway he or she checks out maybe ten items a year.
But the bell curve is not the only possible distribution. Take print-runs. In
Norway, most books are published in small editions. The typical novel is distributed
in a few thousand copies. But the books people talk about are the best-sellers. Take
public libraries. There are 433 municipalities in Norway. Three quarters have less
than ten thousand inhabitants. The average number of inhabitants per library staff
person is about 2.500. Therefore most public libraries are small - with a staff of
four or less.
50
Distributions with very many small units - combined with fewer middle sized
and a few very large ones - are often called J-curves. When we deal with J-shaped
distributions, we must reason with great care. Bell curves are roughly symmetric
around the middle. J-curves are asymmetric, with a single tapering tail. This causes
the average to be pulled away from the median. In highly skewed distributions, the
median unit and its immediate neighbors are more typical - or more representative
- of the statistical population as a whole than the average unit.
Typical libraries
The distribution of Norwegian libraries by population is J-shaped rather than bell-
shaped. In Norway, the median public library has a staff of two and serves a com-
munity of about five thousand inhabitants. Municipalities close to the average popu-
lation size are twice as big. Their libraries typically have a staff of four and serve a
population of ten thousand.
If we count heads rather than municipalities, the picture changes. Half the
Norwegian population lives in one of the thirty-three communities that have more
than 25 thousand inhabitants. From smaller to larger, these are: Lillehammer, Rana,
Ski, Hamar, Halden, Gjøvik, Moss, Ringerike, Lørenskog, Haugesund, Ringsaker,
Porsgrunn, Tønsberg, Karmøy, Arendal, Ålesund, Larvik, Sandefjord, Skedsmo, Bodø,
Sarpsborg, Skien, Asker, Drammen, Sandnes, Tromsø, Fredrikstad, Kristiansand,
Bærum, Stavanger, Trondheim, Bergen, Oslo.
Norway has only five public libraries serving communities with more than
100.000 people: the four cities of Oslo, Bergen, Trondheim and Stavanger and the
suburban community of Bærum, to the west of Oslo. One quarter of the Norwegian
population lives in these large communities. Their library staffs run from about fifty
to several hundred employees. A second quarter lives in medium sized municipali-
ties, with populations between 25 and 100 thousand people. There are 28 public
libraries in this group. These libraries typically employ from ten to forty librarians
and support staff.
Staff numbers are roughly proportional with population. This means that half
the librarians - and other library staff - in Norway work in communities with at
least 25 thousand inhabitants. The remaining half is equally divided between small
(less than ten thousand) and small-to-medium size municipalities (10-25 thousand).
There is, in other words, no typical library setting as such. We must specify the
counting unit? Are we enumerating libraries - or librarians? The typical library
serves five thousand people. The typical librarian works in a community with 25
thousand people. Both statements are correct. There is no contradiction - only a
difference in focus.
51
Visitors and users
This article is not about statistical sampling, which has many pitfalls of its own.
But I want to touch briefly on a sampling problem that lies close to the library-
versus-librarian problem discussed above. Clarity about the counting unit is par-
ticularly important when we gather survey data. Confusing visits and users is a
typical mistake. Many user studies gather data from the users that actually visit
the library - for instance during a particular day or week. Let us assume that all
visitors fill in a form as they leave the library. Since some people use the library
frequently, while others use it seldom, these data will never constitute a represen-
tative sample of the users. Frequent users will be overrepresented and infrequent
users underrepresented in the sample (see note 7 for a concrete example).
Here, the sampling unit is visits rather than users. This does not invalidate
the information. Visits are important in their own right. Hotels and air lines that
ask customers to fill in forms are using visits as their counting unit. Why shouldn’t
they? Steady customers generate a steady income. Frequent travelers are more
important than occasional visitors. Libraries also need to take care of their “loyal
customers”. Collecting visitor data on a regular basis is a good way of spotting new
trends, new opportunities and new problems. The important thing is to recognize
that visitor data derive from the population of visits and not from the population
of users. When we interpret such data we must have the right mental image present.
We can get data about the users as such in two ways. We can make a special
survey, by mail or phone, with a sample of respondents from the local population
or from the group of registered users. As a second option we can convert visitor data
to user data by a suitable weighting procedure. To do this, we need information on
the frequency distribution of library visits among the visitors. The calculations
involved are not particularly difficult. But weighting the data after collection should
not be done mechanically. The investigator must understand the logic of weighted
averages.
International comparisons
The most common indicator of public library usage is the annual number of loans
- or library transactions - per inhabitant. The Millennium study (p. 129) calls this
“the best single index of public library activity”. The European average lies around
five. The range is surprisingly great - from 0.2 in the case of Portugal and Greece
to 20.0 in the case of Finland (Millennium study, Table 7.10.). If we divide the
countries (for which we have data) into three levels, we get the following ranking:
• Low (0.0 - 2.9): Portugal, Greece, Spain, Romania, Bulgaria, Austria
• Middle (3.0 - 6.9): Hungary, Ireland, Germany, Norway, Slovak Republic,
Poland, France, Lithuania, Czech Republic,
52
• High (7.0-20.0): Latvia, Slovenia, Belgium, Estonia, Denmark, Iceland,
UK, Sweden, Finland
Country code IS DE NL FR NO SE UK DK FI
Visits per 2,6 4,0 4,3 5,0 5,0 5,4 5,5 6,3 12,8
inhabitant
Let us take this approach one step further. The population as a whole consists of
users and non-users. When we plan library services, we need to consider these as
two different target groups. The first group has already been “recruited” and can
be reached at the library itself. The second must be contacted and approached in
a different way. Library visitors come from the first group only. We can empha-
size this by factorizing the number of visits per inhabitant:
In Norway, the actual numbers (2000) are: 5.0 (visits/person) = 9.6 (visits/user)
* 52 % (users). Here, a user is defined as a person who has visited the library
during the last 12 months. If we combine the two factorized expressions, we get:
Here, the “best single indicator” at the left of the equality sign is written as a product
of three meaningful indicators to the right. Factoring provides a more detailed
53
picture of events. User/Population shows the percentage of people who actually
use the library. Visits/User shows how often the actual users come to the library.
Loans/Visit suggests how the library is used: mainly for borrowing or for other
purposes as well. Recent survey data from Denmark indicates that half the visits
concern activities inside the library rather than borrowing library materials
(Hansen, 2005).
For practical planning these three indicators are much more valuable than
Loans/Population as such. The first shows the potential for recruiting new cus-
tomers. The second and the third describe the behavior of existing customers. A
strategy for increasing the number of visits to the library would demand one
marketing approach. A strategy for increasing the number of loans per visit
would require another. Norwegians must find public libraries useful for other
purposes than borrowing. Why would they bother to come otherwise?
Demographic analysis
Library use decreases substantially with age. In mid-life, this trend is counteracted
by children who “drag” their parents with them (or vice versa). We can, however,
remove this confounding effect by separating families with children from couples
without children and from those who are single (Table 5).
Table 3 (right) shows in fact four different effects. Couples are somewhat more
active library users than singles. Couples with children lie slightly above couples
without children. Females are definitely more library active than males. But age is
clearly the strongest influence. The visits are halved as we pass from childhood to
mature adult life.
54
Life phase Users Visits
Young people 9-24 with parents 71 11
Girls 9-15 81 14
Boys 9-15 73 11
Women 16-24 70 14
Men 16-24 54 10
Singles 9-44 53 16
Couple 16-44 without children 50 13
Couple with children 0-6 53 12
Couple with children 7-17 55 10
Single parent 75 11
Couple 45-79 without children 43 9
Singles 45-79 38 11
All groups 54 11
Table 3. Percentage that have used public libraries in Norway during the last
12 months by life phase. Visits per user. Source: Norsk kulturbarometer 2004.
The actual frequency for single parents is much higher: 75 rather than 59 %.
This means that gender only contributes about 5 percentage points to the difference
between couples and single parents. A 16 point gap remains. In other words: single
parents use public libraries more mainly because they are single, not because they
are female.
Weighted averages
In a demographic perspective, library use is affected by three major factors: age,
gender and family situation (life phase). The age effect is strong, but it is only half
the story. Those who are young today are generally better educated than older
people. They have studied for twelve or fifteen or even twenty years rather than for
seven or ten. The transition from industry to knowledge means that people must
learn more before they start working.
Those who were born in the nineteen thirties, say, have much less education than
those who were born in the sixties. The effect of age is therefore mixed with a cohort
55
effect. To understand the role of libraries in more detail, we must also separate age
from education. This means that we must look at library visits and lending within
subgroups of the population. Knowledge workers frequent libraries. Manual
Table 4. Library use by type of occupation. Visits per year. Percent. Norway 2004 and
1988. Source: Central Bureau of Statistics.
workers do not. The most active users – after pupils and students - are people in
services and people with higher education. Less than forty percent of the workers
in the primary sector and in industrial occupations set their foot in a library in 2004.
In the past, however, this differential was bigger. In 1988, only one fourth of the
workers in the primary sector and in “industrial” occupations visited a public library.
In the traditional service sector the frequency rose to forty percent. But the most
active users came from the new, knowledge based professions: a welter of technical,
scientific, humanistic and artistic occupations based on higher education. In this
category, sixty percent were active library users in 1988.
56
One dangerous trend is hidden behind the surface. We know that more and more
people enter higher education. Knowledge societies depend on highly educated
workers. The children of farmers and industrial workers become professionals. As
the population becomes more educated, library use should, therefore, go up. In fact
it stays constant. To explain the stability of use, we must find a counteracting force.
The distribution of workers between sectors is changing – and should push library use
up. But at the same time education-specific rates of library use seem to be declining.
We have some survey data that suggest this is happening, but the whole question
needs more detailed investigation.
Library logistics
Library collections are productive when they are used. Books are for reading. If we
divide the size of the collection with the number of loans, we get the circulation
rate. It shows how many times the average document has been used in the course
of a year. In public libraries, the stock ought to circulate at least three times a year.
If the normal loan period is one month, this means that the average book is in active
use for three - and available on the shelves for nine - months every year.
Books that move slowly need not be available in every local library. It is enough
if they are stocked at the county - or even at the national - level. With efficient
interlending, slow books are still part of the library system as a whole. Finding the
proper balance between local, regional and national storage is a matter of practical
logistics. If we know the service level we want, we can actually use statistical models
to find the optimal distribution of documents between the first, the second and the
third line of supply. Commercial distribution networks do this as a matter of course.
Slow motion
In the library world, such thinking is hard to implement. Local libraries have a
strong tendency to overstock. Librarians are justly proud of their interlending
systems. But they do not really trust them. Instead they offer the customers shelves
full of outdated books - just in case ... This occurs in many European countries
(Table 5). But Norway - together with Iceland - is the greatest sinner. Our pre-
cious documents spend only nine percent of the time with the users. This means
that the stock is stuck, bored and lonely, on their shelves for about ninety per-
cent of the time.
57
Country code IS NO SE FR DK FI DE UK ML NL
Percentage time 9 9 14 16 20 21 23 28 33 36
with users*
Stock/100 pop. 850 450 500 260 500 720 130 190 200 260
At the same time I note that few people take such conclusions seriously.
Librarians and library authorities are fully aware of the data. But they do not
really care. In Norway, collection development is not on their strategic agenda.
The matter is too technical for politicians - and maybe too uncomfortable for the
library profession. The users do not complain. Why should we bother?
New media
The European data apply to the collection as a whole. We lack good comparative
statistics for separate media types. But in Norway new media now represent 25
percent of all loans. By new media I understand both analogue and digital multimedia,
including old-fashioned audio- and videotapes. At the moment, some multimedia
documents are still distributed in analogue form. But digital formats are already
dominating the market. Analogue formats are set to disappear.
New media are much more popular than books. In the country as a whole, five
percent of the stock consists of new media. But these documents represent, as I said,
one quarter of all loans. All the new media have much higher circulation rates than
books (Table 6). All satisfy Moore’s demand: that an active document collection
should circulate at least three times per year, on the average. The contrast between
old and new is glaring. The book stock, and especially the books for grown-ups,
moves very slowly indeed.
Media type Video/ CD- Audio Music ML Other Books for All Adult Adult non-
DVD ROM books media children media fiction fiction
Circ. rate 10,2 6,9 4,2 3,1 3.0 1,2 1,2 1,1 0,75 0,74
Stock 310 19 360 370 - 430 6.100 22.000 7.700 6.700
ML = Moore’s limit. Moore proposes a circulation rate of at least 3.0.
Table 6. Circulation rates and total stock in thousands for books and other media.
Public libraries. Norway 2003. Source: Central Bureau of Statistics.
58
Different readings
From a strategic point of view, we can interpret Tables 5 and 6 in several different
ways. Three alternatives are:
We should be inspired by the popularity of new media - and use them as a model
for our book collections as well. The rapid turnover of new media illustrates what
public libraries can achieve if they are allowed to invest in new and attractive
documents.
The investment in new media is a mistake and should be reduced to a minimum.
The growth of new media shows that public libraries are abandoning their real
mission. We should not use public funds to finance ordinary entertainment. Libra-
ries are meant to empower people. People should learn to read on a regular basis.
They should read quality materials, and they should learn from their reading.
Libraries must prepare for a future without new media. The current boom is
temporary. In the near future such documents will mainly be delivered online, on
demand. It is only a matter of time before broadband speeds make downloading
much more convenient. Commercial publishers will not allow public libraries to
provide these items for free. Libraries will in practice be restricted to materals that
are distributed in physical form.
We cannot use statistical reasoning to decide between the three. Statistics provide
context but not political conclusions: - One man’s ceiling is another man’s floor...
Increasing circulation
What would be the consequence of taking Moore’s limit seriously as an operational
goal? We can, in principle, improve circulation rates by reducing stocks or by
increasing lending. In the Norwegian case, we would either have to reduce our book
stocks from 21 to 7 million - or increase lending from 18 to 62 million!
The first strategy is clearly feasible. It lies within the power of the library
community to remove the dead wood. Such a drastic slimming program would make
the real profile of the library visible. Collections would turn lean and hungry. We
know that current budgets do not allow libraries to present a collection that is
reasonably up-to-date in all main areas. Adult non-fiction is the biggest problem.
Strong points and gaping holes would appear side by side.
The second strategy, which would bring Norway close to Finland, is not on
today’s agenda. Lending can not be tripled, from five to fifteen loans per capita, with-
out a vast program of investment and massive political support. We have supposed
that the book collection would remain constant in size. But most of today’s stock
would still have to go. Millions of items have to be scrapped - and replaced by
attractive new volumes.
59
Books and reading
On an average day, the average Norwegian spends 12 minutes on book reading
- for leisure (Norsk mediebarometer 2004). In addition, he or she spends 11 minutes
on periodicals - and 30 minutes on newspapers (8). Let us explore these statistics in
more detail. The mental image of people who open a book, read for twelve minutes
and put it back on the shelf is false. The average value is not typical. In this case,
as in many others, the population must be divided into sub-groups. If we distinguish
users from non-users, our conceptual understanding of the statistical information
becomes much clearer.
On an average day, more than three quarters (77 %) of the people in the survey
had not read a book at all. The book reading time derives from the 23 percent that
had opened a book on that particular day. And these people spent, on the average,
almost an hour (52 minutes) reading. This number - about an hour - is typical.
The Norwegians that do read tend to spend about an hour whenever they start
reading. Keeping this pattern in mind, we get a good picture of the amount of
reading by looking at the number of readers in different social categories.
Women read more books than men. This is true in general, and also for every age
group. The difference is greatest among young people (9-24 years). Does this mean
that boys read less than girls? Should librarians make an extra effort to motivate
boys to read? That is not automatically the case. Reading takes many forms.
Norwegian media statistics single out five categories: books, comics, magazines,
journals and newspapers. Girls spend more time on books and magazines than boys.
Boys prefer comics.
If we add up all five, girls between 9 and 15 spend on the average 28, while
boys spend 25 minutes reading. When all print channels are counted, girls and
boys spend almost the same amount of time on reading. The strategic conclusion
seems to be: if you want boys to read more - buy comics.
Transparent organizations
The public sector is under scrutiny. In the past, public service was often associated
with low efficiency. Public institutions were monopolies, protected from the market
and its demanding customers. People could not shift their custom from one local
authority to a better one - just across the street. Incentives for innovation and change were
weak. Public jobs might be poorly paid, but they were normally safe for life.
Today, European governments want public services to become much more agile.
The growing productivity of private enterprise puts pressure on public services. Safe
and dull organizations should become flexible, transparent, competitive and account-
able. If private firms can increase their efficiency - producing more with less -
public service providers should be able to do the same.
60
Imposing change on established institutions is never easy. Change implies
additional work, since new plans must be developed, debated and implemented.
It requires additional learning: old book horses must learn new digital tricks. It
promotes uncertainty and fear: Will my job disappear? Will my skills be respected?
Can I master the new technology? Change is seldom popular on the shop floor. Here,
the Don’t Rock the Boat Party can usually outvote the Party of Rapid Transfor-
mation by a good margin.
But we have little choice. Those who only fight rearguard actions end up in
the rear. As a statistician I believe in a forward approach: embracing rather than
rejecting statistics. To make themselves heard, libraries need to learn the con-
cepts, the models and the language of statistics. Words and numbers are both
tools. We need them in our efforts to describe, to understand, to manage and to
change the social institution we call libraries – as well as the larger social institution
we call society. With that in mind, we propose a set of guidelines for libraries that
want to use statistics.
61
7. In Norway, close to fifty percent of all new library books are now financed
by the Norwegian Cultural Council. These books are selected centrally.
The purpose is to stimulate publishing in Norwegian. The effective demand
for these books is highly uneven. Only books in real demand contribute
to renewal in a meaningful sense.
8. Reduce collections. Norwegian library collections are far too large –
mainly because dated books remain on the shelves. This is the case in
many other countries as well. In the years ahead, professional collection
development will require a substantial reduction in the size of our col-
lections.
9. The active stock – the books available on open shelves for browsing and
lending – should generally be reduced to one third of total lending. Books
in normal demand should, in other words, circulate at least three times
a year. In Norway, more than fifty percent of current public library
collections are effectively worthless.
Library services
10. Libraries have low visibility. Develop a clear picture of how much time
people spend inside your library. The more hours they spend, the more
satisfied they are. They vote with their feet. Count the shoes – and tell
your local politicians.
11. Decision makers need mental pictures of library services that go beyond
basic lending. It is not very hard to document what people do inside libra-
ries. Simple observation methods can be used to collect convincing data.
12. Library staff spends much time guiding and advising customers. This work
will be more visible and appreciated if libraries could develop decent
reference statistics.
13. Libraries provide many services for groups of users: school class visits,
book presentations, fairy tale readings, exhibitions, user instruction,
lectures, concerts, etc. Take care to document them well – with quantita-
tive and narrative data.
14. Libraries often cooperate with schools, nursing homes, and other com-
munity institutions. The national program “Boka kommer” [The Book
comes to You] and other forms of outreach activities also belong here.
Document these as well – they are part of the social networks that create
a durable civic society.
15. An increasing share of library resources are now being channeled into web-
based services. We have an urgent need for meaningful virtual statistics.
62
Library authorities still spend too much effort on repetitive data collection and
too little on data analysis. In this paper we have argued for a broader use of offi-
cial library statistics in library management and strategic planning. We have
showed how new statistical indicators - in the form of simple ratios – can be con-
structed. And we have suggested how such indicators can be used for effective
strategic planning. Simplistic decision making based on one or two indicators
can be opposed on statistical grounds – by offering a wider range of tools and
better ways of using them.
Notes
1. Library students are covered by DBH, the national database of higher edu-
cation statistics. URL= http://dbh.nsd.uib.no/dbhvev/. Read: October 24, 2005.
2. Statistics on professional publications in LIS are included in FRIDA, the
national database of research results from universities and colleges. URL=
http://wo.uio.no/as/WebObjects/frida.woa?inst=215. Read: October 24, 2005.
3. Information on StudData at URL=
http://www.hio.no/enheter/senter_for_profesjonsstudier_sps/studdata.
Read: October 24, 2005.
4. See the official classification scheme at URL=
http://www.ssb.no/emner/06/yrke/. Read: October 24, 2005.
5. Library statistics 2004 at URL=
http://www.ssb.no/emner/07/01/40/ffbibl/tab-2005-06-01-01.html.
Read: October 24, 2005.
6. Their association is found at URL= http://biblioteknett.no/smaabib/.
Read: October 24, 2005.
7. The library of Bolton (UK) conducted a user survey in 1994. “Customers were
sampled during each hour of opening during the two weeks from 16th to 28th
May. ... The sample [2.415] was large enough to ensure that the overall results
of the survey should provide a valid picture of our users and their views. ...
Perhaps one of the most surprising results of the survey was the very frequent
use of the library by most of those surveyed”. England and Sumsion (1995):
p. 162-164
Bibliography
Bohme, S. and Spiller, D. (1999). Perspectives of public library use 2.
Loughborough: LISU and Book Marketing Ltd.. England, Len and Sumsion,
England, Len and Sumsion, John (1995.). Perspectives of public library use. A
compendium of survey information. Loughborough: LISU.
63
Hansen, Lone (2005). Trafiktælling i folkebibliotekerne.
URL=http://www.bs.dk/content.aspx?itemguid={0CF00343-DD43-43B2-
850B-6BBFFFDA6D10} (Read: October 24, 2005)Høivik, Tord (2003).
Høivik, Tord (2003). Why do you ask? Reference statistics for library planning,
Performance measurement and metrics, vol. 4, no. 1, pp. 28-37.
Høivik, Tord (2004). Når statistikk blir politikk. Om KOSTRA og norsk
bibliotekstatistikk [When statistics turns into politics: on KOSTRA and
Norwegian library statistics]. Bok og bibliotek, vol. 71, no. 2, p. 40.
Lakoff, George (1987). Women, Fire, and Dangerous Things. Chicago, IL:
University of Chicago Press.
Library economics in Europe. URL: http://www.libecon2000.org/default.asp
(Read: October 24, 2005). (= Millennium study)
LibEcon.org. A research study into international library economics. URL:
http://www.libecon2000.org/default.asp (Read: October 24, 2005)
Moore, N. (1989). Measuring the performance of public libraries: A draft
manual (PGI-89/WS/30). Paris: UNESCO
Statistisk sentralbyrå (Central Bureau of Statistics). Norsk mediebarometer 2004.
URL= http://www.ssb.no/emner/07/02/30/medie/ (Read: October 24, 2005)
Summary
In modern knowledge based societies public institutions are increasingly exposed to
economic scrutiny. They must document the efficiency and the value of their work.
Public libraries are no exception. In Norway, the Central Bureau of Statistics has
introduced a sophisticated system for collecting and comparing municipal statistics.
In the past, nobody outside the library world showed much interest in library sta-
tistics. Now they are studied closely by decision makers.
Librarians need to master a discourse based on statistics. In this paper we
explore some central issues in statistical reasoning – counting, distribution curves,
indicators, correlations – in the library setting, with Norway as the main case. We
also look at Norway in a European context and draw some new conclusions about
the actual state of affairs. The article concludes with a set of recommendations
for libraries that want to document their activities with a maximum of relevance
and political impact.
64
Cyberspace and market place:
library messages beyond the border
Myoung C. Wilson
Chair, Information Services/Steering Group
[email protected]
and
Farideh Tehrani
Head, Access and Collection Services
[email protected]
The authors wish to acknowledge the editorial assistance they received from Professor Richard W. Wilson,
Professor and Chair, Department of Political Science, Rutgers – the State University of New Jersey.
“If we add value, and yet are undervalued; and if the stereotyped image of the
traditional library is far removed from the reality of the modern hybrid library
and information services—then, clearly we have a marketing issue to address.”
Bob McKee.1
65
revealed that 73% percent of U.S. college students use the Internet more fre-
quently than libraries for research purposes.3 This is, indeed, challenging news
for academic librarians.
The adage that the library is the “heart of the university” has been rephrased by
some as either the “electronic hub” or the “circulatory system.” These phrases reflect
the changed nature of how and where information is created and stored, its distri-
bution and dissemination routes, and access. Simultaneously, the importance of
the classroom as the sole place of learning has also been challenged. Any place
(and any time) where (when) students have access to the Internet is now a source
of information, including even the lecture notes of professors and course reading
materials. In a wireless digital environment significant learning activities take
place where students are and assemble: in hallways, in cafeterias, in dormitories,
in student centers, and in computer centers.
The image of the university as an ivory tower is slowly giving way to that of
a ravenous shark competing for profit in the market place of ideas. While uni-
versities in the past monopolized teaching, learning and research, these core mis-
sions have become mechanisms for profit maximization. This is especially true for
some online institutions, which have taken full advantage of the rapid develop-
ment of information technology and communication. In other areas, universities
now spend large portions of their financial resources to compete for new students,
most especially from non-traditional population groups. Academic institutions
have also established major fund raising arms and alumni relations offices; senior
academic officers such as vice presidents often head these offices. Despite cau-
tionary warnings by Derek Bok, the former president of Harvard University,
about the seductive power of commercializing university research,4 modern uni-
versities have engaged in marketing as a necessity. Much as a soap company
attempts to sell a brand of new soap with a different fragrance, universities have
developed staff and skills to advertise their educational programs and services
using mass media.
University libraries have always mirrored the images and practices of their
parent institutions. As will be discussed in this paper, although academic librar-
ians were initially reluctant to incorporate marketing as an accepted practice,
there is growing evidence that this is a fast growing area in librarianship.
66
but not the whole and each gave a different description of what the whole must
be. Just as in this example, there has been no agreed upon meaning regarding
what constitutes marketing for libraries.
As demonstrated in recent surveys by the Association of Research Libraries,
(ARL) the term marketing for academic libraries has multiple meanings covering a
wide range of activities. The 1999 ARL survey on marketing and public relations
assessed the extent and nature of marketing activities by North American research
university libraries. This survey revealed that the terms “marketing”, “public rela-
tions” and ”development” are used interchangeably in most academic libraries; the
trend is to establish separate offices for these activities with marketing efforts closely
tied to fund raising activities.6
In 2004 the ARL conducted another survey entitled Library Services in Non-
Library Spaces. This survey does not use the term “marketing” to describe these
activities. Instead, the report points out that there is no consistent name for library
services in non-library spaces, and this lack of a standard nomenclature reflects the
entrepreneurial, ad-hoc nature of many of these out-of-library services.7
The discussions on library marketing concepts and practices appear in many
books and journal articles. Notable among them in recent years are the works by
Darlene Weingand (1999), Rejean Savard (2000), Eileen Elliott de Saez. (2002), Dinesh
Gupta and Ashok Jambhekhar (2003) and by Jeannette Woodward (2005).8 As noted
above some major surveys regarding marketing activities were also conducted by
the ARL and by Shontz and Parker for public librarians.9 Thanks to the work of
IFLA and its Section on Management and Marketing, an important international
platform for library marketing has also been provided. Papers presented at IFLA
conferences have for many years provided valuable information on library mar-
keting experiences and practices worldwide
This literature often points out two consistent themes. One is the librarians’
failure to market themselves and two is librarians’ hesitance in accepting marketing
as part of their essential activities. Some have faulted libraries for marketing
beautiful buildings and dusty books at the expense of the other valuable services
that librarians provide. Indeed, too often librarians fade into the background10
rather than being identified as a “keystone species” that gives unique shape and
strength to the library information environment.11 As Nardi and O’Day affirm
in their study, although librarians have a flourishing information consulting
practice, not enough people know about it.12
The literature also indicates that librarians carry an almost legendary reputation
for feeling uncomfortable with the term “marketing” with its traditional association
with “advertising,” “public relations,” and “commercialization.” Librarians, how-
ever, are not alone in their aversion to the term. Museums, one of the institutions
67
that shares common ground with libraries, have the same reluctance. A recent
Washington Post article reports about the Smithsonian’s marketing drive as follows:
“This focus on business doesn’t sit well with all of the Smithsonian’s huge
scholarly staff…. They say the emphasis on enterprise is at odds with the Smiths-
onian’s culture of collecting and preserving the nation’s stories and accomplish-
ments. Branding – putting the Smithsonian’s name on items – to them is more akin
to marketing J.Lo’s perfume than preserving a dinosaur.13
Compared to their colleagues in public libraries academic librarians are rather
latecomers in actively engaging in marketing activities. However, as numerous
studies indicate, now that today’s college students gain access to research infor-
mation by going online instead of going to campus libraries, academic librarians are
experiencing a rude awakening.
In fact, since the early 1970s academic librarians have experienced immense
success in marketing (and integrating) library instructional programs into academic
courses. However, because the fundamental mission of university libraries is to support
and underscore traditional academic and research activities, the non-academic
units of the university seldom market library services. This paper highlights mar-
keting initiatives practiced at the Rutgers New Brunswick campus utilizing non-
academic units as tools for marketing library services, Our goal was to deliver
library messages to students where they congregate in non-library places.
68
Piscataway campus is the main campus of this system hosting about 25,000 full
time undergraduate students; these were the main audience for the marketing
activities described here.16
At Rutgers, some marketing activities are organized at a system wide level,
some at the campus level and some at the level of individual buildings. On a system
wide level a communication’s audit was conducted in 2004 on three campuses
scattered around the State in four cities. This was a strategic audit that aimed to
“evaluate the current communication program (internal and external) and provide
directions for enhancing its effectiveness.”17 In other words, this audit was to
identify how Rutgers can best grow and become stronger. External consultants
were hired to meet with different constituencies who were composed of librarians,
staff, faculty, students, and university administrators. This was, in essence, what is
frequently termed a “marketing audit” that attempts to identify strengths, weakness,
opportunities and threats (SWOT analysis).18
However, prior to this system wide audit, several marketing initiatives took
place from 2003 through 2004 on the campus level on the New Brunswick/
Piscataway campuses. We present five representative examples of these marketing
activities in this paper.
The New Brunswick Libraries (NBL) is a library system within the Rutgers
University Libraries (RUL) composed of four major libraries housed in four sepa-
rate buildings and ten departmental libraries and centers located on five campuses
across two municipalities in central New Jersey. New Brunswick librarians are
keenly aware of the changes that have taken place in user habits and in the expec-
tations that users have of library resources and services at Rutgers. Among the three
functional teams at NBL it is the Information Services/Steering Group that led
the discussions about the marketing library website and that took the initiative
by creating outpost services as well as outreach programs.
No New Brunswick campus user surveys were carried out for the purposes of
marketing although smaller and informal surveys by individual libraries and
librarians were conducted. Instead, large-scale studies that were conducted on a
national level that revealed how college students in general use libraries and the
Internet were employed as the basis for planning and discussion. One such analysis
was a 2002 OCLC study which revealed how college students use the Web for
research. Another undertaken by Outsell, Inc. on behalf of the Council on
Library and Information Resources and the Digital Library Federation surveyed
the students’ use of libraries and the Internet. Additionally, a Pew Internet Life
study entitled the Internet Goes to College reported that 73 percent of college
students use the Internet more than libraries for their research; only 9 percent
claimed to use the library more often.19
69
Rutgers New Brunswick librarians have been very successful integrating library
instructions into course work. Moreover, in recent years, we have been able to
coordinate the delivery of library instructions to lower level courses, those with
multiple sections, with scripts of lesson plans and with web tutorials. Such courses
use part time lecturers and teaching assistants for library sessions to meet the rising
demand for library instruction.
In addition to these successful class room instructional programs the marketing
efforts were designed to provide reference services and to disseminate library
information (such as the library Web address), outside the classroom and outside the
library. Such services were often referred to as “outpost services.” The main objec-
tives were to facilitate remote access, provide pin numbers, and answer reference
questions, among others. In order to achieve these goals, librarians worked with
the office of the Dean, specifically the Rutgers College Dean, the Office of the
Campus Center Director, and the Office of Parking and Campus Bus Operations.
70
In the fall, 2004, however, the Rutgers Ask A Librarian 24/7 email reference
service was inundated with questions from students who were requesting their
PINs online in order to gain remote access to the libraries’ licensed databases.
Our Access Services staff, either in person or via the Ask A Librarian service,
normally issues the PIN numbers. Therefore, instead of replicating reference
service outpost services where relatively few reference questions were asked, it
was agreed by the Head of Access Services and the Chair of the Information
Services Steering Group to jointly establish library outreach service stations for a
two week period from September 20 through October 4, 2004. These stations were
placed at the two largest campus centers under a banner that read “Your Libraries
@ Campus Center.” The particular period was chosen to capture the attention of
freshmen and transfer students who were new to campus and who were unfamiliar
with the Rutgers libraries system. This project was an effort to be proactive by
offering library information in a non-library environment in order to promote
our virtual and physical library collections and services.
A Personal Identification Number (PIN) is required for all electronic transactions
with libraries (for example, to renew books, to request a book delivery service,
etc). At the time, a PIN was also required in order to gain access to our commercial
databases from remote sites. Many students in frustration ask for their PIN at the
last moment. We wanted to be proactive and offer PIN and other services at the
busy Campus Centers.
Unlike the Librarians without Borders project, providing reference services was
not the main objective of this project. The two service stations were designed to
raise the visibility of the libraries by distributing promotional materials, and by
offering PINs to those who did not have one, among other services. Therefore, while
reference librarians were asked to volunteer their time, these service stations were
largely organized and staffed by Access Services staff members.
Not surprisingly, Access service related questions (interlibrary loan, circulation,
etc) were the highest (168). Almost as high (138) were general questions regarding
campus directions (these questions have nothing to do with library services); 78
library users were issued PINs and 31 reference questions were answered. During
this time almost 1700 library informational brochures and promotional items (such
as “post it” packets with the library logo and library web address) were distributed.
Putting this data in the context of current existing information services sheds
some light regarding the preferences of Rutgers library users. Table 1 presents
the number of questions by type at three different service stations—two physical
and one virtual. Table 2 is a graphic presentation showing the percentage distri-
bution of the types of questions that were asked. Table 3 is a graphic representation
of Table 1 illustrating the types of questions that were answered in person and
71
by phone at one of the largest libraries in the Rutgers system (the Alexander
Library reference desk), via the Rutgers Ask A Librarian 24 /7 email reference
service, and at the Your Libraries @ Campus Center locations during the period
from September 20 through October 4.22
72
Types of questions
These data24 clearly indicate that students (and other library users) identify
the library’s physical reference desk as the primary place to seek assistance for
research, compared to virtual or non-library place reference services. They also
suggest that almost 88 % of the reference questions were answered in person and
by phone at the Alexander Library—this number would only increase if all the
Rutgers reference desks were added. These data also confirm our colleagues’ earlier
findings that students do not bring large numbers of reference questions to the
Campus Centers.25 Students and faculty also clearly demonstrated their prefer-
ence for using online forms and virtual reference services when asking factual
and personal questions regarding library collections and services, (for example,
obtaining a PIN, borrowing, the status of interlibrary loan requests, etc) While
the library service stations at the Campus Centers were not the primary locations
that students used for library assistance, the data clearly suggest that they pro-
vided a significant supplemental service to the traditional reference desk and Ask
A Librarian services. Determining the place and the time of library service in
non-library places that will have the highest impact on student learning is clearly an
important marketing agenda for academic librarians.
73
C. “Lost in Cyberspace? Try Your Library Space at www. Libraries. Rutgers.
Edu”: Campus Bus Advertising
When we were organizing “Your Libraries @ Campus Center” project in the fall,
2004, we also contacted the office of the Director of University Parking and
Transportation Services. As described earlier, Rutgers New Brunswick/
Piscataway campuses span over two municipalities divided by a river. The uni-
versity operates one of the largest transportation systems in the State. The inter-
campus bus system transports an average of 40,000 students daily among the five
major campuses.
What librarians learned at our first meeting with the Assistant Dean of the
Campus Bus Operations was that we were actually late comers in expressing an
interest in using the campus bus system as a medium for advertising. For example,
a local campus restaurant such as Wendy’s even offered a hefty sum of money to
advertise their restaurant on all campus buses, as did many others. However,
because of limited space, the Campus Bus Operations rejected all advertising
requests except for posting their own messages and class schedules for the semester.
The Acting Director of the New Brunswick Libraries and the Chair of the Infor-
mation Services Group were able to convince the Campus Bus Operations that if
they posted library messages, they were indeed participating in helping students
succeed in their academic endeavors, thus adding to the value of their transportation
service. The libraries then obtained permission (gratis) to post two messages. “Google
not Good Enough? Visit the Libraries Website at www.libraries.rutgers.edu” and
“Lost in Cyberspace? Visit Your Libraries Website at www.libraries.rutgers.edu.”
Due to concerns regarding a possible trademark infringement of Google, we
decided not to post the Google message. The process of creating and selecting
these messages involved staff, librarians and students.
We were not able to collect systematic data from this initial year regarding
how effective the message was, what percentage of students were cognizant of it,
and how it impacted students’ use of the libraries. A very informal show of hands
in library instructional classes indicated that only a small number of students saw
the posting. One problem was that the poster was of relatively small size and was
posted on a long double bus. Clearly much needs to be improved in delivering the
library message via the inter-campus bus system as well as the effectiveness of the
design. Nevertheless, we have made significant inroads in attempting to provide
students with library messages in a non-library setting.
D. Making library public workstations show images with a large distinct library logo
Creating student awareness of libraries also meant creating a clear and consistent
message that students would pay attention to, comprehend, retain and act upon.
74
This marketing principle prompted the librarians to make our messages consis-
tent throughout the campuses.
The campus bus advertising message, described in the previous section,
prominently displays the university library logo,” RUL.” In order to help students
make the connection between the campus bus message and the computer work-
stations in the libraries, we requested the Library Systems Office to redesign the
screens of all public workstations to prominently display the library logo along with
a choice of Internet browsers. Prior to these marketing efforts, the public work-
station screens did not display the library logo. Instead, the screens displayed a
collection of small icons including the Internet browsers. Most users clicked on
those browsers that are defaulted to the library’s homepage. However, unsophis-
ticated users, including our own students, frequently approached the reference
desk in search of library catalogs rather than clicking an Internet browser. We then
realized that nowhere on the screens of all library workstations were there instruc-
tions on how to begin library searches. In other words, for many users our screen
display was counterintuitive. The re-imaged screens now clearly indicate that the
workstation is a gateway to Rutgers University Libraries resources and services.
75
structure activities that will influence the ways that students do research. Most
of all, such activities will improve the quality of library learning and research
and reduce the probability of students being lost in cyberspace.
The marketing initiatives described in this paper are only a few that were
experimented with at the Rutgers New Brunswick/Piscataway campuses. Many of
these practices were “bottom-up” initiatives that were planned and implemented
by librarians and staff who met to search for alternate information services models.
A successful marketing strategy requires temporary realignment of internal
organizational structures such as combining Access and Information services for
a specific task. Simultaneously, librarians need to forge working relationships with
other university offices, particularly with non-academic units whose objective is
to enhance the general quality of student life. An organizational culture that
encourages looking outward in search of partnerships with non-academic units
is an essential element in successfully delivering our message to a wider audience.
In social science terms, librarians need to make “constitutive choices” which
sociologist Paul Starr defines as “those that create the material and institutional
framework of fields of human activity.”27 It implies the establishment of conditions
that set the path for an institution’s future direction. Many academic libraries
have indeed begun to construct just such a framework for marketing activities. At
Rutgers deliberate choices are being framed by a system-wide marketing committee
to address marketing issues both in training and in practice.
Malcolm Gladwell, the popular author of The Tipping point: how little things
can make big difference and recently Blink: the power of thinking without thinking,
suggests that “libraries must consider how to frame the way libraries are viewed
–what associations come to mind when people think about libraries? Is the library
viewed as a safe haven, a literary adventure? Or a technology hub? Whatever the
framing may be, it is the first critical step in starting an advocacy epidemic.28
Bob Mckee also warned about the emergence of a dangerous divide between our
profession’s perception of libraries and the public’s perception.29
To paraphrase Gladwell and McKee, we can ask ourselves how the Net
and, now, the Gamer generation, views libraries – as study halls, meeting places,
library cafeteria (at least this is what students expressed great interest in having
in the future), computer centers or hot zones? The first step is to learn student’s
perceptions of today’s libraries and to offer them a product that other search
engines cannot. This, of course, is a tall order and difficult to do. However, the value
and potential of libraries as places to learn, where your “ultimate local search engine”
can be found in the form of your local librarian, must be marketed vigorously.
Whatever the framing may be, it is the first critical step in starting a long term and
sustained marketing epidemic.
76
The current marketing challenge for academic librarians is to understand the
elusive ways that the Net generation of students and faculty use digital and print
libraries. Librarians are urged to reframe how the unique strength and advantages
of libraries and librarians are marketed. Our challenge is to convince our users
that libraries and librarians can deliver access to information with greater economy
of effort than at any other time.
The Internet provides everyone with fertile ground for research. It particular-
ly provides rich sources of research data collected by national organizations and
others. Librarians as information professionals must take advantage of the avail-
ability of these data. They must analyze the information/research habits of users
and deliver a library product that will be compatible with them. Through the focus
group interviews, the electronic survey questionnaires, and the communication audit,
Rutgers in recent years has amassed data about how faculty and students view and
use libraries. Such information clearly helps define future marketing strategies.
Notes
1. An integrated approach to services marketing: a book of readings on marketing
of library & information services. Edited by Dinesh K. Gupta and Ashok
Jambhekar. Allied Publishers Private Limited: Mumbai, India. 2003. p. v.
2. “Newspapers struggle to avoid their own obit,” by Randy Dotinga, Christian
Science Monitor, April 25, 2005. Retrieved from
http://www.pewinternet.org/pdfs/PIP_College_Report.pdf. May 24, 2005
3. Jones, Steve. The Internet goes to college: How students are living in the
future with today’s technology. A Pew Internet & American Life Project. 3.
Retrieved from
http://www.pewinternet.org/pdfs/PIP_College_Report.pdf. May 24, 2005
4. Bok, Derek. Universities in the marketplace: the commercialization of higher
education. Princeton and Oxford: Princeton University Press. 2003.
5. Gupta and Jambhekar, p.7
6. Marketing and public relations in ARL Libraries. SPEC Kit 240, Washington
D.C.: Association of Research Libraries. 1999. p.4 Retrieved from
http://www.arl.org/spec/240fly.html May 24, 2005
7. Library services in non-library spaces. SPEC Kit 285. Washington D.C.:
Association of Research Libraries. 2004. p.10 Retrieved from
http://www.arl.org/spec/SPEC285web.pdf June 1, 2005
8. Among these we found the following three titles particularly helpful in under-
standing library marketing issues in a number of areas. They were Eileen
Elliott De Saez’s Marketing concepts for libraries and information (Facet
77
publishing, 2003), an edited volume by Dinesh K. Gupta and Ashok Jambheka’s
An integrated approach to services marketing: a book of readings on marketing
of library & information services (Allied Publisher, 2003), and an edited volume
by Rejean Savard, Adapting marketing to libraries in a changing world-wide
environment (K.G. Sauer, 2000)
9. Shontz, Marilyn L, Parker, Jon C. and Parker, Richard. “What do librarians
think of marketing? A survey of public librarians’ attitudes toward the marketing
of library services,” The Library Quarterly, vol. 74, no.1 (January 2004): 63-84
10. Tovote, Christina. Marketing and Swedish libraries, about the situation today
and the importance of visible librarians. In Adapting marketing to libraries
in a changing and world-wide environment: papers presented at the 63rd IFLA
Conference, Copenhagen, September 1997. Edited by Rejean Savard. K.G.
Saur: Munchen. 2000. pp.40-44
11. Nardi, Bonnie A. and O’Day, Vicki L. Information ecologies: using technology
with heart. Cambridge, Massachusetts and London, England: The MIT Press.
1999. p.81
12. Nardi and O’Day, p.102
13. “At the Mall, a renewed focus on the customer, ” by Jacquline Trescott, The
Washington Post National Weekly Edition, April 25-May 1, 2005. p.34
14. De Saez, Eileen Elliott. Marketing concepts for libraries and information
services. London: Facet Publishing. 2003. p.11
15. Shontz, Marilyn L, Parker, Jon C. and Parker, Richard. “What do librarians
think of marketing? A survey of public librarians’ attitudes toward the marketing
of library services,” The Library Quarterly, vol. 74, no.1 (January 2004): 63-84
16. 2004-2005 Rutgers Fact Book, Retrieved from
http://oirap.rutgers.edu/instchar/factpdf/enroll04.pdf, May 24, 2005
17. Library Communication Strategies, Inc. Communication analysis for the
Rutgers University Libraries: Executive summary of key findings & recom-
mendations. July 30, 2004. Unpublished report. p.1
18. DeSaez, p.38
19. Library Issues: Briefings for Faulty and Administrators vol. 23, no.3,
(January 2003), Retrieved from
http://www.libraryissues.com/pub/LI230003.asp), May 2005.
20. Kuchi, Trivini, Mullen, Laura Bowering, and Tama-Bartels, Stephanie.
Librarians without borders: reaching out to students at a Campus Center,
Reference & User Services Quarterly, 43(Sept, 2004): 310-317.
21. Kuchi, et. al. p.317
22. The hours of staffing of these service stations varied. The Alexander Library
reference desk was staffed from 9am through 9pm Mondays through Thurs-
78
days, 9- 5pm on Fridays, 1-5pm on Saturdays and 12-7pm on Sundays. The
two @Campus Center service stations were originally planned to staff from
11am through 8pm Mondays through Thrusdays and 5-9pm on Sundays.
However, due to staff shortage and slow activities, not all hours were staffed
as originally planned during this two week period. Ask A Librarian is a 24/7
Rutgers email virtual reference service.
23. The Alexander Library reference desk does not record access questions as a
separate category. Most access questions (particularly the requests for PINs)
would have been considered as directional unless the question required a
response of reference assistance—such as verification of an ILL citation.
24. We were not able to separate the status of users in this data.
25. Kuchi, et. al. p.317
26. Lipow, Anne G. Serving the remote user: reference service in the digital
environment. Retrieved from
http://www.csu.edu.au/special/online99/proceedings99/200.htm
May 24, 2005.
27. Starr, Paul. The creation of the media: political origins of modern communi-
cations. New York: Basic Books, 2004. p.1
28. “Gladwell speaks at president’s program,” by Alberta Davis Comer, ALA
Cognotes Boston Midwinter 2005, p.1 and 12
29. Gupta and Jambhekar, p. v
Abstr act
The concept of “marketing” or “public relations” is still an underdeveloped (indeed,
perhaps unrecognized) area in academic librarianship. In order to advertise library
resources and to teach library research skills, academic librarians have been
increasingly successful in building partnerships with academic units and course
instructors. Building partnerships with non-academic units has not, however, been
frequently explored.
This paper examines library collaborations with campus partners who are not
directly involved in student academic activities yet who have an enormous impact
on the quality of student life and on factors that influence academic success. The
paper explores the concept of physical and virtual library outposts, of using campus
physical spaces, such as campus centers and campus buses (which are not normally
considered to be part of student intellectual life) to inform students about library
resources. How these concepts were applied in developing campus outreach pro-
grams is a central focus. The paper presents five representative campus outreach
programs that used non-academic units as the venue for marketing. Partial findings
of the effectiveness of such programs are also presented.
79
Quality Standards: Public libraries
on the island of Montreal
Louise Guillemette-Labory
Associate Director
Pierre Meunier
Advisor in Standardization and evaluation
and management information
Planning and development Department
Montreal Public Library System
Canada
80
lations of 5,000 or fewer inhabitants are served by a network of Public Library
Regional Service Centres (Centres régionaux de services aux bibliothèques publiques,
CRSBP), non-profit private corporations that are financed largely by means of
subsidies paid by the Ministry of Culture and Communications of Quebec. These
regional organizations will be concerned by supplying and cataloguing of docu-
ments for these small libraries. Besides, a great majority of the 165 public libraries
localized in the largest municipalities (serving 5,000 or more residents), are managed
by their municipal administration by virtue of their municipality’s charter. The
Ministry of Culture and Communications sets up different grant programs to
support the development of library networks.
In the late 70’s and early 80’s, the Government of Quebec began a major deve-
lopment plan for public libraries by including grant programs targeting municipali-
ties. At the same time, operating standards were proposed. These would be the
subject of major revision in 1996, under the responsibility of three associations of
the Quebec documentary sector (Association pour l’avancement des sciences et tech-
niques de la documentation (ASTED), Les Bibliothèques publiques du Québec
(group of Directors of Quebec public libraries) and Regroupement des CRSBP)1
These standards concern resources only and most of these resource indicators are
established according to the population served.
In 1985 and 1986 we experienced major cuts in provincial government funding
and an inquiry committee was then created (Commission on public libraries —
the Sauvageau Committee). Following this Committee’s findings, new rules of
grant allocation were established. Subsequent to revision of the parameters of the
annual survey of statistical data in 1992 and revision of the standards guidelines,
Pour des bibliothèques québécoises de qualité: guide à l’intention des bibliothèques
publiques, in 1996, (joint project by the three associations: Association pour
l’avancement des sciences et techniques de la documentation (ASTED), Les
Bibliothèques publiques du Québec and Regroupement des CRSBP, the following
year the Government proceeded with consultations on the future of public libraries.
These hearings enabled the Ministry of Culture and Communications of Quebec to
implement, in 1998, a three-year public reading program. As government inter-
ventions centred only on enriching book inventories, they obtained rather miti-
gated results and did little to improve the quality of the documentary services.
Finally, over the last two years, the Government of Quebec introduced some
important modifications concerning the grants distribution program. Concerning
the standards guideline, this one is under revision process now with the coordi-
nation from ASTED and will be probably completed in 2006.
Consequently, according to the statistical and financial data published in
annual reports from ministries of the provinces of the Alberta, British Columbia,
81
Ontario and Quebec in charge of programs to public libraries, we have to recog-
nize that the public libraries of Quebec suffer from chronic underfunding com-
pared with the libraries of the other Canadian provinces. For example, in 2001, the
public libraries of Quebec spent 30.1% less money per capita (or $27.35 CAN /
inhabitants) compared with an average spending of $35.58 CAN by the libraries of
three other large Canadian provinces: Alberta, British Columbia and Ontario.
This underfunding has the effect of considerably reducing inventory renewal;
public libraries in Quebec have 2.58 books per capita compared with 3.02 in the
three other provinces, a deficit of 17.1%. It is especially at the level of personnel
that we find a more substantial deficit, in Québec there is 0.63 FTE per 2,000
inhabitants compared with 1.04 in the other three provinces (a deficit of 65.7%).
Finally, overall library use is far less with just 5.9 loans per capita compared with
10.12 in these provinces (a deficit of 71.5%).
Concerning Public libraries on Montreal Island, these ones spent, in 2002,
11.8% less money per capita (or $38,3 CAN / inhabitants) compared with an
average spending of $43.4 CAN by 7 Largest and Urban Canadian Library Systems
serving 500,000 inhabitants and more. Again, this underfunding has the effect to
create an important deficit in term of staffing: 0.52 librarians per 6,000 inhabi-
tants compared with 0.76 in other Canadian Large and Urban Libraries (a deficit
of 31.6%) and 0.95 employees per 2,000 inhabitants compared with 1.24 in the
same Large public libraries in other provinces (a deficit of 23.4%). So, it is not
a surprise to have a large disparity in terms of loans per capita (6.5 at Montreal
compared to 12 in other 7 comparable largest Canadian public libraries – a deficit
of 45.8%).
Finally, the merging of municipalities in January 2002 and the opening, in
2005, of the Grande bibliothèque du Québec, have had and will have, major
impacts on the development of the Quebec public libraries and more specifically at
Montreal.
82
Service points Borough limit
83
gations are specified by classes 143 until 146 of the new City Charter of Montreal.
They must fix the level of services in each of the boroughs to assure service offerings
in municipal libraries. Furthermore, by virtue of this legislation, the application of
standards may not in any way compromise the autonomy of local library service
management by Direction of boroughs. This legislation confirms the management
autonomy of the boroughs as it relates to libraries. This is no mean feat, requiring
a reasonable limit on the projected normalization process.
Second reason, the borough budget must be established by respecting these
minimum service standards. The objective of establishing such standards is mainly
to secure equality in documentary services for the citizens of the 27 boroughs by
protecting a minimum threshold defined by norms. For this purpose the balance in
endowments process will be based in function of disparities to minimal standards
and the service levels will be defined by Consolidation plan. The quality standards
must guarantee the minimum service levels in each borough.
Third, Québec Standards are not adapted to the required needs in term of
quality indicators for Montreal Public libraries System:
Finally, the fourth reason is the quality standards are essential parameters to sup-
port the Network consolidation on these three levels: to assure fine tuning of the
new network, to secure quality of document services offered and to introduce a
model of service levels.
84
cipated degrees of use of the resources and the services and the proximity of ser-
vice points) of libraries, and the reorganization of the new library system. These
quality standards will be determined with purpose to realize these six objectives:
• to offer equitable access to document services2;
• to assure library effectiveness in providing users with document services;
• to optimize efficiency of the reader advisory services offered;
• to harmonize the services with the City of Montréal’s strategic plan;
• to consolidate the newly reconstituted network and plan the activities
that remain;
• to propose minimum standards in keeping with the socio-demographic
characteristics of the boroughs.
Boroughs:
2 directors (Culture, Sports, Leisure and Social Development)
6 divisional heads (Culture and Libraries)
Central services:
• Finance
• Associate Direction of Libraries
• Associate Director
• Divisional head
• 2 advisors in document resources
By virtue of these four activities, the Direction of Montreal Public libraries gave
to the Committee of Minimum standards the following mandate:
85
or application bases recommended for each of the specific objectives to fix
just and fair minimum thresholds;
• identify the relevant performance indicators for each of the minimum service
standards retained;
• clarify harmonization efforts of information management to grant and to
propose modalities to achieve goals;
• recommend a strategic plan of application and the phases of establishing
the new minimum service standards;
• devise appropriate follow-up reports integrating the selected performance
indicators (as balanced scorecard).
86
As well as assuring the supervision and validation of the analysis work, the
service standards committee defined the parameters of its mandate to well defi-
ne its reach regarding the execution of the diagnostic of the state of the opera-
ting situation and the consolidation of the library system Furthermore, it identi-
fied the sectors in which standardization could be useful to be developed and will
be susceptible to future interventions, the main concerns of management and
activities appropriate to each.
The realization of this multi-action project is extremely important, a plan that will
determine how the new library system is consolidated and which is indispensable to
the successful application of the consolidation plan. Beyond the characteristics
revealed by the analysis and the operational analyses as well as the more specific
projections ensuing from the first exercise, the standards committee considered the
repercussions of the cultural policy statement of the new city, this policy was pre-
sented during autumn 2004 and that stems from ideas generated by the Montreal
Summit in 2002. It must also consider operating results since the merger, among
them the impact of user migration, the beginning of work on harmonizing the
systems and the impact of work by political consulting committees. Furthermore,
87
the opening of new units in the library system deserves an updating of examina-
tions undertaken within the framework of the analysis.
Finally, the development of new standards must take into account the opening
of the Grande bibliothèque du Québec, combining the vocations of national
library and research centre as well as public reference library.
The Assessment is the first step of our transverse approach as an integrated planning
system.
This work was overseen by the Committee on the minimal standards of services,
which we described before. A preliminary report was submitted to the Ministry of
88
Culture and Communications of Quebec in August 2003. An improved version
including a more detailed description of the strengths and weaknesses of some
components of the library system and a comparative analysis is now underway.
The purpose of this new version is to facilitate the identification of priorities of
consolidation and development. This will support our negotiations with the
Ministry of Culture and Communications as well as help to plan the upcoming
consolidation of the library system, to develop new standards adapted to the
application of new strategic developmental axes to better adapt the service offer
to the diverse levels of documentary services in Montreal and to introduce per-
formance indicators. The first part of our presentation consisted to dress the
principal weaknesses and disparities of service points in 27 boroughs relatively
to Annual opening hours, Staff, Document resources and Area Space.
89
The results of our Assessment were presented in details in the first part of our
presentation at Bergen’s Conference and this one can be accessible on our web
site to the address http://www2.ville.montreal.qc.ca/biblio/ (click on the red icon
named DIAGNOSTIC (Version anglaise PDF – 3.7 Mo) to download the English
version).
90
especially those that have adapted similar approaches, such as those in Europe.
Evidently, the definition of strategic axes and specific objectives in the Mon-
treal public library system is largely inspired by work done in this field in Great
Britain. We particularly referred to the plan of British development presented in
2003 by the Department for Culture, Media and Sport in its document, “Frame-
work for the Future: Libraries, Learning and Information in the Next Decade4”.
This plan is based on standards proposed before in the document: “Comprehen-
sive, Efficient and Modern Public Libraries; Standards and Assessment5”.
91
We present in next Table these five (5) strategic goals.
Seven of these specific objectives can be associated with the consolidation of the
library system, whereas the others are more in the order of a plan of strategic
development, over the more or less long term. As a result, we considered that the
development of minimum service standards first had to be carried out according
to the orientations given to the consolidation of the library system.
The sub-committee also raised a list of management concerns associated with
each of these specific objectives. For the moment, there are 46 of these concerns.
Finally, certain means (50) allowing us to realize these management concerns were
identified.
So, the first strategic goal “Access to quality of service” will be assure by the
realization of these five specific objectives:
• provide appropriate facilities and spaces;
• implement basic services in each boroughs;
• purchase adequate and diverse resources of library materials and offer
required quantity of documents;
• provide adequate and qualified human resources;
• collaborate with the Bibliothèque nationale du Québec.
Second strategic goal « Increase readership and usage by people less than 18
years of age » will be supported by expanded services for young people. This is
the sixth specific objective.
92
Finally, the third strategic goal concerning the role of libraries as tool of inte-
gration and social development consists to offer collections and develop specific
programs customized for varied target clientele. It is our last specific objective of
Consolidation plan.
Next figures dress these specific objectives in function with these three strategic
goals of first part of Business plan focused on consolidation of library system.
93
Regarding these 14 fields of normalization, different analyses and simulations
will be carried out over the next few months to determine the number of norma-
tive (minimum standards) and performance indicators. It is difficult for the
moment to overestimate the number of indicators which can be proposed follo-
wing this work. At the time of this writing, we are at the stage where we are
determining, for each of these 14 standardized fields, the list of dependent vari-
ables to identify the components of the eventual indicators, determine indicators
that must be simulated as well as the potential bases of application to be tested
(e.g.: population density, indication of socio-economically underprivileged popu-
lation, degree of clientele proximity, etc.), while favouring diversification of stan-
dards according to groupings (or families) of libraries and the level of service
offer. For example, standards indicators could express themselves as follows:
• surface area required according to the level of services (indicator of the
standards in human resources and inventories of required collections) and
of socio-demographic factors (as population density within radius of service
area);
• number of FTE required according to the population density within the
radius of service offer and the level of offered services and an early indication
of use (indicate to define);
• number of books required in function of rotation rate X and of a anticipated
lending rate per capita Y— the whole of which can be the object of a stronger
indication taking into account the use and the aging of collections compared
to a level of targeted service or a targeted rate of use.
94
But, the principal indicators, by benchmarking with Large and Urban compa-
rable Canadian libraries, are now determined.
First one, the surface area per borough, will be fixed to 57 m2 per 1,000 residents.
95
public library system indicate us that 50% of boroughs offer service points with
a large deficit of areas. Also, the deficit of spaces is very variable for 15 boroughs
and is larger in the former Montreal territory specifically in the central area of
the city in which the density of population is substantial.
This disparity of deficit in spaces according to required space is well illustrated
by the present map. Less than 20% of boroughs have less than 50% of required
space recommended by Standards of Quebec. But 40% of boroughs are served
by libraries localized in buildings with larger space (or area) as recommended by
Standards of Quebec.
Finally more than 60% of boroughs offer less space in comparison with the
mean space (57 m2 / 1,000 inhabitants) of large Canadian public libraries serving
500,000 inhabitants.
Besides, the Montreal territory is characterized by a marked variety with the
concentrations of population. For example, 50% of Montrealers are localized in 7
boroughs. These 7 boroughs cover 33% of territory superficies on Montreal Island.
According to Standards of Quebec, the population to be served should be localized
inside of a radius of service equivalent to 1.5 km.
We illustrate on next map the service areas (in term of radius of service). The
concentration and overlap of radius of service, localized specifically in the center of
the Island of Montreal, should not be considered as overestimates service to real
needs. Some simulations were analysed to identify the real deficit of service points
or library services on the territory.
96
The simulation of radius of service equivalent to 0.75 km for libraries localized
in borough with a very large density of population should be probably more
appropriate, illustrating the deficit in service points. Also, for boroughs with less
density of population, the size of radius of service could be increased more than
1.5 km as recommended by Standards of Quebec as 2.0 or 2.4 for boroughs with
weak density of population. This analysis will facilitate the determination of basis
or criteria of application of minimum standards in function of proximity indicator,
density of population, distance between neighbour libraries and socio-demographic
characteristics of boroughs.
This approach is used to optimise the reduction of disparities in term of served
population. The new criteria of application of minimum standards based on density
of population and other socio-demographic factors instead of served population is
more appropriate and relevant in regard with a urbanized territory as in Montreal
and open new perspective levels of services and inter-boroughs cooperation.
The second series of minimal standards of services concern the access to basic
services. According to benchmarking study of opening hours offered by boroughs,
against the large deficit and disparity of opening hours offered by some
boroughs, we propose to increase substantially the opening hours. We introduce
this global approach:
97
The third category of quality standards concerns the required resources of library
materials. We propose a required collection of printed monographs based on target
of National promoting program, 3.0 books per resident for each borough.
98
inally, the last standards concern staffing: according to benchmarking with
human resources of Large and Urban Canadian libraries we propose to increase the
number of employees from 0.95 employees per 2,000 residents for all boroughs to
1.24 employees. On the same way, we increase the number of librarians from 0.52
to 0.76.
99
Furthermore, next months, after the up-dating of data used for the assessment,
we will determine other minimal standards on specific resources to support level
of services in liaison with planned and anticipated output. Before the implemen-
tation, it was important to define the first level of services (free basic services).
We mean the Services that must be offered in order to maintain a functional
library. These Services were determined by Managers of library services in boroughs
and members of Committee of Minimal Standards and Experts working on
Planning and development of new Programs to the Central Services.
The List of free basic services to be retained is presented in next figure. The met-
hods of providing the range of basic services will be covered by minimum stan-
dards.
The coverage of standards will be on these three levels in function of services and
will provide to support any issues of inter borough collaborations:
• Libraries;
• Boroughs;
• Network:
• All boroughs and the associate Direction of Libraries
• Interborough
Consolidation plan
According to priorities determined in Assessment report and disparities with
Large and Urban Canadian public libraries we estimated the required funds for
100
Montreal Public Libraries System to achieve minimum standards of quality des-
cribed in the previous part of this presentation. The timeline of this Consolidation
plan is next 10 years. This one includes recurrent expenditures (operating expen-
ditures) and investments corresponding to expenses of more than 200,000 millions
of Canadian dollars. The next two figures present these investments.
101
• Build up a basic document service
• Diversify the availability of service levels while taking local characteristics
into account
• Implement a network service while relying on inter borough cooperation
and the support of central services – for increased efficiency
• Improve coverage of the region, taking socio-demographic disparities into
account
• Increase the user base by approximately 7 million visitors
• Increase the lending rate by 9.6 million loans
This one intervenes at two levels represented well in our plan. The median level
illustrates again the dependence between the specific objectives of the library system
and the normative indicators function of different criteria established by means of
preliminary simulations.
102
As for the lower level, indicators of performance are selected to estimate:
• the relevance of specific objectives in regard with the needs of library users;
• the appropriateness of specific objectives and resources (documents, human
resources, buildings and equipments), selected activities and services;
• the evaluation of distance between specific objectives and means;
• the effectiveness of activities conducted by the library on social level (impact
of documentary services and resources) and in terms of quality (satisfaction
in regard of services);
• the efficiency of means used (staff, documentary resources and financial
resources) from the point of view of the productivity while optimizing the
costs of operation;
• the evaluation of impact of services in function of projected specific objectives;
• the evaluation of the outcome or of the impacts on served population in
function of services offered.
So, the minimal standards of service are in the heart of the Plan of consolidati-
on and the introduction of the indicators of performance allows to make sure
that not only the minimal standards of service are affected but that the Plan of
consolidation comes true in a optimal way and allows the new library system to
meet the needs adequately.
Furthermore, next year, in the light of the recognized indicators either by the
International Standards Organization (ISO 11620) or by American Library
Association or as needs be, following our own model, measures of performance
both at the resource and at the output levels will be determined.
Conclusion
We could conclude by considering that the project of new normalization begun by
the Public Library System of Montreal exemplify a basic principle. The selection of
indicators and measures of performance must always relate to the plan of strategic
development of the library by referring to the specific objectives. Furthermore, the
choice of statistical data, normative indicators and measures of performance must
address the needs of the relevant stakeholder groups and support the Business plan.
With regard to Standards of Quebec in comparison to the large urban library
systems in Canada, certain libraries of the suburbs of Montreal are short of docu-
mentary and human resources. Benchmarking shows the need to reduce major socio-
demographic disparities by reviewing the location of certain service points and
the possible implementation of auxiliary services. The new Public Library System
of Montreal will develop a more adapted set of standards based on the identifi-
cation of strategic axes and specific objectives. Looking at the benchmarks, it seems
103
necessary that the new standards should define service levels based on groups of
libraries. Within the framework of the first phase of the project, an exercise of
“prioritisation” of 14 fields of standardization will identify the main standards
which will bring about consolidation of the new Library system.
Finally, before proceeding to the second phase of creation of minimum service
standards, we intend to begin the process of harmonizing management information
management information to make sure of the comparability of the performance
measures that will be eventually put into effect. Also, we intend to develop, with the
collaboration of recognised experts, follow-up tools or quality control measures
with a Balanced-scorecard, not only to make sure of the efficiency of the activities
put in place in view of the strategic plan but especially to evaluate the outcome
resulting from this first phase of the implementation of the strategic plan.
Notes
1 Pour des bibliothèques québécoises de qualité: guide à l’usage des biblio-
thèques publiques. Montréal: ASTED with Les Bibliothèques Publiques du
Québec and Le Regroupement des CRSBP du Québec. 1996. 104p.
2 For reference see the model on the evaluation of social impact of public
libraries proposed by the Department of Information studies of Sheffield
University: Usherwood, Bob et Rebecca Linley. 2000. Evaluating equity in
public library services. Journal of Librarianship and Information Science
32 (June): 72-81.
3 Fuegi, David. 2004. Recent developments in the application of statistics,
standards and performance indicators in public libraries in England.
In Libraries: Tools for education and development – World Library and
information Congress: 70th IFLA General Conference and Council.
Buenos Aires: IFLA, session no 131.
4 Framework for the Future: Libraries, Learning and Information in the Next
Decade. London: Department for Culture, Media and Sport, 2003. 59p.
5 Comprehensive, Efficient and Modern Public Libraries; Standards and
Assessment. London: Department for Culture, Media and Sport, [2000]. 18p
6 Giappiconi, Thierry. 2001. Manuel théorique et pratique d’évaluation des
bibliothèques et centres documentaires. Paris: Cercle de la librairie, 223p.
Abstract
Following the merger of 28 municipalities on the Island of Montreal (Canada),
the analysis on the state of this library system revealed an imbalance between the
service offer and the demand. Compared to the “Standards of Quebec” and other
urban library systems in Canada, certain borough libraries of Montreal demon-
104
strate marked deficiencies to the spaces and documents. Concerning the current
library service, major disparities from the point of view of socio-demographic
characteristics demand. Re-evaluation of the location of certain points of service
and the possible implementation of auxiliary services. The consolidation envisaged
for the new library System of Montreal will realized by creating new minimum
service standards favouring levels of service offers and groupings of families of
libraries, as well as introducing performance indicators. These two types of inter-
vention will be defined according to a strategic plan of five axes or strategic
objectives, 17 specific objectives and a little more than 40 management concerns.
A first phase of the project is already underway to determine normative and per-
formance indicators for 14 fields of standardization considered to be priorities
and support a Consolidation plan. The new standards will be determined for
each group or family of libraries in reference to an integrated analysis (simulation)
by quartiles and comparative study of socio-demographic characteristics, resources
and anticipated degrees of use of the resources and the services. The first main
standards concern Library material resources, opening hours, required human
resources, location of service points and spaces based on density of population
and socio-demographic factors instead of served population are more appropriate
and relevant in regard with urbanized territory as in Montreal and open new per-
spective of inter-boroughs cooperation. The free basic services that be offered in
each boroughs are determined and the consolidation plan proposed to reduce
disparities and to achieve new minimum standards of quality is briefly described.
Résumé :
À la suite de la fusion des 28 municipalités localisées sur l’Île de Montréal
(Canada), le diagnostic sur l’état des bibliothèques publiques révèle un déséqui-
libre important entre l’offre et la demande. En regard des « Normes du Québec »
et en comparaison aux grands réseaux de bibliothèques canadiennes, certaines
bibliothèques d’arrondissements de Montréal dénotent des carences marquées
aux plans des ressources documentaires, des heures d’ouverture, des ressources
humaines et des espaces. Au chapitre de la desserte actuelle des bibliothèques, des
disparités majeures sur le plan des caractéristiques socio-démographiques engen-
drent la réévaluation de la localisation de certains points de service et l’éventuelle
mise en place de services d’appoint. La consolidation prévue du nouveau réseau
des Bibliothèques de Montréal se réalisera par la conceptualisation de nouvelles
normes minimales de service, favorisant l’offre de niveaux de service et la seg-
mentation par regroupements de familles de bibliothèques, ainsi que par l’intro-
duction de mesures de performance. Ces deux types d’intervention seront définis en
fonction d’un plan stratégique composé de cinq axes stratégiques, de 17 objectifs
105
spécifiques et un peu plus d’une quarantaine de préoccupations de gestion. Une
première phase du projet est en cours afin de déterminer les indicateurs norma-
tifs et les mesures de performance des 14 champs de normalisation jugés priori-
taires en vue de soutenir la mise en œuvre d’un plan de consolidation du réseau.
Les normes principales concernant les ressources documentaires, les heures d’ouver-
ture, les effectifs requis, la localisation des points de service et les espaces établies en
fonction de la densité de population et des caractéristiques socio-démographiques
au lieu de la population desservie sont mieux adaptées à un territoire fortement
urbanisé comme celui de Montréal et ouvrent une perspective de collaboration
inter-arrondissements. Les services de base gratuits devant être offerts dans chacun
des arrondissements sont également énoncés et un plan de consolidation afin
d’éliminer progressivement les disparités et de permettre l’atteinte des nouvelles
normes de qualité est brièvement décrit.
106
“Using Customer Data for Improved Strategic
Marketing Planning and Decisionmaking”
Dr. Christie Koontz
GeoLib Program
Florida State University
C2200 University Center
Tallahassee, FL. USA 32306
Introduction
Awareness of and access to geographic data is complex and new to many profes-
sions, including librarianship. Geographic data is best described as information
such as the geographic boundaries of the neighborhood the library serves, charac-
teristics of the people who live there (age, language spoken, level of income and
education), and how far library users and potential library users live from the
library. Library research indicates all these factors which are geographic in nature,
affect library use. Which materials and services are consumed is called library use
data. Collectively, these data are often called ‘customer data’ in the business world.
This paper introduces: 1) the four-step marketing model; 2) the critical nature
of geographic/customer data relevant for strategic marketing planning and decision
making in public libraries (although other types of libraries may also benefit); and
3) new technologies that facilitate use of geographic data such as GIS (geographic
information system software) and the US Public Library Geographic Database
developed by the GeoLib Program, Florida State University, Tallahassee, FL, USA,
www.geolib.org/PLGDB.cfm .
107
often consider that they serve the whole of the public, and lack incentive to gather
customer data. This may create a less competitive edge for the library. By contrast,
collection of this data provides strategic insight into exactly who chooses to use the
library, for what, how far they will travel, and how much time they will spend
procuring library offerings, which ultimately affects type and level of library services.
The Answer….Competition
Libraries are facing market competition like never before. Customers are eliminating
actual library visits and accessing library databases via their desktop. Avid readers
are logging onto Amazon.com rather waiting for interlibrary loan. A plethora of infor-
mation resources continue to burgeon via broadcast, print and online. Customers
108
Figure 1. The Four Step Marketing Model
face many choices. The library is no longer the premiere community information
provider. Parallel—libraries are vying with other public agencies for same public
dollars. And the greatest competitor for any group is simple acceptance of the
status quo. This attitude, which overlooks customers’ changing expectations, leaves
many a business with a ‘closed’ sign swinging from the front door.
Any agency facing competition must prioritize gleaning and gaining cutting edge
customer data. For libraries—it is more important than ever to identify changing
customer characteristics and information needs. This is necessary for libraries to
viably compete, and offer the most desired and effective services and materials
possible. Simply, there is less and less margin for wasted effort of staff or funds.
In today’s increasingly heterogeneous and technologic society, dynamic and
ongoing customer research is crucial to provide library services and materials
that meet complex needs in ever-changing communities. Also, available research
regarding customer use of public libraries indicates that for certain groups such as
the elderly, juveniles, lower income or minority or immigrant groups—libraries
must be placed within ‘stumbling distance,’ (this also includes easy computer
access)—for these groups to have the opportunity to develop the skills associated
with library use, including the reading habit. Not only can something as obvious
as distance or lack of transportation be a prohibitive factor to library use, but also
109
more subtle cultural barriers can be identified, such as the beginning or the end of
a perceived neighborhood. Some groups do not and will not travel beyond that
invisible line. Library managers must be cognizant of what changing factors increase
and decrease the customer base. Other public sector agencies successfully adopted
marketing research practices to identify competitors and better address the unique
needs of customer markets. Why not public libraries?
110
This market data is external to the library – or extracted from external environ-
ments outside of the library’s immediate control. Interestingly enough, most libraries
collect this type of data for customer use. See figure 2 for an example of a libra-
ry and its external environment.
It is important to remember people choose to spend their time traveling from
their home to places to purchase or access services. It matters to customers how far
they have to travel – and therefore, it must matter to library professionals where
customers live and the possible distance they will be required to travel. People
primarily travel by foot, bus, subway, or car. Without a geographic market area deter-
mination the characteristics of the people that live there can not be described. For
libraries serving changing populations with changing information needs, this user
information is critical. While libraries rarely map customer data, they have in the
past needed to ascribe service areas to branches to assess the presumed extent of
library services geographically. This presumption is often inaccurate and not based
upon true customer dispersion.
111
Figure 3. Estimated Geographic Market Area Using
a Radius and Subsequent Population Totals.
1. A base map is a map that has a known acceptable level of accuracy that is accurate enough for the
geometric control of other positional information (i.e., one can accurately “overlay” with other geo-
graphically-referenced data to this base map.)
112
The other key data set is annual library use data for public library entities
collected by a federal agency. These data are linked to the digital base map of
approximately 9,000 library entity locations throughout the US.
113
Figure 4. Customer Segmentation
of a customer segment mapped on the US PLGDB. This type of map display, and
subsequent extraction of data from within the radius selected, provides quick review
and data for managers asking ‘what if’ and ‘how many’ questions. For example, ‘what
if’ the library closed—how far is it to the next facility, and how many people are
possibly affected by the closure? Or ‘how many’ people live within two miles of the
library?
114
(marketing evaluation) be completed, which identifies whether or not the offer is
a success.
References
Christie Koontz, Dean K. Jue, Charles McClure & John Bertot. (2004). The
Public Library Geographic Database : what can it do for your library ? Public
Libraries vol. 43, no. 2, 113-118.
Christine M. Koontz. (2001). Marketing research: a useful tool for libraries.
Marketing Library Services, vol. 15, 4-5.
Christine M. Koontz (1997). Library Facility Siting and Location Handbook.
Westport, CT: Greenwood Press.
Summary
The purpose of this paper is three fold to: 1) introduce the four steps of systematic
marketing; 2) identify the critical nature of customer data required for successful
marketing; and 3) introduce a new tool for strategic marketing planning and decision-
making at www.geolib.org/PLGDB.cfm.
Yet this contribution in an international forum, within countries’ varying levels
of availability of population data and technologies, is offered more importantly to
acknowledge the critical nature of library customer data for effective planning and
decisionmaking. A manager does not need an Internet-based map of customer
data to be effective. A manager needs first-hand knowledge of customer market
areas and the needs and desires of the actual and potential customers who live
there. Technologies only facilitate effective planning—yet can not now or in the
future create critical customer data, or strategic use of same. Only a library manager’s
acumen and willingness to implement systematic marketing can effectively accomp-
lish this.
115
Library statistics without Fear
Ellen Maleszewski and Michael Bailou Huang
Health Sciences Center Library
Stony Brook University
8034 SUNY, HSC Level 3, Room 136
Stony Brook, NY 11794-8034, USA
[email protected]
[email protected]
I. Introduction
In today’s world, the concept of calculating statistics is still frightening, yet the
actual calculating part is now automatic. With programs such as Microsoft Excel or
SPSS, the “number crunching” side of statistics is no longer arduous. However,
the concepts of statistics are still difficult for some to grasp. Most often, the truly
grueling statistical functions are only necessary when an experimental research
study has occurred. For most daily functions, the basic statistical functions or
descriptive statistics are all that are needed.
Knowing how what statistics are used is essential for all librarians. They are an
important aspect of budget rationales, usage reports, patron trends and other indi-
cators that librarians would use to manage the library. They are required when
summarizing results from surveys. They are a vital part of “benchmarking” or com-
paring from library to library. Research that is reported in library literature or for
any professional literature will require an understanding of statistics. Reference
librarians should be able to grasp results of professional literature reporting sta-
tistics, so that they can guide patrons to the information that they are seeking.
116
Examples:
117
II. Concepts of Statistics
Descriptive Statistics: Why use them?
Statistics are facts and figures. The purpose of statistics is to utilize rules and
methods, to organize and interpret observations. Generally, there are four types
of statistical tests; Descriptive, Parametric test for means and mean differences,
Nonparametric tests, and Measures of relationship between two variables
Descriptive statistics is the most well known statistical tests, as they are the foun-
dation of all types of statistics. The purpose of descriptive statistics is to summa-
rize data. They are the best type to use for summarizing surveys, trends in pur-
chasing, trends in usage, and other “non-experimental” data collection that
libraries do on a daily basis. Hypotheses are not required! The 4 different types
of descriptive statistics tests are: (Gravetter)
1. Frequency Distribution tables and graphs
Frequency tables and graphs are easy to create and give a snapshot of all
your observations. The different types of tables and graphs are; the frequency
table, the stem and leaf display, a pie chart, line graph, bar graph and histo-
gram.
2. Measures of central tendency
Some of the Measures of central tendency are the mean, median, and the
mode. The purpose of the central tendency is to find one number that repre-
sents the entire set of data by being a measurement of the most typical score.
So the “summary” is one number representing many. This works well with
large numbers of data because it can be too complex at times to graph
enormous data sets.
3. Measures of variability
The measure of variability is also one number that represents an entire set
of data. What it measures is how the data varies from score to score.
Standard deviation is an example of a measure of variability. Standard
Deviation is the average distance of each score from the mean. Range is
another example, it tells you the length of your score set (minimum to
maximum score)
4. Z-scores-
The z-score is a measure of each individual score. Where as the Central Tendency
is one score that represents many, the purpose of the Z-score is to measure
where an individual score lands in a distribution of scores. For example is
a score below the mean or above the mean?
Parametric tests for means and mean differences and nonparametric tests are utilized
for experimental data, when comparing populations, samples and a hypothesis has
118
been stated. The term parametric refers to the concept that one is creating para-
meters or a number which dictates whether your experiment proves or disproves
your hypothesis. It is then plausible to infer the results of the experiment from
the sample (that you experimented with) to the population that your hypothesis is
about. The parameters utilized are; the mean, the standard deviation and z-scores.
Nonparametric tests infer results in the same manner; they are just utilizing data
that cannot use the mean and other quantitative measurements because the data is
non numerical, it is categorical. (You cannot average gender for example). This is
known as inferential statistics.
You can use statistics to measure and describe relations. The data for these
statistics involve two observations for each individual – one observation for each of
the variables being examined. This is known as regression or correlations. Mea-
sures of relationships are well known to most. Correlation and regression are easy
to calculate and great for “observation” studies. Just remember they do not mean
causation.
The biggest problem for most people is to know when to use what. The usage
of statistics depends on two factors:
1. What are your variables? How are you measuring them? What are the scales
of measurement? The four scales of measurement are nominal, ordinal,
interval and ratio.
2. What are you trying to demonstrate? If you are trying to compare two samples
of data, z scores might be your route. If you are trying to show the change
over time, then a line graph would be a good choice. When trying to get
across the “big picture”, choose graphical or tabular statistics. When trying
to get a handle on the typical score, or if you are in need to show one score
in representation of many, choose central tendency.
119
How the data is summarized and reported will be dependent on what type of
data it is. As previously mentioned, there are four types of data; nominal, ordinal,
interval and ratio. The data types are what dictate the type of statistics utilized.
The nominal scale is not actually a scale as one would ordinarily think of one.
Actually, data that is nominal, is not numerical, it cannot be “measured”. Nominal
scales are just groups of data sorted and categorized. An Example is gender (who is
male, who is female). Eye color is another nominal scale. If you work in an aca-
demic library, and you keep track of who uses the library, faculty, administrative
staff, or students, each of those are categories and this would be known as nominal
data. Each category that you utilize to catalog information could be nominal data.
Ordinal scales exist for ranking. In an ordinal scale, items are ranked according
to their size or magnitude. The “numbering” that is utilized is not measurable other
than with your data. For example most surveys will utilize a Likert scale or the
other similar scales, the scale utilized with that system will be an ordinal scale.
Do you feel 1 2 3 4 5
you have learned
from this class?
The “1, 2, 3,4,5” really means nothing other than that “1” means something
lower than “2” the words could very well be used rather than the numbers, they
are interchangeable.
Interval scales have no absolute zero, however they do demonstrate magnitude.
What does this mean? In the above example, there is no real difference in “dis-
tance” between the 1 and the 2. The numbers used could have easily been 1, 3,
5, 7 and 9. Instead, look at the temperature scale. There is a difference between 1?
and 2?. In fact the difference is 1?. And that difference is the same as the differ-
ence between 2? and 3?. This scale has a zero, you can go below or above the zero.
However, we created the zero.
Ratio scales are the scales that are the easiest to measure. They are numerical
and measurable. Weight, time, and distance are all ratio scales. If you are keeping
track of the number of days an item is allowed to circulate, the number of days
would be a variable that would be a ratio scale. The weight of a book is a ratio scale.
The number of minutes computers are used for internet searches is a ratio scale.
120
The importance of your scales is as easy as this: you cannot do numerical
calculations to data that is nominal or ordinal. To work with that data, you need to
do frequency tables, frequency graphs or the mode. Interval and ratio data can
be multiplied, subtracted etc, in other words you can do mathematical calculations
with data that is quantitative. You can average the number of searches you do per
day!
121
To create a pie chart, you convert the percentage into a decimal and multiply it
by 360?. Example: 21.3% have bachelor degrees, so 21.3%=0.213. 0.213 X
360? =77?
(Example Modified from Moore 176-177)
b.) To create a bar graph, you would be working with nominal or ordinal data.
The height of each bar represents the number of times that category occurred, or
the frequency. It can be easier to draw then a pie chart, and can be better to use
when comparing items. Pie charts have to equal 100%, where as bar graphs, if
you add up the columns do not have to be part of a whole (or be equal to 100%).
The vertical axis should be the frequency (either a count or a percentage is fine) and
the horizontal axis should be the categories. In bar graphs, the bars do not touch.
Example:
You are tracking what databases your users utilize in your library – below is your data:
PubMed 69 (Medical Database) InfoTrac 88 (General Academic)
Web of Science 78 (Science Database) Proquest 190 (General Academic)
** Each database is part of the whole for the specific discipline they cover.
Frequency
Categories
122
c.) A line graph is used mainly to demonstrate change over time. One axis is the
measure of change, the other axis is time. Example: You have done a survey of
the number of staff in your library. You are comparing it to benchmark data,
which demonstrates the average of staff through the years.
Library Staffing
d.) Histogram-
Histograms are used when your data is interval or ratio (numerical). Again, they
are a frequency graph, and one axis is the frequency (or percentage). Unlike in
a bar graph, the histogram bars do touch. Think of using a histogram when you
are using central tendency numbers as well. It will give you the big picture plus
the central number. For example, you survey your area for household salaries.
The following histogram displays your results:
Histogram
123
e) Stem and Leaf Display
Stem and leaf displays are another graphical representation. You use this for
numerical data. You can use a stemplot when you have small data sets. It’s easi-
er to draw then a histogram, and gives you actual values. It gives the same infor-
mation. To make one
1. Separate each observation into a stem consisting of all but the final most
digit and a leaf is the final digit. Stems may have many digits but each leaf
contains only a single digit.
2. Write the stems in a vertical column with the smallest at the top and draw
a vertical line at the right of this column write each leaf in the row to the
right of its stem in increasing order from the stem.
Example:
2. Central Tendency
Trying to decide between mean, median and mode can be difficult. They are all
basically defined as the center number, representing the entire distribution.
You utilize the mean for numerical data (scales of measurement that are ratio or
interval) and for distributions that are normal. Your data has to be numerical,
considering the mean (or average) is a sum of all the scores divided by N or the
number of scores.
• For a population of N=4 scores, 3,7,4,6
Mean = Ì = ™X a 3+7+6+4 = 20 a 20/4 = 5
N
• A group of six students decide to earn some extra money one weekend picking
vegetables at a local farm. At the end of the weekend the students discovered
124
that their aver income was Ì = $30. If they decide to pool their money for
a party how much will they have?
You don’t know how much money each student earned. But you do know that
the mean is $30. This is the amount that each student would have if the total
were divided equally. For each of six students to have $30 you must start with
6 X $30 = $180. The total, ™ = $180
To check this answer, use the formula for the mean:
Ì = ™ X = $180 = $30
N 6
Restaurant Frequency
College Grill 5
George & Harry’s 16
What is the mode? Luigi’s
Because Luigi’s has the most Luigi’s 42
students who claimed it was Oasis Diner 18
their favorite (42) Roxbury Inn 7
Sutters Mill 12
What is the Median? The median is the middle score. You utilize the median when
you have numerical data and the distribution is skewed. Or, you utilize the median
when you have ordinal data (a type of categorical data). The median is most often
used when the data is skewed. Example: You work in a public library that has a
mostly poor population. Yet, in a survey that you have mailed out, you request
to know the salary range of your constituents. There might be one area, which
is very wealthy, but the majority of the population is not. Your survey results are
as follows:
125
35,000 37,500 100,000 30,675 31,003
35,000 36,400 100,000 37,251
28,000 40,850 85,000 36,223
40,000 29,750 33,750 35,313
80,000 30,605 33,750 33,113
The average or mean would be $45,199, yet the median would be $35,000. That
is a substantial difference. However, if I was to remove the data that is out of
the ordinary (the 80-100,000) then my average would be $34,364 and my
median would be $35,000. How did I calculate that? To get the mean I added
all the salaries and divided them by 21 (there are 21 scores).
To get the median I put all the numbers in order from lowest to highest and
counted 10 from each side.
Those 4 salaries that stand out are known as outliers. They are data that stand
away from the norm. If your distribution is skewed like this, you would choose
to utilize the median.
• Consider the following: 3, 5, 8, 10, 11. N = 5 scores.
And the middle score is X=8. So the median is equal to 8.0
• 3,3,4,5,7,8 Now select the middle score (4 and 5) add them and
divide them by 2 = 9/4 = 4.5
126
Although the concept of standard deviation is straightforward, the actual equa-
tions will appear complex.
X X – Xbar =
10 10-9 1
7 7-9 2
6 6-9 -3
10 10-9 1
6 6-9 -3
15 15-9 6
Step 3:
X X – Xbar = (X-Xbar)2
10 10-9 1 1
7 7-9 2 4
6 6-9 -3 9
10 10-9 1 1
6 6-9 -3 9
15 15-9 6 36
Step 4:
Sum the squared deviation scores to obtain the value for SS
SS = Sum(X-Xbar)sssquared =1+4+9+1+9+36=60
Compute the sample variancee ss/n-1 = 60/5 =12
127
Step 5:
Compute the sample standard deviation SD=Square root of ss/n-1 =Square root
of 12=3.46
How is this useful in the library? Let’s go back to our example of the average age of
a book in the library. The average age of the books in that example is somewhere
between 21 and 30. Let’s choose the number 23. If the mean is 23, and there is a
SD of 10 years where does that leave us? That would mean that the majority of our
data would have to be with 1 standard deviation or with 10 years (+/-) of 23 (13 or
33 years old). If the standard deviation is 5 years, then the data would look totally
different. Looking at that chart, that tells us that this is the case. How the data
varies around the mean makes a big difference.
Let’s look at the example talking about salaries. If we include the outliers our
Mean is 45,199 with a standard deviation of 20,791 and if we don’t include the
outliers our Mean is 34,364 with a standard deviation of 4932. The dropping of the
outliers demonstrates that without them, the data is extremely close. The standard
deviation shows that the data does not vary much from the mean. Including the out-
liers causes the SD (Standard deviation) to jump up in size, because the data varies
much more.
4. Z Scores
Z scores describe one individual score within a set of data. They consist of a sign and
a number. The sign (+/-) tells you whether the score is above or below the mean.
The numerical part indicates how many standard deviations away from the mean
your score is located. It is an excellent choice for comparing individual scores. Let
us look at our staffing example again. For the year 2005, the average number of
staff in libraries similar to
ours was 35. Our Library had
a staff size of 30 people. Is
that a tremendously large dif-
ference? It is if the standard
deviation is 2 people. Z= (x-
xbar)/SD = (35-30)/2 =-5/2=-
2.5. This means our score is
less than the mean, and 2.5
standard deviations away from
the mean. If most of your data in a normal curves lies within 1 standard deviation,
this makes for a large difference.
Taken from http://www.afb.org/images/celeb_sol-figure2.gif
128
If our sister school has 34 staff members, that makes their z score -.5 and they
are not even one standard deviation away from the mean. Some people look at z
scores as if they are a conversion to a standard deviation score. Now let’s compare
to another department in your institution. Perhaps HR. The average number of
employees in benchmark data for HR is 48. Your HR department has 38 with a
standard deviation of 8. Who has a lower “deficit”? HR’s Z score is (38-48)/8=
-10/8= -1.25. The library has a more significant staffing issue!
Tips:
• The histogram has a “bin” option. That is the intervals that you set up for
your data. In the example listed above for histogram, 28-31000 is an interval.
If you don’t put a bin in, then excel will. I find it easier to leave it blank
and let excel decide the bin. Then I go into the bin and change it.
• The histogram in excel, appears without the bars touching it (really!).
To fix that simply double click on the series (the vertical bars) and click on
the options tab. Look for overlap and gap. Change gap to 0. Then you have
a correct histogram.
129
• Descriptive statistics in the data analysis option is your best choice for most
of the statistical work you need to do. It gives you all of your central tendency,
your minimum and maximum score and more.
• For Correlation and regression graphs, use the scatter plot chart.
To calculate r utilize the paste function option and go to correl.
Statistically Significant.
Statistically significance is based on a value of probability. What is the probability
that the answer you give will be wrong? That is the “layman’s” definition of it.
Statistical significance has to do with hypothesis testing. When you test something
you say either the null hypothesis is true (nothing happens) or the null hypothesis is
not true (meaning some change has taken effect). Think of it in a doctor-patient
setting. Does aspirin cure a headache? The null hypothesis is no, it does not (no
change occurs). If you say the null hypothesis is not true (called rejecting the null
hypothesis) then aspirin does work (change has occurred due to your intervention).
By mistake, you can reject the null hypothesis, even though it is true! Maybe, aspirin
has no effect, but everyone taking the aspirin automatically relaxed and the head-
ache went away. Maybe the results were recorded wrong. For whatever ever reason,
you reject the null hypothesis (you state that change occurred) when actually the
answer should have been null. What are the chances of that? If you say that you
have a 90% chance making that mistake, then your experiment is not statistically
significant! If you lower that to 10%, it will have a greater degree of significance.
5% and 1% are the most widely used significance levels. They have not the best degree,
but some of the highest degrees of significance. Statistical significance in symbolic
form is known as alpha or · . So using the symbolic form, · =.01 or .05 (.01 = 1%).
The question most people have is where does the alpha come from? In school,
alpha is always given to you. In the real world, the person conducting the study
chooses the alpha. You of course would want to select a good alpha, so 90% would
be out of the question. I like to choose my alpha based on my sample, if I have a
really large sample, .05 is ok, smaller samples should have a .01.
130
I am reading? Is it in a structured format? If not, it will make deciphering infor-
mation very difficult. I then look at the study. When considering polls, surveys et, I
consider the following points: (1997 Moore.)
Furthermore, I look for the data. You should be able to replicate their charts and
statistical representations based on the data that they provide. Knowing that the
data is included, it easy for you to draw your own conclusions before you read
theirs. Don’t let an author bias your own reading capabilities. Know the difference
between categorical data and numerical data. Consider what could have biased
the researcher or their results. What errors could have changed the answers?
Always question the methods that they used. Be wary of correlational studies as
they only indicate that a relationship has occurred. They do not tell you cause and
effect. Take note of overall trends, data sources and patterns.
131
1. Try to utilize graphs, bar graphs, line graphs, and histograms, something
people can see easily. It works to your advantage to use fewer words!
2. Don’t have too many categories in your bar graphs; if your survey has
many just highlight the top 5.
3. Try to utilize color, be sure not to make pastel, and if you need something
to stand out make that item the brightest color.
4. Change intervals in axis to make your charts stand out more. See example
below.
132
6. Know your audience.
7. Benchmark! Comparisons to other libraries not only help you learn what
you need and don’t need, but they also help your audience.
Conclusion
In conclusion, most of us for our day to day use of statistics can utilize the funda-
mentals or basic statistic option. Once you understand the theory behind the basic
statistic, you can simply utilize a software package to do the math! The most
important things to keep in mind is what you are trying to do with the data and
what type of data do you have. Try to use your descriptive statistics to make the
work you do in your library stand out. Working with more complicated statistics
such as inferential can be difficult and you should try to avoid that unless you have
a strong understanding of statistics. However, many librarians are daunted by sta-
tistics because they feel they cannot do math. The more statistics is utilized as an
application, the more you understand them. To understand more about statistics,
133
a class is always an excellent idea. Statistics are always offered in library scho-
ols, however any school that offers behavioral science courses will have a statis-
tics course as well and this meshes very well with library science.
Glossary: Many of these definitions are taken directly from the texts (electronic
and paper format) that are mentioned in the bibliography. I simply searched for
the clearest definition.
Central Tendency:
A statistical measure that identifies a single score as a representative for an entire
distribution. The goal is to find the single score that is most typical or most
representative of the entire group.
Control Group:
Is a condition of the independent variable that does not receive the experimental treat-
ment. The control group is the baseline for comparison with the experimental group.
Dependent Variable:
Is one that is observed for changes in order to assess the effect of the treatment.
Hypothesis Testing:
Hypothesis Testing is an inferential procedure that uses sample data to evaluate
the credibility of a hypothesis about a population.
Independent Variable:
The variable that is manipulated or controlled by the researcher.
Inferential statistics consist of techniques that allow us to study sample and then
make generalizations about the populations from which they were selected.
Level of Confidence: The level of confidence says what percent of all possible
samples satisfy the margin of error.
Margin of Error: The margin of error says how close the sample statistic lies to the
population parameter.
The mean is the most commonly used measure. It is the central number of a normal
distribution. It is equaled to the sum of all the scores divided by the number of scores.
134
The Median: exactly 50% have values less than equal to 50th percentile.
The mode is the score with the greatest frequency. The mode is used when the scores
consist of measurements on a nominal scale.
The range is the distance from the lowest to the highest score in a data set. The range
is the difference between the upper real limit for the largest X Value and the lower
real limit of the smallest.
Raw score:
Is an original measurement or observed value.
p-value
The p-value represents the probability of error that is involved in accepting our
observed result as valid, that is, as “representative of the population.” For example,
a p-value of .05 (i.e.,1/20) indicates that there is a 5% probability that the relation
between the variables found in our sample is a "fluke.
Parameter:
Is a value, usually numeric, that describes a population.
Population:
The entire group of individuals that a researcher wishes to study.
Probability
In a situation where several different outcomes are possible we define probabili-
ty for any particular outcome as a fraction or a proportion.
135
Sampling error is the discrepancy or amount of error, between a sample statistic,
and its corresponding population parameter.
The Standard Deviation is a measurement of the standard distance from the mean.
Type 1 Errors:
It is possible to reject the null hypothesis when in reality the treatment has no
effect. The outcome of the experiment could be different from what Ho predicted
just by chance. This is a type 1 error. A Type 1 Error consists of rejecting the null
hypothesis when Ho is actually true.
Type 2 Errors:
A Type 2 Error the investigator fails to reject a null hypothesis that is really false.
Variability: describes how spread out the values of the sample statistic are when
we take many samples. Large variability means that the result of sampling is not
repeatable
Z scores: The sign of a z score indicates whether it is above or below the mean.
The numerical value of the z score. The numerical value of the z-score indicates
how many standard deviations are between the score and the mean.
136
Bibliography
Bailey, K.D. Methods of Social Research, 4th edition. Macmillan, NY, 1994
Current Population Survey: http://www.bls.gov/cps/
Electronic Statistics Textbook. http://www.statsoftinc.com
General Social Survey. www.norc.org
Gallop Poll. www.gallup.com/poll
Gravetter, F.J. Satistics for the Behavioral Sciences, 3rd Edition.
West Publishing Co., NY, 1992
Nielsen Media Research. www.nielsenmedia.com
Norman, G.R. PDQ Statistics, 2nd Edition, Mosby, St. Louis, 1997
Shaughnessy, John J., Research methods in psychology, 2nd Edition,
McGraw Hill, NY 1990
Statistical Abstract of the United States. http://www.census.gov/statab/www/
Statistics: Concepts and Controversies (5th edition) 1997
David. S. Moore WH Freeman & Co.
Statistics: The Standard Deviants. Video 1,2 and 3. Cerebellum Corporation.
www.cerebellum.com
US Census Bureau: http://www.census.gov/
Abstract
Many librarians who don’t have a mathematical or statistical background are
often intimidated by a wide spectrum of statistics. A basic understanding of sta-
tistics would help librarians answer reference inquiries; write successful proposals
for funding of libraries, and to conduct research. This paper will address the fol-
lowing topics: (1) what are basic descriptive statistical methods and how they
can be utilized; (2) how to understand “statistically significant” and how to make
statistics work using graphs and charts; and (3) how to understand, interpret, and
utilize statistics and a variety of the professional research literature to help manage
your library.
137
Statistics To Plan: Statistical Development
in a Regional System of Public Libraries
(Valencian Community – Spain)
Ignacio Latorre Zacarés
Head of the Department of Libraries.
Department of Books and Libraries of the
Valencian Autonomous Government (Valencian Community – Spain)
[email protected]. Conselleria de Cultura, Educación y Deporte.
Dirección General del Libro y Bibliotecas. Servicio del Libro.
Avenida Campanar, 32.
46015 Valencia (Spain)
138
current state of the regional library network and that acts as a tool for the
making of decisions in library policy. This paper analyzes the progress made in
statistical management and its practical applications in the adoption of planning
strategies and in research on public libraries.
139
One of the first measures for obtaining an accurate knowledge of the situation
was the Map of Valencian Public Reading2 drawn up between year 2000 and
2001. This Map analyzed all the parameters of use, services, facilities, personnel
and expenditure that affected the Valencian public libraries through on-the-spot
surveys in each of the libraries. The Map of Valencian Public Reading meant the
creation of a powerful database that also provided an improvement in the whole
statistical system of the Valencian Community that since its creation it was simply
limited to the monthly compilation of certain data: visitors, loans, registred users
and total number of resources. In addition, the Library Inspection Service was set
up in November 2000 as an instrument of control and knowledge of the library
system.
The Map of Valencian Public Reading confirmed the absence of computeri-
sation in many libraries. Thus, the first measure that to be implemented, thanks
to a better knowledge of the state of affairs in libraries, was the creation of the
Valencian Public Reading Electronic Network3 on 18 September 2001 which
currently integrates 223 libraries (http://xl p v.cult.gva.es/). The second measure
was the change of orientation in the grant policy for the purchase of basic library
resources, giving priority to the purchases for diversification of the bibliographical
supply (fiction, juvenile literature, essay...) rather than to a subsidized purchase
that was previously very much directed towards reference works (encyclopedias),
particularly in small towns.
The current situation of libraries unveiled the need of a progressive improvement
in the entire statistical system. From the very beginning, it was also decided that the
whole statistical process (dispatch of questionnaires, creation of tools, tabbing and
use of data, verification of data, supply of statistical information) should be kept
in the hands of the officials of the Department of the Books and Libraries, without
outsourcing it, so that our Department was in control of the full process.
140
and Windows 2000 posts integrated in a network managed by Windows 2000.
Furthermore, the database is connected through common tables with other data-
bases of the Culture Department of the Valencian Government. It is perhaps a
somewhat complex tool for the data entry, but it is very powerful with respect
to the large storage capacity of information and the enormous possibilities about
data processing and development of Web applications.
XABIB adopts a tree structure, organized in displayable menus under the follo-
wing sections:
The statistical applications mentioned in this paper will come out from this central
core. In addition to the computer copies, there is also a paper file of the annual
and monthly statistics that are archived with the corresponding name and area
of the library following a chronological and alphabetical order. These folders are
kept in boxes that are passed on to the management records and afterwards to
the intermediate archives.
141
Picture 1
142
consulted on-line via Web, and the citizen should receive the most reliable and
updated information.
143
This annual survey was used for the first time in the collection of data of the year
2000 and is elaborated in a way that enables the delivery of statistical data
requested by the Ministry of Culture, the National Statistical Institute and the
Valencian Statistical Institute, as well as parameters of interest for the Department
of Books and Libraries of the Valencian Autonomous Government. The survey is
reviewed annually according to criteria adopted by the Spanish Working Group of
Statistics of Public Libraries in compliance with the Regulation ISO 2789:2003.
Therefore, from the first survey elaborated in the year 2000 until the present
time, changes have been made with the intention of standardising and controlling
the most significant parameters at library level.
144
As explained before, the series of annual statistics are more recent (data exist
since the year 2000) and comprises a greater amount and complexity of parameters.
Thus, in this type of statistics, since 2001 (when the registration of this type of data
began), a special effort of filtering and checking of data has been undertaken.
Efforts have been made to rectify all the possible errors and the lack of data by
many telephone calls or via fax, postal or electronic mail. In this context, time
has also been an important ally and, over the years, a clear improvement in the
coherence and the volume of the data provided by the libraries has been perceived.
On the other hand, efforts have been made to make the questionnaire as clear as
possible. The experience of each year and the identification of recurring errors
when analisyng out statistics have resulted in the inclusion of new explanatory
notes or "aids" in the questionnaire, in order to guide the librarians and secure a
greater reliability in the statistical data. The current policy consists in amending the
questionnaire as little as possible and in continuing to offer better consistency levels.
145
Picture 2
Picture 3. Screens of free access web pages of the Valencian Library Directory (XABIB).
146
Picture 4. XABIB web application is also integrated in the interface of the Electronic Network
of Valencian Public. Reding connecting catalogues with data of the libraries directory.
147
Picture 5. Online statistical data search screen in the Dynamic Map of Libraries. To the left,
search criteria: Centers, users, loans, members, activities, expenditure, personnel, database, etc.
148
Practical applications of statistical management and approaches for the future
The investment in statistical management quickly brought good results regarding
data supply. The whole process of improvement has permitted, in a relatively
easy way, all provision of the data annually requested by the Spanish Ministry of
Culture, the National Statistical Institute and the Valencian Statistical Institute.
These statistical tools serve very often to answer certain specific reports reque-
sted by the Valencian Government or by its Department of Culture, as well as
those requested by other departments. The data are analyzed by the Department of
Books and Libraries for making reports on this subject and, occasionally, serving as
a basis for the adoption of measures of improvement. Furthermore, some of these
reports have been published7 in specialised magazines. In other instances, the annual
overall statistical information has been provided to the media, so that citizens
may appreciate the importance and the dynamism that public libraries have in
present society. Working with the data has also allowed the drawing up of articles
on certain aspects of the Valencian Library System8, and we expect that with the
new Web application (Dynamic Map of Libraries), research in this field will increase.
On the other hand, since 2004, the Department of Books and Libraries, via
its statistical programme, has also collaborated in the "Project Tibidabo"
(http://www.tibidabo-libraries.info/), programme of the Diputació de Barcelona
and the Consorci de Biblioteques de Barcelona carried out with the Foundation
Germán Sánchez Ruipérez. This project concerns a comparative study between
2000 and 2003 of the situation and evolution of the public library service in cities
and regions of Europe: Valencia, Barcelona, Madrid, Zaragoza, Oslo, Birmingham,
Bremen, Helsinki, Stuttgart and Dublin.
The data are the principal part of statistical management, but these data only
register facts without providing any value or interpretative judgment. The data
must be analyzed, valued, and interpreted in order to generate information and, at
the same time, knowledge. The information and the knowledge generated allow
us to have a clear vision of the real situation of libraries and, at the same time, this
knowledge allows for consistent policies and strategies to be adopted. The better the
information; the greater the capacity to adopt adequate and appropriate decisions.
In this context, the crossing of the library data strictly with demographic, economic
and sociological variables produce indicators that allow a deeper knowledge of the
situation and a greater capacity of comparison with the levels or ratios of other
regions. The figures or absolute data must be analyzed and translated into ratios
and indicators that allow a better understanding of the situation. The comparisons
by chronological periods reflect on the degree of development of the different para-
meters and the dynamics, more or less positive, in each section (for example, sustain-
able and significant increase in number of visitors, stagnation in investments,
149
improvements in the computer equipment, etc.). Also, the preparation of grap-
hics helps understanding and makes the reality of the situation or its develop-
ment in a certain number of years more visible: graphics of loans per years, grap-
hics of change in monthly visits, etc. It is very important to be able to study the
data by geographic areas, so that one can delimit the indicators by districts,
towns, etc. The library situation often changes radically in relation to the regi-
on. In short, once the right tools for statistical management exist, it is more and
more necessary to further analyze the data and work with them for developing
indicators and zonal studies. On the other hand, another essential aim in statis-
tical management is to obtain each time a greater consistency level in the data.
Notes
150
4. We thank Rafael Martín and Javier Belmonte, computer technicians, for the
technical data of a computer nature provided for the preparation of this
communication. We thank also Deborah Hall, Elena Ortells and Ana-Rosa
Latorre for their assistance and collaboration.
5. These letters stand for the corresponding expression for “Net of libraries”
in the Valencian language.
Abstract
In 2000, the coordinating institution of library policies in the Valencian
Community (Spain) began a process of improvement in the statistical system of
the Valencian Library System that has allowed a better knowledge of the current
state of the regional library network and which acts as a tool for the decision-
making process in connection with library policies. This paper analyzes the pro-
gress brought about in statistical management, the new computer programmes
developed and its practical applications in library policies and in research on
public libraries.
151
Key words: Statistical management/ Data processing/ Library policy/ Computer
programmes/ Valencian Library System
152
Development of Estonian public libraries
during the last decade. (1994-2004)
Margit Jõgi
Leading Spetsialist on Statistics
Research and Development Centre
National Library of Estonia
Estonia, one among the three Baltic states, regained its independence 13 years
ago. The official language of the country is Estonian and the national currency
unit, at the present moment, is still the Estonian kroon (EEK). Estonia acceded
the European Union on 1 May 2004. Its population is 1 377 445 inhabitants and
area of its territory - 45 227 km2. Estonia is divided into 15 counties and gover-
ned by 241 local governments.
The major developments in Estonian libraries during the 1990s were the
following:
• Legal basis was created for the functioning of the library system
• The library network was reorganised
• The information technology of libraries was modernised
• The educational level, professional knowledge and skills of library
staff improved
• The co-operation between libraries broadened both on the national
and international level
After Estonia regained its independence, the country carried out a library reform
during 1992 to 1994. In 1992 the Riigikogu (Parliament) adopted the Public
Libraries Act specifying the regulation of the work, collections, services, mana-
gement and financing of public libraries. All public libraries were transferred to
municipal ownership. In addition to that several sub-acts have been adopted, co-
ordinating the basic operation and work processes of public libraries.
The Public Libraries Act notably supported the development of library services
to the wide public in the new democratic state, also improving the economic con-
153
ditions of public libraries and creating prerequisites for the implementation of
new information technology solutions.
All public libraries are supervised by the Ministry of Culture who is responsible
for the statistics in the field of culture. The collection of statistics, and verification,
processing and analysing of data has been assigned to the National Library of
Estonia. The National Library’s Research and Development Centre manages the
statistical database and specifies the criteria for data collecting in accordance with
all national legal acts and ISO standards. These unified principles and methodology
have been applied to data collecting since 1992, all this statistical information is
preserved in the electronic database of the National Library of Estonia.
The last decade has witnessed a decrease in the total number of public libraries
by 29. In most cases it has been the result of organisational changes, i.e. the joining
of services for children and adults as well as public and school libraries. Only very
few libraries have been closed down.
154
The total number of inhabitants in the country has decreased, causing the joining
of libraries in very small villages and thus enabling to save resources.
Collections
In 1995 the total collections of public libraries comprised over 10 million docu-
ments. During the last decade public libraries have acquired 5,3 million new
documents and withdrawn 4 million documents, the total rise has thus been 1,3
million documents. The extensive movement of collections during the past 10
years has undoubtedly enriched library resources, considering the strict censorship
of publication during the soviet occupation. Annual acquisitions per one reader
have stayed on the same level during all the past years, being 1,2 documents per user.
The collections of public libraries today comprise 8,3 documents per one
inhabitant and nearly 26 documents per one user.
In small rural municipalities libraries constantly exchange literature within
the municipality in order to ensure optimum use of resources.
The majority of the collections in public libraries is made up of printed books
which form 98% of the total.
155
The remaining 2% are other documents which in turn are divided as follows:
The coming years must certainly increase the proportion of electronic documents
but the high price of technical equipment slows down this process in public libraries.
By languages the collections in Estonian public libraries can be divided as follows:
1995 2004
Estonian 73% 79%
Russian 25% 19%
Other foreign languages 2% 2%
The role of other foreign languages has increased considerably in everyday life
but public libraries cannot fully consider it in their acquisition policy. Books in
foreign languages (except Russian) are considerably more expensive and acqui-
sition resources are insufficient.
The percentage of fiction and children’s literature has been the stable 63% of
the entire collections.
Use of libraries
156
The following factors have had an impact on the use of libraries:
All the above developments have been the basis for constant increase in the num-
ber of readers and library visits during the past decade. In 1995 the percentage
of library users among the entire population was 24% while in 2005 the corres-
ponding percentage was already 31. (See fig. 3)
1995 2004
Visits per capita 3 5
Visits per user 11 16
The Public Information Act, adopted in 2000, notably extended the functions of
public libraries and changed the statistics of library use. The said Act specifies
that the State and local governments must ensure access to public information
via the Internet in public libraries. Within 3 years, all Estonian libraries were
provided with Internet connection and at least one PC for users under a corres-
ponding national programme. This has certainly been one reason for the increa-
sed number of library visits.
Another factor increasing the number of library visits is lifelong learning – a
library has become an educational environment.
157
The change in the amount of readers in 2004 was –2,1. The number of loans is con-
stantly decreasing. Why are all the positive changes not reflected in the statistics of
readers service?
• The population of Estonia is relatively small and all minor changes have a
notable impact on the statistics. As the increased quality in all areas of
readers’ services is usually preceded by the reorganisation of library services
(closing down, shorter opening hours, denied access to certain part of the
collections), all these changes are immediately reflected in statistics.
• Since 2000 public libraries are not calculating the on-site use of documents,
this has been another factor influencing the amount of loans.
• Another reason for the smaller total of readers is the decreasing number of
inhabitants and children as readers. After the re-gaining of independence,
the birth rate went down in Estonia and libraries have less and less children
among their readers.
Acquisition costs generally comprise 48% state allocations and 52% local govern-
ment allocations, the contribution of local governments has been growing con-
stantly. The proportion of acquisition costs in the budget has increased by an
average of 2-3% annually which is certainly insufficient considering the growing
prices of new documents.
To sum up
Estonian public libraries still have to undergo certain changes. The administrative-
territorial reform has not been completed and the desired efficiency of regional
development and administrative capacity has not yet been achieved. Larger local
government units definitely have to consider the uniting of small and perhaps ineffi-
cient libraries in order to have one larger and more effective library.
158
The role of public libraries in the Estonian society is considerably wider than just
that of providing library service. Public libraries often act as cultural and social
institutions. For that reason the efficiency and performance measurement of public
libraries in smaller regions may not always be justified as the library may well be the
only local cultural institution.
References
Priimets, H. (1996) Estonian Public Libraries in the Time of Changes (1990 – 1995).
In: Independence and Libraries: papers of the 5th Congress of Baltic Librarians
October 21 – 22, 1996, Tallinn, Estonia, 142 – 148.
Saul, M. and Priimets, H. (1999) Statistical Survey of the Public Libraries
Activities in 1995 – 1998. Raamatukogu, 3, 20 – 22.
Priimets, H. and Jõgi, M. (2001) Basic Statistical Indicators of Estonian Public
Libraries in 2000, Raamatukogu, 3, 21 – 24, 29.
Sepp, I. (2002) Public Libraries. In: Libraries and Librarianship In Newly
Independent Estonia, 40 –58. Tallinn : National Library of Estonia
Valm, T. (2003) The Estonian librarianship developments in the 1990s.
Tallinn, 2003
Abstract
This analysis is based on Estonian public libraries’ statistical reports of 1994–2004.
During the period, the forms of statistical reports have changed. The instructions
how to present library statistics have been improved to meet the requirements of
international and national standards and other guidelines.
In this report, I dwell upon public libraries’ network and some basic indices
(collections, users, loans and visits).
After the restoration of the Estonian state, library reform took place in 1992–
1994. As a result of the ownership reform, public libraries were made a municipal
property. The adoption of Public Libraries Act in 1992 contributed the preservation
and development of public libraries’ system. The Act facilitated the development of
public library services in the new democratic state, by improving, inter alia, material
situation of public libraries.
During ten last years, the number of public libraries has decreased. The pro-
vision of library services has been considerably reorganised (numerous children’s
libraries have been affiliated to municipal libraries that have got new premises,
suitable also for the provision of children’s services; several village libraries have
been turned into service points of rural commune libraries).
159
The changes in the library network will continue in the future because of on-
going economic changes and the need to improve library services.
The demand for library services has grown in recent years. Rapid social develop-
ment, a constant need to learn, and the development of IT in libraries have all
contributed to consistently increasing importance of public libraries.
The numbers of library users and visits have grown steadily during the past
decade.
Every third resident of Estonian is a registered library user and 4.7 visits per
year have been counted per capita.
The rapid growth of library visits has been largely influenced by the fact that
libraries have been connected to the Internet.
Since 1994 the number of library users has increased. However, since 2000,
the number of library users in rural areas has decreased, caused by the decrease in
the size of rural population.
The public libraries’ collections total about 11, 120,000 items, predominantly
books and other documents on paper carriers. Documents of other format make up
1 percent of the collection.
The financial support is allocated from the state budget on the basis of money
allocation per resident of a particular area served. The amount of money granted to
libraries for book purchases by local governments has been very different, being
especially low in bigger towns. The last decade saw the boom of publication.
Compared with Soviet era, the annual production of book titles has redoubled.
Libraries have preferred to acquire more titles in less number of copies. Only one
copy of a reference publication is purchased for a rural library; the number of copies
of fiction and children’s literature is also low.
160
Audit for libraries… which one?
Marielle de Miribel,
PhD, Mediadix,
Université Paris 10,
France
When a library manager wants to see how the library is managed, he or she has
to operate an audit. But which one could he choose?
There are many possibilities of assessing the way the library is managed, and I
shall propose here three methods of survey: Marketing audit, Culture audit, and
Structure audit. Each of these has a special purpose, so as to get inside the library
with different viewpoints.
Marketing audit
What is the use of it? It is like leading an orchestra, keeping balance
between internal and external pressures.
As it is the library manager’s job, for who is in charge of reaching
the aims and goals of the library.
Marketing audit is summarized in four letters: SWOT: S for
Strength, W for Weaknesses, O for Opportunities and T for Threats.
Threats? Strengths?
Weaknesses? Opportunities?
161
For the study of the environment, there are threats or opportunities, and for the
inside survey, we speak of weaknesses and strength.
With a marketing audit, the survey of the situation is a dynamic map for
interpretating facts. By the way, the same fact can be seen for one library as a
weakness and for another one, as a strength.
For example, if you have three young girls in the staff, would you consider
that as a weakness or as an opportunity? And if there is a new Internet Club next
to the library, could you consider that as a threat or as an opportunity?
Marketing audit is a very large way of keeping reality in mind; how to be sure
that any very important item to consider is not forgotten?
In my opinion, pressures exerted by the environment are more important for
the life or the survival of the library than those coming from within, as we could see
in Structure audit. So I just suggest not to say SWOT any longer, but TOWS!
Culture audit
What is the use of it? The aim is the reduction of the gap between the
external representation about the library and the way the staff wants to
be considered. Very often, there is a very significant difference in view-
points: librarians are supposed to read all day long.
Culture audit is the job of the communication officer of the library. He has to
collect information about the history of the library and its activities, to be able to
incline the perception and the image of the library in a way which is much closer to
reality. He is working on values, perceptions, representations, and the world of the
mind. Culture audit is the preliminary and necessary job for every work on pictures
and signs for the library, to be able to give it a living and representative logo and
graphic chart.
The library’s communication officer has two important difficulties to cope with:
most of the material he needs is oral as there is not much written material. When the
librarian who is the memory of the library is retiring or leaving, all the precious and
necessary information vanish.
The other difficulty is that the librarian’s world is not very businesslike, and many
librarians do things, realise many sucessful projects for users, but nobody knows…
To realise a culture audit, there are five focus points to consider:
• Founders and foundation of the library
• History of the library
• Professional abilities
• Values
• Signs and symbols
162
Founders and foundation of the library are important
to consider, as the person who made something
emerge from nothing has a positive energy, which
stays and influences all the foundation keys. His/Her
personality, his/her challenges, the innovations s/he
introduced, his/her principles and rules to cope with
the environment, management, and research can influ-
ence decision-makers during decades and centuries.
In the memory of the library and librarians, many facts can be relevant: we
can find the year when all the librarians were pregnant, the one when there was a
strike, the one when the shelves were inundated, the one when they changed the
computer system, or methods of management, etc. Every fact concerning key figures,
structure, great moments, and important changes in the environment is relevant.
The best way to have a real survey of what life is in a library is the study of signs
and symbols:
• Every element of external communication is to consider: B to B communi-
cation, phone calls, access, etc.
• the way of running relations inside the library: ways of talking, dressing,
lunching, etc. For example, is coffe time a ritual for discussing work or
chatting, are there commemoration cakes …?
• space and time management : how are circulations, schedules, links
between office and working hours ?
• and about symbols, which are specific and relevant rituals, rumours,
and external communication tools ?
The last but not least item to consider is the values of the library:
• there are values as declared : conventions, manager statements
• values as obvious : strategic choices, characters
• operating values : quality control, policies and procedures
• behaviours with administration, competition, environment
163
With that more complete survey, the communication manager can work on
focusing on the more relevant items to market and lobby the library in its envi-
ronment. He can do it himself as nearly 80% of the informations are in the hands
of the staff, or ask a consultant for inquiries and evaluation.
Structure audit
What is the use of it? The aim of this audit is to cure ailing structures as libraries
could be. If marketing and culture audit were able to be held in inside business,
structure audit has to be conducted by an external consultant who would not be
involved in structure games.
There are four focus points which are :
• Environment
• Working group
• Membership
• and Group authority, with Canon and Leadership.
Environment
The most important key is the Environment, as the world is changing. And the job
of the environment is to push, exerting pressures on the boundary of the library.
For example, users ordinarily want larger library hours, and more services, and
facilities, and free of charge. Partners in common projects want jobs for the library
and notoriety for themselves. And institutions want good and free services from
the library.
As a library exists because it meets a need in the environment, it is a necessity
for the manager to sniff at what is changing in the environment, to be able to
adapt the library to the new strategic focus points: What is the added value of this
library faced with competition ? What is now the strategic goal? If the library were
to close down just now, who would be the most handicapped by the lack of answer
for its needs?
The manager has to face many different and contradictory pressures from the
environment and has to choose between them and main priorities. In that external
group process, he has the task to balance pressures from the environment with
coherence.
He has to give the environment a coherent face in his talks and facts. And that
is a great difficulty for a librarian as he has to encounter complexity and antago-
nism in the priorities. For example, if I am a small public library manager, how
can I focus on elderly peoples’ services for example, which is the Mayor’s priority,
and continue to track illiteracy, which is a long term project, with the same funds
and staff?
164
Coherence
Working group
«Working» means two things: activity and process. If it is easy to qualify activity as
work, it is less obvious with process. It includes training time, communication,
rituals, games and fights inside the library and outside, and so on. The sole dif-
ficulty to consider is that when people are focused on activity, they are not on
process, and vice versa.
Membership
In membership, there are two points: public structure and private structure. In
public structure, open to public observation, there is to consider organisational
structure (organisation chart) and Individual structure (who is in this position?).
Very often, librarians deal with difficulties in mixing organisational and individual
structure, putting together people who like one another but don’t have the best
abilities for the job they have to do.
The Private structure is the way each person feels his own place in the group.
And that feeling is mostly private and secret. By the way people behave according
to that private structure, some consultants can tell where there are problems inside
the structure of the library.
165
Group autority: Canon
The canon of the library is a sort of foundation of the structure. There we find:
• Constitution and Rules, with name, goals and aims, rules and amendment
procedures. There we find the legitimity of the library and its inner strength
(or weakness).
• And in Culture, we find most of the items we found in Culture audit: as
technical culture (the way people do it), group etiquette (values and state-
ments) and group character (the way staff can have the freedom of dressing
and behaviouring, without being rejected cast out.
• Effective leader is the one staff is hearing when there are doubts about
activity. He is coopted by the staff and may or may not be the responsible
leader. He is the one who knows about changes in the environment,
because he is an expert in his field. He knows about strategic goals and
is the real leader of the structure. He is influent on action fields. Curing
consultants have to make responsible leaders become effective leaders.
166
• Apparatus is the means that the leader can lay on, in order to know
about reality and problems. Secretary and very often library are parts
of an apparatus.
To conclude with that presentation of three sorts of audits, I shall just point out
that Structure audit is the most complete investigation, which includes Marketing
and Culture audit. With this one, the library management is scanned and criteria for
cure are current.
Thank you very much.
Bibliography:
The Structure and Dynamics of Organizations and Groups, by Eric Berne.
Abstract:
Comparaison entre un audit de culture, un audit marketing et un audit de struc-
ture, dans le cadre d’une médiathèque Différents outils d’analyse, empruntés au
monde privé, permettent d’appréhender la complexité des bibliothèques et de
comprendre quels en sont les enjeux stratégiques. Je me propose de présenter
brièvement ces trois outils de diagnostic, de montrer quel en est leur intérêt et en
quoi ils se complètent mutuellement.
2. L’audit de culture
Dans un autre registre, celui du patrimoine, l’audit de culture est un inventaire
des 5 points clé qui permettent à une structure de définir les bases de son capital
d’image. (les fondateurs, l’histoire, le métier, les valeurs et les signes et symbol-
es). Il permet de nommer, faire exister, consolider et fructifier le capital d’image
qui sous-tend toutes les actions de communication externe et interne à al struc-
ture.
167
3. L’audit de structure
Il étudie la complexité de l’organisation considérée, à partir de l’environnement,
pour en déterminer les objectifs stratégiques, condition de survie de la structure.
De là, tel un fil rouge, il balaie les différentes zones d’exploration (autorité du
groupe avec leadership et canon, membres du groupe et activité du groupe) pour
permettre de se poser 12 questions concernant les points clés déterminant la
bonne santé générale de la structure.
Conclusion
Après cette présentation théorique, on pourrait prévoir un atelier en 3 groupes,
où les participants dresseraient le profil d’une bibliothèque témoin, état des lieux
suivi d’une mise en commun et de commentaires en terme d’enjeux stratégiques.
168
Coordination of higher educational institutions
and professional library associations – the key to
training quality rise of librarians of XXI century
Natalia I. Gendina
doctor of pedagogical sciences, professor
director of R&D Institute of Information Technologies
of Social Sphere of Kemerovo State University
of Culture and Arts, Russia
Introduced by IFLA the slogan: “Libraries are the heart of information society”
essentially changes the approach to the librarians training. The transition from
information society to knowledge society, transformation to modern education para-
digm made necessary cooperation of higher educational institutions and profes-
sional library associations. The main forms of this cooperation are discussed.
“Libraries are the heart of information society”. Presented by IFLA, the slogan
“Libraries are the heart of information society” exactly reflects the key role that
libraries have to play in solution of one of strategic tasks of modern society: in
providing access to information and knowledge for all. The 69th IFLA Council
meeting (Berlin, 2003) passed the following resolution on the World Summit on
the Information Society: “Whereas the world Summit for the Information Society
offers a unique opportunity to be recognized as the heart of the information society…
it is resolved that IFLA calls upon all governments to address the growing gap
between the information rich and the information poor, and promote library
development programs for poor rural and urban populations, library instruction
through libraries, and the strengthening of library educational programs”.
According to this resolution Russian Library Association (RLA) held in 2004
the 9th Annual Session and Conference under the slogan: “Libraries are the heart
of information society”. At this largest forum of Russian library professionals
among the most important ones the problem of library staff training called to
provide Russia’s entering into information society was discussed. At that practicing
librarians and higher educational institutions’ teachers were united in admission
that it is necessary to change essentially the organization of library-information
169
specialists’ training. So, if we really believe that “Libraries are the heart of infor-
mation society”, then the problem of quality of librarians’ training gains a special
meaning. However, it is impossible to answer the question of what exact changes
must be done in this training without taking into consideration the context of
these changes which, firstly, are connected with information society development,
and, secondly, with the transformation of modern education paradigm.
170
specialists’ training, but they have special meaning in perfection of library-infor-
mation staff training.
Key competencies
The new education paradigm presupposes the transition from the traditional prin-
ciple “to form professional knowledge, abilities and skills” to the principle “to
form professional competence”.
Competence is a sphere of relations existing among knowledge, abilities and
actions in human practice. The connection is evident: without knowledge, abilities
and skills there is no competence, but not all knowledge, abilities and skills and
not every situation can be considered to be competences. I should remind that
171
the idea of key competences was introduced by experts of European Council in
education. They identified five groups of key competences which have a special
meaning and which must be acquired by citizens of information society:
1. Political and social competences, such as an ability to take responsibility,
participate in mutual take decisions, regulate conflicts by an unviolent way,
participate in functioning and improving of democratic institutions.
2. Competences concerning life in multicultural society. In order to prevent
racialism or xenophobia, spreading the climate of intolerance education must
“equip” the youth with cross-cultural communications, such as recognition
the differences, mutual respect to each other, ability to live in peace with
people of other cultures, languages, and religions.
3. Competences connected with abilities of oral and written communication,
which are so important in work and social life that persons who do not have
such competences can be excluded from the society. To have a good command
of foreign languages taking ever-growing importance belongs to this group
of communication.
4. Competences connected with the rise of information society. A good com-
mand of new technologies, understanding of their use, advantages and dis-
advantages, ability of criticism to information spreading by mass media
and advertisement.
5. Ability to long-life study as the base of continuing training in professional,
private and social life.
Thus, the solution of the problem of training quality rise of librarians must be
fulfilled with taking into account the three factors characterizing modern educa-
tion system in general:
172
ments both to the contents of professional education and to the quality of library-
information specialists’ training.
For many countries having long traditions of professional library associations
which fulfill the functions of results’ evaluation of educational institutions’ activity
in librarians’ training this problem may have been solved. However, for modern
Russia this problem is rather actual. Its actuality is conditioned by the fact that
even in the recent period, the period of the USSR, under conditions of totalitarizm,
the activity of educational institutions was extremely ideological, strictly controlled
on the part of the state, and professional library association didn’t exist at all.
173
technologies, global informatization and information society establishing; the
change of factors influencing the education system.
Name and code of speciality or direction Name of received qualification Period of study
What was the new in this system? Distinctive features of a new system of library
education standards are the following:
• according to Bologna process in Russia there has been done a transition to
multistage library education on the base of introduction of bachelorship and
mastership;
• all the universities of culture and arts which have been training librarians –
bibliographers of higher qualification in speciality “Librarianship and biblio-
graphy” turned to a new speciality “Library and information activity”;
• introduction of standards’ system reflects radical changes connected with
social-economical changes in Russia: development of marketing relations,
democrating freedom and privacy in a choice of education, setting free of
educational institution from ideological dogmas, administrative guardianship
and over-reglamentation. The advantage of actual education standards is
the possibility to regulate the quality of education, to provide a unified
educational space in Russia, to develop multy-level library education;
174
• while developing the standards there was used a new strategy – the strategy
of collective work. It embodied a temporary creative group consisting of
experienced teachers of Moscow, Saint-Petersburg and Kemerovo State
Universities of Culture and Arts who were the developers of education
standards;
• for the first time there was a close interaction of developers of the education
standards with professional library community – Russian Library Association.
175
The problems which must be solved at the national level
Mutual work cleared up the demand in perfection of the interaction’s mechanism
of higher educational institutions, libraries and Russian Library Association. The
solution of this problem supposes its stratification:
• the level of higher educational institution. At this level there is a need of
development scientifically based demands of the society in information-
library specialists; development of scientific foundation of education programs’
contents; development of educational-instructional materials for library-
information staff;
• the level of Russian Library Association. On the part of RLA there is a need
to make up the consolidated opinion, generalization and expression require-
ments of libraries to the qualification and quality of library-information
specialists of different steps of professional education; discussion and control
of standards, evaluation of text-books created in the Universities at the
sessions of RLA and in “Proceedings of RLA”;
• the level of libraries. The leading specialists of libraries should elaborate and
formulate the requirements to qualification and quality of library-information
specialists; they also should be the experts in evaluation of education stan-
dards and textbooks written in higher educational institutions.
176
• to identify the goal of library education under conditions of infor-
mation society and knowledge society;
• to define the criteria of contents of professional library education;
• to define more exactly the criteria of a graduate readiness to
professional activity.
This research should provide scientifically based decisions about criteria of
differentiation of education contents at various steps of education system
(bachelor-specialist-master); to formulate more exactly the requirements to
professional competency of graduates who got professional training of dif-
ferent levels, to provide integrity and unity of standards’ system for library
education.
3. Optimization of standards’ system which allows controlling library education’s
quality should be done under conditions of wide participation of library
professional associations in discussion of the quality of education standards
in professional papers.
4. The formation of library education standards’ system presupposes collegiality,
united forces of scientists, university teachers and members of library com-
munity, because the standard is based on the agreement of sides as it states
a single and optimal norm for majority. The standard is good only when it
is well based. The work of education standards’ development should be done
on the long-term base with compulsory expertise and standards’ evaluation
for their perfection.
And at last it should be noted that if we take the metaphor offered by IFLA and
believe that “Libraries are the heart of information society” then interaction of
higher educational institutions and professional library association looks like
communication vessels which are the sources of quality rise in training of librar-
ians of XXI century, the century of information and knowledge.
References:
1. Abdul Waheed Khan. Towards knowledge societies //A World of SCIENCE,
Vol. 1, No. 4, July–September 2003
Abstract:
The main preconditions of library education’s renovation are information society
establishing, global informatization, rapid development of ICT, realization of
information resources as strategical resource of the society, the change of educa-
tional paradigm from “education to the rest of life” to “education during the rest
of life”, strengthening of library role as the most important social institution
providing access to knowledge and information.
177
The content renovation of library education, training quality rise of library staff is
the subject of interest for both higher educational institutions providing highly
qualified library specialists’ training and professional library community. The
result of this work depends on a productive dialogue between the educational
institutions and organizations expressing the requirements of professional commu-
nity to the level of graduates’ training. The most important corporate organization of
professional community of librarians is library association. The main problem
lies in the development of working mechanism of coordination f educational
institutions and library associations. It gets a special acuteness under conditions of
development and introduction of state educational standards.
During the last decade in Russia the activity of standardization of education
including a library one got development. Standardization is deeply connected with
renovation of the content of education. Thus, instead of the speciality “Librari-
anship and bibliography” traditionally taught by the Institutes of Culture and
Arts in Russia since 2003 they started training staff in a new speciality “Library-
information activity”. The standard provides training graduates in such qualifi-
cations as “Librarian-bibliographer, teacher”, “Manager of information resources”,
“Technologist of automated information resources” within above-mentioned
speciality.
For the first time there was close coordination between developers of educational
standards and professional library community – Russian Library Association (RLA)
which provided a possibility of a large-scale professional discussion of standards
and attraction leading specialists of library-information activity as experts.
However mutual activity demanded the perfection of coordination mechanism
of educational institutions, libraries and RLA. The solution of the problem of
advanced quality of library staff training requires its stratification:
• Level of educational institutions: development of scientific base of the
content of curricula; creation of text-books and educational instruction
materials for library-information staff’s training;
• Level of RLA: generalization and expressing libraries’ requirements to qualifi-
cation level and quality of library-information staff’s training; organization
of discussion and examination of standards, instruction books and text-books
in the sphere of library education at the RLA sessions and in RLA Newsletter;
• Level of libraries: development and introduction requirements to qualification
and quality of information-library specialists’ training; participation in
examination of educational standards, text and instructional books.
178
La bibliothèque municipale face aux fluctuations
financières : l’impensé managérial dans les
bibliothèques municipales des villes moyennes
Limam Latifa, France
179
lités de gestion qui se présentent aux décideurs. Ces choix sont différents et complé-
mentaires. Il s’agit de :
• Se replier sur soi-même et donc d’agir seul en adoptant des solutions de rema-
niement interne ;
• Tarifier les services afin d’assurer des rentrées financières ;
• Avoir recours à l’extérieur pour :
- chercher des aides, de nature financière ou autre,
- mettre en commun certains services et ressources avec d’autres organisations
et donc pour coopérer,
- confier, en sous-traitance, certaines tâches à des entités indépendantes
publiques ou privées.
Dès lors, chaque choix appelle de nombreuses questions : Quels sont les raisons
qui ont incité ou empêché les responsables des bibliothèques d’opter pour un
choix ou un autre ? Comment ces choix sont-ils appliqués ? Que génère leur
application et comment pouvons-nous décider de la pertinence et de l’adéquation
de chaque choix ?
L’analyse des résultats faisant l’objet de cet article sont exposés comme suit :
d’abord nous présenterons les ressources financières accordées aux bibliothèques
et leurs justifications ; ensuite, nous arborderons les solutions internes engen-
drées par une augmentation ou une diminution budgétaire, aussi bien que la tar-
ification des services. Enfin, nous traiterons dfes différentes pratiques « externes
» (le recours aux aides et aux subventions, l’élaboration de partenariats, la sous-
traitance de certaines tâches).
180
« Le responsable de la bibliothèque, une fois qu’il possède une formation spé-
cialisée, une personnalité convaincante… C’est assez pour négocier et obtenir ses
demandes. »
Aussi, il semble que le facteur économique intervient pleinement dans l’ori-
entation des choix politiques concernant les bibliothèques. Les difficultés écono-
miques dans lesquelles se trouve la ville (l’endettement, la dégradation des recettes
liées à un manque, à l’inexistence ou à la disparition brutale de sources de
financement : entreprises, etc.) pourraient orienter les choix politiques, soit vers
d’autres priorités que la lecture publique, soit vers le développement culturel,
considéré comme un véritable pôle de reconversion, créateur d’emploi et de
richesse. «La préoccupation culturelle est essentielle à l’Homme et un arrondisse-
ment sinistré a plus que les autres besoin de projets culturels structurants et
mobilisateurs.»
Par ailleurs, des changements de l’équipe municipale n’ont pas d’effets impor-
tants sur le positionnement de la bibliothèque dans la politique municipale. Nous
avons constaté une continuité des choix et des décisions politiques concernant les
bibliothèques malgré les changements politiques, et a contrario une continuité de
couleur politique mais un changement de décisions et de choix en matière de cul-
ture et en particulier pour ce qui touche à la bibliothèque. De ce fait, la même
couleur politique peut influer d’une manière positive ou négative sur le finance-
ment des bibliothèques. Par ailleurs, il est impossible d’avancer que les biblio-
thèques municipales sont plus développées dans les villes de gauche que dans
celles de droite ou l’inverse. Bien des élus ont compris l’importance de la lecture
publique dans le développement social et économique, mais plus encore n’en sont
pas convaincus.
En outre, pour nous rendre compte de la réalité budgétaire des BMVM, nous
avons consulté, auprès de la Direction du Livre et de la Lecture (DLL), les budgets
de toutes les BMVM pour la période 1990-2000. Nous avons choisi cette période
pour deux raisons. La première étant les élections municipales, qui ont eu lieu en
1995. Certaines villes ont vécu un changement politique de nature à nous
informer sur l’influence de la couleur politique sur le financement des biblio-
thèques. La deuxième, parce que cette période est suffisamment longue pour
nous de constater une évolution des budgets dans le temps. Nous avons observé que
parmi 348 bibliothèques, une majorité de 336 ont connu une augmentation de 2 à
8% durant cette décennie.
Nous ne pouvons pas conclure que les bibliothèques connaissent une situation
florissante. Pour pouvoir interpréter ces chiffres, il faut aussi prendre en considéra-
tion l’évolution du marché de l’information, à savoir l’évolution de l’offre et des
prix. De plus, l’étude du budget de chaque bibliothèque nous permet de constater
181
que de nombreuses bibliothèques n’ont pas connu de stabilité budgétaire. Elles
ont pu connaître, aussi bien une augmentation qu’une stagnation ou une diminu-
tion au cours de cette décennie. Cela explique le sentiment de mécontentement
qui a surgi dans de nombreux cas malgré le fait que la bibliothèque représente
souvent le premier budget culturel de la ville et que l’effort financier concédé par
la municipalité à cette dernière est important. En effet, la fluctuation budgétaire
continue et par conséquent, l’incertitude des moyens accable toute initiative
réelle de développement. Ajoutons à cela l’inadéquation entre les budgets d’in-
vestissement et de fonctionnement. Les tutelles engagent des moyens importants
pour la construction de médiathèques sans, une fois encore, en prévoir les budgets
de fonctionnement adéquats.
Ainsi se présente la réalité des BMVM : un positionnement incertain par rap-
port aux tutelles et des fluctuations budgétaires permanentes qu’il faut gérer. Les
BM sont donc appelées à effectuer des choix, à organiser leurs activités et à plan-
ifier leur actions dans la perspective d’une réalisation progressive de l’ensemble de
leurs objectifs. Cependant, il nous reste à savoir si les BM constituent un champ
favorable au management et à analyser la mise en oeuvre de l’ensemble des solu-
tions dégagées par la littérature, à savoir les solutions de remaniement interne,
de tarification et de recours à l’extérieur (pour la rechercher d’aides financières
ou d’autres nature, pour coopérer avec autrui ou, encore, pour sous-traiter).
182
décision reste du domaine de la compétence des directeurs. L’implication de
l’ensemble du personnel semble limitée. De plus, les outils et les démarches man-
agériales restent méconnus ou rejetés. Les démarches managériales se limitent
souvent à l’évaluation qui se réduit elle-même à son aspect quantitatif et qui n’a
souvent qu’un objectif de légitimation. Les bibliothécaires ont tendance à laisser
parler les chiffres et à comparer le niveau de leurs activités avec le niveau national,
étant donné la sensibilité de la tutelle à cette comparaison.
Face aux fluctuations budgétaires, il apparaît que les solutions adoptées le
sont souvent d’une manière intuitive et subjective. Rares sont les cas où une étude
des besoins a précédé cette adoption et tout aussi rares sont ceux où une évaluation
a été prévue.
Dans le cas d’une diminution budgétaire, les solutions retenues consistent prin-
cipalement, du côte des élus, à diminuer les budgets des acquisitions ainsi que les
dépenses liées aux ressources humaines (le blocage de la création de postes, le
non-remplacement de ceux qui partent à la retraite, le recours aux emplois jeunes ou
à des vacataires). Dans certains cas, «les agents non titulaires représentent 25%
de l’effectif ». De plus, « l’augmentation continuelle du budget du personnel due
principalement à l’ancienneté, soit au passage d’un échelon à un autre, dissuade
les élus à recourir au recrutement et donc conduit à une maîtrise des coûts du
personnel par l’augmentation des emplois précaires ».
Quant aux choix des bibliothécaires les plus conséquents résultent de l’appli-
cation des décisions municipales : redéploiement du personnel (« les agents tour-
nent d’un service à un autre. Le personnel en place comble l’absence du personnel
non renouvelé».), diminution des achats, non-renouvellement des collections,
stagnation ou diminution du nombre d’abonnement. Cela représente donc une
atteinte probable à la cohérence et à l’exhaustivité des fonds. Dans bien des cas, les
bibliothécaires auraient préféré la suppression ou la diminution de services, notam-
ment le service d’animation, afin de préserver les achats de documents. En effet,
malgré l’importance confirmée de l’animation pour la valorisation de l’institution
aux yeux du public et des responsables de la politique culturelle locale5, celle-ci
constitue le premier service que la plupart des bibliothèques acceptent ou envisagent
de supprimer lors d’une diminution budgétaire, afin de limiter les dépenses.
Le travail en partenariat avec les associations locales et la sous-traitance de
certains services comptent parmi les solutions évoquées pour diminuer les dépenses.
A ceci s’y ajoute la redéfinition des sources d’achats : recours aux grossistes, sol-
deurs et clubs, et pression accrue sur tous les fournisseurs afin d’obtenir les
meilleures remises. Cependant, l’application de la loi du droit de prêt et par con-
séquent le plafonnement des rabais à 9% pour les bibliothèques publiques, impose
aux bibliothécaires de trouver d’autres alternatives.
183
Par ailleurs, la création de nouvelles activités rémunératrices parait presque
inconcevable. En revanche, le développement de services payants (expositions
payantes du fonds anciens, production de cartes postales des fonds patrimoniaux,
location de salles, etc.) et l’augmentation des tarifs d’inscription se développent
de plus en plus.
Dans le cas d’une augmentation budgétaire, la tendance est à l’abondance de
l’offre documentaire. Maintes décisions ont ainsi été prises sans études préalables ou
estimation de la capacité réelle de la bibliothèque pour la création de nouveaux
services, pour l’enrichissement des collections ou encore la multiplication des
programmes d’animation. Les augmentations budgétaires ne constituent pas néces-
sairement un facteur garantissant une meilleure offre. Citons, à titre d’exemple, l’ac-
cumulation des acquisitions, en dépit du manque de personnel technique, qui
dans certaines bibliothèques enquêtées a conduit à la fois à une accumulation de
travail mais aussi à la non-disponibilité des documents pour le public. Nous
rejoignons Dominique Arot (1997) lorsqu’il constate que « paradoxalement, la
progression des budgets des bibliothèques ne semble pas se traduire dans la réalité
par une amélioration flagrante du service rendu ».
La pratique de l’évaluation ou les études de besoins sont assez marginales et peu
utilisées. D’un côté, les bibliothécaires ont toujours la conviction que leur produit
répond aux besoins de leurs usagers, mettant en avant leurs connaissances
empiriques. D’un autre côté, une telle pratique managériale requiert du temps, des
moyens et un savoir-faire dont peu de bibliothèques disposent.6 La tendance à limiter
l’évaluation aux statistiques, à la collation des chiffres dans un rapport annuel pour
la DLL ou pour la tutelle, domine toujours.
184
L’évolution de la tarification dans les bibliothèques municipales des villes
moyennes
185
bibliothèque et renforçant leur protection sociale, entrées en vigueur le 1er
aout 2003. Ces mesures ainsi que le plafonnement des rabais engendrent
la hausse des dépenses des communes.
Les bibliothécaires légitiment leur consentement à une politique tarifaire par l’accès
libre et par la différenciation des prix selon la nature des documents, l’âge et la
catégorie socioprofessionnelle des usagers. Des tarifs non-dissuasifs et de nombreuses
exonérations en faveur des enfants, des adolescents et des publics défavorisés (chô-
meurs, bénéficiaires du RMI, etc.) sont appliquées. Une forme de démocratisation
de la culture semble , ainsi, être assurée.
Les recettes obtenues, que les tutelles prennent en compte même si elles sont
souvent inavouées, sont garanties. Pour maintes bibliothèques (41%), la tarification
a permis de couvrir des dépenses et de combler un manque budgétaire. Quelques
citations nous paraissent intéressantes : «La discothèque, son budget est équivalent
à ce qu’elle rapporte». «Les recettes représentent 15% des dépenses».
Dès lors, il est vrai que les recettes obtenues sont marginales et incomparables
avec les financements municipaux et qu’il est illusoire d’escompter d’une BM une
rentrée d’argent à la hauteur des coûts induits, comme le soulignent Dominique Arot
et Sylvie Fayet (1994)7 mais, elles sont souvent essentielles.
Par ailleurs, toutes les recettes sont reversées à la trésorerie municipale et
affectées au budget global de la mairie. Rares sont donc les bibliothèques qui en
profitent. Il en résulte de cela que la satisfaction des contraintes et l’atteinte des
objectifs d’un acteur se réalise au détriment d’un autre. La réussite d’une politique
tarifaire suppose l’adoption d’un compromis entre les usagers (accessibilité), la
tutelle (des entrées financières), les professionnels (la compensation des charges de
travail).
186
L’Etat et les collectivités territoriales demeurent partenaires des BM. Leurs inter-
ventions sont représentées essentiellement par la dotation générale de décentralisation
(77% des BM enquêtées), par les aides du Centre National du Livre (69% des BM
enquêtées) et celles des collectivités locales ( 49% des BM enquêtées)8.
187
mairies ou aux besoins réels des bibliothèques. « C’est vrai que les critères pour
lesquels on le fait, correspond souvent aux critères de la DRAC et pour le CNL,
on se coule dans le moule de leurs priorités ». Nombreuses sont ainsi les con-
traintes dont il est nécessaire d’évaluer les impacts. Nombreux sont par ailleurs
les bibliothécaires qui signalent que les subventions obtenues entrent dans la
caisse de la mairie et ne s’ajoutent pas à leurs budgets. Ils ne sont guère encour-
agés à rechercher des sources de financement spécifique.
Il est fondamental d’évaluer les effets de toute aide extérieure et de pouvoir
juger de son opportunité réelle.
188
L’évaluation des bibliothèques pratiquant la sous-traitance :
189
pétence interne et à une disqualification du personnel. Les professionnels perdent la
mise à jour de leurs connaissances apportées par le travail quotidien et la possi-
bilité d’avancer et d’innover. «Il est nécessaire que le personnel de la bibliothèque
connaisse son fonds». «La gestion propre est préférable pour une meilleure approche
des collections».
Le temps de contrôle et d’ajustement du produit sous-traité au profil exact de
la bibliothèque, tel que dans le cas d’un ajout de données locales dans une notice
bibliographique, aussi bien que le temps d’adaptation, suite au redéploiement du
personnel, sont parfois longs. La nouvelle répartition des tâches est parfois con-
testée. Elle ne satisfait pas nécessairement tout le personnel. Des conflits surgissent.
De plus, la sous-traitance est pour certains le prélude à la privatisation. C’est
pourquoi ils décrivent le métissage public-privé comme « redoutable, négatif, danger-
eux, extrêmement dangereux, impossible, jeu de crétins, pas très sain ». Dans
l’ensemble, le dilemme des bibliothécaires est loin d’être de nature managériale. La
sous-traitance a ses atouts et ses contraintes et son évaluation doit être effectuée en
prenant en compte ces différents éléments.
En outre, de nombreuses activités font l’objet d’une sous-traitance et en même
temps d’une coopération. Il est à noter que 80% des bibliothèques qui pratiquent la
sous-traitance pratiquent en parallèle la coopération. Cela touche les animations et
la fourniture de notices bibliographiques. Il resterait à préciser l’effet que pouvait
avoir la pratique de la sous-traitance sur la pratique de la coopération et vis versa.
190
Les niveaux de la coopération des bibliothèques municipales des villes moyennes
191
local est satisfait. « …Je dis si nous arrivons à répondre aux besoins de nos
usagers, je ne vois pas pourquoi avoir recours à la complexité de la coopération ».
En outre, l’existence des réseaux informatiques inter-bibliothèques à étendue
géographique plus large (en dehors de la commune) est encore embryonnaire. Le
passage en réseau, notamment autour d’une base de données bibliographiques
commune, est souvent subordonné, d’une part, à un investissement matériel et
humain lourd dont beaucoup ne peuvent se doter et d’autre part, à des sacrifices
imposés à l’un ou à l’autre des partenaires sur la base d’un ensemble de règles
normalisant le partage, jugé accablant pour certains.
De plus, l’apparition d’Internet et de la norme Z39.50 permettant un accès
par le web aux catalogues des différentes bibliothèques, a mis en cause un tel
regroupement. «Avoir un portail web commun qui va mettre à la disposition des
gens la possibilité d’accéder simultanément aux fonds des différentes bibliothèques
…est la forme de coopération la plus adoptée actuellement. » L’avenir des simples
réseaux bibliographiques, le regroupement des bibliothèques, uniquement autour
d’une base bibliographique sans autre possibilité, est à repenser face aux nouvelles
technologies d’information. « Il est toujours raisonnable d’avoir un réseau biblio-
graphique mais autour d’une base de données bibliographique spécialisée sur des
domaines ciblés. »
La coopération « traditionnelle », sous forme de rencontres et de discussions
dans un contexte fraternel et non institutionnalisé, paraît être la forme de coopéra-
tion adéquate et préférée des professionnels. Leur raisonnement reste principale-
ment focalisé sur les nouvelles obligations à assumer et sur le surcroît de travail que
la coopération engendre. En effet, la réussite et l’émergence d’un tel mode de gestion
semblent fortement liées au facteur humain. Elles restent tributaires de la bonne
volonté et de la disponibilité du personnel ainsi que de la nature des relations
interpersonnelles au sein de la bibliothèque et des relations avec les partenaires.
Cependant, l’acceptation de la coopération devrait principalement être déterminée
par rapport à l’intérêt économique et informationnel qu’elle présente.
Conclusion
De l’ensemble des résultats obtenus, il ressort que les décisions des BM reposent
rarement sur un raisonnement gestionnaire. La façon dont les professionnels
gèrent leur établissement relève plus de l’intuition, du parti-pris, que d’une véritable
rationalisation économique. Sur la base de ce constat, l’élaboration des outils d’aide
à la décision s’impose. Les bibliothèques ont fait la preuve de leur utilité sociale, il
leur reste à devenir un service public plus performant.
192
Notre travail trouverait son aboutissement dans l’élaboration d’un outil d’aide
à la décision, « une grille d’évaluation » qui permettrait aux décideurs de juger de
l’opportunité réelle de leurs choix dans le domaine de la gestion des biblio-
thèques.
La constitution de cet outil a commencé par la définition de l’ensemble des
composantes d’une bibliothèque. La bibliothèque peut être définie comme : l’ensemble
des moyens matériels et humains auquel s’ajoutent des composantes immatérielles
qui se dégagent de l’ensemble des travaux sur le management des organisations, à
savoir la finalité ou la mission, la stratégie et les méthodes de travail, la culture, le
relationnel et le capital de connaissance.
De plus, la bibliothèque s’identifie aussi par son activité de service, constituée
de deux sous-systèmes en interaction :
• un sous-système de préparation et de maintenance du service ou l’ensemble
de tâches s’effectue loin de l’usager, nommé base arrière ou chaîne docu-
mentaire
• un sous-système de réalisation du service et donc de l’offre de service, qui pour
se réaliser, nécessite des rapports directs avec les usagers.
193
Notes
1. Laurence Tarin .- des lecteurs aux élus.- In : ABF, n° 179, 1998, p 56
2. Anne Marie Bertrand .- Les bibliothèques municipales : acteurs et enjeux .-
Paris : éd du Cercle de la librairie, 1994, p52
3. Une ville moyenne, selon la DLL et l’association des maires des villes moyennes,
est une ville dont le nombre d’habitants varie entre 20 000 et 100 000
habitants.
4. Notre première enquête s’est étalée sur une période de quatre mois. Elle a
débuté en décembre 1999. Sur les 352 bibliothèques sollicitées, nous avons
reçu 163 réponses, dont 145 exploitables, soit un pourcentage de réponses
effectives de 41,19%. Notre deuxième enquête par entretiens s’est déroulée
tout au long du second semestre de l’année 2001.
5. Selon une enquête de F. Rouet sur les bibliothèques municipales (1998), il
constate que 20% des usagers des médiathèques sont intéressés par les ani-
mations.
6. Aline Girard-Billon .- La mise en œuvre des indicateurs de performance dans
les bibliothèques de lecture publique : bilan et perspectives .- In :Mieux
évaluer, mieux gérer, journée d’étude, ENSSIB, 15 juin 1999, 37p
7. Dominique Arot, Sylvie Fayet .- Les budgets des bibliothèques publiques :
du désir à la réalité .- in : BBF, n°3, 1994, pp20-29
8. Le regroupement de ces pourcentages dépasse les 100% étant donné qu’une
bibliothèque peut avoir plusieurs sources d’aides. Elle peut bénéficier d’une
subvention de la DRAC et du CNL en même temps, etc.
9. Timothy Mason .- Le financement de la culture en Ecosse : un système
d’économie mixte.- In : Economie et culture : culture en devenir et volonté
publique.- Paris la documentation française, 1988, pp 145-150
10. A titre d’exemple, ils ne considèrent pas l’achat des notices comme une
opération de sous-traitance.
11. Il est à noter que la définition du cœur du métier provoque encore des
polémiques au sein du corps des professionnels. Les activités constituant le
cœur du métier sont le traitement intellectuel des documents pour certains
et le contact avec le public pour d’autres.
194
Bibliographie
AROT Dominique .- Les bibliothèques publiques confrontées à la rigueur bud-
gétaire : regards croisés France-Allemagne .- In : Économie et bibliothèques .-
Paris : éd du Cercle de la Librairie, 1997 .- pp129-146
AROT Dominique, Fayet Sylvie .- Les budgets des bibliothèques publiques : du
désir à la réalité .- In : Bulletin des Bibliothèques de France, n°3, 1994, pp20-29
AUBY Jean-François .- Management public .- Paris : Dalloz, 1996 .- 118p
BARTOLI Annie .- Le management dans les organisations publiques .- Paris :
Dunod, 1997.- 300p
BENHAMOU Françoise .- Questions posées par l’économie publique aux
bibliothèques .- In : Economie et bibliothèques .- Paris : éd du Cercle de la
Librairie, 1997.-pp147-156
BERTRAND Anne Marie .- Les bibliothèques .- Paris : La Découverte, 1998 .-
123p
BERTRAND Anne Marie .- Les bibliothèques municipales : enjeux culturels,
sociaux, politiques.- Paris : éd du Cercle de la Librairie, 2002.- 147p (2ème
édition) ( 1ère édition en 1994)
BORZEIX Jean-Marie .- La question du droit de prêt dans les bibliothèques .-
Rapport pour Madame la ministre de la culture et de la communication, 1998,
66p, http://www.culture.fr/culture/actual/communiq/borzeix.htm
Department of National Heritage .- Contracting-out in public libraries/ KPMG,
Capital Planning Information (CPI), September 1995, p64
EYMARD Daniel .- La tarification des services dans les bibliothèques .- In :
Economie et bibliothèques .- éd du Cercle de la Librairie, 1997.-pp199-230
GIAPPICONI Thierry, CARBONE Pierre .- Management des bibliothèques :
programmer, organiser, conduire et évaluer la politique documentaire et les serv-
ices des bibliothèques de service public .- Paris : éd du Cercle de la Librairie,
1997 .- 264p
UDAY Apte .- Global outsourcing of information systems and processing servic-
es.-.- In : The information society, vol 7, 1999. p 288
HERO Peter .- Des modes de financement culturel public autres que le finance-
ment budgétaire aux États-Unis .- In : Économie et culture : culture et devenir et
volonté publique, 4ème conf. Inter. Sur l’économie de la culture : , Avignon, 12-
14 mai 1986
KANE Bart, WALLACE Patricia .- L’outsourcing en débat : le dilemme de la
sous-traitance des acquisitions .- In : Bulletin des Bibliothèques de France, n°2
1999, pp83-87
KUPIEC Anne .- Bibliothèques et évaluation .- Paris, éd du Cercle de la Librairie,
1994.- 197p
195
MACVEAN Carolyn .- Outsourcing noncore library activities : a case study of
victorian public library.- In : Aplis, n° 2, 1996, pp83-90
MEUNIER Baudouin .- Management du non-marchand : évaluer pour mieux
décider .- In : Politiques et management public, n°3, 1993, pp97-115
MISSINGHAM, Roxanne .- Outsourcing and libraries - threat or promise? .- In
: Australian Special Libraries, n°27, 1994, p.131-139.
PROBST JB Gilbert, MERCIER Jean Yves, BRUGGIMANN Olivier .-
Organisation et management .- Paris : éd. d’organisation, 1997 .- 709p (177p,
265p, 262p)
QUATREBARBES Bertrand .- Usagers ou clients ? écoute, marketing et qualité
dans les services publics .- Paris : éd. d’organisation, 1998 .- 391p
ROUET François .- La grande mutation des bibliothèques municipales : moder-
nisation et nouveaux modèles .- Paris : Ministère de la culture. Département des
études et de la prospective,1998 .- 196p.
ROUISSI Jalel .- L’évaluation des effets de réseau en bibliothèques : pour une
meilleure prise en compte des coûts et avantages qualitatifs de la coopération.-
Thèse de doctorat, Université Lumière Lyon II, Septembre, 2001.- 274p
SAEZ GUY .- De la démocratisation à la gestion ; l’évolution des politiques cul-
turelles .- In : Équipements culturels territoriaux : projets et modes de gestion .
Paris : La documentation française, 1994.- pp21-29
SALAÜN Jean Michel .- Peut-on-traiter la lecture publique ? Le débat britanni-
que.- In : Economie et bibliothèques .- éd. du Cercle de la Librairie, 1997.-
pp81-83
TARIN Laurence .- Des lecteurs aux élus .- In : Bulletin de l’Association des
Bibliothécaires Français, n°179, 1998, p57
THOMAS Barbro .- Contracting Out Of Public Libraries.- 62nd IFLA General
Conference - Conference Proceedings - August 25-31, 1996
TROGER François .- Services publics : faire ou déléguer ? .- Paris : VUIBERT,
1995 .- 181p
VAN DER GHINST Pierre .- L’outsourcing est un problème de management .- In
: L’informatique professionnelle, n°128, 1994, pp51-58
WILSON Karen A., COLVER Marylou .- Outsourcing library technical services
operations : practices in academic, public and special libraries.- London,
Chicago : American library association, 1997. – 217p
196
Résumé
La bibliothèque municipale face aux fluctuations financières : l’impensé managé-
rial dans les bibliothèques françaises des villes moyennes
Le secteur culturel est connu pour sa fragilité économique. Ainsi les bibliot-
hèques, souvent les premières sacrifiées au nom de la contrainte budgétaire, ren-
contrent régulièrement des problèmes financiers avec lesquels elles doivent com-
poser. Elles sont alors amenées à introduire des changements, à adopter de nou-
velles approches et méthodes de gestion.
Nombreux sont les choix et les modes de gestion alternatifs qui se présentent
aux décideurs. Ils peuvent opérer un repli et tenter de faire face aux changements
budgétaires par des remaniements internes. Ils peuvent décider de tarifer les ser-
vices pour assurer des rentrées financières. Ils peuvent aussi préférer se tourner
vers l’extérieur : pour rechercher des aides, de nature financière ou autre; pour
mettre en commun certains services et ressources avec d’autres organisations et
donc pour coopérer ; ou encore pour confier en sous-traitance certaines tâches à
une entité indépendante publique ou privée.
Notre enquête sur les bibliothèques françaises des villes moyennes montre
que l’ensemble de ces choix gestionnaires est mis en œuvre. Les raisons sont
multiples et varient d’une bibliothèque à une autre. Mais les décisions reposent
rarement sur un raisonnement gestionnaire. Les outils et les démarches de mana-
gement restent encore des concepts ambigus pour les professionnels. Pour nom-
bre d’entre eux, il subsiste une inadéquation entre la culture et l’économie. Dès
lors la façon de gérer leur établissement relève plus de l’intuition, du parti-pris,
que d’une véritable rationalisation économique.
Sur la base de ce constat, ce travail se conclut sur la proposition de construc-
tion d’un outil d’aide à la décision qui permettrait aux décideurs de juger de l’op-
portunité réelle des choix qui s’offrent à eux dans le domaine de la gestion des
bibliothèques.
197
Summary
The cultural sector is known for its economic fragility. Thus, being the first sacri-
ficed because of the budgetary constraint, the libraries are regularly face finan-
cial problems with which they must adapt. Libraries have therefore to introduce
changes, to adopt new approaches and methods of management.
Decision makers have many alternative choices and methods of management.
They can either drawback and try to face the budgetary changes by internal
rehandlings or they can decide to tariff the services to ensure of the financial re-
entries. They can also prefer to seek financial and other kinds of assistance from
outside ; to share certain services and resources with other organisations and
thus to cooperate ; or to entrust in subcontracting certain tasks to a public or
private independent entity.
Our investigation into the French libraries of the average cities ( of 20 000 to
100 000 inhabitants ) shows that all of these administrative choices are imple-
mented. The reasons are multiple and vary from one library to another. But the
decisions seldom depend on managerial reasoning. Managerial tools and actions
still remain ambiguous concepts for the professionals. For a number of them,
there remains an inadequacy between culture and economy. Consequently, the
way of managing their establishment relies more on intuition, bias, than on a
true economic rationalisation.
On the basis of this report, this work concludes on the proposal of the con-
struction of a decision-making aid tool which would allow the decision makers
to consider the real opportunity of the choices they have in the field of library
management.
198
Evaluation of libraries: Experiences
from applying a method for non-market
valuation developed in economics
Svanhild Aabø
Associate Professor at Oslo University College,
Norway
email: [email protected]
The context of my study “The Value of Public Libraries” is two major challenges
for the libraries today: 1) the effects on libraries and library use of the digitisation
in society, and 2) the continuing economic pressure on public budgets generally and
library budgets specifically. These challenges are studied from different angles
within library and information science, varying in both theoretical perspective
and methodology.
Some studies explore the impact of various aspects of public library activities,
such as the impact of reading, of information technology access and end-users
services, or community projects. Other studies investigate the impact of public
library services on special groups, on social excluded, low achievers, and groups such
as children, youth, elderly, persons with disabilities, foreign language speakers,
etc. In addition, there are studies exploring the overall or social impact of public
libraries (Linley and Usherwood, 1998).
My doctoral project supplements this last subgroup of research and goes one
step further, aiming at measuring of the overall value of the Norwegian public
libraries (Aabø, 2005). The economic situation in the public sector continues to be
restrained and the controversy of how to prioritize public funds hardens. In this
situation, it seems necessary to determine the value of public libraries in monetary
terms. To be able to estimate this value, it was relevant to turn to methodologies
developed in economics. The starting point is the economic concept of value.
Economic value
Economic value ”[…] which is not synonymous with financial or commercial value,
although it is ultimately expressible in terms of either a numeraire good or
(preferably) money – comprises any direct use value of the cultural good or service
199
in question, plus whatever non-market values it may give rise to,” states David
Throsby (2003, p. 279), nestor of the cultural economics research area. It is the
economic value of public libraries in this sense that my dissertation seeks to
explore.
The fundamental monetary measures of value in economics are based on sub-
stitutability and can be expressed in terms of willingness to pay (WTP) or will-
ingness to accept compensation (WTA). The economic concept of value has its
foundation in the theory of modern welfare economics and is related to choice.
Based on, and constrained by, his or her economic situation each individual can
choose to consume private, public and other non-market goods, including library
services. The trade-offs that people make as they choose less of one good and sub-
stitute more of another reveal something about the values people place upon these
goods.
My project seeks to find ways to estimate the value of public libraries from the
perspective of the general population. The aim of the empirical study is to measure
the value of Norwegian public library benefits to the citizens in monetary terms and
thus determine if their benefits outweigh the costs of providing them. This will
establish whether or not the general public finds the public libraries worth their
price. In addition, the study attempts to elicit motivations - why do Norwegians,
both users and non-users, value public libraries? The purpose is to provide a better
understanding of the total value of public libraries and demonstrate their instru-
mental value as well as their democratic and cultural value. We must here bear in
mind that the study is based on a valuation by citizens. Expert views of the value of
public libraries and political aims and visions for their activities formulated by
the authorities are not considered here.
Economic analysis relies in most cases on market prices as a first approximation
to relative values. Since library services are not exchanged in markets as private
goods and have no market prices, that approach is inoperable here. Information
on demand and benefits can instead be obtained through methods for valuing
non-market goods which have been developed in economics for application to the
environmental, health, education, and cultural sectors. Approaches for valuing non-
market goods make it possible to achieve estimates of how the citizens value such
goods. If one is able to monetize the non-market benefits of public libraries, these
benefits can be balanced against the costs.
The CV method
The contingent valuation (CV) method is a direct and explicit method using surveys
to value public goods. The method circumvents the absence of markets for public
goods by presenting the respondents with a hypothetical market, in which they
200
have the opportunity to ‘buy’ or ‘bid for’ the goods in question. The CV method is
based on the individual’s own assessment of the goods to be valued. The technique
aims at eliciting people’s willingness to pay in money for a change in the provision
of a non-market good. It has been applied in valuing various cultural goods (Noonan,
2003), such as museums and theatres and also libraries (Harless and Allen, 1999;
Holt et al., 1999).
There are, however, difficulties in implementation of methods based on con-
structed markets owing to their reliance on expressed intent and to hypothetical and
not to real behaviour. A main objective is therefore to bring respondents’ intentions
as closely as possible in line with their probable actions. The description of the
scenario where the valuation is going to take place is critical. Careful considerations
are necessary in designing the scenario in a CV study which consists of three main
components:
1) The choice setting in which the respondents are to imagine themselves,
with questions eliciting their WTP or WTA for the goods to be valued.
2) Information on the paying vehicle and the decision rules for whether or not
the proposed change will be carried out.
3) Questions about the respondents, e.g., socio-economic characteristics, use or
non-use behaviour and attitudes concerning the goods to be valued.
“It is well known that the economic situation in most of the municipalities
is deteriorating. This can imply that some public services have to be reduced
or closed down, unless the revenues of the municipality are increased.
201
Assume that the Public Library Act has been amended so that the munici-
palities themselves could decide whether or not they wanted a public library.
Imagine that the council administration was considering closing down the
library. An option would then be to use the public library in a neighbouring
municipality or for you to buy all books, reference manuals, information
services, etc. needed by yourself and your household. Library services to
schools and adult training courses and to various groups in the local com-
munity, such as the ”Reach Out”-service to elderly in institutions, kinder-
gartens, etc. will cease to exist.
Another alternative is maintaining the library services on the understanding
that the revenues of the municipality are sufficiently increased through
additional local taxes.”
202
tion’s “true” value is reasonably closer to the upper bound. For public goods to
which the citizens perceive they have strong property rights, the WTA estimates are
extra important (MacDonald and Bowker, 1994).
The overall conclusion from the empirical study is that, on the average, Nor-
wegian households clearly value the benefits from public libraries higher than the
costs of providing the library services, demonstrating a cost-benefit ratio of approxi-
mately 1:4. In other words, for each NOK of taxes that is used on public libraries,
the general population gets four times back in benefits. This does not mean that
all the public libraries of the 433 Norwegian municipalities have a positive net
value. The estimate is an average implying that some municipal libraries have a
higher value and others a lower, giving room for improvements. At the national
level, however, the Norwegian public libraries definitely have a net value.
Motivations
The study seeks to elicit the respondents’ motivations for valuing public libraries.
Approximately 40% of the total valuation is justified by own and close family’s
direct library use, 20% by their future library use (option value) and 35-40% by non-
use values, motivated by appreciating other persons’ library use; the libraries’
dissemination of literature, culture and knowledge; and promotion of democracy
and equality. A substantial part of the value of the public libraries is thus moti-
vated by their social and cultural benefits. The majority of respondents are moti-
vated by both self-interest and benefits accruing to others and the community.
This blend of motivations is an important finding and may be interpreted as
reflecting the standing of the public library of today as a community institution.
Summing up
The need to document public library value is apparent owing to continuing eco-
nomic pressure on public budgets. This study is the first CV study for the valu-
ation of public libraries at a national level, in Norway and internationally. Based on
empirical data, a cost-benefit ratio of about 1:4 is established, concluding that the
Norwegian public libraries are, overall, well worth their price as viewed from the
perspective of the general population.
An overwhelming majority of the population perceive they have property
rights to their municipal public library. Both library users and non-users find that
public libraries have value and the majority are motivated by social and cultural
interests as well as self-interest, demonstrating that municipal libraries have charac-
teristics of being public goods.
203
References
Aabø, S. (2005). The value of public libraries: A methodological discussion and
empirical study applying the contingent valuation method. Oslo: University of
Oslo. (Series of dissertations submitted to the Faculty of Arts, University of Oslo ;
222)
Harless, D.W. and Allen, F.R. (1999). Using the contingent valuation method to
measure patron benefits of reference desk service in an academic library. In:
College and Research Libraries, 60, 56-69.
Holt, G. E., Elliott, D. and Moore, A. (1999). Placing a value on public library
services. In: Public Libraries, 38 (2), 98-108.
Linley, R. and Usherwood, B. (1998). New measures for the new library: A social
audit for the new library. London: British Library.
MacDonald, H.F. and Bowker, J.M. (1994). The endowment effect and WTA:
A quasi-experimental test. In: Journal of Agricultural and Applied Economics,
26, 545-551.
Noonan, D.S. (2003). Contingent valuation and cultural resources: A meta-analytic
review of the literature. In: Journal of Cultural Economics, 27, 159-176.
Throsby, D. (2003). Determining the value of cultural goods: How much (or how
little) does contingent valuation tell us? In: Journal of Cultural Economics, 27, 275-
285.
Abstract
In a situation characterized by a growing pressure on public budgets, most public
institutions are under increasing pressure to document their value. Libraries are no
exception in this respect and the situation is reflected in library research. From
different theoretical and methodological positions researchers are striving to
develop instruments, which will make it possible to make valid statements about the
value of libraries. Within the social sciences, economists have developed the most
sophisticated methods for determining the value of non-market goods.
In a recent Norwegian research study to valuate the public libraries in Norway,
we discuss the fruitfulness of and some problems connected to making use of
methods developed in economics for evaluating non-market goods when trying to
determine the value of public libraries. The purpose is to provide a better under-
standing of the total value of a library, both its use and non-use values, as viewed by
patrons as well as by non-users and potential users in the library’s environment.
By surveying a representative sample of the library users and non-users and aggre-
gate the individual preferences, an estimate of the library’s total value in the
organisation can be reached.
204
We have conducted an empirical study of Norwegian public libraries applying
one such method, the contingent valuation. In this study, the value of public libraries’
benefits was compared with the costs of providing them, thus exploring whether
they had a net value. Results from the study show that the benefits from the
libraries are clearly higher than the costs to provide them library services. The
research project explores the possibility of fruitful use of the contingent valuation
method in evaluation of different types of libraries. Crucial for the success of the
method is the construction of a scenario and a survey instrument that can measure
the value of the actual library in a valid way. Based on theoretical discussions and
empirical data we conclude that such approaches developed in economics can con-
tribute to the theoretical and methodological arsenal of library and information
science. This paper gives a brief presentation of the Norwegian study.*
* This paper was first published in the Norwegian journal Bibliotekforum 2005,
30 (6).
205
Customers Value Research
Sue McKnight
Director of Libraries and Knowledge Resources
Nottingham Trent University
Libraries & Knowledge Resources
The Boots Library
Goldsmith Street
Nottingham NG1 5LS
[email protected]
206
lar library service and cannot be used for direct comparisons with other library
services.
Which Customers?
In an academic library, there are many customer segments and all, if asked, will give
slightly to vastly different value elements. Therefore, it is most important to first
identify these customer segments. Then a choice is made, based on strategic deci-
sions, as to which customer segment or segments are engaged in the customer
discovery research process.
The comparisons in this paper relate to undergraduate on-campus students and
academic staff. Details of other customer segments from the Australian university
are available – off-campus students, researchers, executive stakeholders – but have
not been included in this paper as comparative research has not been undertaken in
the UK context.
207
A customer’s perception is their reality. So, it is important to understand their
perceptions and to adjust service provision accordingly. A customer who believes
that inter-library loan services are not available, when these are, is really telling
library management that information about that service is not well communicated.
208
on what adds value for the customer and what are the irritations, and by their
participation in teams established to define what change is required within the
organisation to deliver the customer value package, we create an internal environ-
ment that is not only ready for change, but which is driving the change from the
ground up. Rather than imposed from management above, change is driven by the
customer value propositions and the staff involved in implementing the change. In
this way, there is a much greater chance of staff “buy-in” and the change process is
much more likely to be successful and sustaining.
It is very important to follow up the participants in the focus groups with a note
of “Thanks” for their participation and to provide a summary of the outcomes, the
value propositions that were derived from the customer discovery research. That
way, they know that their participation was appreciated and that the library has
taken notice of their opinions.
Once library staff have analysed the customer research data and identified
appropriate actions to either reduce the irritants or improve the value, it is very
important to communicate the changes that are happening as a result of the cus-
tomer discovery research. This can be done on a regular basis, via articles in the
University’s newsletter, in reports to Faculty/College and School Board meetings,
to the Library Committee and Academic Board. In this way, the communication
reinforces the link between customer values and actions and clearly demonstrates
that the library is not only listening to the people it serves, but also acts upon what
is conveyed to us. The communication is not all outwards, but also into the library.
The library’s operational plan, incorporating the agreed actions to reinforce value
elements and to reduce irritants, reminds library staff of the connection between
customer value propositions and their individual actions.
Having identified the customer value propositions, it is not necessary to under-
take comprehensive discovery workshops every year. Rather, I have found that an
annual validation exercise, where the hierarchy of values and irritants are tested
by way of an online survey, is all that is necessary. Value propositions, in my experi-
ence, tend to remain more or less static, whereas the irritants change as improvements
to services remove or decrease the degree of irritation experienced.
The results of the customer discovery workshops, the value propositions, have
been validated by statistically significant student satisfaction surveys in the UK
university. Over 3,400 students participated in an online satisfaction survey and
produced no new value factors, or irritants, than the discovery workshops that
involved approx. 60 students.
209
segment. It is possible to aggregate the results from the different customer segments
to develop an overall hierarchy of values as well as retain the results for the particu-
lar cohorts. Below are the hierarchy of values and irritants by two major customer
segments, undergraduate students and academic staff, with 1 being the most impor-
tant or most irritating. There are differences in emphasis between the needs of
academic staff and students as evidenced by the different weightings for similar
value factors, and by the inclusion of different value factors for each segment. How-
ever, the overall results are very similar.
210
211
The software, OptionFinder, which is used in the workshops to gather the input
from participants, produces the rankings in a variety of formats. For instance, the
hierarchy of student irritants is expressed as:
212
It is clear from the lists of irritants that not all issues identified fall into the respon-
sibility of the library. For instance, the Library does not provide the University’s
network environment. However, it does have a responsibility to pass this infor-
mation on to the relevant areas of the University to try to influence future decision-
making.
There is often a close correlation between value factors and irritants: Students
value “easy access to materials” and find “materials not where they are supposed
to be” an irritant; they value “Up to date complete comprehensive relevant mate-
rials” and are irritated by “Collection inadequacies” and “Out of date materials”.
The gap analysis is important in confirming or challenging the perceptions held
by library staff. In many instances, staff are not accurate in predicting how the
customers will vote. This, if left unchallenged, could result in energy and resources
being spent on areas that do not add value or significantly lead to improved custo-
mer experiences.
213
Value Modelling
After consolidating all the data from the customer discovery workshops, library
staff are brought together in a final workshop to consider actions that would either
reduce irritants and/or improve value factors. They estimate realistic improvement
targets for those values and irritants and, using the ithink software, can plot the
likely changes in customer satisfaction. This way, library staff and management can
see if the effort is worth the benefit, and this improves the quality of decision-
making.
It is not possible in this paper to fully describe the value modeling exercise, and
the capabilities of the ithink software. However, this method of customer satis-
faction modeling rates overall performance between positive and negative 100.
This is because the total value of all the irritants is subtracted from the positive
value factors. This does make the overall score more difficult to explain to stake-
holders, who are used to seeing a ‘satisfaction rate’ of a percentage, e.g. 70%. Using
this model, a positive score of 30 is considered successful, as there will always be
things that annoy the customer, however good the service is. The aim, over time, is
to make sure that the irritant factors are not critical aspects of the service delivery.
For instance, it would be ‘better’ to have customers complaining about the air
conditioning of a building than about the quality of the reference service.
Having identified the irritations and value factors, it is very important to act
on the findings as quickly as possible, so that customers and library staff see the
benefit of the exercise and the commitment of management towards customer-
focused services. The following table outlines the immediate steps taken by the
UK library service as a means of reducing the irritation factors while, with the same
strategies, improving value to customers.
214
215
Conclusions
Why do we have a library? Because we have customers who need one! Customer Value
Research is used to improve the service to customers. In an academic library context,
it is important to know and understand what the real needs of students and staff are.
Using this methodology, planning is constantly informed by perceptions of current
practices and also by the future aspirations and trends of the market.
Often, having undertaken the customer discovery research, it is easy to say,
“I could have guessed that” or “I always thought that was so.” Rarely are there real
surprises in the value factors. However, the confirmation of what is really valuable
and to know the customers’ perceptions of our services is a mighty management
tool. The regular monitoring of performance against expectations and hierarchy
of values enables close alignment of resources and services. Library staff can see
how their services provide value and participate in the decision-making about how
to deliver on the customer value propositions.
Everyone benefits. Students and academic staff have services and resources that
help them achieve their learning and teaching goals; the library can demonstrate its
value to University and Faculty Executives; library staff benefit from the praise that
follows making the customers happy. It becomes a self-perpetuating cycle of con-
tinuous improvement.
Abstract
The needs (or value factors) of academic library customers, principally academic
staff and students, are the same regardless of what country in the world they
come from. Examples from two university libraries, in Australia and the United
Kingdom, are used to demonstrate that, using the same methodology, there is very
little variation in what customers value about academic library services. The main
variations that do occur are in the irritant factors, the local aspects of the library
service that annoy or frustrate customers, but even with these, there are common
themes. A description of the methodology for Customer Value Research is provided
and the benefits of using this methodology are explained.
216
Management and marketing in the Library and
Documentation Centre of Artium Basque Centre-
Museum of Contemporary Art
Elena Roseras Carcedo
Library and Documentation Department Manager
ARTIUM , Basque Centre-Museum of Contemporary Art
C/ Francia, nº 24
01002 Vitoria-Gasteiz (Alava)
[email protected]
1. Introduction
Devising a marketing programme in Artium’s Library and Documentation Centre
involves analysing library resources and services, drafting a strategic marketing
plan and establishing an evaluation programme to enable us to assess the extent to
which our goals have been achieved.
The marketing plan has been included within the overall planning process of the
library.
217
Through analysis, planning, organisation, execution and control, we seek to
determine the needs of our users and to estimate the potential of the library and
of the market in order to be able to offer services of the maximum quality.
3. a) Internal analysis
The library must have a profound knowledge of what it is and wishes to be, its
objectives, its resources and its weaknesses, its opportunities and threats, etc.
The internal diagnostic process is an overall, systematic and regular exami-
nation of the activities, resources and results of our Centre. This analysis allows us
to highlight our strengths and the areas where we can improve.
Within this diagnosis, it is necessary to consider those elements that exist with-
in our organisation that effect the competitive position of our Library:
• Analysis of human resources: Capabilities, skills and the satisfaction
of the people who work in our Centre.
218
• Analysis of internal performance indicators: Processes and services.
• Analysis of financial resources.
This internal analysis helps us to detect the weaknesses and potentials of the Library.
The internal assessment begins by collecting and systemising the information in our
Centre. This information consists of statistics, management data and process indi-
cators.
Is necessary to analyse the feasibility of the actions and strategies to be under-
taken and examine the risk factors.
We must analyse the library services and their integration within the framework
of the institution. We must examine the existence and operation of formal mecha-
nisms of relationships between the managers of the Museum and the Library.
Is also necessary to assess the actions performed by the Library to inform
Museum staff about the services and programmes it is developing. An analysis must
be made of the pertinence of the documentary requirements of the Museum, and
normalise the flow of communication established between all members of the insti-
tution.
This assessment should not be limited to a simple diagnosis of the situation, but
contain proposals for solutions.
219
4. Analysis of users
Knowing what our customers are like is the starting point for taking any deci-
sion. We need to be familiar with the characteristics of our customers and their
expectations with regard to our Centre.
We must identify which user segments we can differentiate. This identifica-
tion involves recognising the different user groups and adapting our services to
their needs. The aim of this analysis is to offer a better service and, especially, to
enable us to provide it in a more efficient manner. In this process, it is essential
to analyse the needs of non-users in order to try to attract them to the Centre.
In this sense, we can establish different segments of the public:
• The Museum’s own staff. These users need the Library and Documentation
Department as an active instrument in their daily work.
They need information about artists and their works before purchasing
them; they need information as a support for preparing exhibitions, and
once the exhibitions have been set up, they need documentary support to
help them explain the works to visitors to the Museum; they need informa-
tion about art criticism and the latest artistic trends referred to in specialised
periodicals; and they need information about the exhibitions and activities
of other museums.
• History of Art students. Normally they ask for introductory works, ency-
clopaedias, dictionaries, reference works and artists’ catalogues.
• Fine Arts students. They request information mainly about exhibition cata-
logues, monographs on design, films, sound art, video art, reference works
and audiovisual material.
• Guides that take part in visits to the Museum. They need very specific and
thorough information about the artists included in the Museum’s exhibitions.
• University teachers. Normally they inquire about the periodicals we receive
and the latest catalogues that have been published.
• Local artists and artists that collaborate with the Museum in the exhibitions it
puts on. Mainly, they ask for gallery dossiers, information about the latest
trends in electronic art, information about the activities of foreign museums,
as well as articles about art criticism and the latest exhibitions being held
on the international art scene.
• Gallery owners. Normally, they ask for specific information about young
artists who are exhibiting their work and about the new techniques being
developed.
• Researchers. They ask for all kinds of documentary sources about the
subject in which they are doing research.
• The general public. They are interested in films, photography, architecture,
220
sound art and catalogues of exhibitions being held in the Museum or else-
where in Spain.
5. Marketing strategies
Once user segments and needs have been identified and the available information
resources have been defined, a marketing strategy is developed.
It is necessary to provide the project with a strategic dimension. Strategic mar-
keting is a process, which, by means of analysis, planning, organisation, execution
and control, seeks to determine the needs of users and to estimate the potential of
the library and its environment.
By means of this strategy we try to adapt our internal factors to external factors
in order to gain a better competitive position.
Marketing objectives are dependent upon the objectives and strategies of the
institution:
• Consolidation of the library in society.
• Application of an efficient policy to attract users, keep them satisfied at
all times and respond rapidly to any sign of dissatisfaction.
Once the objectives have been established, we must take a series of decisions
about the actions to be taken and on the resources to be used.
221
6.Actions:
• Extension and modification of products and services.
• Improvement in the quality or characteristics of our services.
• Rationalisation of products and services.
• Development of specific communication campaigns.
• Selection of communication means and definition of the messages it is
wished to convey.
• Motivation of Museum staff in the use of the Documentation Centre.
• Personalised contact with users.
Specific programmes:
Digital contents
The main objective is to identify, locate, create, organise and provide access to com-
plete documents in any format: electronic and digital texts, videos, music and any
multimedia material.
The digital contents of the library may be extremely varied, both with regard to
the type of materials it contains and to the diversity of the elements that make it up.
The type of material contained in the library includes:
• Digitised physical material: a part of the printed material is being converted
to digital. The library is digitising part of its documentary collection to
integrate graphics and text information. The documentary supports being
digitised are as follows:
– Brochures published by Artium.
– Analysis of press coverage of the Museum.
– Cataloguing periodicals.
222
– Digitising posters.
– Digitising comics.
Documentary Dossiers
Information dossiers are being prepared in order to document the different pro-
grammes of activities developed by the library and to enable it to offer information
and documentary support for the exhibitions organised by the Museum.
Different kinds of dossiers are produced. On the one hand, we have artists’
dossiers and on the other, dossiers on films, videos, exhibitions, etc.
These digital dossiers allow a high degree of interaction with the user, as they
enable him or her to choose what works he or she wants and when he or she wants
these.
Likewise, these dossiers offer the possibility of a non-sequential reading of the
document. Digital information is designed in order to facilitate different ways of
browsing the contents or gaining access to these.
223
When we access the library catalogue, we find three different sections:
Bibliographical catalogue
In the catalogue, special emphasis is being placed on the notes that com-
plement the information in the bibliographical register, in the relation-
ships established between the different registers that make up the cata-
logue and in the links between the register and the electronic documents
that complement this. The catalogue is a combination of documents on
traditional supports and on electronic support.
In order to be able to integrate all the information generated and facil-
itate the flow of communication with users, the digital dossiers produced
by the Library have been linked with the library management programme.
224
Artist archive
Electronic documents on contemporary artists that are in the process of
being documented.
225
Journal contents tables
In this database, users can consult digitised contents tables of the most
representative journals of the Centre. Once the contents tables have been
digitised, an OCR programme is applied to these, enabling searches to made
of free text against indices.
226
Virtual services
In the library, we try to articulate around the documentary contents a set of serv-
ices that offer added value. The intention is to promote the creation of virtual
documentary services:
• Inter-library loans: The aim of the inter-library loan service is to exchange
and obtain documents between different libraries and documentation centres.
• Desiderata: this service allows users to recommend the acquisition of biblio-
graphical collections (books, magazines, videos, DVD, CD-ROM, etc.) relating
to the subjects covered by the Documentation Centre.
• New acquisitions bulletin: monthly bulletin that presents bibliographical
references of works acquired by the Centre.
• Selective dissemination of information (SDI): service designed for professionals
and researchers of contemporary art. With this service the library intends to
anticipate the information needs of users. To do this, the information processed
by the Documentation Centre on a series of previously-established theme areas,
to which users can subscribe, is sent periodically by e-mail.
• Internet resources: the intention of this contemporary art portal is to provide
access to information on artistic resources. The aims we have established
focus on offering an interactive means of communication for all users inter-
ested in the development of cultural, technical and training activities at a
national and international level. The intention of this resource is to make
the library a reference site for information on art and cultural issues.
227
Monthly activities programme
• Discover other collections. Programming of audio pieces and works of art
in CD-audio, CD-ROM and video together with the documentation asso-
ciated with these collections.
• About the cinema. Collection of documentation relating to the cinema over
the ages and any of its facets, accompanied by an individual viewing of the
corresponding film. With this activity, the intention is to foster cinemato-
graphic documentation, by integrating different artistic disciplines and
documentary supports.
• Documentation about… Bibliographic documentation and exhibition on
different issues relating to contemporary art.
• Getting to know contemporary dance.
Culturally-related activities
• Seminars for Contemporary Arts Documentation Centres
The library organises biennial meetings with the intention of setting up a
forum in which the role of documentation centres can be analysed with
regard to new information dissemination strategies and also to take advantage
of communication technologies in order to favour cooperation programmes
between these centres.
The main aim of this seminar is to foster the development of museum libraries,
providing incentives for co-operation between different institutions and in
this way exploit the full potential of the centres.
• Artium research grant on the documentary heritage of contemporary art
Taking into consideration the aims of the Library and Documentation
Department of Artium with regard to the support and promotion of research
work and the dissemination of the study of contemporary artistic production,
this research grant is organised on a biennial basis. Through this grant, the
Library intends to reach young researchers and to a encourage them to
participate in our project.
• EditArte
EditArte is a programme designed to circulate the different publication
procedures and formulas in the world of art (magazines, catalogues, books
on artists, electronic proposals, etc.) between the public and general, students,
artists and the specialised public.
EditArte has taken the form of small independent but interrelated modules
that form an integral part of the activities of the Documentation Centre.
• Workshops
The library organises a number of workshops to analyse a range of different
228
aspects of artistic creation. These workshops are open to artists, cultural
agents, designers and individuals interested in research and putting into
practice the different projects as these emerge.
• Letters for art
The aim of the “Letters for art” programme is to link art and literature by
offering a new way of approaching and discovering art. Through the eyes
of a series of writers, this programme intends to offer an individualised study
of the most significant works of the Museum’s collection.
• Comics library
Artium’s Library and Documentation Centre considers comics to be a visual
medium which facilitates the collection of information and an instrument to
promote culture. For these reasons and due to its relevance in the formation
of a new artistic discipline, it has been decided to establish a comics library
which will be used as a basis for future cultural activities and as a meeting
place for a new kind of user.
• Corporate image
Firstly, we have tried to build our own unique identity and we intend to
convey this to society.
This corporate image embraces the project towards which the Library and
the corporate culture of our Centre is oriented.
The aim is for users to discover what we have to offer and what they can
229
find in our Centre. The image we convey must be coherent with our trajec-
tory, capable of responding to the expectations created.
• Promotional campaigns
Planning of promotional campaigns aimed at different user segments.
In order to promote and provide information on our products and services,
the following methods are used:
– Publication of information brochures about the Library.
Information brochures have been published about the Library, speci-
fying for whom it is intended, its objectives, the composition of the
documentary collection and sections of the Library opening hours
and contact information.
– Publication of specific brochures to promote the different activities
organised by the Library.
– Information banderole placed at the main entrance to the Museum.
– Bookmarkers.
Bookmarkers have been published with information about the Library
and have been distributed among cultural institutions and given to
visitors to the Museum and users of the Library.
– Guided visits.
Guided visits to the Library, designed for anyone who wishes to know
more about our collections, sections and services, have been organised.
The intention of these visits is to provide users with a clear idea about
what we offer in our Centre and the way to access to our services.
– Book Day.
On the occasion of Book Day, the Museum’s Library takes part with
a stand containing displays of the latest documents received by the
Centre, as well as a small representation of the most recent issues of
specialised contemporary art magazines.
Direct contact with users.
• Establishing alliances.
Relationships with academic and cultural institutions. The Library has taken
part in a number of different conferences and workgroups to provide
information on its products and information services.
• Mass media.
The intention is to convey a clear and powerful message as the help of the
media is considered to be essential. It is essential for the media to be trans-
mitters and witnesses to the different programmes and activities developed
by our Centre.
Apart from periodic news items about our Centre and its activities, a number
230
of articles presenting our Library have been published in specialised art and
documentation magazines.
231
whether this activity has contributed to helping the organisation achieve the speci-
fied objectives.
With this assessment, the Centre ensures, firstly, user satisfaction and the maxi-
mum performance of its resources. The Centre is able to rationalise costs as changes
of activity can be introduced when badly conceived work is being performed and,
likewise, we can use this assessment to justify investments according to quality and
value, to users and interest groups.
The Department has prepared a number of forms for users to fill in when they
are taking part in the activities and in this way determine their level of satisfaction.
The ultimate objective is to improve the services we offer on a continuous basis and
to programme subsequent activities in accordance with the requirements of users.
Some other questions on the form must be filled in by the staff of the Centre, while
the rest are intended for users who take part in the activities.
Our aim is to continue increasing the added value of our services by including
new programmes and innovating and improving existing ones, placing special empha-
sis on the need to reach a larger number of users.
8. Conclusions
Being responsible for the management of the Museum’s collections, as well as other
activities relating to research and the dissemination of contemporary culture,
ARTIUM’s Library and Documentation Department represents a key element in the
pursuit of its objectives.
The aim of the marketing programme is to create an awareness among users
and the Museum itself of the value of the Documentation Centre. A feature of our
Centre is the constant improvement in the quality of the services we offer, allowing
us to reach an ever-larger number of users.
In order to draw up in marketing plan it is necessary to determine the needs of
real and potential users, dividing these into different segments according to types or
groups of specific needs, adjust the organisation to the needs detected, provide users
with information about the services and products offered and to assess their level of
satisfaction in order to make the final adjustments to these programmes.
Bibliography.
Afcosid. Conception, organisation et gestion d’un centre d’information. Paris: PUF,
1988.
BAKEWELL, K. G. B. Managing user-centred libraries and information services.
London : Mansell, 1992.
BOOTH, J. “Marketing public library services”. In Library Management, 1993,
14 (1), pp. 9-23. il.tables.refs.
232
BROPHY, P. Management information and decision support systems in libraries.
Aldershot: Gower, 1986.
BUSTAMANTE, E. and ZALLO, R. (ed.). Las industrias culturales en España.
Madrid: Akal, 1988.
CLARK, E. La publicidad y su poder: las técnicas de provocación al consumo.
Barcelona: Planeta, 1989.
CONTRERAS, Fortunato. Marketing estratégico en bibliotecas y centros de doc-
umentación. Lima: Ediciones Bibliotecología en Debate, 1998.
DAVARA RODRÍGUEZ, J. Estrategias de comunicación en marketing. Madrid:
Dossat-2000, 1994.
EVANS, G.E., WARD, P.L. and RUGAAS, B.: Management basics for information
professionals. New York: Neal-Schuman, 2000.
GALLIMORE, Alec. Developing an IT strategy for your library. London: Library
Association, 1997.
Gestión de la calidad y marketing en las bibliotecas públicas. Barcelona:
Fundación Bertelsmann, 1999.
Gestión estratégica del marketing: establecimiento de objetivos. Madrid: Díaz de
Santos, 1989.
GIAPPICONI, T. and CARBONE, P. Management des bibliothèques. Paris: Editions
du Cercle de la Libraries, 1997.
HALM, J. V. The libraries and information market programmes of the commis-
sion of the European communities. In Alexandria, 1992, 4 (3), p. 171-185.
HAMILTON, Feona. Infopromotion: publicity and marketing ideas for the infor-
mation profession. Aldershot: Gower Publishing, 1990.
JOHNSON, William C. and CHVALA, Richard. Total quality in marketing.
Singapore: S.S. Mubarak & Brothers, 1996.
KEISER, B. E and GALVIN, C. K. Marketing library services: a nutsandbolts appro-
ach. La Haya: FID, 1994.
KINNELL, M. and MACDOUGAL, J. “Marketing public library services-opportu-
nities for change”. In Library management, 1992, 13 (4), p. 22-32.
LAVINE, J. and WACMAN, D. Gestión de empresas informativas. Madrid: Rialp,
1992.
SANZ DE ORMAZABAL, Iñigo. Marketing bibliotecario: estudio de mercado: bib-
lioteca municipal de Rentería. Rentería: Ayuntamiento, Comisión de Cultura ,
1992.
OJIAMBO, J. B. “Application of marketing principles and techniques to libraries
and information centres”. En Library review, 1994, vol. 43, núm. 2, pp. 46-51.
RAMOS SIMON, Luis Fernando. Dirección, administración y marketing de
empresas e instituciones documentales . España: Editorial Síntesis, 1995.
233
RIGGS, Donald E. “Developing a strategic plan for the global library”. In
Planning global information infrastructure. Norwood, NJ: Alex Publishing
Corporation, 1995, p. 79-83.
STUEART, R.D. and MORAN, B.B. Gestión de bibliotecas y centros de informa-
ción. Lérida: Pagès, 1998.
Las tres dimensiones del marketing de servicios: marketing tradicional, market-
ing interactivo, marketing interno. Madrid: Díaz de Santos , 1993.
VICKERY, B. C. “Information management: selling a concept”. In Information
management: from strategies to action. London: Aslib, 1985.
UNE: Información y documentación: indicadores de rendimiento bibliotecario.
(UNE 50137. Equivalente ISO 11620-1998). Madrid: AENOR, 2000.
Abstracts
Devising a marketing programme in the Library and Documentation Centre of
Artium involves a number of different tasks such as analysing library resources and
services, drafting strategic marketing plans and establishing an evaluation pro-
gramme to enable us to assess the extent to which our goals have been achieved.
Firstly, an evaluation model has been established to ensure the total quality
of the services offered by the library. The aim of the methodology used to assess the
quality of the services offered is to obtain objective information of a quantitative
and qualitative nature and in a systematic manner, as a basis for the decisions to be
taken in this Centre in the future.
The marketing programme also includes a comparison of the products and
services offered by the library with those available on the market. This will allow us
to develop the appropriate programmes in accordance with specific user groups.
The systematic evaluation of programmes represents an essential element in
the management of the library. In accordance with the comprehensive approach that
we wish to give the evaluation process, this does not begin when the activities end
but before these are planned and while they are being carried out.
Resumen
La planificación de un programa de marketing en la Biblioteca y Centro de Docu-
mentación de Artium implica un análisis de los recursos y servicios bibliotecarios,
el establecimiento de un plan estratégico de marketing y la fijación de un programa
de evaluación que nos ayude a analizar los logros alcanzados en relación con los
objetivos marcados.
En primer lugar se ha establecido un modelo de evaluación que asegure la
calidad total de los servicios de la biblioteca. La metodología de evaluación de
234
los servicios ofertados pretende obtener información objetiva de carácter cuanti-
tativo y cualitativo de manera sistemática, a fin de fundamentar las decisiones
futuras que se tomen en el centro.
El programa de marketing se completa comparando los productos y servicios
ofrecidos por la biblioteca con los disponibles en el mercado, lo que nos permitirá
desarrollar los programas necesarios, en función de los grupos específicos de usuarios.
La evaluación sistemática de los programas definidos constituye un instru-
mento esencial de la gestión de la biblioteca. De acuerdo con el enfoque integral
que queremos imprimir a la evaluación, el proceso no se inicia cuando finalizan las
actividades, sino desde antes de ser planificadas, y mientras se están llevando a cabo.
235
Marketing to Diverse Populations
Kathleen R. T. Imhoff,
Executive Director/CEO
Lexington Public Library
Lexington, Kentucky,
U.S.A.
Introduction
Lexington, Kentucky, U.S.A. is a southern community of 250,000 with a consoli-
dated city/county government. Known as the “Horse Capital of the World”, its
economy is centered around the sale of horses, horse farms, the world famous
Keeneland Race Course and horse related industries. The gently rolling hills and
bluegrass fields punctuated by white wood and dry stone horse fences compliment
the picturesque landscape.
236
Lexington is an old city by American standards, having it origins in l775. A group
of land-seekers, hunters, surveyors, and speculators exploring Kentucky gathered
and talked about creating a frontier settlement. They called this settlement Lexing-
ton. In the late l780’s the Lexington Library Company was formed. This was the
beginning of what is known today as the Lexington Public Library. This library was
the first public library in America west of the Allegheny Mountains.
The library plays a vital role in Lexington’s present with a collection that
exceeds 750,000 items and an annual circulation over 2 million. A Central Library
and five branches serve the growing population. Lexington Public Library is a place
for children to discover the joy of reading through story times and the Summer
Reading Program. The Library is home to a unique resource, the Kentucky Room,
with local materials dating to l787. It also has unique services like Book Buddies,
community volunteers who deliver library materials to the homebound.
The Lexington Public Library system is composed of a central library and five
branch libraries. The five story Central Library is located in the heart of down-
town Lexington on Main Street. The five Branches, which vary in size, are located
geographically throughout the suburban/urban area surrounding the central city.
All of the Libraries are heavily used as community spaces, for reference and
information seeking activities, for children’s programs, art exhibits, author events,
casual reading spaces, computer use and computer classes, homework help and for
237
materials check out. The Library seeks to meet the informational needs of all of the
people in the county.
238
renovated. It was a former auto shop with black walls, a black and white checkered
tile floor, and a bay to change oil in cars.
The space is located in a very active strip shopping center on a bus route between
a discount grocery store, a pawn shop and a beauty parlor. Many families are within
walking distance which is unusual for an American branch library service area. The
elementary school is less than a half mile away.
Renovation of the space began almost immediately and provided many chal-
lenges since the space was not purpose built. The large, store front glass window
provided good visibility for neighborhood people to watch as the project pro-
gressed. Signs were posted in the windows which announced the coming of the
branch library. People were very curious since most of them were not familiar
with the concept of a free public library. The carpenters and other workers
received many questions about what would fill the space.
239
Figure 6: Bright colors of Village Figure 7: Geometric furniture.
Branch.
Strong colors, bold red, lime green, and royal blue on the walls, doors and
shelves contrast sharply with the checkerboard black and white tile floor. The
counter tops for the information desk and the check out desk are bright lime
green. The lime green colour is continued on the far wall. Red table tops contrast
with the blue chairs. Midnight blue and amber penduleum light globes outline
the children’s space. The meeting room wall is punctuated by random height cut
outs of brightly colored plexi-glass. Shiny, bold red pillars tie the ceiling to the black
and white gleaming floor.
The colours selected for the furniture are bold too. Geometric shaped children’s
stools feature lime green, bright blue and orange. The end panels with stars and
moons cut into the wood are bright blue. All of the table tops are pomagranite red.
The sliding doors are also vivid red.
High impact graphics are another feature of the building. The wall mounted
computer terminals have canopies of bright blue with yellow stars to identify them
as a place to find a computer. Carrying out the same theme, the low dividers at the
information desk and the check out desk continue the same colours and star and
galaxy theme of the fabric partitions.
One of the most difficult obstacles was the cement block wall that, due to cost
constraints, could not to be removed. Note from the pictures that this obstacle was
overcome by placing the staff office, the public computer room and the small meet-
ing rooms in this area. Adding sliding doors to cover the multiple openings in the
cement wall made the space functional.
Another challenge of the renovated space was to make the cement block walls
attractive. Again, the budget did not allow for installing dry wall so a different solu-
tion had to be found. Specially designed fabric panels were made to match the desk
240
Figure 8: Low dividers. Figure 9: Creative utilization of
cement walls.
panels and computer canopies. The panels are each five feet by eight feet, cover
almost the entire cement wall and are the most noticeable feature when you enter
the building. The mural continues into the meeting room. Since the space is a rental
space, if the library were to move, the graphic fabric panels, which are hung as easily
as large pictures, can be removed and taken to a different location. The wall opposite
the fabric paneled wall is painted high impact lime green.
All of signage throughout the building is in both English and Spanish. The library
card applications and welcome brochures are in both languages also. The Hispanic
focus group recommended not having the large Lexington Public Library outdoor
sign in two languages. They were concerned that if it was in Spanish, English
speakers would not think that the library was for them. The library has a self-check
out station. The directional words on the screen are available in both Spanish and
Figure 10: Fabric Panel. Star and Figure 11: Programming for all people.
Galaxy theme.
241
English. The public access catalog has ten language selections available on it, includ-
ing Spanish.
The Village Branch staff is all bi-lingual in English and Spanish. Two thirds of
the staff were born outside of America and come from Cuba, Peru and Columbia.
The Calendar of Events that the library publishes, lists all of the programs that go on
in the six libraries, and has the Village Branch section in both English and Spanish.
The library uses the whole family approach for the programs held at the branch.
Most of the programs that are planned encourage participation from the entire
family. Children are welcome at the adult programs while parents, grandparents and
care givers are welcome at the children’s programs.
The four “A’s” of building design were integrated into the Marketing Plan for the
Village Branch. The first of the “A’s” is adaptability. Many of the shelves are on
wheels for easy moving. When a program is planned that anticipates a crowd
that is too big for the meeting room (over 75), the front shelves are moved into the
meeting room and the front area is used for the program. Sometimes the shelves are
pushed against the wall so that there can be two programs going on – one in the
meeting room and one in the front open area.
Another reason that the building is very adaptable is the sliding doors that
help several areas function in two different ways. The public computer area with
the doors open operates as a computer area for adults and teens. When the doors are
slid shut, the space operates as a computer classroom. When the small meetings
rooms need to be open, the doors are open. When there is a need for a more private
space, the doors are closed.
The big meeting room is very adaptable too. It can be set up with chairs for 75
people in a lecture style. It can be set up with tables and chairs for about 50 people,
and it can be set up without tables or chairs for about 100 people. It also can be set
up for exhibits. The large meeting room contains an overhead LCD projector, a wall
mounted screen, and a movable podium. The double glass doors that lead into
the meeting room let people see what is happening even if the doors are closed.
They can both be opened to make the meeting room area and the contiguious area
connected. The entire space of the library is flexible, the furniture easy to move and
the areas are multiuse.
The second “A” of good building design is Accessibility. The high impact
entrance has a remote controlled handicapped accessible front double door. The
entire building is on the same level and the bathrooms are accessible. The library
shelving is all low and the bottom shelves are not used. Much of the shelving is
face out shelving for convenient selection.
The library functions as a gathering place for the neighboring area including
many school related events. Since the library is located within a half-mile of the
242
Figure 12: Large meeting room. Figure 13: High impact entrance.
elementary school and there is no community center in the area, the library is the
center for many well attended programs and community events. The open hours are
convenient. The library is open Monday through Thursday, Saturday and Sunday
and only is closed on Friday.
The third “A” of building design integrated into the marketing plan is Aesthetics.
The goal of the entire building design was to create a warm, inviting space where
everyone would feel welcome and comfortable. Non-traditional furniture helped to
create spaces where people could sit low on a stool, cuddle with their child on a
sofa, hang-out with teens at a high ice-cream style table with tall stools or relax in
a comfy seat to read a magazine. Part of the marketing plan was to create a posi-
tive perception of the library which would then translate into a positive image.
The fourth “A” of excellent building design is Accommodation. The building is
designed as a safe and secure place for both children, teens, adults and senior adults.
It is a place of coming together for all of the people in the Village Branch commu-
nity. It is a place for enjoyment and celebration.
Figure 14: Warm, inviting space, low Figure 15: A gathering place.
seating.
243
The Branch statistics reinforce after only seven months, the Village Branch
Library is a very well used community space. Since September 2004 when the branch
opened, the circulation has risen from a little over 2,000 items circulated per
month to about 8,500 per month. These statistics do not account for the large
number of items that are used in the Branch, but only include the items that are
checked out for home use. Throughout the seven month period, materials checked
out increased from 9 to 35 per hour.
The reference transactions rose significantly over the same seven month period.
The number of reference questions asked went from 1,500 per month to over 4,000
244
per month. This does not include directional questions. The reference transactions
increased from 6 to 17 per hour.
Other measures of the success of the branch include attendance exceeding
over 200 for family programs, the program and small meeting room space being
totally booked, two and a half additional staff members had to be added after only
five months to be able to keep up with the increased demands for service and the
twenty-four computers are in use at all times with waiting lines, and the materials
budget had to be increased mid-year. The Village Branch of the Lexington Public
Library is a marketing success.
Abstract
This paper outlines the marketing techniques developed and used by the Lexington
Public Library, Kentucky U.S.A. to establish highly successful library service to a
diverse population.
245
Getting help and doing research:
what do patrons want?
An exploratory study comparing desk
users with virtual reference users.
Diane Granfield,
Librarian, Ryerson University,
Toronto, Canada
Introduction
Ryerson and York Universities in Toronto, Canada, have been involved in a real-time
chat reference collaboration since 2001. Catering to a student body of over 55,000,
we have witnessed the service grow in popularity to the extent that by 2003 we
modified our staffing model and increased hours. A successful pilot phase segued into
a relatively stable service. In spite of the clear popularity of virtual reference at our
universities, questions regarding its cost effectiveness do not go away: the length of
time to answer questions, staffing model challenges and the inconsistent performance
of software, to name a few.
Chat services materialized in earnest in the late 1990’s from essentially these pres-
sures and influences:
• Digital content and technologies
• Declining reference desk usage
• Computer labs on campus
• The Net Generation and non-traditional learners (cite)
• More Distance Education and online (distributed) course delivery
• Reference desk aversion and library anxiety
• Learning styles debates, English as a Second Language (ESL), disabilities
• Adoption of call-centre software
• 5 years ago: less broadband
246
Like most academic libraries we had experienced declines in usage at our reference
desks since the early 1990s. Due to the massive changes of the past decade, much
of it because of the emergence of digital technologies and content, the decision
to take on a chat virtual reference service (VR), from our vantage, was a logical,
appropriate and progressive response. (For the purposes of this study, VR (and for
brevity, the acronym) encompasses a synchronous, real time reference encounter
where library staff chat live with library patrons over the internet. Email reference
services will be referred to as email services and are defined as reference assistance
through asynchronous means.)
The initial enthusiasm of VR adoption and experimentation has given way more
recently to decidedly tempered support due to persistent technological challenges
and questions regarding cost effectiveness. At the same time, the community has
matured to grapple with issues concerning the development of service standards
and performance measures, as well as calls to adopt a comprehensive research
agenda (see for example, R. David Lankes, et al, The Virtual Reference Experience:
Integrating Theory into Practice ). One particularly noteworthy sentiment that
struck a chord was voiced by Steve Coffman, one of the early and influential pro-
ponents of chat reference services, when he questioned the ongoing relevance of
synchronous web-based services in an article written in late 2004 (see bibliography).
A rebuttal article was published by Bailey-Hainer (see bibliography). An important
debate has clearly emerged regarding the efficacy of VR, versus telephone, email and
hybrid services.
Our study represents a preliminary and exploratory consideration of the help-
seeking preferences of a growing student body that prefers to be off-site using
digital resources, away from the library, and/or just not willing or able to reach
a reference desk. Specifically, we were interested to know in what proportions
different modes of reference services are used by our patrons (email, chat, phone,
desk and other), what users prefer to do to get help whether on or off campus, and
their preference for location when doing research. We were also interested in
exploring differences, if any, between face-to-face reference desk users and users of
our VR service.
Literature Review
Turning to the literature to find insights into user preferences for different types
of reference services proved challenging and to some extent inspired us to delve into
this research in earnest. Up until the late 1990’s reference services involved mainly
telephone and reference desk services and for a growing number of libraries, email
reference. Interestingly, the literature mostly lacks research focusing on comparative
analyses, even of telephone services. Library users have ever increasing amounts
247
of digital content at their finger tips and many studies show they prefer this format
over print. That we know (see particularly the excellent review article, by Carol
Tenopir listd in bibliography). On the other hand, help seeking preference studies
or studies that compare different reference services reside in somewhat uncharted
territory.
Methodology
Survey
This study consisted of two similar surveys, one in-person and one online, carried
out during the fall of 2004. The surveys were distributed to library users at two
universities in Toronto, Canada: Ryerson University with a full time student popu-
lation of 18,000 and York University with a student body of 38,000.
A pop-up survey was provided to all VR (chat) users over a two week period in
November of 2004; and a similar survey issued to reference desk users over the same
time period. The survey was distributed until an acceptable amount had been filled
out: approximately 100 for each university’s reference desks; and approximately
100 from VR users (the final frequencies for each survey were, reference desk, 242
and VR, 106). Admittedly these sample targets were arbitrary; however, it was some
assurance that smaller groups (like graduate students) would be adequately rep-
resented. The survey asked seven core questions exploring use and preference for
reference services and habits and preferences for study location (in library, off
campus, etc.), resources and chat software use. The survey distributed to VR users
included additional questions on the chat process, expectations and VR software
preferences. The appendix contains both surveys.
Since this is an exploratory study, a purposive, non-probability sampling method
was employed. Given the focus was on patron use of various reference services, a
random sampling of the entire student body was considered too time consuming
and of dubious use at this stage. Furthermore, the data analysis plan was to be able
to compare and contrast VR and Desk users (rather than doing a random sample of
university students or even library users) in terms of their characteristics, prefer-
ences and behaviour. While this type of sampling does not allow for statistical
significance testing (for e.g. Chi square), the survey instrument and the sample size
provide some latitude for descriptive analysis as well as providing the opportunity
to suggest direction and options for future study.
Focus Groups
Four focus groups were conducted both in person and online as an adjunct to our
survey results and to assist us with defining directions for future study. Our
intention was to include the results as a formal part of the research, however, the
248
sample size for the focus groups proved too small: seven for the in-person focus
groups and four for the online focus groups. One of the most interesting learning
outcomes of this aspect of the study was how difficult focus group research can
be, especially the time consuming and often disappointing results of gathering
subjects. Each focus group was given seven questions relating to help seeking
preferences, problems encountered when getting help, expectations of the chat
reference service and suggestions for improvement to the chat service. The results
will be noted as anecdotal evidence only.
Results
In total, 348 library users completed surveys. Of these 106 were completed by
virtual reference users (30%), and 242 (70%) were completed by reference desk
users. The proportion by institution differed between the two types of surveys.
Because York University’s virtual reference service is busier than Ryerson’s the
majority of the VR surveys were completed by York users. 75% were York users,
22% were Ryerson users and the remaining 3% were VR users who used one of
the two services but were unaffiliated with either institution. The proportion was
more even for the surveys completed at a reference desk; 53% of these were York
surveys and 47% were Ryerson surveys.
249
of the reference desk respondents. The Continuing Education category, is a category
of users at Ryerson who are all undergraduates taking part time programs.
Table 2: If you are in one of the libraries, how would you prefer to get research
help? (on a scale of 1-5, where 1=least preferred, 5=most preferred)
Table 3: If you are off campus, how would you prefer to get research help?
(on a scale of 1-5, where 1=least preferred, 5=most preferred)
Survey VR Survey
Telephone Reference 2.6 2.8
Chat Reference 2.6 4.3
Email Reference 2.9 2.9
Library web site 4.3 3.8
Google/search engine 3.9 3.2
Other 2.4 1.9
Tables 2 and 3 represent responses to two separate questions: preference for help
depending if you are in library or off campus, respectively. Among the options we
included consulting the library web site for information, and searching Google
or an internet search engine. We included these options because we felt that our
users may increasingly seek answers to what would be reference questions by
employing self-help strategies and consulting sources on the internet (whether
they be sites we have constructed ourselves or popular external sites).
250
The reference desk is rated highest by respondents from both groups. This
was confirmed by our focus group participants who see the reference desk as the
“premier” service offered by their libraries and the majority see the “face to face”
personal encounter with a staff member as desirable. Desk users and VR users alike
have moderate to low interest in telephone and email in terms of staffed services and
both see the library’s web site and Google as options for research support. How-
ever, for desk survey respondents, choosing the library’s web site and Google for off
campus assistance could be indicative of a lack of awareness of off-site options for
help, since clear differences emerge for the two survey groups in terms of preference
for chat reference. VR users show a preference for chat reference when either on
or off campus, a preference comparable to their preference for the desk. All but one
of the focus group subjects, all of whom were VR users, preferred chat reference
when off campus. The one hold out, preferred the phone.
The meager showing of email and telephone, particularly telephone reference, is
a somewhat worrisome result. Most libraries have policies that position telephone
reference as a lower priority to in-person reference (and this was noted strongly in
the Steve Coffman article criticizing Chat reference services, noted above). Unlike
chat and email reference services, the telephone, for the most part, continues to be
a service offered by staff at the reference desk. This fact is clearly problematic
both in policy and in practice. Focus group respondents had either not used the
phone service or tended to speak poorly of it; though two participants had positive
experiences. It is difficult to generalize the problems with a low preference for
email – the results could reflect a lack of awareness. Focus group participants
generally confirmed this; and a general perception is that it is not “fast” enough
– even though turn-around time for both universities is 24 hours, or better.
It can be concluded from these results that exposure to VR creates a positive
perception and indeed a preference for chat reference services when off campus
that is comparable to the reference desk. It is important to stress that the survey
data tells us that exposure to VR creates some degree of preference for use when
in the library. The majority of focus group participants noted that, in addition to
using VR from home, they had used or considered using VR while in the library.
A majority of the focus group participants were turned off by line-ups at the desk
and preferred VR use in the library for this reason. Two participants noted the staff
“were intimidating” so preferred chat reference over a face to face encounter,
regardless of being on or off campus.
251
Table 4: In the past 12 months how often have you visited one of the libraries?
Desk user vs. VR users
Those respondents who filled out the desk survey were more likely to be frequent
(several times a week/once a week) visitors to the library than respondents from
the VR survey: 68% for the desk respondents and 60% for VR.
Undergraduates Graduates
Library 46.5% 23.5%
On campus, not in library 4.4% 23.5%
Off campus 36% 41.2%
No Preference 13.1% 11.8%
(Total (real numbers) 383 34)
Undergraduates Graduates
VR 2.6 3.4
Email 2.8 3
Phone 2.6 2.9
Library Web site 4.3 4
Google 3.8 3.1
252
It is important to note that graduate students, in real numbers, represent only 34
respondents, making drawing conclusions somewhat problematic. That said, the
data reflects what we do know about graduate students in terms of study habits
and privileges: they have more options in and around campus to study and have
longer loan periods, making library visits less necessary on a regular basis.
Graduate students help preferences reflects a clearer awareness of staff-based
options and perhaps it could be said more sophistication and/or exposure in the use
of library resources and services. For graduate students, unlike undergraduates, VR
figures as a significant choice along with the library web site.
253
when in the library. Although many users have yet to try our virtual reference
services, those who use virtual reference tend to perceive their options for getting
help differently from other users. Far from being a marginal service or unknown,
virtual reference is seen as a significant service option for those who use it.
In addition, our results show that virtual reference services seem to have a
special appeal to graduate students since graduate students are more likely to con-
duct their research outside the library. Johnson’s study showed similar results for both
faculty and grad students in terms of use of email and phone services. Our sample
size for faculty was too small to draw any conclusions at this time. Johnson’s data
also showed there to be slightly more interest for chat services among grad students
than the other populations sampled. Again, it needs to be stressed that the chat
service at Johnson’s university was only one year old.
Though the methodology employed in our study makes drawing general con-
clusions problematic, as an exploratory study it points to a number of useful and
interesting areas for further study. Some of those are listed here for consideration
and discussion:
1) Conduct a study where surveys are provided to email and telephone users.
It may be that, like chat users, exposure to a service and regular use of a
specific service is a predictor of preference for that service.
2) It was problematic to include “web site” and “google” as reference options.
We cannot be sure how survey respondents interpreted these options as
“reference services.”
3) So that significance testing can be performed, survey randomly the university
population of grads, undergrads, faculty, staff; or randomly sample library
users.
4) Consider other angles to the population like distance education, learning
disabilities, part-time vs. full time, to name a few.
5) Ask about awareness of services and about openness to newer services.
These would indicate some kind of understanding of the different services
offered.
6) Focus group participants indicated a desire for “online communities” to assist
in doing library research. This should be explored.
7) Persist with a series of focus groups to get more feedback.
8) Explore sex and age differences with preference for reference service.
9) Library anxiety studies and preference for help.
10) Information Search Process (ISP) – like the work of Carol Kulthau –
research should consider help seeking preferences in future.
254
Studies Considered for Preference for Reference Services Research
Frederiksen, Linda, Cummings, Joel, and Ursin, Lara. (2004), “User perceptions
and virtual reference services,” in The Virtual Reference Experience:
Integrating Theory into Practice, Neal-Schuman, New York, NY. p. 45.
Nilsen, Kirsti. (2004), “The library visit study: user experiences at the virtual
reference desk,” Information Research, Vol. 9 No.2 (internet journal).
(informationr.net)
Faggen, Margie and Fagan, Jody Condit. (2002), “Instant messaging reference:
users’ evaluation of library chat,” Reference Services Review, Vol. 30
No. 3, pp183-197.
Kelley, Kimberly B. and Orr, Gloria J. (2003), “Trends in distant student use
of electronic resources: a survey,” College and Research Libraries,
May 2003. pp. 176-199.
Stoffel, Bruce and Tucker, Toni. (2004), “E-mail and chat reference: assessing
patron satisfaction,” Reference Services Review, Vol. 32 No. 2,
pp. 120-140.
Foley, Marianne. (2002), “Instant messaging reference in an academic library:
a case study,” College and Research Libraries, January 2002, pp. 36-45.
Johnson, Corey M. (2004), “Online chat reference: survey results from affiliates
of two universities,” Reference and User Services Quarterly, Vol. 43 No. 3,
pp. 237-247.
255
Abstract
Are virtual reference users reaching a new type of user? Are they addressing substan-
tially different needs and preferences than traditional reference services? Should
virtual reference be a key player in addressing new service pressures as a result of
the growth in digital content and the shift to remote usage of library resources? These
questions formed the impetus for a comparative study that was conducted to explore
the preferences of our users for different modes of reference assistance as well as
a number of other related variables like visits to the library, preferences for location
when doing research, types of resources they consult and expectations of staff. A
survey was administered to reference desk users, virtual reference users and visitors
to our web sites. To further explore these issues a series of focus groups both in-
person and online were conducted. This session will report on the findings of the
study, the methodologies employed and problems encountered, and suggestions for
further research.
256
Marketing library services.
A case study at University of Illinois
at Urbana – Champaign USA
Yoo-Seong Song
LIR Librarian &
Assistant Professor of Library Administration
101 Main Library
1408 W. Gregory Dr.
Urbana, IL 61801
(217)333-8021
[email protected]
257
they need quick access to quantitative databases with which they can quickly
retrieve numeric data. On the contrary, their use of scholarly journals or other
materials is minimal at best, compared to graduate students in other subject
fields such as humanities and social sciences. Business students and faculty mem-
bers need information resources which they can easily access and which are con-
tinuously being updated, and electronic information has thus become the perfect
solution for them. Electronic information can easily be manipulated and then
incorporated into their business presentations and project assignments, while data
from paper-based resources often require laborious and time-consuming process
to copy data into computer software programs for further analysis.
As the nature of library services changed, BEL strongly felt the need to change
students’ perceptions of the library from a “house of books” to an electronic infor-
mation center. In other words, BEL needed to develop a branding strategy and to
market itself to students and faculty members as a new kind of service provider. To
accomplish this goal, BEL decided to follow basic marketing research techniques
that would involve careful analysis of data. This paper presents a case study in
which how BEL created marketing campaign strategies based on the data collected.
Customer Segmentations
The first step was to determine the target population. The three main segmentations
of BEL’s user group consist of students, faculty, and staff at the College of Business.
These segments can also be broken further into several segments:
• Students
• Undergraduate students
• Graduate students
• International students
• Domestic students
• Faculty
• Fields of study (e.g. marketing, finance, accounting)
• Tenure status
• Staff
• Functions (e.g. admissions, career services, facilities)
It was clear that no single marketing strategy would work effectively for all seg-
ments. BEL needed to build different strategies for individual segments. BEL deter-
mined that the first target segment would be graduate business students, both
domestic and international.
258
Data Collection
Understanding students’ current perceptions and expectations of the library was
critical to formulate marketing strategies. BEL conducted two surveys with question-
naire in 2003 and 2004. The questionnaire was designed to understand demo-
graphics, satisfaction with various library services, and the use of the Internet.
The questionnaire was distributed to business students on various locations on
campus, and a total of 271 valid responses were received. To measure students’
satisfaction with and importance of various library services, the author used the
Likert-scale (5 = very satisfied or very important, 4 = somewhat satisfied or
somewhat important, 3 = neutral, 2 = somewhat dissatisfied or not too impor-
tant, 1 = very dissatisfied or not important at all). The author mainly performed
descriptive statistical analysis due to the insufficient number of the respondents for
meaningful inferential statistical analysis; however, the author also performed t-tests
and simple regression analysis as necessary.
Summary of findings
The author reported the survey results and analysis in detail (2003 & 2004). This
section provides a summary of key findings from the survey results. First, library
instruction proved to be an excellent tool to change students’ perceptions of library
services. The survey results showed that students in general were more motivated to
use library services after they received library instruction, and especially interna-
tional students indicated that library instruction helped them learn library services
which they would not know otherwise. Secondly, it was interesting that space for
personal study was the most important library service to most respondents, and
students showed little interest in virtual reference services via e-mail and online
chat, which the University Library was promoting heavily. Thirdly, the length of stay
at the College of Business did not correlate with the frequency of library use. In other
words, simply spending more years at the College of Business did not lead to the
increased use of library services. Fourthly, graduate business students generally did
not have a clear understanding of subject librarians’ roles, and they did not have
confidence in subject librarians’ knowledge in the field of business. Lastly, inter-
national students had much less experience with electronic business information
resources in their home countries than did domestic students.
The rapid adoption of the Internet undoubtedly affected the nature of library
services in many ways. The survey results showed that approximately 80 percent
of graduate business students had broadband access to the Internet, and thus
telecommunications infrastructure was not a barrier to using electronic business
information on the Internet. Surprisingly, over 80 percent of international students
259
indicated that they had broadband access to the Internet in their home countries,
but about an equal percentage of them had not used electronic business information
via the Internet for research or assignments. The results suggested that advanced
Internet connection did not automatically lead to the use of electronic information
provided by their home university libraries. In addition, such information seeking
behavior was very likely to continue, even after they started studying in the U.S.
About a half of the respondents spent the most time on a number of career-
related Internet sites, and it was potentially the most significant piece of infor-
mation in developing marketing strategies. Business schools at graduate level sought
to train business practitioners, not business academicians, and their quality of
education was ultimately measured by the employment rate of their students and
starting salaries. Similarly, graduate business students’ main motivation for going
to business schools was to find jobs with high salaries after graduation.
260
broadband access to the Internet. BEL now had to emphasize the fact that elec-
tronic information could be accessed from anywhere at any time, regardless of
location and time, as long as students had reliable Internet access. Especially since
many international students had little previous experience with electronic infor-
mation provided by libraries in their home countries, BEL had to make extra efforts
to promote the convenience of accessing electronic information resources using the
Internet.
3) Students did not initiate learning library services but library instruction
greatly changed students’ perceptions of library services. However, the survey results
showed that library instruction was a very effective marketing tool to introduce new
library resources and services to students. Most students stated that they learned
library services that they would not have known otherwise, and library instruction
motivated them to explore library services further. Based on the survey results,
BEL decided that library instruction would be the main marketing channel to
communicate the value of BEL’s services to students and build relationship with them.
4) Library was still viewed as a physical place rather than a service point.
Students valued the space provided by BEL, but they did not know other services
such as reference, instruction, and individual research consultation. Such a percep-
tion might be due to their lack of understanding in the role of librarians and lack of
confidence in librarians’ subject knowledge in business-related fields. Library
instruction sessions were excellent opportunities to help students to have confidence
in librarians’ knowledge in business and to help them realize that BEL was more than
a physical space but a service point where they could receive valuable assistance for
their research.
261
interested. Prior to the workshop, the author contacted all the participants and
asked if they had specific questions. The author then conducted extensive research
to answer those questions at the workshop. The workshop led students to learn
BEL’s electronic information that was easily accessible, and, after the workshop,
those students who did not participate in the workshop request additional work-
shops for them. As a result, nearly 40 students participated in the two work-
shops. The success of those workshops led to more requests from BCSO in the
coming year. Most electronic information resources introduced during the work-
shops could be used for academic purposes such as class assignments, thesis, and
projects. Hence, career research workshops became an excellent marketing venue to
promote BEL’s rich electronic information collection that could be used for a variety
of pedagogical purposes.
Furthermore, BCSO incorporated BEL’s career research workshop as a regular
component in the new student orientation, and, as a result, BEL could start building
relationship with students at the early stage of their programs. Since the length of
stay at the College of Business had no correlation with the frequent use of library
services, promoting library services early was very important. In addition, the
successful collaboration with BCSO led to a new opportunity with other depart-
ments. The Finance Department requested BEL to host a library research workshop
during its orientation for new students in the finance program and the technology
management program within the Business Administration Department asked BEL
to help target potential sponsors for its new program as BEL’s electronic informa-
tion resources were their primary tools for researching potential sponsors.
When providing library instruction in the forms of workshops, seminars, and
classroom teaching, the author carefully designed the instruction so that any
instruction would be a marketing opportunity to communicate BEL’s services and
increase its visibility. Library instruction was generally designed around the concept
of information literacy, which was to help students to become competent in identi-
fying and retrieving relevant information according to their purposes. In addition
to information literacy, two other components were included in library instruction
designed by BEL. As the survey results clearly showed, students initially had low
expectations on librarians’ expert knowledge in their subject areas, and the author
sought to change this perception during instruction. The survey results suggested
that such a lack of confidence in librarians’ subject specialty was especially preva-
lent among international students. Changing the perception that they had carried
over from their home countries proved to be a challenge, but instruction was an
excellent opportunity at least to demonstrate that subject librarians’ deep knowledge
in business fields.
262
4 P’s of marketing mix
Data collected from the survey were analyzed and resulted into the 4 P’s of market-
ing mix. The 4 P’s of marketing mix (product, price, promotion, and place) were the
fundamental concept for marketing, which were widely used by marketing practi-
tioners in developing marketing strategies. Based on the survey results, the author
constructed a marketing strategy using the 4 P’s of marketing (Table 1).
Evaluation
Devising methods of evaluation is a critical factor in any project, but it is also one
of the most difficult items in project management. The author used several methods
to assess the success of BEL’s ongoing marketing efforts. One key indicator was that
8 pt experienced a significant increase in individual consultation requests from
graduate business students. Individual consultations usually took more than one
hour in length, and appointments were usually required. In 2002, there was no
individual consultation request, but in 2004, there were a total of 38 individual
consultation requests, all of which were related to career research. During each
consultation, a student shared personal career goal, interest, and some unique
situation she/he faced in exploring job opportunities. The author, in turn, drafted
research agenda and plans based on the student’s needs, and provided suggestions
in identifying and using relevant electronic information resources.
Also, BEL’s career research workshops became a regular component of BCSO’s
year-long education program for graduate business students. BEL was asked to
provide three career research workshops during the new student orientation, to
participate in career seminars along with corporate recruiting managers, and to
263
help students in writing resumes and preparing for actual interviews. The number
of attendees at BEL ’s career research workshops grew from 42 in 2002 to 126 in
2004. The role of BEL in helping students with career research expanded significantly
as a result.
Conclusion
Reshaping user perceptions of BEL was a challenging initiative, especially because
the traditional perception of BEL as a house of books had been shared among
students and faculty members for a long period of time. To formulate effective
marketing strategies, collecting data to understand current perceptions and
expectations was necessary instead of simply depending on librarians’ opinions and
observations; subsequently, transforming survey findings into actual marketing
plans through analysis greatly helped build BEL’s new identity as an electronic
business information center. Undoubtedly, new strategies will need to be developed
when BEL targets different segments such as undergraduate business students, the
faculty, and the staff. Regardless of the target segment, however, collecting and ana-
lyzing data through careful research design and implementation will serve as the
foundation for developing marketing strategies.
References
DeHart, B. (1996). Job search strategies: library instruction collaborates with
university career services, Reference Librarian, 55, 73-81.
Feast, V. (2003). Integration of information literacy skills into business courses,”
Reference Services Review, 31 (1), 81-95.
Glynn, T., & Wu, C. (2003). New roles and opportunities for academic library
liaisons: a survey and recommendations, Reference Services Review, 31 (2),
122-128.
Hollister, C. (2005). Bringing information literacy to career services, Reference
Services Review, 33 (1), 104-111.
Song, Y. (2005). A comparative study on information-seeking behaviors of
domestic and international business students, Research Strategies, (In press).
Song Y. (2004). International business students: a study on their use of electronic
library services, Reference Services Review, 32 (4), 367-373.
264
Abstract:
Due to changes in pedagogical requirements for business education and students’
information seeking behaviors, the Business & Economics Library (BEL) at the
University of Illinois at Urbana – Champaign sought to launch a marketing cam-
paign to promote its new services. BEL conducted extensive survey to study stu-
dents’ experiences and expectations of library services, so that it could develop
marketing strategies that would meet students’ needs based on the survey results.
This paper discusses how BEL constructed marketing strategies by applying statisti-
cal analysis, and preliminary results of the marketing campaign.
Challenge: Starting 2002, the BEL sought to reshape its image from a “house of
books” to an electronic business information center. The authors conducted exten-
sive research to study user experiences and expectations of library services and
developed marketing strategies to promote the BEL’s services.
Solution: Overall, the key elements of the BEL’s marketing strategies were collabo-
ration with the Career Services Office in the form of co-branding and relationship
management with faculty. Research activities also provided valuable insights into user
experiences and expectations, which became the foundation of marketing strategies.
265
Marketing Strategies
The BEL then developed several marketing strategies using the 4P’s of marketing
mix. To increase its visibility and awareness, the BEL determined that collaboration
with the Career Services Office was critical and proposed to hold joint programs.
The BEL also developed instruction programs on business databases which students
expressed their strong interest to learn. Most instruction sessions were held at
computer laboratories to be hands-on classes, so that students could immediately
see and learn the benefits of electronic resources. In addition, the BEL continuously
cultivated and maintained close relationships with business faculty members who
would then become strong advocates of the BEL, and in so doing, the BEL could
establish strong presence as a pedagogical partner.
Evaluation
Various methods were used to assess the success of the BEL’s ongoing marketing
efforts. One key indicator was that the BEL experienced a significant increase in
individual consultation requests from international students who had traditionally
not been active users. The BEL’s special instruction programs also received high
ratings from participants. The Finance Department also embedded the BEL’s
library instruction sessions into the official orientation program for graduate
finance students. Graduate students also rated the BEL’s services highly according to
the survey administered by the University Library.
266
The Library as a part of cultural behavior.
Summary of a large scale survey to identify user
trends and reading behavior in Flanders libraries
Bart Vercruyssen
Project Manager,
Vlaams Centrum voor Openbare Biblioteken vzw,
Brussel, Belgium
Introduction
Flemish libraries and library legislation
Since it became mandatory in 1978 that every community, city or village have a
public library the Flemish1 region has what is known as a high “library density”.
This means that there are 309 libraries with more than a 1000 service points covering
every part of Flanders. In total the Flemish libraries employ about 2400 people, 1600
of which are full time. The majority of library employees are female including at the
executive level.
Flemish libraries provide in general a wide range of information and cultural
services. In every Flemish library you will find both fiction an non-fiction books,
magazines, multi-media resources, databases as well as computer facilities. Two
thirds of the libraries also have an audio CD and DVD/video collection.
Depending on the calculation mode between 28 to 35% of the population of
Flanders are a member a public library or visit the library. Most of the members of
the library, 67%, are older than 15 years old.
Since the year 2000 the library legislation in Flanders has changed profoundly.
Whereas prior to 2000 the legislation focused primarily on definin what a library is
(what is a library, how many titles, surface of the library …) the new library law
shifted its attention to what a library should do (what is the place of a library in
a society). The basis for governmental library subsidy became more qualitative
instead of quantitative.
1) Although Belgium barely has a population of 10 000 000 people it is a federation consisting of Flanders
(the Dutch part), Wolonia (the French part) and finally the Oostkantons (the German part). Cultural affairs,
ic library legislation is insight the authority of the ‘federations’, therefore we’ll speak about Flanders here.
267
In order to achieve this major turn around communities, cities and villages
received greater autonomy in dealing with their financial recourses. A business
plan for every library became mandatory and a support/expertise centre –the
Flemish Agency for Public Libraries (VCOB)- was founded.
268
This paper will focus primarily on the market research done in 2004. This
involved a major investigation of the people who utilize the library.
User research
Basic assumptions:
Before 2004 there were basically no useful statistics on library users available.
As a direct result of the fact that every library needed a business plan the demand
for user data grew. To avoid every library starting its own survey independently
the VCOB launched a project that responded to this need for data.
Because the VCOB is a support centre with no actual authority over the
libraries we were limited in the ways to set up such a massive project. We calcu-
lated that there are roughly two ways to set up such a project. One might set up a
training program that enables the interested librarians to perform a survey them-
selves. Another way would be that the VCOB sets up a survey and publishes the
results so they can be used by the libraries.
The advantages of the former method were its was low cost and that the
VCOB has experience in this approach since it had been successfully used for the
process of business planning. The disadvantage lay in the fact that a great effort
would be needed from the local librarians who would need training in market
research and statistics. Given the educational background of a majority of the
staff (human and social sciences) this was not evident.
Together with the University of Brussels the VCOB (Flemish center for public
libraries) collected in 2004 an impressive mass of data among the library visitors.
Based on random samples in 165 libraries from more than 32 000 visitors we’ve
got the answers on a large survey form as well as what those visitors borrowed
during 6 months. As thus this became the largest survey ever performed in Belgium
in the field of public libraries.
The collected data is now being used for marketing goals. Using a recent devel-
oped logarithm for clustering and starting from their cultural behavior and media
preference, six different user groups have been detected among the library user.
These types were called: fun seekers, the house sparrow; the cultural passer-by; the
cultural fastidious, the omnivores and the cultural elite.
Secondly this approach would have led to a patchwork of data that would have
been difficult to compare to each other.
The top down approach guaranteed unified and comparable data, but in order
for it to be useful to the individual libraries we knew it was imperative that many
people be questioned. At the very least enough people so that something useful
could be said for every type and size of library. It became obvious that this data
collection would become too expensive.
269
Therefore a project was designed that combined the best of two worlds. All
operations that needed statistical expertise were done on a central level and all
tasks involving collection of data, for instance, distribution of the survey forms
and entering the answers were done at the local level. In this approach three basic
assumptions were formulated:
1. Scientific correctness.
The method of data collection and the data processing had to be designed
and preformed according scientific and mathematical standards.
3. Easy to perform
All tasks that needed to be done by the local libraries were clear and didn’t
assume a specific background from the library employees.
Research assumptions
Even in a non-profit environment the essence of marketing is that it should be used
to increase ‘turnover’. As a library our goal is to get new people to utilize our facili-
ties or we want existing users to come to the library more often. A market study is
in this respect useful when it reveals interesting market segments. To find interesting
segments it behooves us to know why people are, or are not as the case may be,
attracted to certain products or services. The question becomes thus: what are the
underlying motives for people to visit a library.
Answers to this question were found in recent sociological research by the TOR
group at the Free University of Brussels. Based upon studies in the use of time these
researchers developed an interesting framework that became the backbone of the
survey.
There is great consensus about the fact that post war European society includ-
ing Flemish society was structured around age, income, gender and religion. These
factors were predominant in people’s life and choices. Consequently a whole net-
work of schools, newspapers (media), unions, political movements, socio-cultural
institutions, etc. were built based upon these factors. Not surprisingly Flemish
libraries were also structured based upon these factors.
270
The TOR researchers subscribe to the common view that these patterns that
structured the post war European/Flemish society have mostly ‘evaporated’. However
they refuse to accept that there is no structure at all anymore. In their observations
of how people spent their leisure time new and clearly defined patterns were found.
Because of their appearance the new factors are called symbolic.
After analysis of all the activities that the examined people did in their free
time it became obvious that there were two dominant dimensions in the activities.
The first dimension can be called the cultural value of activities. Visiting opera and
theater have for example a high cultural value. The other dimension focuses on the
fun and action value. Examples of activities with high fun and action value would
be visiting sports games and discos.
With these two dimensions a coordinate system with two axis can be drawn,
creating as such four different groups or segments.
The segment in the upper left field is called “cultural univores”. People in this
quadrant participate predominantly in activities with a high cultural value. These
people are seen in the museums, opera and theater houses. In their choice of media
271
this group prefers quality newspapers and information and/or classical radio and
TV stations.
At the lower right side the fun/action univore is found. This group exclusively
participates in activities belonging to the “fun world”. They are seen at bars, discos,
sports events and movie theaters. This group prefers popular newspapers and media.
People in the upper right side are called omnivores because of their tendency to
do both type of activities. These people go to the theater and classical concerts, but
they also like to go to bars, sports events as well as music events. However their media
preference is more similar to that of the cultural univore than to that of the fun/
action univore.
Finally in the lower left corner we have the non-participants. These people do
not participate in any form of outside leisure at all. This generally, although not
exclusively, older group is found at home in front of the television in their free time.
Popular media is predominant in this quadrant.
Based upon an analysis of existing datasets it became clear that library visit
was also determined by these factors. Library visitors were found unevenly in all four
groups but there were strong indicators that the way of use varied accordingly.
Thus the challenge became to reveal witch segments came more or less fre-
quently to a library and above all who comes and for what purpose.
Project outline
Due to a unique partnership between the VCOB, the research unit TOR and the indi-
vidual libraries a large set of data was gathered in a relatively short period of time
and at a low cost for all the partners involved.
Libraries joined the project voluntarily and paid a small contribution. As already
mentioned the libraries also performed most of the fieldwork.
After joining the project a random sample of the members of the library was
taken. The library software was then prepared for the survey and the library staff was
trained to do the fieldwork.
During six months all data was gathered and analyzed. The results were pre-
sented in individual reports and using an interactive website.
Random sample
In all the libraries that joined the project a random sample was taken. According
to the size of the library these sample varied between 100 and 500 active adult
members. An active member was somebody who did at least one transaction in
the year preceding the survey.
The members of the library taking part in the sample were check marked in
the library software so that their lending activities were stored and so that the
272
Random Customers Analysis Individual report
sample taken Questioned
in participation
On line
5. Data collection
This part of the project was done primarily by the individual library. Therefore
the library staff received a brief training. During this stage of the project a
helpdesk was available during office hours.
In total more than 300 people were trained in six days.
In order to get an answer to al the questions that lived at al different levels it was
decided that three major datasets would be collected. Knowing a survey form,
borrowed items and library features.
Survey form
In a large surveyform questions were asked about library use, the library experi-
ence, visitors backgrounds and specific variables.
Library use
In this subset questions were asked to reveal how people use the library.
For instance, what materials, how do find your materials, when do you
come, with who, why, etc.
Library experience
In a number of questions peoples opinions were asked. This part naturally
contained many questions about satisfaction, general and specific, but also
opinions about the image of the library and its staff.
Background
Not only were people asked about “classic” variables such as age, gender,
education,etc. but they were also asked how they spent their leisure time,
what kind of media they preferred, as well as general opinions about reading
and education.
273
Specific variables
Finally every local library was given the possibility to add specific questions
to the survey form. The majority of these questions were about the use or
satisfaction of a specific or new service.
Borrowed items
During six months every transaction of the people taking part in the study that was
stored. A transaction consisted of what item (book, cd, etc), the title, the author and
the borrower’s identification number. The identification number consisted of a set of
numbers that made it possible to join this set of data to the answers of the survey form.
To obtain this data changes had to be made to the local library systems. Due to
privacy laws this information is not automatically stored.
After six months all the libraries sent their data to a central point. It was
clear that the local datasets needed data cleaning before it could be consolidated
into one database. The union catalogue of the five largest libraries in Flanders was
in this respect very useful.
The result is a dataset that can be analyzed in detail on the level of individual
borrower, type of material and book genre, title and author both for fiction and
non fiction.
Library features
Finally the libraries had to fill in a survey themself. Questions were asked about
the library. For instance, how big are the different collections, when is the library
open, what are the tariffs, does the library do any particular actions, etc. This
information was used for multi-level analysis and provided insight into the relations
between the features of a library and the actual user. For example, is there a
corollation between the satisfaction of full-time employees and the opening hours
of a library?
The added value of all these datasets lay in the fact that they are interconnected
and that an almost endless number of relations can be analyzed.
In total more than 32 000 people handed in their survey form and more than
500 000 borrowing activities were registered.
274
Finally cluster analysis of the loan statistics will be made as well as the multi-level
analysis.
275
Fig 3: Age structure of the Flemish library user
REASON OF USE
The library is mostly used for recreational purposes (a good book or CD). Infor-
mation is for almost half of the people a reason for visiting the library. About a third
visit the library for the children. Computer and internet score surprisingly low.
LIBRARY VISIT
An overwhelming majority of the people, 86,6%, visit the library at least every
month. The larger the library the bigger the groups of both very occasional as well
as heavy users (more than once week) become. The monthly visitors are more pre-
dominant in smaller libraries.
A library visit takes in 82,7 of the cases no longer than a half an hour. The bigger
the collections the longer a visit takes.
USE OF MATERIALS
Almost all users come to the library for books (98,1 %). About half (42,4 %) also
use CD’s. Comics, video/DVD, cd-rom and magazines are used by +/- 20%.
SEARCHING MATERIALS
Books are found by wondering between the shelves or by going immediately to the
title of choice. A smaller but significant amount of, about one third, use the catalogue.
SATISFACTION
Visitors are very satisfied about the different library services. Only the availability
of new books and the printer and copy services score a bit less. It is obvious that the
bigger the library the less satisfied the people are. This is a strange twist since the
availability of new works is actually higher in larger libraries.
73,7 of the visitors indicate that they are satisfied about the opening hours. When
276
asked when a library should additionally be open saturday afternoon and, to a lesser
extent sunday morning, were the top answers.
MARKETING CONCLUSIONS
Based upon this data marketing conclusions can already be made.
A more thorough investigation of the data shows that the age variable follows
a particular strange pattern. The age curve of the library visitors starts with a steep
drop for the age group 18-30. At 30 years the curve starts to climb again to reach it’s
highest point at the age of 40. After this age the curve starts to decline although less
dramaticly than the way it did between ages 18 and 30. Finaly at an age of 70 the
decline seems to almost stop.
By examining the curve four age groups can be defined (18-30; 30-45; 45-60;
60+) which we will look at more closely.
277
likely be someone from this group.
This is the functional, young and unsatisfied multi-user!
278
Starting from this analysis the VCOB is shifting it marketing attention to the
two middle groups. Via promotion the re-entry of the 30-years old must be intensi-
fied and by loyalty and retention programs the drop out of the 45-years old must be
tempered.
To do so, deeper insight is needed into the core of these two groups. Therefore
the aforementioned framework as outlined by TOR is useful.
SYMBOLIC SEGMENTS
As it was mentioned in the project outline the aim was to use this data for marketing
purposes. Therefore segmentation using the framework of the TOR researchers
proved useful.
Analysis of the loan statistics is still in progress but a first clustering, based
mainly on the survey, reveals indeed six different ‘symbolic’ groups, as seen in the
table below.
The popular univor is a younger segment. They are more female and have in
general a lower level of education (compared to the other library users).
Cultural tourist
Cultural fastidious
279
Cultural axis Fun axis Media Demografics
Fig 5: Overview
In their leisure time they like activities that belongs to the “fun world” (bars,
discos, sports events and movie theaters). On the other hand they don’t go to pure
cultural activities. They prefer popular media.
The house sparrow is called so because this segment doesn’t participate much at
outdoor leisure activities at all : they’re not seen at fun activities, nor at cultural
activities. This middle aged, more female group has the lowest level of education and
also prefers popular media.
280
The cultural tourist and the cultural fastidious are similar groups. They’re both
higher educated and a bid older than the former group. Gender wise they’re more
evenly divided. Both the cultural tourist and the cultural fastidious have an average
score on the fun and cultural axis. The big difference between the two of them lies
in their media preference : the tourist prefers popular media, the fastidious prefers
quality media.
As we can expect he omnivore participate both on fun and cultural activities. In
this younger and higher educated segment the proportion men and women are almost
equal. They prefer quality media.
Finally the older and high educated cultural elite only goes to cultural leisure
activities. The prefer quality media and also are gender wise evenly divided.
Conclusion
Due to an unique partnership between the support centre for Flemish Public libra-
ries, 165 libraries and a university, a process of data collection an analysis was
successfully completed.
The results of the survey showed that the Flemish library user is more educated
and more female and between the 30 and 45 years old. The recreational function of
the library seams to be the most important for users and they are very satisfied.
Based on the lifecycle four groups could be identified. Based upon this insight
promotion attention should be drawn to the group between 30 and 45 since this is
a group that tends to return to the library. Loyalty and retention programs should
be designed for the group after 45.
Further investigation showed that based on cultural behavior and media pref-
erence, library users can be segmented into different interest groups.
The next step will be that this information should be translated in an opera-
tional marketing strategy. Further also the lending histories will be incorporated in
the survey.
Abstract:
Together with the University of Brussels the VCOB (Flemish center for public
libraries) collected in 2004 an impressive mass of data among the library visitors.
Based on random samples in 165 libraries from more than 32 000 visitors we’ve
got the answers on a large survey form as well as what those visitors borrowed
during 6 months. As thus this became the largest survey ever performed in Belgium
in the field of public libraries.
281
The collected data is now being used for marketing goals. Using a recent
developed logarithm for clustering and starting from their cultural behavior and
media preference, six different user groups have been detected among the library
user. These types were called: fun seekers, the house sparrow; the cultural pass-
er-by; the cultural fastidious, the omnivores and the cultural elite.
282
Evaluating library services – best practice
initiatives in Australian university libraries
Helen King
Associate Librarian
La Trobe University Library
Victoria, Australia
[email protected]
Introduction
Collection and use of data in the planning and management of library activities, and
the measurement of performance of these activities has a long history. In recent years,
with the automation of library functions and the shift to a networked information
environment, the potential sources and types of data that can be collected have
increased, at an almost exponential rate. This has resulted in the need for libraries
to refocus on data collection, question their current activities, and rationalise efforts
to ensure that the range of data being collected is relevant, sustainable and meets
specific objectives. In other words the reasons for collection are clearly understood
by all, and can be justified in terms of their role in the monitoring and improvement
of library performance. Hiller and Self (2004) provide a useful historical summary,
tracing the evolution of data collection and its application in improving library
performance. The authors contend that a key catalyst in the evolution of collecting
data for improvement was the introduction of strategic planning in libraries during
the 1980s. This resulted in the implementation of planning and improvement frame-
works, which identified overall library objectives, action plans to meet those objec-
tives, their implementation, the monitoring and evaluation of results through mea-
surement activities, and the consequent introduction of new actions to improve
performance.
This evolution of data collection for measurement purposes has now reached a
stage where performance measures are being grouped into three main categories –
283
inputs, outputs and, increasingly, outcomes (or impacts). Examples of inputs are size
of collections, size of budgets and staffing profiles; examples of outputs include use
of collections, number of reference questions answered and number of information
literacy classes held. Outcomes, on the other hand, are more complex and have been
broadly defined as “what impact the library has on the life of its clientele” (Hiller
and Self, 2004, p.140) and “the ways in which library users are changed as a
result of their contact with the library’s resources and programs” (ACRL, 2000).
This shift in the measurement focus is being particularly driven in the United States,
with the many accreditation agencies now moving to outcomes based assessment.
However, as Cullen (2002) observes, “outcomes have proved to be a more difficult
area of evaluation, and there is no work to date on standards for outcomes”. Hiller
and Self (2004, p.2) in discussing recent deliberations of the ARL Committee on
Statistics and Measurement, note the ARL comments that “it is only through using
a wide variety of measures that one can hope to get a full and accurate reading of
the library’s activities”. The ARL New Measures Initiative was established to explore
data collection measures that would “go beyond traditional input/output measures,
to capture the use and impact of libraries”. Eight areas of interest have been iden-
tified by the ARL initiative – user satisfaction, market penetration, ease and breadth
of access, library impact on teaching and learning, library impact on research, cost
effectiveness of library operations and services, library facilities and space and orga-
nisational capacity (ARL, 1999).
Hernon and Dugan (2003) further note the need to recognize that the measures
utilised will differ according to the perspective of who wants to know. They contend
there are four perspectives which need to be considered –
1. library centred - the library’s perceived service priorities and its success in
meeting these priorities as defined by input, output and performance measures
2. institution centred – the output and performance measures used to demonstrate
the library’s contribution to accomplishing the institution’s mission
3. user or customer centred – the comparison of user expectations with service
performance, the gap between expectations and performance and the data
that will lead to improved service delivery
4. stakeholder centred – measures will include elements from the above three
but also new requirements for demonstrating institutional effectiveness and
efficiency. The focus shifts to “what happened because of the outputs” and
introduces the concept of outcomes assessment. In the case of libraries, an
example would be “how does the library’s information literacy program
contribute to the knowledge and skills that students should display by the
time of graduation”. The authors argue that the impact of outcomes assessment
284
is only starting to unfold and will alter institutional and organisational
(e.g. library and academic programs) cultures over time.
The challenge for library researchers will be to develop, as Hernon and Dugan note
(2003, p.2) “a universal set of measures and data reporting methods from which we
can select, given the perspective we are trying to address.”
Terminology
The evolving nature of the measurement debate requires some clarification of the
terminology used in this more practically oriented paper, which describes the ini-
tiatives in Australian academic libraries. Here, the definitions of Hernon and
Dugan are followed, namely
Assessment is a set of initiatives the institution takes to review the results
of its actions, and make improvements
Evaluation is narrower, and produces data to improve service and to ensure
the results conform to the stated mission, goals and objectives
This paper focuses on evaluation activities which, unlike the concept of assessment,
and more specifically outcomes assessment, are well developed and understood
and have been used over a long period of time.
285
Council of Australian University Librarians (CAUL) Initiatives
In Australia, national co-ordination and encouragement of collaborative initiatives
between university libraries, including the development of performance measure-
ment and benchmarking is facilitated by CAUL, the Council of Australian University
Librarians, primarily through its Best Practice Working Group. Significant achieve-
ments in this area which have been achieved through CAUL initiatives are
1. the annual collection of statistical information which enables comparison
of key library input and output measures, and the ongoing revision and
updating of the range of statistics that are collected by university libraries.
2. the development of three performance indicator kits in 1995 which were
intended to provide standard instruments to be used by libraries in moni-
toring their own performance, and sharing this performance information
with other libraries
a. Library/clientele congruence indicator
b. Document delivery performance
c. Proportion of sought material obtained at time of visit (Materials availability)
CAUL has developed a Best Practice Database on the CAUL website1 which
enables the loading of individual library results for Document delivery perfor-
mance and Materials availability surveys, and also provides access to results of
286
the customer satisfaction surveys. Results can then be compared with both a
specific library’s previous performance, and the performance of other academic
libraries in the database, providing both internal and external performance bench-
marking opportunities.
3. the sponsorship of the Performance Measures for Reference Services Working
Party established in 1994 to:
- identify performance measures and indicators currently used to evaluate
reference services in Victorian academic libraries
- identify from the professional literature performance measures and
indicators for evaluating reference services in academic libraries
The final report of the Working Party was published in 1998 2 and summarises
the indicators and measures used by undergraduate, postgraduate and academic
staff at 8 Victorian universities, based on focus-group interviews conducted
during 1996 and 1997.
4. the sponsorship of the project “Best Practice for Australian University Libraries”
which received significant funding from the Australian government and resulted
in the publication of two major reports published in 2000 “Guidelines for the
Application of Best Practice in Australian University Libraries”3 and the com-
panion “Best Practice Handbook for Australian University Libraries”4. This
project investigated and compiled current “best practice” activities within
Australian academic libraries and compared these with activities in selected
overseas countries. The term “best practice” used in the study encompassed the
implementation of quality frameworks, and the use of benchmarking and per-
formance measurement as tools for the continuous improvement of products,
processes and services.
5. the development of best practice guides, such as the CAUL Principles for Library
Services to Offshore Students. This is an aid to libraries in providing services
to students enrolled in offshore campuses of Australian universities.
The CAUL website also provides the opportunity for university libraries to load
or make reference to a range of their planning documents (such as building
plans, strategic plans, workflow diagrams, skills audits and staff development
plans) which would be of wider interest to the academic library community and
assist in identifying best practice.
287
The Rodski Customer Satisfaction Survey
This is currently being used by 37 Australian and New Zealand university libra-
ries, many now implementing it on a biennial basis. Survey results provide a
guide for potential improvements in the areas of services, collections, facilities
and library staff behaviours, based on the gap between how important the
service is to the user and the user perception of how well the library is per-
forming in that area. The survey includes a set of nearly 40 core statements
or variables, common to all participants. There is also the opportunity for a
library to add a small number of customised statements specific to local needs.
Respondents to the survey are asked to rank each of the statements according to
the level of importance to them (on a scale of 1 to 7), and then to rank the
library’s perceived performance, again on a 1 to 7 scale and from the respondent’s
perspective. The detailed analysis provides ranked lists of the statements accor-
ding to both importance and performance, and subsequently a ranked list of
statements according to the gap between importance and performance, the
assumption being that the larger the gap, the greater the level of dissatisfaction,
and the greater the need to introduce improvement in that particular area.
The statements or variables are grouped into the broad categories - Com-
munication, Service Quality, Service Delivery, Facilities and Equipment and
Library Staff. Two further questions ask respondents to rate the overall quality
of the library and their overall satisfaction with the library on a scale of 1 to
7. The quantitative results are further informed by free text comments which
respondents provide in answer to 1. Comments (including positive and negative)
and 2. What is the one area we could improve to assist you?
Rodski Behavioural Research provides support for the analysis of the
survey and has also developed a results website which enables comparison or
benchmarking of individual library results from survey to survey, comparison
against the means of all other participants in the database and also against
the performance of individual participants. The CAUL Best Practice Working
Group also surveyed the top performing libraries in the Rodski surveys to share
ideas for improvement. La Trobe University Library has published the results of
the two surveys so far conducted (in 2002 and 2004), on the library website 5.
288
Other Benchmarking Activities
Within Australia’s 39 universities, formal sub groups have been established where
there are commonalities of background and purpose. These sub groups are an avenue
to explore and encourage collaboration and exchange of information between insti-
tutions and the further pursuit of common goals, one of which being to compete
more effectively with the other universities. Such sectors include the Australian Tech-
nological Universities ATN (those universities which have come from a technological
background), Innovative Research Universities Australia IRUA (universities estab-
lished in the late 60s to cater for the growing demand for tertiary education and
usually located in outer suburban areas of capital cities), the Group of Eight uni-
versities GO8 (the oldest, most wealthy and heavily research oriented universities).
These sectors usually involve their libraries, who meet to discuss and share
information about areas of common interest, and identify collaborative oppor-
tunities such as benchmarking of performance across a range of areas. For example,
the IRUA group of libraries has been undertaking the benchmarking of a range
of “processing” activities, the objective being to identify the best performers and
look at best practice, with the aim of improving individual library performance.
289
the university itself which is reported in an institutional Performance Portfolio and
submitted to AUQA. This is followed by an audit visit to the institution (usually 3 to
5 days) to test the content and the assertions in the portfolio. AUQA publishes a
report on the audit approximately 3 months later, including commendations, affir-
mations (where AUQA affirms the improvement needs which have already been
identified by the institutions) and recommendations. The university is then expected
to produce an action plan showing how it will respond to the audit findings, speci-
fically the recommendations. In the next audit round (approximately 5 years later),
AUQA will review the institution’s response to the first audit. In 2006, the first round
of audits of Australian universities will be completed.
The audits include scrutiny of all areas of academic endeavour including the uni-
versity libraries. Library specific sections of the AUQA audit reports published to date
have been focused on assessing the available evidence for
290
The University was formally audited by AUQA in September 2004. Preparation
for the AUQA audit precipitated the establishment of a self review regime and the
articulation of a quality management system at the institutional level. At La Trobe,
quality assurance is devolved to a unit level planning and continuous improvement
cycle. The University is committed to the benchmarking of these operations and to
the continuous improvement of the outcomes of its activities in the light of appro-
priate measures and indicators of quality assurance and accountability.
In preparation for the audit and the compilation of the Performance Portfolio,
each unit (all academic and administrative areas, including the university library) was
expected to carry out a self review of activities, identifying the success (or otherwise)
in achieving its objectives, targets, or quality improvement initiatives. Outcomes of
the review were expected to inform unit strategic planning for the forthcoming year
and also include a quality improvement plan for that year. Ongoing self review has
now been mainstreamed within the University, with formal review cycles and desig-
nated responsibility for the monitoring of these reviews established from the insti-
tutional level (e.g. University Council) down to the unit level.
To assist in the self review process the University’s Quality Office developed
“Quality Management Checklists” for the administrative and academic areas of the
University.
Library Preparation for the Audit and the Self Review Process
The University Library has a well established planning process which required little
modification to incorporate the requirements of the initial self review. The Library
Strategic Plan 2000 – 2004 was developed initially through an extensive process of
consultation with staff across the campus libraries. In addition, there was consulta-
tion and input from the university community. In each year of the plan, over the
August/September/October period and prior to the annual internal library budget
allocation, senior library staff review directions, and identify and refine priorities
for the following year in a workshop environment. This process incorporates prior
input from a wide range of library staff through campus/work area meetings held
during the year.
The pre AUQA self review was incorporated into the above planning process.
The library developed its own self review checklist incorporating appropriate ele-
ments from both the academic and administrative checklists. As part of the review,
the library documentation (e.g. policy statements) which supports the evidence pre-
sented in the self review was also identified and included. The broad areas which the
self review addressed included
291
1. Planning and management (planning, budgeting, communication)
2. Staff (staff development, position descriptions, staff induction, leave manage-
ment, performance management)
3. Stakeholders and standards (client service training, client feedback, service
standards)
4. Policies and processes (development, documentation, communication, review)
5. Community engagement
6. Outcomes (performance indicators and outcome measures)
7. Response (strengths and shortcomings, opportunities for improvement, actions)
The template used for the library self review is included as Appendix 1.
The section ‘Outcomes’ in the Self Review Checklist revealed some opportuniti-
es for improvement for the library. Responses were required for the following
questions
1. How do you know you are achieving your objectives? What performance
indicators or outcome measures do you use?
2. Are these measures closely matched to the objectives?
3. Do you seek customer feedback from internal and external customers?
Analysis of these revealed a gap in library evaluation activities. Activities being under-
taken at the time were limited, somewhat adhoc in their timing and only loosely lin-
ked to the library’s strategic objectives. As a consequence and as part of the quality
improvement plan, the library identified the need to take a more systematic
approach, expand the performance measurement and benchmarking of key library
areas and further develop the suite of service standards.
In the absence of a universally accepted set of standard outcome measures (as
previously defined) for academic libraries, La Trobe is identifying a mix of input,
output and outcome indicators (both qualitative and quantitative), in order to mea-
sure performance in achieving its strategic objectives, and to identify areas for
improvement. These measures, in the context of a whole of library assessment set,
are incomplete, imprecise and continually evolving at this stage. There are diffi-
culties in defining a set that is manageable (avoiding the danger of ‘analysis para-
lysis’), meaningful at the “whole of library” strategic level and persuasive, at the
institutional level, in demonstrating the library’s contribution to the outcomes or
impacts of the parent university’s endeavours as a whole.
The measures currently in use and under development by La Trobe University
Library are listed in Appendix 2.
292
Future Challenges
The task for Australian university libraries will be to broaden the current suite of
evaluative activities that all are undertaking, to a greater or lesser extent, and move
to more outcomes focussed activities. Some progress in this direction has already
been described earlier in this paper. Pressure to demonstrate the value that academic
libraries add to the Australian higher education system is likely to intensify as the
proportion of government funding available to universities continues to contract, and
universities are required to generate more and more resources from other sources.
Similar scenarios are being played out in the international arena. For example,
Lakos (1998, 1999), in describing the North American environment, outlines the
culture of assessment that must be developed “in order for libraries and librarians
to be able to work in an environment where decisions are based on facts, research
and analysis, and services are planned and delivered in order to maximise positive
outcomes and impacts for the library clients”. He contends that, despite the long
history of data collection by libraries, assessment activities are still not routinely
integrated into library operations, and are rarely applied systematically with appro-
priate follow–through and evaluation.
Lindauer (1998) documents the influence of the outcomes assessment movement
of accreditation agencies in the United States, which now require that institutions
provide evidence of their contributions to desired educational outcomes. In a very
comprehensive paper, she identifies “important institutional outcomes to which
academic libraries contribute, describes specific performance indicators whose
measures of impacts and outputs provide evidence about progress and achievement,
and offers a conceptual framework of assessment domains for the teaching-learning
library”. The schema provided however is very large and complex and is not practical
to be implemented in its entirety.
The ultimate challenge will be to select key indicators and associated assessment
activities which clearly demonstrate “what impact the library has on the life of its
clientele” (Hiller and Self, 2004, p.140).
Notes
1. See CAUL Best Practice website at http://www.caul.edu.au/best-practice/
2. See Final Report at http://www.caval.edu.au/wpr/crig/wp/#WPPM
3. Wilson, A., Pitman L. & Trahn, I. (2000). Guidelines for the application of
best practice in Australian university libraries. Canberra: Dept. of Education,
Training and Youth Affairs.
4. Wilson, A., & Pitman, L. (2000). Best practice handbook for Australian uni-
versity libraries. Canberra: Dept. of Education, Training and Youth Affairs.
5. See LTU Library Survey results at
293
http://www.lib.latrobe.edu.au/about/surveys.php
6. See AUQA website at http://www.auqa.edu.au/
References
Association of College & Research Libraries (ACRL). (2000). Standards for college
libraries 2000 edition. Retrieved April 13, 2005, from
http://www.ala.org/ala/acrl/acrlstandards/standardscollegelibraries.htm
Association of Research Libraries (ARL). (1999). ARL New Measures Retreat
January 14-15, 1999 Tucson, Arizona. Retrieved April 13, 2005 from
http://www.arl.org/stats/program/transcript.html
Cribb, G., & Hogan, C. (2003). Balanced Scorecard: linking strategic planning
to measurement and communication. In: Proceedings of the 24th annual
IATUL Conference, Ankara, Turkey. Paper retrieved April 13, 2005 from
http://www.iatul.org/conference/proceedings/vol13/
Cullen, R. (2002). Setting standards for service quality. In J. Stein, M. Kyrillidou,
& D. Davis (eds.): Meaningful measures for emerging realities: Proceedings
of the 4th Northumbria International Conference on Performance Measure-
ment in Library and Information Services (pp. 9-16). Washington, DC:
Association of Research Libraries.
Hernon, P., & Dugan, R. E. (2003). Different perspectives on assessment and
evaluation: the need to refine and link them. In: Proceedings of the 5th
Northumbria International Conference on Performance Measurement in
Libraries and Information Services Durham, England.
Hiller, S., & Self, J. (2004). From measurement to management: using data wisely
for planning and decision-making. Library Trends, 53 (1), 129-155.
Lakos, A. (1998). Building a culture of assessment in academic libraries. Paper
presented at a panel discussion at the Living the Future II Conference.
Tucson, AZ: University of Arizona, April 22, 1998.
Lakos, A. (1999). The missing ingredient – culture of assessment in libraries.
Performance Measurement and Metrics, 1 (1), 3-7.
Lindauer, B. G., (1998). Defining and measuring the library’s impact on campus-
wide outcomes. College & Research Libraries, 59 (6), 78-102.
McGregor, F. (2000). Performance measures, benchmarking and value. In:
Proceedings of the ALIA 2000 Conference, Canberra, Australia. Paper retrieved
April 13, 2005 from http://www.alia.org.au/conferences/alia2000/proceedings/
felicity.mcgregor.html
McGregor, F. (2003). Benchmarking with the Best. In: Proceedings of the 5th
Northumbria International Conference on Performance Measurement in
Libraries and Information Services, Durham, England.
294
Appendix 1
Planning
1.1 Does the Library have a strategic plan?
1.2 What is the mission?
1.3 What key factors internal and external to the University shape strategy?
1.4 Are objectives well aligned to those in the University and Faculty Strategic
Plans?
1.5 Are staff and students involved in the development of these library plans?
1.6 Are library staff involved in the development? If yes, how is this achieved?
1.7 Do you regularly review the objectives and plans?
Budgeting
1.8 How do you ensure that resources follow strategy within the Library?
1.9 Are resource requirements prioritised and the budget regularly monitored to
ensure that expenditure is kept within budget?
1.10 Is there a plan to replace computers and other equipment at appropriate
intervals?
1.11 Are library staff consulted on budgetary issues? If yes, what is your decisi-
on making process on budgetary issues?
Communication
1.12 Are staff in the Library well informed about the University mission and
objectives as well as those at library level? If yes, how do you provide this infor-
mation?
1.13 How are library staff kept informed of changes in procedures?
1.14 How are library staff kept informed of decisions from elsewhere in the
University which may impact on their activities?
1.15 How do your staff inform other areas of changes to policies, procedures
and processes?
2. Staff
2.1 Do senior staff attend the Heads of Schools and Managers training programs
conducted by the Personnel Office?
295
2.2 Do staff have well defined position descriptions or duty statements?
2.3 Are there processes in place for induction of new members of staff to cultu-
re, policies and procedures? If yes, describe these processes.
2.4 Do you provide new staff and current staff with service standards or expec-
tations for service levels? If yes, attach further information.
2.5 Does the Library encourage staff to enhance their skill base and/or qualifica-
tions? If yes, what is the process for achieving this?
2.6 How many staff have availed themselves of these opportunities?
2.7 Are there transparent workload allocation procedures?
2.8 Do you have a leave management strategy?
2.9 Are there procedures in place for dealing with staff concerns and difficulti-
es? If yes, outline the procedures.
2.10 Is there a process for ensuring that PEDS supervision and reporting is up to
date.
2.11 Is there a process for ensuring that IPPPS supervision and reporting is up to
date.
2.12 If you have a multi campus operation is there some recognition of the impli-
cations of travel for workload, staff development opportunities?
296
5. Community Engagement
5.1 Is there liaison with (as appropriate)
industry, community, government agencies, professional bodies, corresponding
university libraries both in Australia and abroad, other educational institutions
in Australia including secondary schools, TAFE institutes?
6. Outcomes
6.1 How do you know if you are achieving your objectives? What performance
indicators or outcome measures do you use?
6.2 Are these measures closely matched to the objectives?
6.3 Do you seek customer feedback from the internal (staff and/or students) and
external customers identified above? If yes, how do you do this?
7. Response
7.1 Have you identified any opportunities for improvement that are within the
control of your unit?
7.2 What actions are planned for next year to address these improvement opp-
ortunities? What are the resource implications for these actions?
7.3 What strengths or successes have you identified?
7.4 Have these results been communicated to staff in your department? If yes,
how has this been done?
7.5 Have you identified shortcomings in services or procedures that are outside
the control of the library? What are your recommended responses?
October 2003
Appendix 2
General
Selected indicators from CAUL annual statistics (e.g. salary expenditure as a %
of total expenditure)
Selected indicators from library annual statistics, primarily use measures (e.g.
building use, number of reference transactions)
Customer satisfaction survey (Rodski survey) (satisfaction level, quality assess-
ment, gaps between importance and performance)
Client feedback from print and electronic suggestion boxes
297
Services
Information desk surveys (adequacy of support for library users)
Web usability survey (ease of access and use of electronic library services)
Information literacy evaluation (impact on user)
Facilities
Study seating usage survey, including computer workstation usage (adequacy of
study space)
Opening hours surveys (adequacy of access to the library building)
Efficiency
Unit cost (monograph and serial processing)
Intercampus loans and document delivery (turnaround time)
Reshelving (turnaround time)
Order placement (turnaround time)
Abstract
Australian university libraries have been implementing performance measure-
ment, benchmarking and quality improvement initiatives over a long period of
time. In recent years the systematic approach to evaluation, benchmarking and
improvement has become an integral part of the Australian higher education
framework as a whole. In 2000 the Australian government, which has overall
responsibility for higher education in Australia, introduced a quality audit sche-
me and established the Australian Universities Quality Agency (AUQA). The
AUQA audits focus on the goals and objectives of institutions, and investigate
the processes universities have in place to achieve their goals and objectives,
including the measuring, monitoring and improvement frameworks. The audits
also include scrutiny of the institutions’ libraries – how they contribute to insti-
tutional objectives and the quality assurance mechanisms in place to achieve this.
This paper provides an overview of the key evaluation and measurement activi-
ties currently being developed and utilised by university libraries in Australia,
298
and the higher education context which is catalysing these activities. Particular
reference is paid to the work of the Council of Australian University Librarians
(CAUL) in these areas, and the national benchmarking initiatives which are
being undertaken. The paper also presents, as a case study, the preparation that
one university library – La Trobe University Library – undertook for the AUQA
quality audit, which was conducted in September 2004, including the “whole of
library” performance measurement and evaluation activities which are being
developed by the library to measure and monitor performance at the strategic
level.
299
The public library’s attractiveness :
A quantitative study
Claude Poissenot
IUT Nancy-Charlemagne, Nancy2
URSIDOC/DOCSI, ENSSIB/Lyon 1,
France
[email protected]
Introduction
In France, people don’t frequent public libraries as much as in English speaking
countries. About 20% have a library card. Since 1998, the frequentation has stopped
growing and tends to decrease slightly though new libraries are regularly being
opened. Librarians and authorities find this situation worrying.
How are we to understand this phenomenon? A first solution consists in searching
for relationships between social evolutions and the level of frequentation. For many
years, I have tried to show that the frequentation of libraries depends not only on
external factors [1] such as reading practices or watching television. The users decide
to come to the library not only from how they define their needs but also from what
they know (or believe to know) about the library’s services. If they don’t come,
maybe it is also because “they vote with their feet” (which means that they don’t
come). The library doesn’t offer what they want. The notion of frequentation covers
a result but also the process that leads to it. Coming to the library means that people
have overcome the obstacles that prevented the visit. On the contrary, when people
don’t come, it means that they encounter something that persuades them not to
come in the library (or outside of it). What are the characteristics that determine
library’s frequentation?
Methodology
How is the frequentation of libraries influenced by their characteristics? More
precisely, what are the characteristics that increase or decrease frequentation? To
answer this question, one method is possible. It consists in asking potential users
what kind of services they would like in order to frequent libraries. This method
comes up against the problem that we only collect people’s statements. We can’t
300
be sure that their behavior (coming to the library) corresponds to their statements.
That’s the reason why we prefer to base our research on the behaviors really observed
rather than the statements.
Our methodology consists in comparing the frequentation of a large number of
libraries that differ by their characteristics. We won’t compare only two libraries but
sets of libraries that share some characteristics. Then we enter into a statistic and
sociological way of thinking : beyond their differences related to their history, their
setting up, their environment, the fact that they have one common characteristic
increases or decreases the probability of a higher frequentation in comparison with
another characteristic. Then, we’ll deal with libraries as we would for individuals:
in spite of their singularity, we can identify social factors that determine their behavi-
ors. Big numbers enable to study populations while identifying statistical regularities
that go beyond the singularity of individuals which they are made of.
In France, the “Direction du livre et de la lecture du Ministère de la culture”
(the section of the Ministry of Culture that deals with libraries) gathers data from
a large sample of public libraries every year. For 2002, we have information on
libraries from 2942 different cities. For each, we know what the collections are,
what the staff is but also the opening hours, the surface area and the frequentation.
The sample libraries for which we didn’t have any information concerning the
number of registered users residing in the city were not taken into account. We’ll
measure frequentation with this indicator. The total number of registered users
is not satisfactory because it directly depends on the size of the town or village
in which the library is located. On the other hand, the number of registered users
of the city is a good indicator of the attractiveness of the library on the population
that have a direct access of this service. So we can compare all the libraries
because they are in the same situation: a service offered to a population of which
we know the number. In 2002, the rate between the number of registered users
living in the city and the number of inhabitants of the city was 15.45% compared
to 17.5% for the rate between the total number of registered users and the number
of inhabitants of the city. Our selection in the beginning sample lead us to a sample
of 2145 libraries. These data allow us to verify our hypothesis because of the large
sample of libraries.
301
The number of books
An American research [2] tackled a similar topic trying to establish the relationship
between the number of books offered and the level of book circulation. The result
was that the growing size of collections tended to increase circulation up to a certain
threshold. Beyond this level the relationship was reversed: the growing size was not
accompanied by a growth of circulation. We’ll study the question from the viewpoint
of frequentation (measured by the rates of registered users). Are libraries with large
collections of books more frequented than those with a fewer number of books?
Graph 1: On average, the libraries offering fewer than 5000 books attract 14.9% of
the population of the city in which they are located.
The relationship between the size of book collection and frequentation is not con-
tinuous. If a small collection is accompanied by a low rate of registered users that is
the case with the largest collection too. Enlarging the books collection doesn’t increase
the frequentation.
But the size of collections has to be related to the population of the city. So we’ll
distinguish libraries according to the number of books they offer per inhabitant.
The average of all libraries is 2.8 and this result doesn’t change according to the size
of the city except in cities of less than 2000 inhabitants where the result is 3.8. But
is the frequentation higher in the libraries that offer a lot of books per inhabitant
than in the libraries that offer few books?
Graph 2: On average, the libraries offering at least 5 books per inhabitant attract
21.5% of the city’s population.
302
In fact, there is a relationship between the number of books per inhabitant and the
rate of library frequentation. The most important thing is not really the size of the
collection itself, but the relative importance it has compared to the size of the popu-
lation. The library’s attractiveness depends on the relative abundance of books offered.
But the frequentation observed in the libraries that offer an important number
of books per inhabitant is perhaps the indirect consequence of the fact that they also
offer a number of other services that attract users. If we have a look at CDs or videos,
the proposal of at least one PC connected to Internet as indicators of resources of the
library, we notice that the relationship between the number of books per inhabitant
and the rate of registered users exists even if the libraries don’t offer these services.
The library’s attractiveness really depends on the size of books collections and not
only on the means of libraries to offer other services than books.
Graph 3: On average, the libraries offering no CDs attract 14.2% of the city’s popu-
lation.
There is a “CD effect”. As soon as a library offers CDs, even a small number of them,
the rate of registered users significantly increase. Whatever the size of the city, the
“CD effect” is observed. Even in small cities (less than 5000 inhabitants), CDs attract
a larger population. This kind of item gets the power of catching young and male
users and keeping them. Books encounter difficulties to do so. That’s the reason why
there is a “CD effect” because it attracts more users.
But the rate of registered users stops growing when the collection of CDs exceeds
4000. In fact, as we observed for books, the rate increases when the number of CDs
per inhabitant rises. The library’s attractiveness depends on the availability of books
and CDs.
303
The attractiveness of videos seems to be lower than that of CDs. The collection
has to be important to have an effect. The users are attracted by videos so it’s neces-
sary to have a large collection to satisfy the demand. The average rate of registered
users inexorably decreases when the number of inhabitant for one video rises:
19.6% when the library offers a video for 8 inhabitants or less and 13.4% when
60 inhabitants or more have to share one video.
Graph 4: On average, The libraries that don’t offer any PC connected to Internet
attract 14.4% of the city’s population.
304
Graph 5: On average, the libraries that offer one PC connected to Internet for less
than 1000 inhabitant attract 19.7% of the city’s population.
Potential users don’t assess the service only according to the way it is promoted.
Clearly, we observed that below one PC connected for 8000 inhabitants, this service
is not attractive any more because the rate is lower than it is in libraries that don’t
offer it. On the contrary, the lower the number of inhabitants for each PC, the higher
the rate of registered users (particularly below 2000 inhabitants). Attracting and
keeping new users with PCs connected to Internet is effective only if libraries offer
enough PCs for the size of the population.
Subscription to periodicals
Some of library users appreciate to find a large choice of newspapers and magazines.
According to the last survey “Expérience et image des bibliothèques municipales”,
42% of registered users say that they sometimes borrow magazines [3, p. 37].
Graph 6: On average, the libraries that have less than 10 subscriptions to periodicals
attract 14.6% of the city’s population.
The relationship between the number of subscriptions and the average rate of
registered users is discontinuous. A too limited choice (fewer than 10 subscriptions)
is accompanied by a low frequentation and it’s the same when the choice is too
large (150 subscriptions and more). We observed the highest frequentation when
the libraries offered between 10 and 50 titles. The choice must be large enough to
attract a large audience but not too much in order to try not to loose users. But the
number of subscriptions must be connected to the population the library serves. In
that way, we measure the relative availability of periodicals in all libraries.
305
Graph 7: On average, the libraries that offer a subscription to a periodical for less
than 100 inhabitants attract 20.2% of the city’s population.
The lower the number of inhabitants for each subscription the higher the average
rate of registered users. Gradually, the gap is growing between libraries that offer
relatively many subscriptions and those not offering many. From the viewpoint of
potential users, the relative density of periodicals offered counts more than their
bare number.
Graph 8: On average, the libraries that have a circulation rate of books more than
3 attract 20% of the city’s population.
306
mation is important because the average rate of registered users is lower in libraries
with a low rate of circulation of CDs or videos than it is in libraries that don’t offer
this kind of items. It means that collections that are too small or collections that
don’t satisfy users don’t attract potential users. They pass judgment on what it is
offered to them and decide to come or not the library. This could show that what we
call “offer policy” in France is not always valid. It is possible to educate the users
exclusively if they agree a little with what the library offers. In other words, the “offer
policy” is thus limited: it can encourage and educate the users to come more often
but only if these users had already come before and were satisfied – at least in part
– with the library’s collection. In a small library, it’s possible to offer CDs or videos
selected among those that are judged as “essentials” of music or cinema. But those
items probably won’t be borrowed often and attract only few users. Though, if we
want to educate people, we first have to give them reasons to come.
New acquisitions
The collections gather all the items bought by the libraries year after year. It is the
result of choices made over a long period of time. Users perceive the library through
the collection as the whole. Acquisitions permit to know what the present situation is.
They reveal choices made recently by the library. As such we know what the offer to
real and potential users is. We want to know what the consequences of acquisitions on
the attractiveness of the library are.
Graph 9: On average, libraries that have a less than 3% rate of the renewal of books
collection attract 14.4% of the city’s population.
307
For the book collection, the average rate of registered users seems smaller when the
rate of renewal is low than it is when the rate of renewal is high. Offering recent
book collection increases the library’s frequentation. For the CD and video collecti-
ons, we observe the same slight trend : a lower frequentation in libraries that renew
their collection slightly.
Acquisition budget
Acquisitions depend on the resources of libraries. According to their means, they
can buy a certain number of items. The library resources also determine the type of
collection because they can thus create more or less diversified collections. Thus we
can expect a larger frequentation when the libraries have large acquisition budgets
to offer varied collections of books, CDs or videos. In order to be able to compare
libraries whatever their size, we’ll divide their acquisition budget by the number of
inhabitants in the city.
Graph 10: On average, the libraries that have 4 and mor e of acquisition budget
per inhabitant attract 20.1% of the city’s population.
The average rate of registered users increases gradually but clearly when the library’s
resources rise. The rate almost doubles between rich libraries and poor ones. Surely,
the cities are rewarded by large frequentation for having done a financial effort.
That is true for all the cities whatever the population. In order to attract potential
users, the libraries have to offer a recent, large and diverse collection. People assess
the library according to a large number of criteria and particularly the collection.
This result suggests that the cuts into the library budget may see a large number of
users leaving or not coming to the library.
308
The surface area
On average, the surface area of the libraries is increasing in France. It has tripled
between 1980 and 2001 and in 2002, libraries offer 5.4 m2 for 100 inhabitants. But
what is the relationship between the size of the library and its audience? Are the
largest libraries the most attractive?
We have to distinguish libraries according to the size of the cities. A small library
for a large city may appear as a big one for a village. For a village of less than 2000
inhabitants, there is a critical size around 100m2 : under this size, the frequentation is
lower than beyond (17.3% compared to 20.3%). On the other hand, the second
step at 200 m2 has no effect on the library’s attractiveness. Why does the surface
area appear as a condition for the frequentation of part of the population? Is it
because the library can offer a larger collection, a more comfortable and cozy place?
For the cities between 2000 and 5000 inhabitants and between 5000 to 10000
inhabitants, the frequentation increases when the surface area of the libraries increases
(from 12.2% to 20.1% for the first and from 8.4% to 18.2% for the second). There
is no clear limit. People have more reason to come and to stay in the library when
it offers more surface. However, surface is not enough: in cities from 2000 to 10000
inhabitants with a large library budget (more than 3 per inhabitant for the accessions),
increasing surface has no effect on the audience of the libraries. It suggests that
frequentation depends more on the budget accession than on the surface area. And
in fact, among cities of this size, the frequentation is higher for the libraries with
large resources and a small surface than in large libraries with a low accession budget
(less than 2 per inhabitant) : 19.6% compared to 14.3%. This result is true for the
whole sample. For the people who are the target of libraries, the library is first a place
with information resources and then only a place, even large. Potential users prefer
a small library with a large, recent and diverse collection than a large building with a
small collection. The size of the library has an effect but it is not the most important
one: among the libraries with a low accession budget in cities from 2000 to 10000
inhabitants, the largest ones have a larger number of users than the smallest (14.3%
to 10.7%).
In cities from 10 000 to 20 000 inhabitants, the surface area is also a deter-
mining factor of the level of the frequentation. We can identify two thresholds:
under 100m2 (7.9%) and between 100m2 to 500m2 (9.7%). From 500m2 until
1500m2 and more, the frequentation is higher (15% and 16.5%). For a city of this
size, it seems to be difficult to attract a large part of the population with a small
library. That is the same situation for cities that have 20 000 to 50 000 inhabi-
tants, there is threshold around 1500m2: libraries under this size are less attractive
than libraries over this level (11% to 15%). These thresholds indicate what seems
to be the optimal surface area of libraries in order to be the most attractive.
309
In cities of over 50 000 inhabitants, we can’t observe a clear trend: the number
of users does not increase when the surface area becomes bigger. These cities are
very different and sometimes they divide their surface area between a central library
and branch libraries.
Another mean to measure the effect of surface on the frequentation is to divide
the number of inhabitants to the surface of the library. With this method, we can
measure the differences among cities of different size. Are the libraries offering the
highest rate of surface per inhabitant the most attractive?
Graph 11: On average, the libraries that offer less than 3m2 per 100 inhabitants
attract 10.9% of city’s population.
There is a clear relationship between the surface offered per inhabitant and the
number of users of the libraries. The more the surface available is, the higher is the
frequentation. The increasing of the surface permits to accommodate a larger popu-
lation. It’s as if there was a kind of self-regulation of the library frequentation.
When the density of users become too high, the potential users turn away from the
library because they feel is too narrow. They haven’t got enough space to satisfy
their expectations of discretion or their wish to remain anonymous.
Whatever the size of the cities, the increasing size of the surface per inhabitant
is accompanied by a rise of the number of users. This result can be observed even
in the large cities (more than 50 000 inhabitants).
Opening hours
In France, the public libraries have been built in reference to the pattern of the
“lecture publique” introduced from the United States. It includes an emphasis on
the accessibility through direct access to the collections, signage but also opening
hours. Libraries have to be opened during a long time to satisfy the various
potential users. For many years, librarians and authorities have noticed that opening
hours are too short and particularly in comparison with those in English speaking
countries. But what are the consequences of opening hours on the audience of
libraries?
310
Graph 12: On average, the libraries that are opened 35 hours per week attract
14.5% of the city’s population.
An unexpected result appears. The audience doesn’t increase with the opening
hours. On the contrary, it seems to drop slightly. The idea that the library’s fre-
quentation would be more important if the opening hours were larger is not con-
firmed. But if opening hours are not the first criterions for potential users to decide
if they’ll come to the library or not, we have to check if this factor has no effect even
for some libraries.
In a village (of less than 2000 inhabitants) and in big cities (more than 50 000
inhabitants) we don’t observe any relationship between the opening hours and the
number of users of the libraries. This criterion appears of secondary importance. If
people don’t come to the library, it’s for other reasons.
For libraries that are neither in small villages nor in big cities, opening hours have
an effect on the library frequentation. Under a certain threshold (10 hours from 2000
to 5000 inhabitants, 15 hours from 5000 to 10 000 inhabitants, 20 hours from
10 000 to 20 000 inhabitants and 25 hours from 20 000 to 50 000), the rate of
registered users is lower than the average. In these middle-sized cities, too short
opening hours tend to decrease the frequentation. On the other hand, when the
opening hours exceed theses thresholds, the rate of registered users doesn’t increase.
Longer opening hours don’t increase the library’s attractiveness. Users want the
library to be opened long enough to organize their visits but non users don’t change
their mind because of the longer opening hours. This result seems contradictory
with the fact that 34% of non users [3, p. 49] explain that they don’t come because
“the library is opened only during times that are not convenient”. If we measure
what non users do (rather than what they tell or think), increasing opening hours
doesn’t make them come more. However, if opening hours don’t modify the fre-
quentation of non users, in the other hand, it has an effect on the users first : as they
come more often than the non registered users, they can’t come as frequently as they
would like. The first effect of limitation of opening hours is that it reduces the
number of visits made by users more than it modifies the number of users itself.
The slight effect of the opening hours on the frequentation appears even more
surprising when we compare it with other characteristics of the libraries. Whatever
311
the size of the cities, the libraries with high accession budget or offering large sur-
face area per inhabitant but low opening hours are more attractive than those with
large opening hours but little space and a poor collection. As potential users say:
“What’s the use of large opening hours if it is to realize that collections or other
services are not convenient?”.
The staff
The staff is needed to welcome users, to select, organize and classify the collec-
tions and for many other tasks as well. This is one of the characteristics of the
libraries. Users see the staff members when they come. Staff are important too
because they make the choices that will determine the services of the libraries.
Graph 13: On average, libraries that have 7.5 jobs or more for 10 000 inhabitants
attract 18.5% of city’s population.
If we divide the number of jobs by the number of inhabitants in the city, we can
notice a trend: the average rate of registered users increases with the job density. The
exception of the low level can be explained by the presence of many small attractive
libraries managed by volunteers in villages (less than 2000 inhabitants). But the
trend is clearly that attractiveness increases with the number of jobs. Staff is neces-
sary to offer an attractive service. But, if libraries have staff, maybe it is because
they have other resources like an important acquisition budget. In fact, libraries
with more than 7.5 jobs for 10 000 inhabitants benefit of 3 of acquisition budget
per inhabitant at least in 62% of the cases though it is only 11% the case of libra-
ries with less than one job. That’s the reason why we can ask the question: does the
library’s attractiveness depend on the number of jobs or on the acquisition budget?
We notice a specific effect of the number of jobs. But it exists only if libraries
have low of medium accession budget (less than 3 per inhabitant). For “rich” libra-
ries regarding to their resources for buying items, increasing of the number of jobs
312
doesn’t increase the frequentation. The number of jobs per inhabitant is a less
important determining factor than acquisition budget. Staff attracts potential users
especially when libraries can’t do it with new items because of tight budget.
Increasing the value of the collections, improving the reception and information are
some of the possible means to attract a larger audience.
Professional staff
Because of their business, libraries need staff with professional skills. What should
those skills be? For example: is cataloging really important? But librarians and au-
thorities partly agree with the need of professional staff in libraries. But is there a
relation between the presence of professional staff and the library’s attractiveness?
Graph 14: On average, the libraries that have less than 0.5 professional job per 10
000 inhabitants attract 15.4% of the city’s population.
Libraries with a large number of professional jobs per inhabitant have a higher fre-
quentation than the others. This trend is true whatever the size of the city.
Professional skills are not only a means for librarians to manage the library. These
skills also help the librarians to define themselves as a profession. They contribute
to the library’s attractiveness.
This result is confirmed by another fact: among the libraries that offer one job
or more, those that only have professional staff have slightly more users than those
that have no professional staff (16.1% compared to 14.8%). The professional staffs
are different from non professional because they create a more attractive service.
Staff spending
The libraries are different by the number of jobs and the number of professionals
among the staff. Those characteristics depend on their budget. Are libraries with
biggest budgets the most frequented?
313
Graph 15: On average, the libraries that spend 20 or mor e per inhabitant for the
staff attract 18% of the city'’ population.
The attractiveness of the libraries clearly depends on the staff spending. When au-
thorities invest in staff, a bigger number of people come to the libraries. We notice the same
result whatever the size of the cities.
But what is the effect of staff spending on the frequentation according to
acquisitions spending? The libraries with a large budget for the acquisitions also
have a big budget for the staff. We have to distinguish the two characteristics. As we
noticed for the number of jobs, staff spending has an effect when the acquisition
budget is reduced (less than 2 per inhabitant). We observe no effect when the
acquisition budget is medium (from 2 to 3) and the effect changes for big resources
(from 3) : among the libraries that have the biggest acquisition budget, those with
a little staff budget (less than 10) have a larger number of users than the libraries
with medium (10 to 20) or high staff budget (20 and more) : respectively 22.6%,
18.2% and 18.6%. When staff spending increases, it acts as a brake on frequen-
tation. Big staff spending does not have always an effect on the frequentation
and particularly when it is accompanied by a big acquisition budget. Why does the
addition of those two characteristics have no positive effect on frequentation? Our
hypothesis is that libraries that spend a large staff don’t have as many jobs but
expensive ones because of the age of employees or of the high level of the pro-
fessional staff. These characteristics of staff have no effect on the library’s attrac-
tiveness. A fact suggests this interpretation: among libraries with large staff and
acquisition budget, those with few jobs in relation to their budget but with expen-
sive jobs have a smaller frequentation than those that favor the number of jobs
rather than the cost per job (20.2% compared to 16.7%).
Conclusion
The analysis of our data leads us to create the concept of “library effect”: the fre-
quentation depends on the characteristics of the service offered to the users; they
assess the library through the collections they find and the surroundings in which
they are located. The type of collections, the proportion of each type of items
(books, CDs, videos), the availability of items, the surface area, the staff and other
314
characteristics appear as determining. These results lead us to have reservations
about the idea that people are coming to the library whatever the services offered.
Potential users become real users only if they find some services that suit with their
tastes, their concerns or their habits, etc. People “vote with their feet”. Just as the
visits of users can be understood by the concept of “user logic”, it would be neces-
sary to study the reasons that lead non users not to come to the library. How do they
assess the library? Do the services offered correspond to what they think they need?
Our research appears as a contribution of the knowledge of the relationship
between the libraries and the users. It remains to study the relationship between the
libraries’ characteristics and the characteristics of the users. What type of users are
attracted or dissuaded by the choices made concerning the different types of services
offered?
References
1) C. Poissenot, « Programme pour l’étude des déterminants interne de la
fréquentation des bibliothèques », in Réjean Savard (dir.), La formation
et la recherche sur le marketing et la gestion de la qualité des bibliothèques,
Colloque satellite IFLA, Québec, 14-16 août 2001, München, K. G. Saur,
pp. 69-86.
2) M. J. Detweiler, « The « Best size » public library » in Library Journal,
vol. 101, 15 May 1986, pp. 34-35.
3) A.-M. Bertrand, M. Burgos et alii, Les bibliothèques municipales et leurs
publics, Paris, BPI/ Centre G. Pompidou, 2001.
Abstract:
How can we understand that people frequent public libraries or not? I have tried
to show for many years that the frequentation of libraries depends not only on
external factors like reading practices, watching television, etc. On the contrary,
I believe that it depends on internal factors: the way the libraries propose their
services to users partly determine the number and the type of users who come
there. But how can we know what the determining factors are?
We can observe a large number of libraries and compare them according to
different criteria. In France, the Direction du livre et de la lecture du Ministère de la
culture (the section of the ministry of Culture that deals with libraries) gathers data
from each public library every year. So we have at our disposal information
about budget, staff, collections, premises, users and loans. Until now, these data
have been analyzed in a simple way: for example we know what the average col-
lection of CDs in the libraries is. Using the same data, I cross the information
about the libraries with information about the users. More precisely, does the rate
315
between the number of users with a library card and the number of inhabitants of
the city depend on the library’s characteristics? For example: is the rate higher in
the libraries with large hours of opening hours? Do the libraries with a large part
of professional staff receive more users than libraries with fewer professionals?
My paper tries to answer such questions. I find some results in order to help
library managers define better practices.
Résumé:
Comment comprendre la fréquentation (ou non fréquentation) des bibliothèques?
Depuis plusieurs années, je défends l’idée selon laquelle ce ne sont pas seulement des
éléments extérieurs à la bibliothèque (le rapport à la lecture, l’air du temps, la
télévision, etc.) qui se révèlent déterminants. Je soutiens au contraire l’idée de «
déterminants internes »: la manière dont les bibliothèques mettent en forme leurs
services décide partiellement de la fréquentation dont elles font l’objet. Mais com-
ment parvenir à identifier les éléments agissant de l’offre ?
Ici il s’agit d’exploiter les données recueillies sur presque toutes les bibliothèques
publiques de France. La Direction du livre et de la lecture du Ministère de la culture
recueille tous les ans des informations auprès de chaque bibliothèque sur le budget, le
personnel, les collections, les acquisitions, les locaux, le public et les prêts. Jusqu’à
présent, ces données sont exploitées de façon simple: nous disposons des moyennes
et de la distribution des réponses selon la taille de la commune dans laquelle est im-
plantée la bibliothèque. En exploitant les mêmes données, je croise statistiquement
les informations sur la bibliothèque avec celles sur la fréquentation. Les biblio-
thèques disposant du budget d’acquisitions par habitant le plus élevé sont-elles
les plus fréquentées? Les bibliothèques ayant un personnel spécifique attirent-elles
davantage de public?
Cette communication essaie de répondre à ces questions. Je mets à jour des
résultats susceptibles d’aider les responsables de bibliothèques à définir des prati-
ques à même d’améliorer l’attractivité de leur établissement.
316
The use of Electronic Information Services and
information literacy: a Glasgow Caledonian
University study*
John Crawford
Library Research Officer,
Glasgow Caledonian University,
Room 302, (3rd floor)
6 Rose Street,
Glasgow,
G3 6RB
Email jcr@gcal. ac.uk
317
Using methodologies discussed in the seminar GCU and LMU agreed the fol-
lowing joint objectives:
2. To equip students with the skills to become independent seekers and discer-
ning users of information in their studies
Sampling frame
At the time of the administration of the survey GCU had 15,269 students, both
undergraduate and post graduate, of whom approximately 60% were female and
318
40% male. Full time students accounted for 71.39% of the total, the remainder of
whom were part time or distance learning students. Of these only about 200 were
distance learners. The percentage of students by year is as below. The percentages
for the first three years is similar although there are slightly more students in third
year. For later years/categories the percentages drop off sharply.
Results
Some general information was collected about the respondents for cross tabula-
tion purposes. Respondents were asked about their year of study:
319
Table 2: Year of study at Glasgow Caledonian University
Year of study Percentage Number
First Year 40.7% 181
Second Year 22.5% 100
Third Year 18.4% 82
Fourth Year 17.1% 76
Fifth Year or more 1.3% 6
There are about twice as many first year respondents as 2nd to 4th years which
opened up interesting analytical possibilities which are discussed below: 2nd to
4th years offer a fairly even spread of data, about 20% each and the percentage
of respondents broadly reflects the overall student body.
Table 3: School
School Percentage Number
Built & Natural Environment 5.6% 25
Caledonian Business School 33.4% 150
Computing & Mathematical Sciences 2.7% 12
Engineering, Science & Design 4.7% 21
Health & Social Care 16.9% 76
Law & Social Sciences 12.9% 58
Life Sciences 4.7% 21
Nursing, Midwifery & Community Health 15.8% 71
None of these 3.3% 15
The high percentage of responses from some Schools and the low response from
others reflects previous survey work.
320
Gender
Mode of study
Respondents were asked whether they studied full or part time
As with most survey work previously undertaken at GCU, part time and distan-
ce learning students are greatly underrepresented in proportion to their numbers.
Internet use
Respondents were asked if they used the Internet for their studies and 84.5%
responded that they did (57 respondents skipped this question)
Internet use declines with year of study as Table 6 shows
321
Respondents were asked to list up to three websites which they had found espe-
cially useful for their programme. (196; 43.4% of respondents skipped this ques-
tion which is interesting information in itself) The remaining 255 (56.6%) listed
a total of 607 websites although it is not always clear what they were. Table 7
lists the most popular
The respondents are mainly reporting on access to websites, rather than the sites
themselves. The important thing is that respondents are ranging over many sites
and many are only mentioned once which shows growing independence in infor-
mation searching. Most of the websites relate to paramedicine or some form of
business study. (Inhouse websites in bold)
Respondents were asked if they used Athens authenticated and other infor-
mation databases in their studies: 53% replied that they did. This compares well
with the surveys in Spring 2002 and early 2003 which showed levels of Athens
registration of 36% and 49% respectively but must raise the question of whether
a peak is being reached.
Respondents were then asked to list up to three databases which were espe-
cially useful for their programmes. Table 8 lists the most used databases.
322
Table 8: Most frequently used databases
Database Frequency of use
Cinahl 40
Medline 34
Ovid 22
Emerald 12
Keynote 12
Ingenta 10
Proquest 9
Westlaw 8
Science Direct 8
Amed 8
Mintel 7
Respondents listed some 228 databases, notably fewer than websites, showing a
continuing preference for web searching over database searching. Searching by
subject is unchanged from the EIS study with a continuing emphasis on paramedi-
cine and business subjects.
Respondents were asked how essential EIS were for the completion of their
programme. The results are in Table 9 below.
EIS are now essential for almost two thirds of students, compared with 69.5% in
the EIS study, a slight fall.
Respondents were asked if they had a computer at home and 78.4% replied that
they did which is virtually unchanged since this question was first posed to students
in survey work about four years ago. However only 51.1% reported having access
to the internet at home, a surprisingly low figure and a big fall from the EIS study,
78% - survey 1; 72% - survey 2.
323
Information searching on the Internet from home produced a varied response as
Table 10 shows
122 respondents (27%) skipped this question and the largest percentage gave a
negative answer but a majority of respondents do use the internet at home to
look for information some or all of the time.
Information literacy
The questionnaire concluded with a section on information literacy.
Respondents were asked if they thought that information literacy would be
important in finding work after graduation (they were supplied with a definition of
information literacy): Two thirds (62.8%) agreed that it would be important but
almost 30% did not know which can be compared with the alumni experience
(see below); (123) skipped this question. However all first year students agreed
with the statement.
Those who had agreed that information literacy would be important in finding
work were asked to say why. There were some118 usable responses which broke
down into 9 categories (See Table 11 below)
324
Exercising independent initiative 2
Communicating within work 2
‘it is a key skill that future employers find important and normally
ask for in interviews and application forms’
Keeping up to date and research were other factors. Paramedical students were
quick to see the link between information literacy and evidence based practice. The
independence and scope for initiative which information literacy offers was also
mentioned and this is clearly relevant to the CDP agenda.
Respondents were asked to compare their current information literacy skills with
those they believed they possessed when they started university. See Table 12 below
Clearly respondents feel that attendance at university has greatly improved their
information literacy skills and indeed 64. 9% (two thirds) confirmed this; 17.7%
said that it had not improved their information literacy skills and an almost iden-
tical number did not know; 100% of first year students felt that their informati-
on literacy skills had greatly improved as a result of attending University.
Respondents were asked to give reasons why they thought this was the case. The
325
results are shown below in Table 13. There were 5 main reasons for believing
why they thought their information literacy skills had improved.
Some respondents may have had difficulty disentangling IT and information literacy
skills but ‘Need to collect information for programme’ still comes top. However
‘Frequency of use’ and ‘Obliged to use’ shows how relentless the pressure to use
electronic systems is and the influence these factors have.
Finally respondents were given the opportunity to make general comments but
these related only to local housekeeping issues.
326
access to the internet suggesting that these factors are more fundamental to their
lives than older students. Intensity of use of the internet at home does not seem to
vary greatly from the overall figure. Slightly fewer first year students (59.2%) than
the overall figure (62.8) thought that information literacy would be important in
finding work; 45% of first years thought that their information literacy skills were
good, implying that they had brought some skills from school, compared with 32%
overall; 53.5% thought that their information literacy had improved as a result of
attending university, compared with 64.9% overall which could either mean that their
skills were good on arrival or that they had not had time to benefit from university
attendance.
Results
Alumni profiles
71% of the respondents were between 21 and 40 with 46% being under 30: 19%
were between 41 and 50 and 10% were over 50. Despite this relatively young
profile the perspective of respondents was largely historical as indicated below.
Female respondents (64%) greatly outnumbered males (36%) which resembles
undergraduate responses to questionnaires.
81% currently have access to the Internet at home with males (88%) more
likely to have access than females (77%).
70% had studied full time with the remaining 30% having been part time
or distance learning.
327
The respondents were drawn from 95 different programmes, the first 30 of which are
listed below (Table 14). They broadly reflect teaching areas within the University with
paramedicine featuring largely.
328
BSc Building Surveying 05
BSc Biosciences 05
BA Public Admin.+ Management 05
BA Combined Studies 05
PG Dip. Construction Management 04
Of the110 occupations listed, the top 30 are given in Table 15. Again they bro-
adly reflect the learning and teaching agenda of the institution. The category civil
servants included senior public servants, both in the UK and abroad. Among the
less frequently occurring occupations were Member of the Scottish Parliament
(MSP) and actor.
329
radiographer 06
podiatrist 06
administration assistant 06
social worker 05
police officer 05
midwife 05
clerical officer 05
senior administrator 04
orthoptist 04
marketing 04
IT training officer 04
dietician 04
Internet use
Respondents were asked what information sources they had used at University.
54% had used the Internet: while 46% had not. Those who had used the Internet
listed websites which they had used (Table 16). The list, of course, includes data-
bases but reflects patterns of EIS usage at GCU. Only 29 had been used by two
or more users and 87 occurred only once, suggesting a wide range of searching
activities. A total of 116 sites were listed.
330
Only 29% had used Athens authenticated and other information databases
which compares fairly well with other data (Crawford et al., 2004 b).
Again there are no surprises here. Only 36 databases were listed although seve-
ral were really websites which reflects historical, rather than current patterns of
activity.
Respondents were asked about the importance of EIS in the completion of their
programme:
Although 75% thought EIS were essential or of some use only 26% considered
them essential
331
92% reported that they use the Internet now, a figure approaching double the
percentage who used it at University. There was no gender difference. The list of
websites actually used totaled 334, far more than the total used by respondents
while at University. Of these 251 were mentioned by only one respondent with
83 being used by two or more people, confirming the pattern of wide ranging
use. The top ten were as below. The paramedical agenda is noteworthy.
However only 42% reported using other information databases. This was pre-
dictably a much lower total of 91 (Table 20), comprising 73 mentioned only once
and 18 mentioned twice or more. The top ten are shown in Table 20.
332
emerald 05
lotus 04
lexis-nexis 03
92 % considered EIS to be essential or of some use in work, with nearly half con-
sidering them essential. Slightly more males than females considered them essen-
tial while slightly more women than men thought they were of some use.
Respondents were asked to rate the frequency of accessing the Internet for infor-
mation searching:
333
76% of respondents use the Internet at work some or all of the time. Only 9%
never use it. There was little gender difference. Respondents were also asked
about their frequency of information searching at home. The results were virtually
identical.
Information Literacy
Respondents were given a definition of information literacy and asked the follo-
wing questions based on it:
Do you think information literacy is important in finding work?
81% agreed that it did with slightly more males agreeing than women.
Respondents who had replied yes were asked to say why you think information
literacy is important in finding work. The points raised may be compared with the
students’ replies. They boiled down to:
• Increases the chances of getting a job
• Pre-requisite for professional level work
• Applications for jobs and CVs can be emailed
• Find out about potential employers
• The internet is an up to date source of information about jobs
• The Internet is increasingly preferred for advertising jobs
• Helps with CPD and keeping up to date
• Helps in changing jobs
• Enhances employability
Respondents were asked if they think that information literacy is important at work:
90% agreed that it is. There was virtually no difference between female and male
respondents.
Respondents who had replied yes were asked to say why they think that
information literacy is important at work. This produced rather more points but
again a limited number of themes recurred:
• Essential for work – could not do my job without it
• Access to current information – helps to keep up to date
• Facilitates management decision making
• Gives access to a wide range of information
• A source of up to date information on products and services – EU directives,
suppliers’ products (e.g. packaging) and patent information mentioned as
examples
• Helps to give reliable advice to clients (including NHS patients)
• Helps with problem solving
• Supports evidence based practice (EBP) in the NHS
334
• Helps to develop initiative and self reliance
• Helps with CDP and career development
• Employers expect it
• Promotes clinical effectiveness
• Can anticipate developments and be well informed
• A self learning tool
• Teaches you to distinguish ‘rubbish’ from reliable information
• Quick and efficient way of communicating with colleagues
• A source of power
• A good way to find information not easily accessible
The comments are valuable not only in themselves but also show that respondents
have a good grasp of what information literacy is about and what it can be used for.
Some respondents noted that the nature of work is a factor and the office worker
has a distinct advantage as a fireman pointed out. One respondent presciently noted
that information literacy is a characteristic of graduateness.
Respondents were asked to rate their information literacy skills when they began their
University course:
Poor 40%; Average 41%; Good 15%; Very good 4%
Females tended to rate their skills lower than men, a common response to this type
of question.
Respondents were then asked to rate their information literacy skills when they
completed their university course:
Poor 6%; Average 32%; Good 41%; Very good 21%
This presents a picture of considerable improvement although females again rated
their skills rather lower than men.
Respondents were asked if their overall information literacy skills had improved as
result of attending University
Yes 67%; No 25%; Don’t know 8%
There was little gender difference in this response and clearly university attendance
has had an impact on information literacy skills.
Respondents who had replied yes were asked to say why their overall infor-
mation literacy skills had improved as result of attending University. Although the
impact of University was clearly substantial it was a little less dramatic than the
experience of work. While a few had had prior experience of computer use there
were also historical factors at work because so much had changed in a short time.
335
One respondent who had graduated ‘a long time ago’ (1997) noted that a lot had
changed since her day. A few others commented on IT rather than information
literacy skills. Many of the comments were fairly predictable:
Finally respondents were asked if their information literacy skills had improved as
a result of working. This produced the following response:
Got better 77%; Got worse 3%; Are unchanged 19%; Don’t know 1%
There was little gender difference and there can be no doubt that the experience
of work contributes greatly to the development of information literacy skills.
Judging by the comments from unemployed respondents unemployment has a
correspondingly negative and disadvantaging effect.
The questionnaire concluded with the opportunity for respondents to make
any comments they wanted although only about a quarter of respondents made
comments. These tended to reinforce points already made, notably the pace of
change but a few points came up which could warrant further investigation:
336
2. ‘Young people should be leaving school with the basic skills to find
employment or further their studies, whilst universities should not have to
make up for this failure’
• Internet use for study: While 54% of alumni reported that they had used
the Internet at University, 84.5 % of current students said they used the
Internet for their studies; 92% of alumni reported they now use the Internet,
a picture of substantial growth.
• Number of websites used: The total number of websites alumni reported using
at University was 116. Current students recorded 607 which they had found
especially useful for their programme and alumni record a total of 334 which
they consider essential to their present work. Again there is an increase here
although alumni are perhaps more focused and concentrate on ‘favourite’ sites.
• Usage of Athens authenticated and other databases: Only 29% of alumni had
used Athens authenticated and other databases while at University but 53%
of current students do so; 42% of alumni reported using databases other than
the freely available Internet now. In terms of total number of databases used
alumni as students used only 36 while current students recorded 228. Alumni
now use a total of 91.
• EIS essential for completing programme: While only 26% of alumni felt that
EIS had been essential for the completion of their programme, more than double
the number of current students (66.3%) thought this to be the case; 49%
(nearly half) of alumni consider EIS essential to their work.
• Improved information literacy skills: 67% of alumni believed that their
information literacy skills had improved as a result of attending University
and 77% felt that the experience of work had improved their information
literacy skills; 64.9% of current students felt that their information literacy
skills had greatly improved as a result of University attendance, one of the
few indicators which shows little difference between alumni and students.
• Importance of information literacy in finding work: This indicator showed
a major difference between students and alumni. While 62.8% of students
agreed that information literacy is important in finding work almost 30% did
not know but 81% of alumni agreed that it is important. Furthermore 90%
of alumni respondents think information literacy is important at work
337
These comparisons show a picture of continuous improvement over the period c.
1995 -2004 and a growing appreciation of the importance of information literacy
but this appreciation is more marked among alumni than students. The impact of
the workplace in promoting an understanding of the importance of information
literacy is crucial.
As to the question of Value and Impact and the issue of making a difference. In
assessing the development of EIS usage and information literacy skills it is extremely
difficult for any one agency to claim the credit as the previous EIS usage study
338
showed (Crawford et al 2004b). Students come to University with some skills although
information literacy skills are probably the least developed. They are thrust into an
environment where most services are IT based and IT skills are needed or have
to be developed to use them. It is clear from the study of EIS usage by students
that there is at GCU a hierarchy of usage by School, with paramedics at the top,
followed by Business School students next and science and technology students
last. Paramedicine is notable for its innovative learning and teaching agenda and its
continuing relationship of learning and work after graduation. The hierarchy of
usage also mirrors the University’s retention and progression figures with para-
medicine showing the best results and science and technology the worst. This
suggests that the Library is linked to other factors and the greatest progress will be
made where the commitment to learning and teaching is also greatest. The most
important outcomes were not Value and Impact but the emergence of an infor-
mation literacy agenda which has been shown to be intimately linked to the
employability agenda. It is here that the library is making an impact and in a direct
way which has not been recognised before and clearly needs further measurement.
We need to know more about how the skills we impart extend to the workplace and
how these skills may be refined to benefit the future employee. We need to know more
about the workplace and attitudes of employers. Some employers are clearly more
sympathetic to the information literacy agenda than others. What factors predispose
them one way or another?
The direct value of library and information services has long been debated. Does
information literacy have a direct value to employers and employees which can be
calculated?
Acknowledgements
Thanks to Chris MacNicol for organising the questionnaire administration and
Simon Docherty for inputting the data for the alumni questionnaire and doing ini-
tial analysis. Also thanks to GCU’s Marketing and Public Relations Department for
making the alumni database available as a sampling frame.
References
Baruchson-Arbib, Shifra and Shor, Frida (2002) Perspectives on the use of elec-
tronic information sources by Israeli college students. Journal of academic
librarianship, vol.28, no.4, pp. 255- 257.
Crawford, John et al. (2004a) Use and awareness of Electronic Information
Services by academic staff at Glasgow Caledonian University. Library review,
vol. 53, no. 8, pp. 401-407.
339
Crawford, John et al (2004b) Use and awareness of electronic information services
by students at Glasgow Caledonian University: a longitudinal study, Journal
of librarianship and information science, vol. 36, no.3, pp. 101-117.
Crawford, John (2003) The use of electronic information services by students at
Glasgow Caledonian University: background to the project and introductory
focus groups. Library and information research, vol. 27, no. 86, pp.30-35.
Harvey, Lee (2005) Student engagement. Synergy, no. 5, pp. 8-9.
Hewitson, Andrew (2000) The use and awareness of electronic information
services by academic staff at Leeds Metropolitan University.
Library & Information Research News, vol. 24, no. 78, pp. 17- 22.
Hewitson, Andrew (2002b) [EIS Student survey]. (an unpublished internal report.).
Leeds Metropolitan University.
Hewitson, Andrew (2002a) Use and awareness of electronic information services
by academic staff at Leeds Metropolitan University: a qualitative study.
Journal of Librarianship and Information Science, March, vol. 34, no. 1,
pp. 43-52
Tenopir, Carol (2003) Use and users of electronic library resources: An Over-
view and Analysis of Recent Research Studies. Washington, D.C.: Council
on Library and Information Resources. URL (consulted February 2004):
http://www.clir.org/pubs/reports/pub120/pub120.pdf [Accessed 16/204]
Waldman, Micaela (2003) Freshmen’s use of library electronic resources and
self-efficacy. Information Research, vol. 8, no. 2. pp. 1-24
Abstract:
Glasgow Caledonian University has a substantial background in survey and eva-
luation work extending over some ten years – see website http://www.learnings-
ervices.gcal.ac.uk/library/research/index.html and also
Crawford, John Reviewing a programme of evaluation in an academic library:
the case of Glasgow Caledonian University, Performance measurement and metrics,
June, 2003, vol. 4 , no.3, 2003, pp. 113-121.
More recently the library was one of the first ten participants in the LIRG/SCO-
NUL Value and Impact study (2003-2004) in which GCU chose to focus on the
impact of electronic information services on users. The outcomes have been published
in three articles and, in a separate project, the Library also worked with a secondary
school in a deprived area of Glasgow to assess ICT skill levels among the pupils
(the Drumchapel Project).
The outcomes of all these studies have led to a need to focus on the informa-
tion literacy agenda because very variable skill levels were identified in both the
340
secondary and tertiary sectors. A need to understand the relationship between
information skills teaching in the secondary and tertiary sectors was also identified.
The application centres around reporting on the results of two surveys which
were undertaken as part of the LIRG/SCONUL Value and Impact Study:
a survey of EIS/IL skills among undergraduates and a study of alumni (former
students who have now graduated). The undergraduate study supports the previous
view of steady if uneven progress across different subject areas but also cites as
factors the pervasiveness of IT systems in the tertiary sector and their growth in the
secondary sector. The subset of data comprising responses from first year students
is especially useful as it gives a perspective on new students IL skills. The alumni
questionnaire data emphasises the growing importance of information literacy in the
workplace and the important role of the University in developing it. Considerable
gratitude and respect for the role of GCU was expressed by respondents drawn
from all over the world. Information literacy and the student employability agenda
have been facilitated by the University and its services.
The two surveys together give an ‘all through’ picture of IL skills at GCU from
new students who have only just completed secondary education, through to the
world of work and the application there of IL skills learned at GCU. IL practice
and evaluation tends to be sector specific and the research aims to encourage a more
holistic approach to research and development in the subject area with a view to
developing a holistic agenda which will extend from school experience to a lifetime
of work. The research will encourage further development in this new and chal-
lenging area.
At the time of applying a new research project has begun, reviewing the rela-
tionship between IL skills training in the secondary and tertiary sectors, and interim
findings on this work will also be reported on. The data collected is also being used
to inform the further development of GCU’s ICT/IL training programme.
341
Statistical indicators on reading and literacy
for the “Information Society” versus the
1
ITU’s “technicist” indices
Ksibi Ahmed
Prof. at the Higher Institute
of Documentation of Tunis (and)
University of Manouba
[email protected]; [email protected]
Introduction
On the eve of the second phase of the World Summit on the Information Society
(WSIS), measuring progress towards the information society, commonly referred to
as “e-readiness”, has become a key issue for governments and communities in a
number of countries.
In implementing the WSIS Action Plan, major international UN organizations
including the International Telecommunication Union (ITU), responsible for
organizing the summit, and neo-liberal organizations such as the World Bank,2
the Organization for Economic Co-operation and Development (OECD), and
many others3 were involved in developing instruments and statistical indicators
for arranging criteria for measuring the information society that can be com-
pared at the international level. Indicators on the impact of new information and
communications technologies (NICTs) are considered essential for action plan-
ning and development, including achieving the UN Millennium Development
Goals.
Looking closer at these statistical indicators from the neo-liberal international
organizations, we see a distorted picture of the information society because it is
based essentially on indices emphasizing computer and telecommunication equip-
ment. This is not a complete picture because it overlooks human factors and human
resource quality and skills.
My proposal attempts to balance “equipment-oriented” data with data based
on variables that bring information literacy into focus. The library use patterns of
young people and the development of reading and literacy are presented for taking
342
into account the driving elements behind the information environments of the
countries studied and to encourage debate on the determining human factors.
The initial hypothesis assumes that the information society is not a single pic-
ture: it is not determined solely by technology or the interplay of economic forces.
Libraries, the most widely used cultural institution among young people, could
top the list of components making up the information society. Thus, the definition of
the information society is not determined solely by a predefined infrastructure, but
also by “sociocultural” rather than technological aspects.
This hypothesis counters the technicist approach adopted by some international
organizations, including the ITU. This technicist approach does not take into account
indicators on reading and literacy, behaviours that are nevertheless necessary for
establishing a literate, innovative society.
By challenging this prevailing approach, we place our albeit modest approach
in the same category as the IFLA.
By questioning the use of inappropriate statistical indicators, we somewhat
support the IFLA’s efforts, to ensure recognition of, among other things, the central
role of libraries in the information society.4 This involves arguing for the need
to place librarians and libraries, as mediators between information resources and
users, among the key players in the establishment of the information society. It
could be postulated that literacy and reading and the purposes of these activities,
form the bedrock required for establishing the “information society”.
343
statistics or other data describing a library’s performance” and “includes both
raw figures and ratios”.
344
2. Criticism of statistical indicators based on “technicist”
and commercial criteria
Statistically measuring the information society based primarily on a list of core
NICT indicators7 is the prerogative of large neo-liberal structures. It is current-
ly being harmonized internationally. It could very likely be approved by all inter-
national and regional organizations and national statistics offices for assessing
the development of the information society.
The ITU digital access index (DAI) and the “network readiness of economies”
indicator of the World Bank’s Infodev program, established as a benchmark for
implementing the information society, are becoming hegemonic. There are an
important reference for governments and donors and identify characteristics that
help attract investments.
The devotion to NICT indicators among international neo-liberal organizations
indicates the technical and commercial tendencies, which ultimately seek only to
broaden the computer and telecommunication sector and boost economies in
financial crisis.
If we take the ITU’s digital access index (DAI)8 as a model, we see that it focuses
on connectivity rate and leans too much toward user solvency (affordability)!
The ITU’s technicist tendency is expressed in its most visible form through
the choice of indicators favouring measurement of infrastructure development: 5
(the prevalence of the indicators at number 7: telephony services, international
Internet bandwidth per inhabitant, for example), to classify countries rather than
cultural information behaviours (reflects only 2 indicators: 1) adult literacy 2)
combination of Internet access at primary schools, high schools and universities).
The ITU’s tendency is also commercial. It reflects the desire to outfit the entire world
with computers with the aim of boosting the economic growth of technology-export-
ing countries. As such, the DAI figures and measurements do not focus solely on
connectivity rate, but lean towards economic profit, as indicated by the “bizarre”
choice of using the user solvency (affordability) indicator to assess progress towards
a knowledge-based society.
The ITU’s measurement of the information society, which is currently limited to
digital equipment sectors, is, in many respects only partial.
Criticizing the ITU’s statistical indicators is vital for developing a new compara-
tive framework that reflects reality and within which the world’s countries can
measure their progress towards the information society. From this albeit limited
questioning of the narrowness of certain government organizations’ indicators
would come a strategic focus.
Our vision is based on the need for taking cultural and human resource factors
into account for collectively managing the fast-paced progress of new information
345
and communications technologies (NICTs). The goal is to introduce library and
documentation service data into the official statistics so that existing gaps in this
area can be identified and filled.
Statistical data and surveys among frequent majority users of information services:
The official statistics or surveys, whose data validity is not in doubt,9 and previ-
ous research10 on this can provide some guidance for identifying the statistical
characteristics of the strategic categories for implementing the information society.
With a cross-section of information from various sources, it is possible to postu-
late that the majority users of libraries and NICTs are young people. Young peo-
ple read and use computers and the Internet more than their elders.
In fact, according to various information sources and numerous studies, one
finding emerges: young people (considered to be a socially marginalized and eco-
nomically passive group), particularly the educated population, appear to be the
majority readers who take NICTs on board.
However, this finding is largely tempered by finer analyses showing complex,
contradictory trends: reading among young people is dropping overall, with
library use on the increase.
The downward trend in book reading, quantitatively and qualitatively, is a
general phenomenon.11 Reading is no longer an intense practice among young
people. Most of them have a purely utilitarian relationship with books and tend to
disfavour the book culture and even replace it with a communication culture12
(mobile phones and the Internet) and media culture (television and newspapers).
This widespread trend would support the hypothesis of a certain homoge-
nization of youth culture. In my view, what characterizes today’s generations is the
feeling of belonging to a specific culture that is age-related and willingly inter-
national. We are not talking of a “young culture”. Gilles Pronovost pointed out that,
346
since 1970, we have not been seeing the disappearance of “classic models” in
cultural practices, but that [translation] “a new, more eclectic culture has grad-
ually taken over, which, remember, also includes new information technologies”.
To ward off lamentation speeches on the reading “crisis” among young people, the
statistics show that other types of reading are emerging and that public library
use is on the rise.13 The number of educated people and rising education level of the
population as a whole (Gagnon et al., 1997) and the influence of the educational
environment (Baillargeon, 2000) apparently affect the behaviour of young people
with respect to cultural activities.
The offering geared towards young people has diversified. Facilities that have
been converted into mediatheques and even cybercentres in some cases are indica-
tive of that.
According to the Médiamétrie surveys in France, the emerging communication
models, particularly the Internet, draw young people, again educated, who are
familiar with or master the new technologies and want access to user-friendly
multimedia locations to communicate, produce and socialize freely.
347
symbolic ways of subscribing for information services, are the template for the
new socialization.
This is apparent in some young people, players in the information society
who define their promotion strategies in new opportunities for accessing cognitive
information or business and relationship opportunities via the Internet and
information systems.
The natural extension of reading is NICT access, which is a necessary com-
plement to literacy. For example, according to a number of sources, Scandinavians,
specifically Finns, are also the champions of the Internet world. Reading from
traditional media is in conjunction with the use of NICTs and electronic media.
Several surveys show that, among those who use their computer almost every
day as part of their free time, we find the strongest readers.16
348
tural and information behaviours, and establishing new directions are prerequi-
sites to modelling the systems to be introduced.
349
Fighting the digital divide is the new mission of libraries
This under-exploitation is glaring in disadvantaged communities. Democrati-
zation of information is central to a library’s mission. As such, it is an opportunity
to fulfil its potential and mission.
As to the divide, this is an enormous challenge because it involves not quantify-
ing a status or visible action, but rather measuring the absence of a practice.
Instead, they are processes excluding information access services and systems,
referred to by several terms “illiteracy, weak readers, learning disorders, semi-literacy,
under-education” that arise under various conditions and must be taken into con-
sideration.
Regardless of the living conditions of disadvantaged populations or the driver
behind the inequalities and injustices, learning disability issues and disorders hinder
access to information services and prevent the exercise of full citizenship.
The conditions that allow illiteracy to be established as a priority and made
into a social problem do not involve just educational and cultural institutions. A
cross-sectoral approach is required for acting on society as a whole for creating
conditions conducive to the development and strengthening of reading skills. The
“weak reader” issue must be analysed as a process in which the players promote
a system of meaning and actions that encode this situation based on local interests.
Individuals having difficulties with reading and writing are not a homogenous
group. They are subject to socio-economic circumstances and their means are lim-
ited to the most frequent physical and psychological difficulties. Their lives follow
different paths: their cultural and information behaviours through social or family
disruptions, professional disconnect, are represented through their discourse. They
are the ones that prerequisite studies for statistical system modelling should capture.
As with libraries in the 1950s and 1960s, which were one of the most important
factors in the democratization of learning and the dissemination of culture, NICT
access centres will be a springboard for progress towards the information society.
Having NICTs in libraries is the best solution for breaking away from the
classic forms of isolation and exclusion by proposing alterative models for the
cultural development of the egalitarian information society.
In a context of library virtualization, in which applying Internet technologies to
resource and service accessibility seems more satisfactory, virtual libraries allow
tremendous flexibility: reference services will be decentralized, interactive, and
available on an extended schedule. Once the geographic criterion is no longer a
factor, northern and southern young people will be able to benefit from libraries’
expertise and vast digital collections, for example as part of distance learning
projects. We cannot aspire to equality until young users have taken on board the
new technologies in their quest for knowledge.
350
The important thing is for virtual libraries to meet the objectives of the com-
munities they serve, where applicable, by getting involved in the education and
learning process.
Nevertheless, developing documentary communication organizations (virtual
reference services) requires redefining information access services and re-inventing
multilateral cooperation formulae. This presupposes altering concepts and investi-
gation techniques (for making progress in harmonizing research indicators on
reading behaviours) in library and information science.
Conclusion
In this time of globalization, which is accompanied by network expansion and
proliferation and the sharing of cognitive and cultural resources, it is crucial that we
eliminate boundaries and integrate into the new knowledge society the information
disadvantaged who feel out of place there so that everyone can aspire to the same
information and education level.
Integrating disadvantaged communities into the information society through
public libraries is an opportunity for integrating public libraries into the social
landscape and gives them their due place. In fact, the information disadvantaged
client base is likely to become more significant. If libraries do not commit to getting
actively involved among disadvantaged communities, they will no longer be over-
looking a minority, but rather a significant share of their potential client base.
Redefining the characteristics of the information society is a new challenge that
could encourage us to use our imagination, which would lead to new research and
develop new social integration models. Conceptual difficulties, lack of resources
and the need for strengthening skills should be examined and corrective action to
reduce the digital divide should be proposed.
Notes
1 Indicateurs statistiques de la lecture et de la littératie pour « la société de
l’information » face aux indices « technicistes » de l’UIT,
2 Guide to Measuring the Information Society, OECD Working Party
3 See the WSIS thematic meeting “Measuring the Information Society” Geneva,
February 7-9, 2005, which included the World Bank, the OECD, and most of
the technical organizations: ITU, United Nations Conference on Trade and
Development (UNCTAD), UNESCO Institute for Statistics (UIS), UN Regional
Commissions (ECA, ECLAC, ESCAP, ESCWA) and the UN ICT Task Force.
The meeting was attended by more than 270 delegates from 85 United Nations
member countries, intergovernmental organizations, NGOs and civil society.
351
4 See the resolution in the Proceedings from “Libraries @ the Heart of the
Information Society”: - Proceedings of the IFLA Pre-World Summit Conference,
Geneva, 3-4 Nov. 2003, The Hague, IFLA, 2003, 142 p.-
5 Adapted from UNESCO
www.unesco.org/bangkok/education/ict/indicators/introduction.htm
6 CSPP’s Readiness Guide for Living in the Networked World.
http://www.cspp.org/projects/readiness/
7 See the annex to the report “Measuring the Information Society”: Core List of
ICT Indicators: Access and Infrastructure Core Indicators.
8 The ITU's upcoming 2003 edition of the World Telecommunication Develop-
ment Report (WTDR) ITU Digital Access Index: World’s First Global ICT
Ranking
9 The three sources used are references whose data collection and processing
methods were monitored by an institution specialising in this:
- A skills assessment, conducted in 2000 as part of the OECD PISA project
that included 32 industrialized countries, assessed performance in reading,
mathematics and science.
- International Adult Literacy Survey (IALS) under the auspices of the
Organization for Economic Co-operation and Development (OECD).
- Surveys entitled Les pratiques culturelles des Français/ Ministère de la
culture, in 1974, 1982, 1990 and 1998.
10 IFLA - Global Library Statistics 1990-2000. September 2003 (DRAFT)
- Eberhart, George M. The Whole Library Handbook 3: Current Data,
Professional Advice and Curiosa about Libraries and Library Sciences.
Chicago: American Library Association, 2000.
11 Olivier Donnat. Les pratiques culturelles des Français // Les pratiques cultur-
elles en méditerranée. Tunis: CEDODEC, 1991. P.104. See also Olivier Donnat
and Denis Cogneau, Les pratiques culturelles des Français 1973-1989, Paris,
La Découverte/La Documentation française, 1990, ch. 4 "Le livre")
12 See the works of François de Singly on young people and reading. -Les Dossiers
Education et Formation, No. 24, January 1993, Ministère de l'Education
nationale et de la Culture, Direction de l'Evaluation et de la Prospective.
13 Monique Lebrun. The Evolution of Library Use and the Development of
Literacy in Adolescence. - in: 70th IFLA Conference in Buenos Aires, 2004.
http://www.ifla.org/IV/ifla70/prog04.htm
14 Sandy Campbell. - Defining Information Literacy in the 21st Century. - in:
70th IFLA Conference in Buenos Aires, 2004:
http://www.ifla.org/IV/ifla70/papers/059e-Campbell.pdf. Division VII.
- Education and Research
352
15 Momar Coumba Diop (dir.), Le Sénégal à l’heure de l’information, Paris,
Karthala, 2002
16 Charles Steinfield. - Changing relationships in the information society:
The effect of information infrastructures on relations among business users.
- Published in French in: Réseau: communication technologie société, No. 84
(July/August 1997).- (Dossier les coûts de transaction)
17 Girard-Billon Aline. Les bibliothèques publiques des grandes villes françaises
et étrangères. - in: BBF 2002 - Paris, t. 47, No. 4, p. 70-83
18 David Fuegi. - Recent developments in the application of statistics, standards
and performance indicators in public libraries in England.- in: 70th IFLA
Conference in Buenos Aires, 2004
Abstract
This essay is a synthesis of statistical data and of a set of surveys among young
people, the frequent majority users in developing countries.
Variables pertaining to their use of new information and communication
technologies (NICTs) and information sources allow us to put forth several signifi-
cant hypotheses regarding the information society and the digital divide.
We intend to suggest statistical indicators on the evolution of library use and the
development of literacy as well as the ability to use NICTs and the information
behaviours of young people as benchmarks for measuring the progress made by
developing countries to reduce the digital divide and establish solid foundations
for a cognitive information society.
This hypothesis counters the prevailing “technicist” approach adopted by the
International Telecommunication Union’s (ITU) digital access index (DAI), which
does not take into account indicators on reading and literacy, though they are
significant behaviours necessary for establishing a literate, innovative society,
The DAI community connectivity indicators were developed by the ITU to
follow the objectives of the World Summit on the Information Society (WSIS,
Geneva 2003) Action Plan, which advocates a composite index for measuring the
information society.
The ITU, the United Nations institution organizing the WSIS instead of UNESCO,
is an expression of the “technico-economic” tendency for facilitating the integration
of NICTs into our societies and highlights the desire to outfit the entire world with
computers to enable economic growth by opening new markets.
This prevailing technicist tendency (see the official literature on the information
society) is expressed in its most visible form by the ITU indicators, which favour
measuring infrastructure development (telephony services, number of PCs, number of
Internet users) to classify countries rather than cultural information behaviours.
353
This quantitative DAI index, as designed by the ITU, leans more towards eco-
nomic profit, user solvency and return on investment. Consequently, the digital
divide between industrialized countries and developing countries, particularly the
marginalized ones (Africa and the Middle East), is imperfectly measured by the ITU’s
index. Outside the anti-globalization movement, the prevailing approach is rarely
challenged and even less so are the quantitative indicators. By questioning the DAI,
my proposal attempts to go beyond “equipment-oriented” data and encourage debate
on the determining human factors to take into account the basic elements of the
information environment of the country under study.
Indicators on library resource use behaviours and habits (registered users,
documents loans, etc.) and minimal action for information mastery, as expressed by
UNESCO statistics, ISO 11620 library performance indicators and Europe’s LIBE-
CON system on library service statistics, include indicators on the information
conditions specific to each country.
It is primarily young people who are the strategic categories of frequent
majority users of libraries and who are capable of using NICTs, the basis of an
information society in developing countries. Comparable statistical indicators of
these user categories must be introduced in order to develop a realistic international
system for monitoring and evaluating (both qualitative and quantitative) of changes
in information behaviour.
This involves disputing hasty statistical modelling by emphasizing the variety
of the information behaviours and attitudes of young people and determining their
specific use of NICTs and libraries. The proposed approach involves different mea-
surement trends, favouring usage and “e-readiness” developed by several research
centers, emphasizing specific characteristics of the information society.
From this albeit limited questioning of the narrowness of certain indicators could
come a strategic focus by redefining the indicators of a knowledge-based society,
which should be multiple and focused on socio-cultural rather than technological
aspects.
In-depth knowledge of strategic categories of users forms the basis of designing
and creating virtual libraries. The development of documentary communication
organizations and information retrieval systems presupposes a revision of concepts
and investigation techniques in library and information science, where theoretical
effort is still insufficient.
Résumé
Cet essai est une synthèse des données statistiques et d’une panoplie d’enquêtes
auprès des jeunes, usagers fréquemment majoritaires dans les pays en développement.
Les variables concernant leurs usages des Nouvelles Technologies de
354
l’Information et de la Communication (NTICs) et leurs utilisations des sources
d’information nous permettent d’émettre quelques hypothèses significatives concer-
nant la société de l’information et la fracture numérique.
Il s’agit de proposer des indicateurs statistiques concernant l’évolution des
pratiques de fréquentation des bibliothèques et du développement de la littératie et
les capacités d’usage des Nouvelles Technologies de l’Information et de la Commu-
nication (NTICs), des comportements informationnels des jeunes, comme critères
de référence pour mesurer les progrès réalisés par les pays en développement pour
réduire la fracture numérique et établir les meilleurs soubassements d’une société de
l’information cognitive.
Cette hypothèse relativise l’approche techniciste dominante adoptée par l’index
sur l’accès numérique (DAI Digital Access Index) de l’UIT l’Union Internationale des
Télécommunications qui omet les indicateurs sur la lecture et la littératie qui sont
pourtant les comportements nécessaires pour former une société cultivée et innovante.
Les indicateurs de connectivité communautaire DAI sont élaborés par l’UIT en
application des dispositions du plan d’action du Sommet mondial de la société de
l’information (SMSI Genève 2003) qui préconise d’instituer un indice composite de
«Mesure de la société de l’information».
D’ailleurs le choix de l’UIT l’institution onusienne organisatrice du SMSI au
détriment de l’UNESCO traduit la tendance « technico-économique »devant faciliter
l’intégration des NTICs dans toutes nos sociétés et souligne par la même la volonté
d’équiper d’ordinateurs la planète toute entière afin de permettre la croissance
économique par l’ouverture de nouveaux marchés.
Cette tendance techniciste dominante (voir la littérature officielle sur la société
de l’information) s’exprime dans sa forme la plus manifeste par les indicateurs de
l’UIT qui privilégient la mesure du développement des infrastructures (les services
de la téléphonie, le nombre de PC pour, le nombre des utilisateurs d’Internet) pour
classer les pays au dépens de la dimension des pratiques culturelles de l’information.
Cet indice quantitatif DAI tel qu’il est conçu par l’UIT est trop orienté vers la
rentabilité économique, la solvabilité des usagers et les retours sur investissements.
Par conséquent, la fracture numérique entre les pays industrialisés et les pays en
développement, surtout les plus marginalisés (Afrique et Moyen-Orient), est impar-
faitement mesurée par l’indice de l’UIT. En dehors des cercles alter-mondialistes,
il existe très peu de contestation de l’approche dominante et encore moins, bien sûr,
de remise en cause de ces indicateurs quantitatifs. Par la remise en cause du DAI,
ma proposition tente de dépasser les données orientées « équipement » et ainsi de
susciter le débat sur les facteurs humains déterminants pour prendre en compte
des éléments fondateurs de l’environnement informationnel du pays observé.
Les indicateurs des habitudes et les comportements d’utilisations des sources et des
355
ressources de bibliothèques (Nbre d’inscrits à la bibliothèque, Nbre d’ouvrages
empruntés) et des actions minimes autour de la maîtrise de l’informatique, tels qu’ils
sont exprimés par les statistiques de l’UNESCO, les indicateurs de performance
dans la norme ISO 11620 et par le système européen LIBECON des statistiques des
services de bibliothèques, comportent des indicateurs pour des conditions informa-
tionnelles propres à chaque pays.
Ce sont surtout les jeunes, qui sont les catégories stratégiques des usagers fré-
quemment majoritaires des bibliothèques et qui possèdent les capacités d’usage
des NTICs, la base de la réalisation d’une société de l’information dans les pays en
développement. Des indicateurs statistiques comparables de ces catégories d’usagers
doivent être introduits pour élaborer un système international réaliste de suivi et
d’évaluation (à la fois qualitative et quantitative), des changements du compor-
tement informationnel.
Il s’agit de réfuter une modélisation statistique hâtive en mettant en exergue la
diversité des comportements et des attitudes informationnelles des jeunes et de connaî-
tre leurs usages spécifiques aussi bien des (NTIC) que des bibliothèques. L’approche
proposée est celle des différentes tendances de mesures, privilégiant les usages et la
« e-readiness », développées par plusieurs centres de recherches mettant en exergue
les spécificités dans la société d’information.
A travers ces remises en cause, même limitées, de l’étroitesse de certains indica-
teurs, on aurait alors une visée stratégique dans la redéfinition des indicateurs de la
société de la connaissance qui devrait être multiple plurielle et se concentrer plutôt
sur les aspects «socioculturels » que sur les aspects technologique.
La base de la conception et de la réalisation des bibliothèques virtuelles est une
connaissance approfondie des catégories stratégiques des usagers. Le développement
d’organisations documentaires communicationnelles et de systèmes de repérage de l’in-
formation présuppose une réadaptation des concepts, des techniques d’investigation
dans les disciplines bibliothéconomiques et des sciences de l’information, où l’effort
théorique reste encore insuffisant.
356
Parameters and indicators for providers
of electronic publications evaluation
María Luisa Alvite Díez and Blanca Rodríguez Bravo
Área de Biblioteconomía y Documentación.
Facultad de Filosofía y Letras. Universidad de León
[University of Leon]
Leon, Spain
[email protected]
[email protected]
1. Introduction
Over the last few years, the first studies about suppliers of electronic publications
have begun to appear. They have focused for the most part on evaluating the use of
such publications by the academic community. Examples would be the recent work
by Tenopir (2003) and, in Spain, that directed by Urbano (2004). Some of these
studies, like those by Pullinger (1999) and by Eason, Richardson and Yu (2000),
provide detailed information about the influence of contents, their coverage and
relevance, and about the technical aspects that affect access and use.
The authors of this paper have carried out previous studies (2004) in which an
individualized analysis was undertaken of two providers of electronic content –
ScienceDirect and Wiley InterScience-. Afterwards they lie (2004, 2005) in the area
of comparative evaluation of information coverage and characteristics of inter-
faces, functions and services of five electronic content providers widely used by
Spanish academic libraries: Emerald, Kluwer Online, ScienceDirect, SpringerLink
and Wiley InterScience.
The study was undertaken within the framework of a research project financed
by the Universidad de León1 for the years 2004/2005. The chief objective of this
research project has been to gain an overall knowledge of the provision of elec-
tronic information, its distribution and use by the academic community in order
to allow universities and their libraries to negotiate with the large multinationals in
the publishing sector on the basis of objective criteria on quality and utilization.
1. Evaluación de los proveedores de revistas electrónicas y estudio de la calidad de las publicaciones
digitales (2004-2005). Investigador principal: Dra. Rodríguez Bravo.
357
2. Objectives and methodology
The specific aims of this paper is to present an evaluation model and to share a
methodology for the analysis comparative of information distributed, characte-
ristics of interfaces and various functions and added value services of providers of
electronic publications. This model has been applied to: Emerald, Kluwer Online,
ScienceDirect, SpringerLink, and Wiley InterScience in order to test the validity of
the methodology proposed. This analysis will permit the acquisition of trustworthy
information on the nature and quality of these systems.
We reckon that works mentioned previously permitted testing the validity of the
methodology proposed. Indicators are established to evaluate not just the extent of
the materials provided, but also the access structure, characteristics of the interface,
functions and added-value services.
The process of evaluation was organized around four parameters (A – D below),
within which there were a number of grouped indicators as sub-parameters:
A) Extension of contents
• Horizontal Coverage: Volume of electronic publications.
• Thematic Coverage: Collections of scientific disciplines.
• Vertical Coverage: Retrospective reach of the contents.
The overall digital content available from the various suppliers was tallied up, inclu-
ding serial publications, electronic books, reference works, current protocols and
databases. Browsing or navigational access by alphabetic order, categories and type
of product routes, and via the listings given in information intended for librarians
was used.
B) Access Structure
• Access Control Systems Used: Passwords, IP address authentication, digital
certification and privileged users (superusers).
• Search and Navigation Performance: The levels and fields for searches,
retrieval language, record of searches, browsing or navigation categories,
fields with hypertext links, granularity of searches, and so forth.
• Presentation of Results: Descriptive data, criteria for ordering results and
possibilities of ordering them, formats of publications, display of associated
graphs and pictures, and similar.
A variety of queries were carried out so as to gain knowledge of the power of the
retrieval tools, the range of simple and advanced search forms, the depth of the
initial search, the relationships between the products distributed and the specific
retrieval tools for some materials (reference works, current protocols and so on).
358
The authors registered as users of the systems that required registration, in order
to have access to capabilities restricted to registered users.
The searches carried out were used to evaluate the characteristics of the inter-
face and its suitability for users, particularly registered users. Error messages
were induced and the help systems were reviewed.
A user profile was created to check requests for alerts and to check the Data Sub-
scriber Interface. For the remaining points we have used the information presented
in the licence held and offered by the firms on their central websites.
Exploration of the electronic packages was undertaken during the first half of 2004
and was revised during the month of September. For the evaluation, subscriptions
taken out by the University of León were used, with the exception of Kluwer which
was investigated through an open access route.
It should be note that in February 2005 was undertaken the integration of
Kluwer’s journals into SpringerLink package. Consequently, Kluwer platform doesn´t
exist longer.
359
3. Summary of results
A) Extension of contents
The analysis includes serial publications, electronic books, reference works, cur-
rent protocols and databases. Nevertheless, all analyzed providers take care of
high-priority way of the electronic journals distribution.
Kluwer Online and ScienceDirect stand out in contrast to the other providers
because of their extensive offerings of electronic content. Wiley InterScience is a
particularly good illustration of the three chief platforms for access to electronic
materials on scientific and technical topics: digital journals, reference databases,
and electronic books. Emerald concentrates on serial publications.
Springer’s list is striking, as in its 30 collections of books there are no fewer
than 2,537 individual publications. The number of electronic books available
from Kluwer, at 1,210, is also relatively large. To a lesser degree, this is also true
of ScienceDirect, whose 8 series of books run to 961 individual volumes, while
Wiley InterScience has more than 500 on offer. Note should be taken of the section
relating to reference works in the lists of Kluwer, Science and Wiley. The last of
these three rounds out its materials with current protocols and reference databases.
ScienceDirect similarly also distributes databases.
From their homepages Emerald, Science and Springer allow easy differentiation
of contents available with the specific licence held, those items for which the insti-
tution has or does not have a subscription. Materials for which there is a subscrip-
tion usually provide access to the full text, while non-subscribers only have access
to reference details or summaries. As the University of León holds no licence from
Kluwer Online, it wasn’t possible to determine if this is true for that provider. It is
also difficult to determine the full-text contents provided by Wiley InterScience when
employing the browsing access routes offered to users from Wiley's web site.
360
It should be noted that the language coverage for the material from all five
providers is almost exclusively English, with a small amount of German and French.
The five providers of electronic contents studied are for the most part multidisci-
plinary. However, they basically offer publications from the areas Natural Sciences,
Health Sciences and Social Sciences. In contrast, the presence of the Humanities in the
packages analysed is limited, this being a field represented exclusively in the Kluwer
and ScienceDirect lists.
If the area of Humanities is left out of account as having only a token presence
in this supplier's range, the extent of thematic coverage offered by ScienceDirect
certainly stands out, being noteworthy even in the area of Pure Sciences, which is
the field having the smallest number of items. The primary orientation of this
provider is towards Natural Sciences and Health Sciences.
Kluwer brings a considerable contribution to all of the thematic areas. The
thematic range offered by Wiley InterScience is balanced, having almost a hundred
publications even in the area in which it is most limited, Social Sciences. It is parti-
cularly strong in the field of Applied Sciences, fundamentally because of its large
number of e-books in these disciplines. This provider lacks any Humanities materials.
Emerald is quite different, being almost exclusively concerned with the distri-
bution of materials in the Social Sciences, mainly in Economics and Information
Science. SpringerLink, on the other hand, has no involvement in the area of Social
Sciences, being strongest fundamentally in Natural, Health and Pure Sciences.
Nonetheless, this distributor does have a large number of single or monographic
publications in the Applied Sciences in its series of books.
It is not easy to achieve an exact account of the start dates for the publications
offered. This is because in some instances there are materials without dates and
at other times there are discrepancies in the dates cited. This is made even more
difficult by the coincidental complexity of the history of the periodicals involved:
there are journals that have ceased publication; back issue files; journals that have
changed names, been subdivided, incorporated or merged; and other complications.
The materials offered by ScienceDirect are noteworthy for their long chrono-
logical range, with some of its serial publications going back into the nineteenth
century. Despite all this, Elsevier’s incorporation en masse of journals really begins
with the 1990s. A major increase of the availability of electronic materials during
the 1990s is noticeable in all providers.
The currency of the collections for Wiley InterScience and to a lesser degree for
ScienceDirect and Springer Link is evidenced by the large numbers of materials
they hold that were published between 2000 and the time of our evaluation.
361
B) Access Structure
In light of the results obtained for the indicators established, it is clear that all the
suppliers perform adequately on the technical aspects that affect access to the con-
tent they offer.
A positive view was taken of systems that could recognize Internet Protocol
numbers (IPs) for access. Passwords are required only if one desires to log on as a
registered user, a feature that is not provided by Emerald. For their part, Emerald,
Springer and Wiley all allow access via Athens login. For Wiley InterScience, there
are superusers accredited for the ArticleSelect service.
The five providers evaluated permit searching of contents by indicating thema-
tic categories for browsing or navigation. While the basic fields almost always have
hypertext links, some suppliers use them more widely than others. In the case of
Emerald, links extend to the classification and keywords, and Springer offers an
interesting anchor or one-click point redirecting users to a range of possible links or
“linking options”.
It was seen as positive if systems had simple and advanced search forms, the lat-
ter so as offer a larger number of combinations and limit results by fields. On this
point, the search forms for ScienceDirect stand out, being complemented with a
Quick Search box.
Positive weighting was given to distributors with positional search boxes,
adapted to the point that the user has reached, with an eye to limiting searches to
within one publication, to the given volume, or the like. The systems considered
here have individualized search engines for those cases in which there is provision
of differentiated products: reference works, current protocols and even databases.
We considered it an advantage if there were possibilities for ordering results that
the systems offer to users, with Wiley standing out through the use it makes of rele-
vance, chronological order of appearance, and title, and with Kluwer adding the
possibility of ordering by authors. All the products have both short-form and full-
form presentation. The variant forms of information contained in the latter are
exploited most effectively by Science and by Wiley.
The format most often used for full-text documents is portable document format
(PDF). On formatting ScienceDirect stands out because it offers up to five different
types of end-user presentation, and it also has a high percentage of documents in
hypertext mark-up language (HTML). Individualized treatment of graphs and images,
the quality of which can be crucial in some areas of academic endeavour, was posi-
tively valued.
In some cases there is room for improvement of features relating to access struc-
tures, primarily in relation to certain indicators under the sub-parameters for search
and navigation capabilities and for presentation of results. While all providers allow
362
searching on various fields and use basic operators, some do not permit recording
of the history of searches and, with the exception of Emerald, there is no session
history recorded.
363
those indicators relating to the quotation systems in use and to the possibility of
requesting quotation alerts.
We consider it necessary for Spanish libraries to be able to have licence agree-
ments drawn up in Spanish and covered by Spanish law when it comes to clearing up
any disputes that might arise. Yet Kluwer and Springer have their contracts in English
and the legislation applicable to their licences is German and Dutch respectively. For
its part, Wiley makes its licences subject to American law.
A positive view was taken of a good range of types of licence and the possibility
of access to materials in ways complementary to, or independent of, publication on
paper, as is the case of E-Choice at ScienceDirect. It is worth pointing out that
publishers like Wiley are currently considering distribution of their materials in
a form suitable for personal digital assistant devices (PDAs). All the providers
considered had options for pay-per-view. Among the models used for this, attention
should be drawn to the novel vouchers or tokens for superusers from Wiley Inter-
Science. If these are used on a publication up to an amount equivalent to 115% of
its price, then it is automatically included by the supplier in the using establishment's
licence.
In most cases, the guarantees offered to licensees can only be described as limited.
Kluwer's commitment has led it to deposit its files at the Online Computer Library
Centre (OCLC). The obligation accepted by the distributors to continue providing
access to their collections of earlier issues is reasonable, and they have stated poli-
cies for back-number files. Guarantees on security and privacy of data are expressly
stated by all of the firms.
In what they provide, suppliers have progressively included access routes comple-
mentary to what is available through an establishment's intranet, so that researchers
can gain access to electronic materials from off-campus locations.
With respect to the sub-parameter relating to analysis of functions, it is necessary
to point out the unusual case of Emerald, the sole provider not to make use of user
registers. For the other suppliers of material, added-value services are largely tied to
user registration. ScienceDirect is to be distinguished from the others, because its
quotation system indicates articles that have cited the one being viewed and offers
quotation alerts on this information. All the suppliers have notification or alert
services. The linking techniques employed make use of the digital object identifier
system (DOI) and CrossRef. Additionally, Wiley participates in CrossRef Search
using Google technology.
The indicators making up the final sub-parameter show that all the suppliers
perform adequately. All parts of the serial publications on offer are in electronic
form, not just the academic articles in them. Production of teaching materials packs
is facilitated and sections showing newly available items are offered. The provision
364
of specific services for librarians and for authors is more uneven. Because of their
added value, the Library Connect programme from ScienceDirect and the portals
with information for thematic specializations at Emerald deserve particular notice.
ScienceDirect is particularly good with respect to the indicators for integration
and standardization, presenting logos, search boxes and explicit facilities for linking
with the online public access catalogue (OPAC) of the institution. It works with
SGML/XML document type definitions (DTDs) for mark-up of documents and with
other similar standards, such as MathML and XLink. Only ScienceDirect and Springer
state that they participate in the COUNTER programme for gathering statistics.
4. Discussion
The evaluation of materials presented above makes it feasible to note the extensive
general coverage, density per subject and long back runs of ScienceDirect. The
analysis likewise points up the striking position of Kluwer, even more so in the area
of electronic books. The horizontal coverage of information is similarly considerable
in the Wiley InterScience package. These products, like Springer's, are encyclopaedic
in nature, neglecting only the area of Humanities, present solely in Kluwer and, to
a lesser degree, that of Science. By contrast, Emerald stands out because of its
specialization and orientation towards social sciences.
The thematic organization for most of the suppliers considered could be impro-
ved. Only SpringerLink presents categories that are adapted to its contents under clear
and self-explanatory labels. A smaller number of thematic classes for Emerald, Kluwer
Online and ScienceDirect might be a better option, with subdivision into subcate-
gories where necessary, the solution that Wiley InterScience successfully adopts.
It would be desirable for suppliers of packages to provide more trustworthy
information about the contents covered: publications available, subjects to which
they are assigned, what their retrospective reach is, whether they are complete texts
or abstracts, formats available, and other points. It is difficult for licensees to check
on these matters, which are critical matters for licensees in the contractual relation-
ship being established.
The results obtained by ScienceDirect are to be noted, since, besides being the
clear leader in the functions and added-value services area, ScienceDirect also brings
together a powerful search engine, a flexible interface and a wide range of choices
for display.
Wiley Interscience is noteworthy for holding the second place for the last three
parameters. The good results for Kluwer's interface, and the correctness and balance
of Emerald for the same parameters evaluated should likewise be mentioned.
Nevertheless, it seems appropriate to recommend the introduction of terminolo-
gical tools to aid in carrying out conceptual searches, which are not satisfactorily
365
covered simply by the use of keywords. The organization of results might in addition
give priority to integrating solutions derived from similarity and clustering techniques.
Similarly, some aspects relating to standardization could be improved, as also the
use of statistical reporting on the basis of the COUNTER model, essential for manage-
ment of the collection by licensees.
It is necessary to carry out further studies complementary to the work reported
here, so as to investigate the academic relevance of the electronic materials on offer,
the overlap between providers and the facilities for access and functions provided
by each of the systems. Such investigations into their quality, together with others
covering the data on use of the products of electronic information suppliers, would
be an essential empirical contribution to the international debate on the way aca-
demic periodicals will be acquired by the university libraries of the future and play
a central role during the renegotiation of licences.
366
JISC Scholarly Communications Group. (2002). Final Report from the JISC
Scholarly Communications Group (SCG) to the Research Support Libraries
Group (RSLG). [On line at:
<http://www.jisc.ac.uk/uploaded_documents/rslg.pdf>].
[Consulted on: 21-05-2004].
Pullinger, D. (1999). Academics and the New Information Environment:
The Impact of Local Factors on the Use of Electronic Journals. Journal of
Information Science, Vol. 25, No. 2, pp. 164-172.
Rodríguez Bravo, B.; Alvite Díez, M. L. (2004). Análisis de los contenidos
distribuidos por proveedores de publicaciones electrónicas. El Profesional
de la Información, vol. 13, n. 6, pp. 441-449.
Rodríguez Bravo, B.; Alvite Díez, M. L. (2005). Survey of the Providers of
Electronic Publications Holding Contracts with Spanish University Libraries.
[On line at]. D-Lib Magazine, April, vol. 11, n. 4.
<http://www.dlib.org/dlib/april05/alvite/04alvite.html>
Tenopir, C. (2003). Use and Users of Electronic Library Resources: An Overview
and Analysis of Recent Research Studies. Washington, D.C.: Council on
Library and Information Resources. [On line at:
<http://www.clir.org/pubs/reports/pub120/pub120.pdf>].
Urbano, Cristóbal (ed.).(2004). Us de revistes electròniques de compra consor-
ciada del CBUC (2000-2003). Informe realitzat per encàrrec del Consorci de
Bibliotequees Universitàries de Catalunya. [On line at :
<http://www.cbuc.es/5digital/Informe_revistes_CBUC_amb_grafics.pdf> ]
Abstract
Methodology for the analysis comparative of information distributed, characte-
ristics of interfaces and various functions and added value services of electronic
publications providers.
Keywords
Architecture of access, Electronic contents providers, Electronic publications,
Evaluation, Functionalities, Information coverage, Interfaces, Methodology,
Services of added value.
Resumen
Metodología para el análisis comparativo de los proveedores de publicaciones
electrónicas: información distribuida, características de la interfaz y funciones y
servicios de valor añadido.
367
Palabras clave
Arquitectura de acceso, Cobertura de la información, Evaluación,
Funcionalidades, Interfaces, Metodología, Proveedores de contenidos electróni-
cos, Publicaciones electrónicas, Servicios de valor añadido.
368
Promoting Library Services, Designing Marketing
Strategies, Evaluating our Past and our Present,
Feeling more Optimistic about our Libraries Future
Antonia Arahova and Sarantos Kapidakis,
National Library of GREECE – Ionio University
Emails: [email protected]
[email protected]
Introduction
In an age where we need to compete among the myriad of Internet content providers
and fight for the limited attention span of our library patrons, marketing and pro-
motion of our services are paramount to our best well-being. While special libraries
may tailor their services to their specific target audience, public libraries and acade-
mic libraries, by definition, is catered to the general public and to the big academic
and student community at large. Because of their heterogeneous market, satisfying
the customers’ needs of public and academic libraries can be very challenging. So,
with the active collaboration with The Greek Ministry of Education and especially
with The Special Secretary for Libraries and Archives, we gathered statistics and
attention is given to the following parameters:
1. Promotion:
2. Understanding Customer’s Needs
3. Community Profiling
A good marketing plan begins with a mission statement that defines the objectives
of the library or the information centre, which includes an identification of the target
market segments. Realistic and measurable targets set should be subjected to ongoing
evaluation process as part of the marketing plan, and used to adjust or revise the
marketing activities. Evaluations can be in the form of official measurement systems
369
including financial accounting, computerized usage tracking, user satisfaction surveys,
or the less structured methods of verbal or written feedback from users.
As librarians we should be actively marketing and promoting our library servi-
ces. The basic aim of marketing is to know and understand our users in order that
the library is able to satisfy those needs in an effective way. A marketing plan is an
essential tool which will enable us to focus our efforts. The market plan should
assess where you are now (market research), where you are going (objectives) and
how you are going to get there (strategies).
370
3. Ministry of Interior, Public Administration and Decentralization
It is responsible for Municipal and Community Libraries that lie under the authority
of the Organisations for Local Communities. The Ministry is responsible for the
distribution of funds. However, the whole organization and running of libraries is
regulated by the Local Administration Authorities. Some of these Libraries are legal
entities of public law, other belong to the Municipal Cultural Centre and other func-
tion as a Municipal Business. There are 650 libraries all over the country and have
collections that exceed 4.600.000 books.
4. Other Libraries:
Libraries of Legacies, Foreign Institutions and Delegations as well as Private ones
falls into this category.
B. Co-operation Activities:
1. Hellenic Public Libraries Union Catalogue
Web site: http://vivl-livad.voi.sch.gr/syllogikoskatalogos/:
Characteristics:
• Material included: Bibliographic data for monographs, serials, audiovisual
material etc.
• Size: More than 24,000 bibliographic records, including 2,625 records for
monographic series.
371
• Composition of records: The records' bibliographic description is based on
the ISBD and the AACR2.The records' subject description and authority
control is according to library's custom methods.
• The classification is based on the DDC system or according to Library's
custom methods. The records are in ISO 2709 / UNIMARC format.
• Update: Continuously
• Producer: Levadia Central Public Library
• Completeness: It includes records of Levadia, Ioannina, Nafpaktos, Serres,
Rhodes, Atalanti and Corfu Libraries.
• Availability of titles: The titles availability is in printed format from the
following Greek Public Libraries, according to the code used in records'
full display.
372
2. The National Documentation Center (EKT) has created ARGO,
a web – engine machine that includes:
• EKT's Databases
Databases produced or hosted by the National Documentation Centre
(e.g. Hellenic Ph.D. Dissertations Thesis, etc.)
• Humanities Libraries in Greece
Contains the library catalogues of historical research centres and foreign
archaeological schools and institutes based in Greece
• Hellenic Academic Libraries
Library catalogues from Hellenic universities and TEI
• Public Libraries
Includes the catalogues of Hellenic public libraries
• Libraries from the World
Includes catalogues and union catalogues from libraries all over the world
(e.g. Library of Congress, MELVYL union catalogue, COPAC, etc.) )
• Serials Collections
Serials (periodicals) collections (e.g EKT's Serials Union Catalogue,
EKT/NHRF Library - Electronic Journals, etc.)
• In collaboration with 200 Greek Libraries has developed and updated the
online database of the Union Catalogue Periodical (UPC) of the Greek Science
and Technology Libraries (HERMES).
373
between the Ministry of Education as well as 12 Research Centers and Highest
Education Institutes, specialized in network and Internet technologies.
Available Services
The Greek Schools Network offers a broad package of services to its units and
users. The most important of these are:
1. Automated registration procedure for educational staff and students -
Users Administration Service
2. Remote network access (dialup)
3. _-mail, accessible through the POP3 and IMAP protocols, as well as the
world wide web
4. E-mail lists
5. Web Portal offering news services and personalized access to telecommuni-
cation and informatics services
6. Controlled access to the World Wide Web, prohibiting access to web
sites with harmful content for underage
7. Web hosting for static and dynamic pages
374
8. Wizards for automatic webpage creation
9. Asynchronous distance learning, for hosting and distributing digitized
lessons Teleconference
10. Video On Demand delivering streaming educational multimedia material
11. Live Internet transmission (webcasting) of various of various events
12. News (www.sch.gr/news) and Discussions (www.sch.gr/forums)
13. Electronic Magazine Personal Calendar, Personal Address Book, Notes
and "To Do", accessible through the World Wide Web
14. Directory Service
15. Voice over IP
16. Online statistics Help-Desk, for immediate solution of technical problems.
The Help-Desk is accessible through one-phone 801-11-801-81
4. E-Trikala:
Trikala announced as the first Digital City in Greece by the Greek Vice Minister of
Economics C. Folias late last year -- will finish its first phase of development by the
middle of 2006, with funding from the Greek Information Society Framework
Program. The Digital City ICT applications aim to improve everyday life by simpli-
fying public transactions, reducing telecommunication costs and by delivering new
services related to the local way of life. Those ICT applications also offer new
methods to enable citizens to participate in policy-making, and help ensure local
government and public authorities as guarantors of the local society's proper ope-
ration. Every medium-sized city has its own social, economic, geographic or political
characteristics. For this reason the digital city can vary from region to region, so that
ICT applications enhance local characteristics rather than detract from them. The
Municipal Library of Trikala is one of 30 selected in Greece, to join the Greek
National Network of Public Libraries. Via this network, the library will have
access to catalogues of all Greek public libraries, to special Web portals, but also to
a “digital depository of books and periodicals” developed at the national level.
Users of the Municipal Library will access a helpdesk located in-house, where PCs
with controlled Internet access are installed, in order to view or order articles and
books in digital form.
375
months to present broadband advantages. In the meantime, special events will be
organized to present specific applications based on broadband solutions, oriented
to groups of citizens (as professionals, lawyers, students, etc.).
C. Statistics:
According to the Report on the situation of libraries, museums and archives pre-
pared in January 2004 for the European Commission's Libraries Sector, DG
Information Society Cultural Heritage Applications Unit Digicult, in Greece the
situation in Libraries Section can briefly described as the following:
• In 2004, Greece had 10.4 million inhabitants and an area of 131,990 sq.
km., giving a population density of 79 inhabitants per square kilometre.
Greece spent, in 2000, 0.30% of its GDP on libraries.
• Public libraries in Greece had 669 service points in 2003, 24 per cent of
which (about 142) in the Attica region, with 64,501 registered users.
The number of volumes in book collections was 9.6 million and 226.3
thousand volumes were added.
• With the exception of a few major libraries (National Library, Library of
Greek Parliament) all the other libraries have a restricted number of books.
The rate of automation is not very high. The majority of libraries rely on
simple software in order to perform simple tasks. Few libraries permit on
line access and not all of them have a web site (mainly university and
research libraries have).
376
• Higher education libraries in Greece had 70 service points in 2003.
The number of volumes in book collections was 6.5 million, and there
were 128.4 thousand registered users.
• All libraries have computers – between 1 and 5, were most of them have
3 computers. Two of the computers of each library have dialup access to
the Internet, in most cases
• The computers are available to the users from 0 up to 62 hours per week, with
an average of 27 hours per week, according to the following distribution:
D. Plans – Proposals:
1. Select Committee Report on Public Libraries: The Greek Ministry of Education
and especially with The Special Secretary for Libraries and Archives has produced
a report on Greece's public library service. The report suggests that the use of
technology is presenting public libraries with an extended role, where new tech-
nologies can provide a broader social exchange mechanism. ICT can be used as
a tool, for example, in life-long learning initiatives, civil society and egovernment
services. The changes identified in the report will have a profound impact on the
nature of the library workforce, which will need a range of capabilities, dispo-
sitions and skills to be effective in the future. Its key recommendations are
designed to focus attention on libraries' fundamental role in promoting reading
and distinguishes between core functions and desirable add-ons. The report
calls for far stronger links between national library standards and effective
mechanisms to encourage and enable library services to meet, if not surpass, them.
It also recommends an action plan for the digitalization of the nation's public
library collections.
3. Social Inclusion and Social Exclusion Library Report: Among its new initiatives,
YPEPTH is planning to produce a report on libraries and community cohesion.
A major section of the report looks at social inclusion and social exclusion and
how libraries fit within national and regional “community” agendas. As well as
providing a detailed analysis of the background to social inclusion/exclusion,
the report can act as advocacy material as well as making recommendations on
priorities for future development.
377
4. Learning Packages: The design of packages consisted of directed learning journeys
through the new Greek Public Libraries’ website content. They can be used inde-
pendently by individual staff, ideally with support from a local mentor, or as part
of an authority’s organized training on work with young people.
Significance must be given at why reading and libraries are so important for young
people, and at simple and practical ways to welcome and engage young readers
and their families. Also the packages aim to increase staff awareness of the
library and reading needs of young people and their families - both users and non-
users - and to help staff to develop skills and ideas for meeting those needs
through the welcome provided by library content, display and activities, and by
everyone working in the library.
6. Virtual Reality and Public Libraries: Our last year report examined the many ele-
ments that make up a library, and identifies the trends that are reshaping our ideas
of what a virtual public library network can be. It also projects a series of future
scenarios, examining the issues, drivers and trends that could have a crucial
impact on the future of the virtual reference provided by Greek public libraries.
378
library may choose to offer the service only for its own clientele. There is no time limit
for answering a question, although the librarian should keep in mind that other
patrons might be waiting. If a question requires more than 15 minutes, referral
to a local librarian may be more efficient. The librarian on duty is not required to
answer more than one question at a time. If a second question appears in the queue
while the librarian is already answering a question, it will be routed after a few
minutes to another online GVRS librarian. If no other librarian is online, the question
will be picked up by the Librarians by Request GVRS staff (Tutor.com). Suggestions
for appropriate electronic or print resources to help find information for a project
or research paper or help in constructing a search statement.
Assistance in the use of electronic resources. For in-depth reference questions or
if detailed research assistance is needed, the librarian on duty can choose to follow
up by email or can refer the question to a librarian from the patron’s host institution.
The service is designed to answer reference questions, but general circulation or
directional questions may be answered using the library policy pages provided by
each institution and available on the GVRS Virtual Reference web site.
6.4. Scheduling
At the beginning of each semester, a schedule will be created using a scheduling soft-
ware. Each institution will be asked to sign up for a required number of shifts. The
scheduling coordinator will make sure that all shifts are covered and will resolve
conflicts. Every effort will be made to accommodate individual institution’s prefer-
ences. If a library is unable to staff the service at its regular scheduled times, they
should first request a shift trade through the scheduling software. The scheduling
coordinator should be notified if a trade is not possible.
379
6.5. Quality Control
Providing virtual reference service in a consortial environment means that librarians
staffing the service answer questions for patrons from institutions other than their
own. This means they will be using online resources they might not be familiar with.
In order to maintain the highest standards of quality, all library staff involved need
to familiarize themselves with the policy pages and the electronic resources of the
participating institutions.The coordinators at each institution are responsible for
notifying consortium members of any changes in policies or any specific things
that could affect the virtual reference service via the GVRS Virtual Reference dis-
cussion list. Individual coordinators are also responsible for reviewing the trans-
cripts involving their patrons and their librarians, as well as the survey responses
from their library’s patrons. They may decide to follow-up by email if the service
given to their patrons was not adequate. It is recommended that the transcripts (or
a sample of the transcripts) be reviewed at least weekly. Any complaints regarding
quality of service should be sent to the quality control coordinator.
380
using, and his IP address. We store session cookies on his machine in order to send
chat messages, web sites and files, but these cookies will dissolve when his session
ends. We keep the transcripts and make them available to supervising librarians
for quality control, but we purge all his personal information from the system after
30 days. If one selects the "Anonymous" user option, the librarian will see the infor-
mation entered in the form, but personal information is purged as soon as the session
has been ended.
This privacy policy will be reviewed periodically. If any changes occur, the
patron will see the word “updated” next to the Privacy Policy link on the entry page.
381
E. Steps in The Marketing Plan:
1. Our Corporate Vision and Ambition for the Public Library Service. The purpose
of the Greek Virtual Public Library Service is: “To help deliver the Country’s
Public Libraries strategic objectives, by promoting learning, by encouraging
reading and literacy, by providing access to information and to digital skills
and services, by helping to build community identity, and by adding to the
cultural and recreational life of Greece by offering services accessible to all and
by making best use of available resources. In doing this we endeavour to ensure
our services are accessible to all and that the resources available to us, whether
human, financial or material are used and promoted in the most effective,
imaginative and innovative ways to ensure value for money. ”
2. The scope:
• Provide comprehensive, efficient and modern Public Libraries and
Framework for the Future
• support their achievement helping to raise standards in schools
• improve the quality of life
• build safer and stronger communities
• promote healthier communities
• support the economic vitality of localities
It is all part of a plan to make sure libraries remain topical and relevant for young
people, not only by involving them in running public libraries, but also by matching
reading, learning and information support to their needs.
3. Underlining the Benefits: Reasons for the increase include the opportunity for
the patron to ‘learn from home,’ and especially “learn how to learn”. Another
added incentive from GVRS, is the offer of public long-life learning for all
distance educated elderly men and women, no matter where they reside. In light
of these goals and objectives, the National Statistic Service in an effort to increase
enrollment to the real-time procedures, is gathering data to facilitate meeting
these objectives. In scanning the external library environment, marketing staff
garnered information in order Greece to remain competitive.
4. Marketing research is the function that links the information professional to the
customers’ wants and needs. In this process relevant customer-related data is
identified that the Greek Public Libraries’ organizational schema already has
access to, as well as data that is needed and how it will be collected.
5. Marketing Mix 5S’s: Moving on this next step, significance must be given to the
marketing mix which is the development of the service, the scope, the strategy,
382
the system and the solution this collaborative interactive virtual technology
provides.
Here is a review of each component:
• Service: The VRS provides items including: 1) email reference; 2) and real-time
assistance using chat software; and 3) 24/7 access to online resources.
• Scope: This service will be built and adjusted especially to the Greek reality
of the public libraries, helping both patrons and librarians finding the best
and more accurate resources in the minimum time
• Strategy: Evaluating the 45 Greek Public Libraries, the 499 School Libraries
and their in our days services, we will all agree that a new national strategy
and its promotion is absolutely necessary for their “renovation”.
• System: Digital technology gives us the key for the creation of a new virtual
reference system that can answer to the challenges of the new virtual époque
when everything is taking place in real time and
• Solution: Through the use of marketing communication tools such as adver-
tising; media/public relations; printed materials; internet communications;
special events and featuring a daily web page of public libraries’ news, called
“My GVRS”, the new service will be considered as a solution the increased
access to online resources, and the new 24/7 VRD services. The “My GVRS”
page pops up each time a patron logs onto an online environment and is
frequently used for distributing timely news.
6. Gathering Current and New Evaluation Criteria: The staff knows that the
detailed records and logs that online transactions offer will yield good evalu-
ation criteria, and that overtime they will be able to add to the initial criteria
established. Long term usability and satisfaction will also have to come from the
mouths of users. The Greek patrons always complaining for the non-existence
of a national system that will enable their hard effort in the hunting of infor-
mation. Librarians know that the web is not enough and that they can, inside a
well –organized network, to provide the right and accurate information showing
the paths not only to information but also to knowledge.
383
implement changes as needed and as resources allow. In Greece especially in
The University of Macedonia, The University of Crete and The University of
Ioannina has made few but quiet serious steps by implementing e-reference
systems, like Ask a Librarian, via email or telephone. It is indicated a demand for
the expansion of this service throughout the country.
Time from initial request to answer Email and live chat sessions
turn around time
10. Campaign – Time for Action: Kick off VRD Campaign. In our vision these sepa-
rately functioned e-services models can be unified in one, a national one in which
each member can deliver, depending to its collection, questions and from
general users, and from students, especially Open University’s students, and from
pupils following the example of e-tutor that the last 3 years is successfully applied
in Boston within the cooperative schedule of The Boston Public Library, Harvard
University, City of Boston and Massachusetts Consortium. A National Campaign
from the web site of The National Library of Greece, or from the formal web
site of The Greek Ministry of National Education, can underline the sense that
this service is for the public’s good.
384
F. “Marketing and Management” The Future of Library Services
in Greece:
The future holds demand for more and more service. The relationship of available
time and money as well as use policy considerations will ultimately either facilitate
or restrict the progress of electronic library services Reduced funding has resulted in the
downsizing of staff/services and an emphasis on rationalization and cost-recovery.
Our present and mostly, our future requires a responsive, up-to-date library service.
The increasing number of cooperative ventures it is time to be driven politically
and financially as libraries and educational organizations become more cooperati-
ve-conscious. Public Libraries, School Libraries and Academic Libraries will be
making agreements among themselves examining to justify their needs and working
for the common good. Promoting the usage of the GVRS and its advantages such as
saving currency and man-hours, exploitation of the existing material, expan-sion of the
number of users of each library, reduction of the expenses, rational usage of the bud-
get of the libraries, underlines the significance of a good marketing plan.
Library staff, with appropriate training, can enjoy surmounting the challenges,
knowing that their work truly makes a difference for remote users, especially stu-
dents, so let’s see its The Role of Librarians:
• Reinforcement in the librarians’ educational mission is necessary. Greek
National Virtual Desk could use the following online tools and resources:
1) the electronic classroom (virtual classroom through split-screen technology);
and 2) the electronic library (catalogue and delivery service).
• Greek librarians should embrace these new opportunities to redefine their
roles as teachers, as advocates for information policy development, as orga-
nizers of networked resources, as social human beings and take a proactive
stance, as eagerly as they welcomed and grasped the technological innovations
that so rapidly are changing their libraries
Conclusion:
Public Libraries work together with Museums, Archives and other institutions in local
level in order to provide better services to the citizen. This is a major trend in
Northern Europe. In Greece, at the same time, there are obvious movements towards
a more active role of Public Libraries within the local community. The question is
how much can we talk about a real change. In what extent people get what they
want from a public library service. More and more the discussion about Libraries
moves from the development of the collections to the services offered. All new
changes need to be discussed and should work towards the development of human
and virtual networks, which apparently will support the developments in local
cultural institutions in general. The GVRS is a first step towards a truly virtual
385
library and extends the access rights of the users of each library. Marketing is one
of the primary forces of any successful business and every type of successful library.
True marketing is a process which is conducted over and over again, a systematic
approach for matching services and products to a customer’s wants, needs and
desires. Marketing planning gathers information that is infinitely invaluable for
creating long term “customer satisfaction”. This is what we now need in Greece.
Having the best and most appropriate service to satisfy our distant patron of any age,
any nationality.
References:
1. Arahova, A., Kapidakis, S., Greek Libraries: A Vision for a National Entrance
to the Virtual Reference, 70th IFLA (International Federation of Libraries
Associations) Conference, Management & Marketing Section, Sao Paolo,
Brazil, 18-20 August 2004.
2. Booth, J. “Marketing Public Library Services: The Gap Between Theory And
Reality In Britain”. Library Management. 14(1) [1993]. 9-23.
3. De Saez, E. Marketing Concepts For Libraries And Information Services.
(2nd ed.). London: Facet. 2002.
4. Hart, K. Putting Marketing Ideas Into Action. London: Library Association.
1999.
5. IFLA Public Libraries Section Alert April 2005: Strategic Plans, Strategic Plan
for Library Service 2005 – 2009.
6. Jolly, Liz. “Only connect: librarians in the Learning Society”. Journal of
Career Development Group, v.3, no.7, July / August 2000.
7. Kies, C. Marketing And Public Relations For Libraries. Maryland:
Scarecrow. 2003.
8. Koontz, Christie, “The Virtual Reference Desk: Reinventing an Old Product
for New Markets through Marketing Planning”, 70th IFLA (International
Federation of Libraries Associations) Conference, Management & Marketing
Section, Sao Paolo, Brazil, 18-20 August 2004.
9. Kozol, Jonathan. "An Unequal Education." School Library Journal Online,
May 1, 2000.
10. Madison, Wis. Findings from the Evaluation of the National Library Power
Program. Executive Summary. DeWitt Wallace-Reader's Digest Fund and
University of Wisconsin at Madison School of Library and Information Studies
and School of Education, 1999.
11. Miller, M.L. and M.L. Shontz. "More Services, More Staff, More Money:
A Portrait of a High-Service Library Media Center." School Library Journal
386
Online, May 1, 1998.
12. Nicholas, J. “Marketing And Promotion Of Library Services. Library and
Information Services in Astronomy III: ASP Conference Series”. 153. 1998.
Date last acceseed: 17 June 2005. <http://www.eso.org/gen-fac/libraries/
lisa3/nicholasj.html>
13. National and Kapodistrian University of Athens, School Libraries Work
Evaluation: Statistics and Results of Evaluation. Athens: 2003.
14. The digital library: remote reference services", PHD paper, Graduate School of
Library and Information Science, University of Illinois at Urbana-Champaign.
http://www.lis.uiuc.edu/~b-sloan/e-ref.html
15. Tenopir, C. A (2002) Decade of Digital Reference: 1991-2001. Reference
& User Services Quarterly. Vol. 41. No. 3, p.264.
I. Abstract:
Our paper includes a proposed model related to statistics according to the Greek
public and academic libraries. We demonstrate evaluation practices and mainly best-
practice and “best-vision” strategy encouraging the improvement in the provision
of library services not only in Greece but in a generally implemented framework.
Greece is making a great effort to achieve a continuous improvement of the libraries'
services. The paper aims to demystify marketing for librarians. Practical solutions
are provided on how to implement a marketing strategy, with particular emphasis
on the value of using electronic information resources. It also shows the link between
promoting library services and raising the profile of the library.
387
A new model for public library and information
services evaluation: an integrated approach
- SIADAP+B
Leonor Gaspar Pinto,
Lisbon Municipality;
Member of the Executive Board,
INCITE - The Portuguese Association for Information Management,
e-mail – [email protected]
Paula Ochôa,
Ministry of Education; Member of the Executive Board,
INCITE - The Portuguese Association for Information Management,
E-mail – [email protected]
1. Introduction
The origins of SIADAP+B lie in the work reported by Ochôa and Pinto (2004b) that
intended to operationalize three evaluation models: Common Assessment Frame-
work (CAF); Balanced Scorecard (BSC) and library standards on performance
evaluation, namely ISO 11620. In that context, the research question formulated was:
can different categories of indicators (representing qualitative and quantitative
variation in conceptions of assessment) be integrated and operationalized during a
Public Administration reform?
Since the 1980s, successive Portuguese governments tried to pay close atten-
tion to the quality of public services. Today, demands for enhanced services and civil
servants’ responsibilities are very strong. These demands surpass product/service
quality and focus on areas such as management practices, transparency and accoun-
tability. In this context, civil servants are the major target for all criticism directed
towards Public Administration. There are significant signs that LIS (Library and
Information Services), especially in Public Administration, might be closed in a near
future due to financial constraints.
In Portugal, LIS performance assessment has been traditionally confined to the
production of statistics. Based essentially on input and output measurements, this
388
is the dominant type of performance information that is produced and used by the
LIS sector. As yet, there is not a global movement towards evaluation, a global
standard that is accepted and used or generally accepted monitoring mechanisms.
There are still many librarians for whom responsibility for managing remains a
distant target.
This situation embodies the very definition of our research field. The subjective
concept of quality leads to decisions based on perceptions of prestige, ranking of
results with the implicit need for impact measurement. The use of evidences will
be outlined in the next years within the context of the quality policy itself. The
development of SIADAP+B thus emerged from an environmental analysis framed by
librarians’ perspective and essentially grounded in librarians’ experiences. An
ongoing research project (2004- ) funded by INCITE - the Portuguese Association
for Information Management uses several evaluation models in an action research
framework. Its main objectives are:
• to enable librarians to develop their evaluation skills and their awareness
towards public services demands;
• to enable librarians to benefit from a strategy to improve image;
• to identify learning, support and action-research strategies that will help
librarians achieving and monitoring their organisations’ outputs and
outcomes.
In this paper we argue that these matters should be integrated into a balanced
model, based on action research as a form of collaborative, practitioner-based
research, which involves participants in the research process as active members
reflecting on and contributing with improvement suggestions.
Our action-research is developed in three stages:
1. Definition of methods and data analysis
2. Implementation and test of the model in a library
3. Focus on conceptual findings and conclusions and dissemination of the model
among Public Administration libraries and information services.
The present study has been exploratory and is also concerned with two issues.
Firstly, librarians need to understand how to deal with citizens’ prejudices. In that
sense, we will try to demonstrate how SIADAP+B can be used to promote libra-
rians’ social image. Secondly, this paper will briefly consider how outcomes may
be used to develop evidence-based librarianship among professionals.
389
Rhodes and Weller, 2003;) about organizational evaluation have contributed to
the growing debates within the information community on the whole process and
how it might evolve (Van House, 1987; Ward et. al., 1995; Poll and Boekhordt, 1996;
Zweig et al., 1996; Zwart, 1998; Sutter, 2002).
The overall process of quality assessment in public services in Portugal has led
to a heterogeneous movement towards modernisation, which included, since 1986,
a marked quality strategy. Created in that year, the Administrative Modernisation
Secretariat longed for a Public Administration, not powerful and bureaucratic, but
centred on customers and capable of satisfying their needs and coping with new
challenges. Since then, several initiatives were taken to improve the information and
communication flow between citizens and Public Administration and to modernise
it. One of those initiatives was the Quality in Public Service Prize, which was
launched in 1994, in order to stimulate the development of Quality Programmes.
In 2000, during the Portuguese presidency of the EU, the process of constructing a
national quality policy entered a new phase: CAF – Common Assessment Frame-
work was recommended as the quality management tool European Public Admini-
strations should use.
In general, we can say not only that Portuguese governments had been respon-
sive to the European quality agenda, but also that this movement towards quality
had a positive impact on public services, though lower then what was possible and
expected.
Specifically in what concerns performance evaluation policy for Portuguese
public services, the last Public Administration major reform was produced in 2004.
Its seven axes are:
• State organization
• Administrative organization
• Leadership & responsibility
• Merit & qualification
• Value and training
• Culture of service
• e-Government
Closely related to the issue of institutional/staff appraisal is the new model SIADAP
- Integrated System of Performance Appraisal in Public Administration. This system
has the following objectives (Law nº 10/2004):
• To evaluate the quality of public services and bodies in search of excellence
and continuous improvement of citizen focused service delivery;
• To appraise, sharpen accountability and recognise the merit of top managers
and staff based on productivity and results achieved;
390
• To recognise differences between performance levels by fostering a quest
for excellence, motivation and recognition of merit.
• To strengthen leadership and management skills in order to enhance efficiency
and service quality levels.
QUALITY
Compared with the situation a decade ago, in some aspects, the movement towards
quality seems to be stronger in academic and specialized libraries. In some academic
libraries this trend has expanded considerably. This can be explained by the fact that
universities are more market-oriented and are trying to be certified by ISO 9000.
In comparison, quality in school libraries and public libraries is largely under-
developed. This is partly due to the existence of a much differentiated knowledge of
management techniques within professionals. Public Libraries are very dependent
on municipalities’ rules and strategies, which is in turn one of the reasons why, in
particular in Portugal, the assessment policy is focused on staff, rather than on the
organization in general.
Overall, this short review (arising from data reported by the Observatory on
Quality of Knowledge and Information Services1 studies suggests that, despite the
Public Administration reform, libraries in many cases do not yet appear to have
substantially embraced quality and performance measurement as their core
objective for the next years. The absence of a specific National Policy towards
quality management or performance evaluation in the Portuguese LIS sector is a
major contributor to this situation, but also to the different development stages in
the sub-sectors as mentioned above. Nevertheless, it should be noticed there are
391
some good isolated experiences. Some case studies debate the focus on performance
and results, customer orientation, application of ISO standards on performance
evaluation and citizen charters. One of the most debated cases has been the Total
Quality Management Program developed by the Library of the Secretary-General of
the Ministry of Education (1996-2005).
This experience was launched in 1996 introducing a performance evaluation
methodology based on Quality Standards and a Citizens’ Charter. In 1998, the
Quality in Public Services Prize was awarded to the Library of the Secretary-
General of the Ministry of Education for its innovative Quality Programme based
on the EFQM model. Until now, this is the only Portuguese library that has won such
a prize, being considered a best practice among the knowledge and information
community. Since then, this library adopted a strategy focused on the improvement
of librarians’ social representation and libraries public image. In 2004, it was
recognized as a national “good practice” and the library’s Director represented
Portugal in the 3QC – 3rd Quality Conference for Public Administrators in the
EU (15-17 September, Rotterdam, The Netherlands).
According to C. Abbott there are six main reasons for performance evaluation
(Abbott, 1994):
• The political imperative
• Accountability to the parent institution
• Performance indicators and quality
• Performance indicators and service level agreements
• Decision support
• Accountability to customers
In the case of the Portuguese LIS sector, the first three reasons, together with a
national need for enhancing the social value of LIS professionals, determined the
need for applying SIADAP to this particular activity sector. Empirical results also
suggest the development of an adapted “version” of SIADAP might be a precious
contribute to the enhancement of these professionals’ social value. But the success
of SIADAP+B strongly depends on four principal variables:
• Role transformation
LIS professionals must take a more active stand on issues related to performance
evaluation and develop as individuals a capacity to create a role transformation
in their careers. Librarians’ role transformation implies a more experimental
approach to issues related to the measurement learning cycles: inter-organi-
zational learning; Inter-professional learning and peers learning. Rather than
maintaining traditional roles, we should take the opportunity to become facili-
tators of organizational evaluation. By assisting this new role, we as librarians
392
may gain a new role towards social impact, not only to cultivate our motivation
but also to encourage future generations to enter this profession.
• Value added
It must be based on a dynamic competence scorecard, which is an essential part
of a model of performance monitoring. Librarians’ performance is as important
as libraries’ performance. Librarians are archetypal boundary workers who look
organizational memory across information sources. The creation of collabo-
rative forms across different competences, and resources management is central
to their work. As performance monitoring has taken more economic significance,
so innovation and Evidence Based Librarianship has become a priority for LIS
professionals. In that sense, value creation will hopefully come by as a result of
the Professional competences image study, which is being carried in Portugal, since
April 2005, by the Observatory on the Information-Documentation Profession2
(OP I-D)
• Process redesign and Integration
These are the other two variables that are important to SIADAP+B success since
they are closely related to essence of this integrated model as we will see in next
chapter.
4. Building SIADAP+B
SIADAP+B’s central goal is to present the LIS sector with a performance evaluation
model that can be used as a strategic tool of organisational quality improvement
and social value enhancement of information professionals. In this model of action,
information professionals, managers, public services with libraries and customers-
citizens are offered important parts.
The construction of a specific evaluation methodology for the Public Admini-
stration LIS sector, like any other evaluation methodology, was guided by pragma-
tism, that is, by the need for respecting the specific birth environment and adapting
to the object being evaluated.
Organizational evaluation in the areas of self-assessment (CAF – Common Assess-
ment Framework), strategic evaluation (Balanced Scorecard) and micro-level
evaluation (Brown, 1996) provide the theoretical reference framework for the develop-
ment of an evaluation model for Public Administration LIS.
The essence of strategic learning lies on the construction of an explicit model
that can be used to structure performance evaluation (Neely, 2002) according to Tichy
and Hornstein´s (1980) three stages:
1. Selection of the constituent elements of the model
2. Development of the categories of each element
3. Specification of inter-relations between categories.
393
4.1 Constituent elements
At the first stage, four evaluation structures (see Fig. 1) were used as essential
elements:
394
A. Assessment Structure CAF
The Common Assessment Framework (CAF)’s main purposes are to promote
the use of quality management techniques among public sector organisations
across Europe and to allow the development of benchmarking studies between
them. This framework incorporates the principal features of both the EFQM3
model and the Speyer model, but also benefiting from adaptations of EFQM
model made by several EU Member States.
CAF provides a self-assessment framework based on nine main aspects of an
organisation (see fig. 2): Leadership, Planning and strategy, Human Resource
Management, Partnerships and resources, Process and change management,
People results, Customers/citizen oriented results, Society results and Key
performance results (CAF, 2002).
Human People
Process Key per-
Leadership and change formance
Planning manage- Customers/cit results
ment
Partnership Society
395
BSC promotes the establishment of tangible objectives and measures that relates
to an organisation’s mission, vision and strategy, placing it on course to future
performance. BSC focuses on four critical success indicators: customer service,
financial accountability, internal processes and learning and growth.
Skandia, one of the largest Scandinavian insurance companies, developed an
adapted version of Kaplan and Norton’s BSC, which has been highly appre-
ciated all over the world mainly due to its high effectiveness – the Intellectual
Capital Navigator. This management model is based on five main focuses: Finan-
cial focus (representing the past), Consumer focus, Human focus and Process
focus (representing the present) and Renewal and development focus (repre-
senting the future) (Rezende, 2003). The strategic evaluation structure that
supports the construction of the integrated model SIADAP+B is an adaptation of
Skandia’s model which also presents five focuses (see fig. 3): Results focus,
Customers-citizen and society focus, Organisational behaviour focus, Internal
process focus and Renewal and development focus.
396
internal communications systems and the efficiency with which it transforms
inputs in outputs (1986, quoted by Cullen, 1998).
The Process Evaluation Structure is formed by five categories (see fig. 4):
• Inputs
• Processing system
• Outputs
• Outcomes
• Objectives (which link organisational and individual performance
to the strategic focus).
397
D. SIADAP – Integrated System for Performance Appraisal in Public Administration
This system is aimed at the integrated development of an overall model for
performance assessment of Portuguese Public Administration capable of
functioning as a strategic tool to gear to changes, professional motivation and
improvement in the sector (Law n. º 10/2004).
Among SIADAP´s governing principles, one can find the outcome-based
approach, the universality of its applicability, the accountability and development
and the recog-nition and motivation.
SIADAP is integrated into the regular annual management cycle within
every Public Administration service and body. It includes five building blocks:
(1) Setting out an Action Plan for the following year (with strategic objectives);
(2) Setting out objectives to be achieved by each organisational unit the follow-
ing year; (3) Setting out objectives for each worker and/or team for the follow-
ing year; (4) Reporting activities; (5) Evaluating performances (see fig. 5).
398
Level 1
Level 2
Level 3
Level 4
399
In fact, the application in a library of CAF’s nine self-assessment criterions - Leader-
ship, Planning and strategy, Human Resource Management, Partnerships and
resources, Process and change management, People results, Customers/citizen oriented
results, Society results and Key performance results – can be assisted by the five evalu-
ation perspectives proposed by SIADAP+B’s Balanced Scorecard. For instance, BSC’s
Organisational behaviour focus relates to CAF’s Leadership, Planning and strategy
and Partnerships and resources assessment criterions.
Though the implementation of the integrated model SIADAP+B can be done in
diverse ways, there is a mandatory pre-requisite: it has to be customized, that is,
adapted to the foster organisation. The successful implementation of this model
depends, therefore, on its ability to reflect the library and parent organisation’s
strategies and adapt to the collective needs and expectations. In this process,
strategic planning must be an organisational practice; the organisational vision
(strategic focus) is an essential piece in this model, since it acts as a continuous
reference for the alignment of strategic objectives, communication, operational
decisions and training.
It is important to use SIADAP+B as an experience of competences development
within the management cycle. Kolb (1984) presents an experiential learning model
with interdisciplinary influences based on individual learning experiences. Four
learning elements are presented: concrete experience (level of involvement); reflexive
observation (systematic reflection upon self-experience and learning); abstract con-
ceptualization (reflections related to knowledge and experiences) and active experi-
mentation (development of experiences and exploration of learning areas). Self-
evaluation is an individual learning experience with relevance to organizational
learning: as people reflect on their performance from open experimentation, they are
encouraged to learn in this way. The added value of this approach to reflection-
performance evaluation has also revealed the importance of “double-loop learning”
(Argyris and Schon, 1978) when actions and intentions can be interpreted through
experiences. Learn with practice is a context dependent professional situation that
must be incorporated in this model.
There is growing evidence to suggest that research skills are crucial to maintaining
the impact of performance evaluation: to improve performance outcomes (individual
and organizational), librarians’ development should be aimed at fostering an evidence-
based librarianship approach. The results obtained can be interpreted in various
ways: reflexive practice and action learning, team learning and professional learning
and performance.
400
5. Conclusions
To summarize, this reflection upon emerging needs to evaluate public services reveals
a new understanding of a government model – SIADAP – going from an assessment
of objectives to a wider definition that can be better captured by a theory driven
perspective based on action-research. Under this interpretation, SIADAP+B is con-
cerned with linking theory (learning, competences, assessment) processes of work
and outcomes through an exploration of several models. It is important that different
tools and techniques in quality management and performance evaluation become
more integrated so that they serve each other. The evaluation design described here
reflects much of the latest influences in multi-method and multi-level collaborations.
A more informed perspective on the priority issues for LIS in Portugal has emerged
with this project. From the first results generated it is apparent that the priority for
further investigation and model improvement should be in the following areas:
• Projects for indicators, statistics and performance targets;
• Improvement in service provision;
• Development of service profile based on staff competencies and quality services
• Levels of organizational learning
Every model will fail to produce their potential benefits unless it is actively led and
supported by individuals who believe that they can and should make a positive
difference to stakeholders. LIS professionals need the “three Ts”:
• Time
• Trust
• Tenacity
Further development of this work will be on the direction of increasing the market-
ing role of the profession as an innovative profession that is prepared to take the
risk of making changes in library management and become a “good practice” in
public services. This strategy of visibility (LIS professional competences-driven and
LIS professional social value-driven) should be linked to Evidence Based Librari-
anship. In a competitive market place, it is now the moment to solve some old
dilemmas between practicing and research.
Although this communication was not able to address this in further detail, it is
our hope that the issues discussed above will provide a framework for such a dis-
cussion.
401
Notes
1) The Observatory on Quality of Knowledge and Information Services (OQIKS)
was launched on the 25th October 2001 based on a knowledge partnership
between two services of the Portuguese central Public Administration: Inofor –
Institute for Innovation in Vocational Training and the Secretary-General of
the Ministry of Education. This innovative experience was presented in
several scientific events, like for instance the 68th IFLA General Conference
and Council (Glasgow, 2002) and the NORD I&D 2004 (Aalborg, 2004)
(Ochôa e Pinto, 2004; Ochôa e Pinto, 2004a).
2) INCITE – The Portuguese Association for Information Management is one
of the members of the OP I-D, a project that aggregates four Portuguese
information professional associations and tries to respond to the tendency
to focus on professional performance and value.
3) European Foundation for Quality Management.
References
Abbot, C. (1994) – Performance measurement in library and information
services. London: Aslib.
Argyris; A; Schon, D (1978) – Organizational learning: a theory of action
perspective. Reading, MA: Addisson-Wesley.
Bevir, M.; Rhodes, R. A.W.; Weller, P. (2003) – Comparative governance:
prospects and lessons. Public Administration, vol. 81, nº 1, pp. 191-210.
Brophy, P. Clarke, Z. (2001) – Library performance measurement and quality
management system
Brown, M. (1996) – Keeping score: using the right metrics to drive world class
performance. New York: Quality Resources.
CAF: [On line] Common Assessment Framework (2002). EIPA: Maastricht, 2002.
Available at the WWW: http://www.eipa.nl/CAF/Introduction_2004.pdf
Crawford, J. (1996) – Evaluation of library and information services. London:
Aslib.
Crawford, J. (1998) – The stakeholder approach to the construction of perfor-
mance measures : outcomes and implications. In INTERNATIONAL CON-
FERENCE ON PERFORMANCE MEASUREMENT IN LIBRARY AND
INFORMATION SERVICES, 2, Northumbria, 1997 – Proceedings. Newcastle
upon Tyne: Information North. p. 125-132.
Cullen, R. (1999) – Does performance measurement improve organisational
effectiveness? A postmodern analysis. Performance measurement & metrics.
Sample issue+ (August 1999), pp. 9-30.
402
DiBella, A.; Nevis, E. (1998) – How organizations learn: an integrated strategy
for building learning capability. San Francisco: Jossey Bass.
Ellis, D.; Norton, B. (1996) – Implementing BS EN ISO 9000 in libraries.
2nd ed. London, Aslib.
Gray, S. T. (1998) – Evaluation with power. San Francisco: Jossey-Bass.
ISO 2789. 2003 – International library statistics. 3rd ed.
ISO 11620. 1998 – Library performance indicators.
ISO 11620.1998/Amd. 1:2003 - Library performance indicators: amendment
1: additional performance indicators for libraries.
ISO/TR 20983.2003 - Performance indicators for electronic library services.
Kaplan, R. S.; Norton, D. P. (1996) – The balance scorecard: translating strategy
into action. Boston: Harvard Business School.
Kaplan, R. S.; Norton, D. P. (1998) – Le tableau de bord prospectif: pilotage
stratégique: les quatre axes du success. Paris: Les Éditions de l’Organisation.
Kaplan, R.S.; Norton, D.P. (2004) – Kaplan e Norton na prática. Rio de Janeiro:
Elsevier.
Kaplan, R.S.; Norton, D. P. (2004) – Strategy maps: converting intangible assets
into tangible outcomes. Boston: Harvard Business School Press.
Kolb, D. A. (1984) – Learning styles and experiential learning: experience as the
source of learning and development. Englewood Cliffs: Prentice Hall.
Lei n.º 10/04. D.R. I Série-A. 69 (04-03-22) p. 1586-1589
Neely, A. (2002) – Avaliação de desempenho das empresas: porquê, o quê e como.
Lisboa: Caminho.
NP ISO 11620. 2004 – Indicadores de desempenho de bibliotecas.
Poll, R.; Boekhordt, P. (1996) – Measuring quality: international guidelines for
performance measurement in academic libraries. München: K.G. Saur.
Ochôa, P.; Pinto, L. G. (2004) - A Knowledge partnership in Portuguese infor-
mation and knowledge services. In Hobohm, H.C. (ed.) - Knowledge manage-
ment: libraries and librarians taking up the challenge. München: K. G. Saur,
2004. p. 201-211.
Ochôa, P.; Pinto, L. G. (2004a) – Librarians as facilitators: a case study on team
skills development (2002-2003). In NORDIC CONFERENCE ON INFOR-
MATION AND DOCUMENTATION, 12, Aalborg, 2004 – Proceedings.
Aalborg: Royal School of Library and Information Science. p. 85-91.
Ochôa, P.; Pinto, L. G. (2004b) – Programa de Avaliação do Desempenho para as
Bibliotecas da Administração Pública. Research report produced for the Curso
de Alta Direcção em Administração Pública (INA).
Osborne, D.; Plastrik, P. (2000) – The reinventor’s fielbook: tools for transforming
your government. San Francisco: Jossey Bass.
403
Rezende, J. F. (2003) – Balanced Scorecard e a gestão do capital intelectual.
Rio de Janeiro. Campus.
Sutter, E. (2002) – À la conquête de nouveaux usagers des services d’information.
Documentaliste – Sciences de l’information. Vol. 39, nº 1-2. p. 34-41.
Tichy, N. M.; Hornstein, H. A. (1980) – Collaborative organization model
building. In Lawler III, E. E.; Nadler, D. A.; Cammann, C. (1980) –
Organizational assessment: perspectives on the measurement of organizational
behaviour and quality of work life. New York: John Willey
Van House, N. A. (1987) - Output measures for public libraries: a manual of
standardised procedures. 2nd ed. Chicago: American Library Association.
Ward, S. [et al.] (1995) – Library performance indicators and library management
tools. Luxembourg: Office for Official Publications of the European Com-
munities.
Zwart, R. J, (1998) Implementing the ISO standard on library performance
indicators at Delft University of Technology Library. In INTERNATIONAL
CONFERENCE ON PERFORMANCE MEASUREMENT IN LIBRARY
AND INFORMATION SERVICES, 2, Northumbria, 1997 – Proceedings.
Newcastle upon Tyne: Information North, 1998.
Zweizig, D. [et al.] (1996) – The TELL IT! manual: the complete program for
evaluating library performance. Chicago: ALA.
Abstract
The aim of this paper is to present the model developed specifically for the evalua-
tion of Portuguese public library and information services as a result of a research
project carried out by INCITE - The Portuguese Association for Information Manage-
ment (2004). The model is based on four action-oriented pillars:
• Common Assessment Framework (CAF) – the self-evaluation framework
recommended for European Public Administration Services;
• Balanced Scorecard – Kaplan and Norton’s strategic tool for organizational
management and performance improvement;
• Library standards on performance measures and indicators (ISO 2789,
ISO 11620 and ISO/TR 20983);
• The Portuguese system for evaluating Public Administration organizational
and individual performance – Sistema Integrado de Avaliação de Desempenho
da Administração Pública – SIADAP.
The balanced integration of all these components focused on a library perspec-
tive is an innovative tool, which can push librarians towards a new social impact,
since it is the first professional group to have a self-evaluation performance tailored-
made tool.
404
The model is described and the integration links are mapped in detail.
The dissemination of SIADAP+B among the library and information community,
together with a (inter)national growing tendency towards quality assessment led to
several marketing initiatives within libraries. These initiatives and projects carried
out by INCITE or, individually, by INCITE members are analysed:
Finally, after reflecting on the difficulties of changing the traditional perfor-
mance evaluation behaviour of librarians, the advantages of using an integrated
model for performance evaluation are emphasized, especially in terms of INCITE’s
marketing policy.
405
Developing a culture of evidence based practice
within the library and information profession:
the impact of library science education.
A teaching and learning model from the
Queensland University of Technology
Helen Partridge & Gillian Hallam
School of Information Systems
Faculty of Information Technology
Queensland University of Technology
Brisbane, Australia
Introduction
Increasingly, the library and information practitioner is being encouraged to engage in
research in order to “create new knowledge and thereby contribute to the growth
of LIS as a profession or discipline” (Juznic & Urbanija, 2003, p.325). Crumley and
Koufogiannakis (2002) propose that “when a librarian encounters a workplace
problem or question to which there is no answer, conducting research to answer
that question benefits the entire profession” (p.112). In 2001 the Centre for
Information Research was commissioned by the Chartered Institute of Library and
Information Professionals (CILIP) to conduct an examination into the research
landscape for library and information science. The examination concluded that
research is “important for the LIS domain in a number of ways” (McNicol &
Nankivell, 2001, p.77). At the professional level, research can inform practice,
assist in the future planning of the profession, and raise the profile of both the
discipline and the library and information service itself. At the personal level
research can “broaden horizons and offer individuals development opportunities”
(McNicol & Nankivell, 2001, p.77). However it was noted that “work is needed to
stimulate greater interest in, and respect for, research within the LIS community”
(McNicol & Nankivell, 2001, p.82). It was recommended that “research should
be promoted as a valuable professional activity for practitioners to engage in”
(McNicol & Nankivell, 2001, p.82). The study concluded, however, that for this
406
to occur, there must be an “obligation on the part of library schools, employers and
professional bodies to ensure the practitioners have the necessary skills to be able
to conduct research effectively” (McNicol & Nankivell, 2001, p.82).
This paper will consider the role of library education in fostering a research cul-
ture within the profession. More specifically, the paper will discuss the teaching and
learning model developed at the Queensland University of Technology (QUT) to
develop student awareness, understanding and skills in evidence based information
practice. The paper is divided into two parts. The first part considers the role of
evidence based practice within the library and information profession. A brief
review of key literature in the area is provided. The second part discusses the teaching
and learning model developed by QUT to embed the skills, knowledge and under-
standing of evidence based practice in the library curriculum. The paper concludes
by considering the role library education can, and should, continue to play to establish
an evidence based culture within the profession. The paper also considers the signifi-
cant contribution to be made by the individual practitioner, the employer and the
professional association in this context. The paper aims to open discussion on the
future (if any!) of the library and information profession without evidence based
practice, and the consequent implications for the skills and knowledge needed by the
evidence based information professional.
407
Evidence based librarianship (EBL) is an approach to information science
that promotes the collection, interpretation, and integration of valid,
important and applicable user reported, librarian observed, and research
derived evidence. The best available evidence moderated by user needs and
preferences is applied to improve the quality of professional judgement .
(Cited in Booth, 2002, p.53)
Crumley and Koufogiannakis, noting that the current definitions of EBL were
overly theoretical, offered a “practical definition for everyday referral” (p.62).
Evidence based librarianship was defined as
a means to improve the profession of librarianship by asking questions as
well as finding, critically appraising and incorporating research evidence
from library science (and other disciplines) into daily practice. It also invol-
ves encouraging librarians to conduct high quality qualitative and quanti-
tative research.
(Crumley and Koufogiannakis, 2002, p.62 )
408
Booth also notes one significant omission form the list, and by consequence, from
existing definitions of EBL: “a preoccupation with obtaining best value services for
available resources” (Booth, 2002, p.54). Booth argues that this characteristic must
be included as recognition of the “pragmatic real world thrust of EBL, coupled with
its emphasis on decision making, requires that all decisions be taken in the context
of finite resources” (Booth, 2002, p.54).
Ultimately however, Booth (2003) anticipates that even the term “evidence based
information practice will…write itself out of existence” (p.70). He proposes that:
the long term future of evidence based information practice probably lies not
in a single minded focus on research-derived evidence but in a more encom-
passing approach that embodies reflective practice. (Booth, 2003, p.70)
409
Booth indicates that the library and information professional of the future will
be a reflective practitioner (with reference to the work by Schön,1991) “with the
ability to critically analyse [and] make informed judgements” (Booth, 2003, p.70)
by drawing on a range of catalysts, with research evidence representing one oppor-
tunity. Booth suggests “ultimately evidence based practice will contribute to a tool
box from which the reflective practitioner will occasionally draw” (Booth, 2003, p.70).
410
this idea by arguing that “research and professional practice are inextricably linked”
(p.xiii) and as such “research skills are a prerequisite [italics added] for those who
want to work successfully in information environments” (p.xiii). He postulates that
research skills represent an “essential set of tools which enable information workers
to become information professionals” (p.xiii). According to Harvey:
The work of information professionals is being transformed. The information
services we offer, the information products we develop and sell, the infor-
mation systems we design and implement, are undergoing rapid change. So,
too, is the society in which we operate. We have a continual need to determine
what is happening, how it is changing, how it will affect our places of work,
how it will alter the services we offer. Change and its ramifications is the
most important reason why research is necessary, and why it is here to stay.
If you don’t know something about the tools of research and about how to use
these tools, then you cannot be an effective information professional.
(Harvey, 2001, p.xii)
In 2001 the Special Libraries Association (SLA) released its revised Research
Statement in which the role of evidence based practice, within current library
and information work, is strongly advocated. In a recent commentary on the
research statement, the SLA Research Committee and Joanne Gard Marshall
(2003) suggest that, as the health and future of any profession depends on the
members’ ability to evaluate both themselves and their professional practice, the
development of strategies to undertake evidence based practice may well be a
valuable opportunity to improve and refine our own professional activities.
In further support of these views, the SLA research statement itself notes that
These are challenging times for professional in all areas of practice. The con-
sumer movement and the wide availability of information, including infor-
mation that was formerly only accessible to professionals themselves, have
led to a demand for increased professional competence and accountability.
It is time for special librarians to recognize the potential value of formal
and informal research in our field as the basis for evidence based practice.
In the long term, such a knowledge base and its effective application will set
information and library professionals apart in an increasingly competitive
world of information service providers.
(SLA Research Committee & Gard Marshall, 2003, p.43)
Juznic and Urbanija (2003) stress the importance of research, particularly in our
own discipline: “Research is needed to create new knowledge and thereby contribute
to the growth of LIS as a profession or discipline. If research is absent, non existent
or even scarce, there is no profession, but only an occupation grounded in tech-
411
niques, routine and common sense” (p.325). On a more pragmatic level the
emerging literature exploring evidence based librarianship proposes that library
and information professionals should ‘practice what they preach’. Crumley and
Koufogiannakis (2002) observed that “in our profession we help our patrons
make decisions by leading them to research evidence. It is vital that we follow
the same model: we should consult our own literature when we have questions
about best practices in our field” (2002, p.112). Ritchie (1999) also noted that,
given our role as managers of the literature of research, library and information
professionals are uniquely placed “to model the principles of evidence based
practice, not only as they apply to other disciplines which we serve, but also as
they apply to our own professional practice…’if you are not modelling what you
are teaching you are teaching something else’” (Ritchie, 1999, para. 6).
412
institutions in other countries; both LIS educators and the accrediting bodies
should heed the need to take action. The immediate and pressing challenge for
library and information science education is to take an active role in fostering the
development of the new evidence based information professional, and consequently
to more effectively achieve the goal of providing industry with information profes-
sionals who are well equipped and able to function in the ever-changing infor-
mation environment of the twenty first century.
What Skills and Knowledge are Needed for Evidence Based Information Practice?
It would be valuable to have a clear understanding of the skills, knowledge and
attitudes required for evidence based practice within the profession which could
serve to inform the development of the LIS curriculum as a vehicle for fostering the
advancement of evidence based information practice. However, at present there
413
Table 1: The Master in Information Management Core Curriculum
414
exists no detailed listing or discussion on this issue. Booth and Brice recently stated
that “specifying generic skills required for the development of EBIP at all levels
(individual, organizational and policy), and allowing for flexibility in augmenting
these with additional specialist skills, would be a major step forward, both in
formal and in continuing education” (2004, p.285). Ongoing dialogue within the
profession has clearly established that “research can and does play a vital role in pro-
fessional practice” (Harvey, 2001, p.viii), indeed, “it is more important than ever to
build our knowledge base and to use evaluation research methods to constantly
monitor and improve the quality of the services provided” (SLA Research Committee
& Gard Marshall, 2003, p.40). The current paper endeavours to contribute to the
current professional debate by providing one perspective on the skills, knowledge
and attitudes required by an evidence based library and information professional,
and by explaining how the LIS curriculum can be designed and delivered to allow
future information professionals to develop in these areas.
One of the key objectives at QUT is to develop new graduates who are enthusi-
astic and confident about their new profession – a dynamic and exciting world of
library and information studies. Aware of its role to industry as a supplier of employ-
ees to the marketplace, QUT undertakes an ongoing review process for the library
science curriculum to ensure it continues to embrace the needs of current industry
practice. The world of libraries and information agencies in the 21st century is
highly dynamic; while some traditional elements of librarianship remain important,
the desired skills set for information professionals is rapidly expanding into new
areas of knowledge. As the new LIS professional will be employed in a rapidly
changing, information intensive working environment, he or she will need to not
only have the ability to combine theoretical discipline knowledge with the practical
application of this knowledge in a range of different situations, including situa-
tions in an unknown future, but to also embody a range of “holistic capabilities
which represent the links between discipline knowledge and professionals skills’
(Bowden & Marton, 1998, p.12). In terms of curriculum content, this encompasses
the need to acquire sound disciplinary knowledge as well as to develop the personal
attributes and attitudes, commonly referred to as ‘generic capabilities’, which are
needed for a successful career as an LIS professional. At the highest level, QUT
LIS educators believe in the need for a holistic approach to student learning
where the personal and professional dimensions are intertwined. The authors of
the current paper propose that is it this holistic focus in LIS education which will
help twenty first century library and information professional to develop into, as
proposed by Booth, a ‘reflective practitioner’ who has the ability to “critically ana-
lyse [and] make informed judgements” (Booth, 2003, p.70) drawing on a ‘toolbox’
of skill and knowledge which will include evidence based practice.
415
The focus on generic capabilities within LIS education is not new. The Reading
the Future for Library and Information Services Education and Practice Conference
held in Melbourne in 1996 made several important recommendations regarding LIS
education, including incorporating generic transferable skills into the LIS curri-
culum (Todd, 1997). The importance of this point has been emphasised by ongoing
dialogue and research throughout the world and by the importance given by pro-
fessional bodies such as the International Federation of Library Associations and
Institutions (IFLA), the American Library Association (ALA) and the Australian
Library and Information Association (ALIA) to continuing education programs that
not only incorporate discipline specific knowledge but also generic capabilities. As
a case in point the Professional Development (PD) Program managed by ALIA
provides a means by which members can document and monitor their professional
growth. “The dynamic environment of the library and information sector dictates
the need for library and information professionals to remain flexible and adaptable
to change… Lifelong learning extends and develops the knowledge, skills and com-
petencies of practitioners. It also enables them to prepare for their work more
effectively, to broaden their career and to undertake new tasks” (ALIA, 1998, para
2-3). Significantly the distinction is made in the program between the necessity of
developing skills in both the “LIS Specific Areas” and “Generic Areas”. The latter
refers to skills such as team membership, effective communication and critical
and evaluative thinking. It is becoming apparent that library educators must not lose
sight of the need for LIS courses to “equip graduates with a range of enterprise skills,
transferable skills, including interpersonal communication, teamwork, report writing
skills, numeracy, computer literacy, time management and so on” (Day, 1997). Generic
capabilities must be considered in the current climate of change within the LIS
profession, and by consequence, in LIS education.
From 2002 to 2004 QUT funded a research project aimed at identifying the key
knowledge and skills required by the library and information professional of the
twenty-first century (Partridge & Hallam, 2004). Participants in the study included
library and information professionals, educators and students from South East
Queensland. Focus groups were used for data collection with 98 participants
taking part in 11 sessions. The focus group discussions resulted in the identification
of 14 fields of discipline knowledge and 10 generic capabilities essential for the
modern day library and information professional. A breakdown of the skills and
knowledge regarded as essential to the library and information professional in these
areas is provided in Tables 2 and 3. Full details on the research project can be found
in Partridge & Hallam (2004).
In short, the current paper supports the view proposed by Booth (2003) by
advocating that, to develop the ‘new evidence based information professional’,
416
LIS education must focus on fostering the development of ‘reflective practitioners’
who are not only discipline savvy but also highly skilled in the area of generic
capabilities.
Table 2: The LIS discipline knowledge required by the Library and Information
Professional of the Twenty First Century.
417
Table 3. The generic capabilities required by the Library and Information Professional
of the twenty-first century.
of potential future career paths, and the constantly evolving discipline knowledge.
The students entering LIS education are not a homogeneous group. The students
represent a wide diversity of differences including gender, personal interests,
employment history, academic background and life experiences. These differences
have significant implications for staff who aim to foster knowledge and skill within
research methods as applied to the library and information context. The diversity in
university education of students is one way of illustrating this point. From 2002
to 2004 the LIS students were invited at the beginning of year each to complete an
418
incoming student survey. A total of 107 completed surveys were received. This survey
provided a basic profile of the students which could be used to further develop and
refine the education program to the student’s specific needs (Hallam & Partridge,
2005). In terms of previous education, 81% of the students surveyed had entered
the library program as their first postgraduate course. The majority of students had
an Arts degree (53%), with education graduates being the next most significant
grouping (13%). 17% of respondents had completed a vocational course in addition
to their university studies, with 26% having multiple university qualifications, eg more
than one bachelor degree or postgraduate qualifications such as a postgraduate
diploma, honours or masters degree. The main foci of the additional qualifications
were education, business and information technology, although there was an eclec-
tic range of fields including retail, tourism, horticulture and community services.
Those students who had postgraduate qualifications included Honours (5.5%),
Masters (4.5%) or postgraduate certificate or diploma (8%). There was one student
who had a PhD. So whilst some students may have obtained research training
though post graduate qualifications, for the majority of students this was not the
case. Also of interest is that students have completed their earlier education at
different universities, with the result that it was unlikely that there were many
common denominators in terms of the research methodologies experienced. The
QUT context is probably no different to many universities in Australia or, indeed,
around the world.
The students entering LIS education have very different future career paths.
One of the more interesting, and challenging, aspects of library education is pre-
paring students to be successful in one of the many possible career choices. The
students entering LIS education at QUT all have very different career ambitions.
This was clearly demonstrated in the 2002-2004 survey of LIS students enrolled in
the QUT program. The 107 students were asked to indicate what type of library or
information work they would enter upon graduating from the LIS program.
They were given the option of nominating: public, academic, government, law,
special, other, no preferences. If they nominated special or other they were asked
to elaborate on their choice. Study findings clearly showed that students had very
diverse career goals with a large percentage of the students indicating an open
future with either no specific preference provided, or a preference for 3 or more of
the options. Possible future work contexts identified by students included libraries
or information agencies specializing in: arts and multimedia, music, environmental
management, landscape architecture, archives, information broker, medical infor-
mation, knowledge management, website development, and school librarianship.
One of the biggest challenges facing contemporary library education is deve-
loping a curriculum that encompasses the traditional and enduring knowledge of the
419
profession alongside the new and emerging areas. Put simply the library curriculum
is becoming increasingly congested. This is not a new problem. In 1992 Clayton
observed that “it is simply not possible to cover all the essentials for professional
preparation in a single short year. The [library] schools are already torn between the
need to provide a theoretical basis for information work that will be of enduring
value, and to equip graduates with skills that will be of marketable value in a very
tight employment situation. As a result research gets left out” (p.74). Even though
QUT has this year extended its LIS program to one and a half years (as opposed to
one year), the challenge to deliver a well rounded curriculum continues.
420
context from which students can directly learn about discipline knowledge and
generic capabilities within the profession. At QUT, industry practitioners have taken
on three vital roles in the MIM learning environment: as guest speakers, as mentors
and as industry partners in the learning activities.
The importance of real world examples cannot be underestimated, as students
need to appreciate the application of the theoretical structures within a range of
diverse situations, given the individuality and often uniqueness of LIS institutions.
Drawing guest speakers into the academic program is therefore an integral ingredient
in this learning environment. It is through the direct involvement of practitioners
that students grasp the amazing diversity of information problems and the range of
possible approaches to solve them.
Reinforcing Kolb’s (1984) views that “an excellent education in any field should
extend beyond the classroom”, valuable learning is achieved through the mentoring
program run jointly with the professional association, ALIA, which involves students
being paired with an industry professional. The mentors and mentees get together
in their own time and in their own ways: some in the workplace, some more socially
over coffee or lunch. Mentoring is a natural part of life for information profes-
sionals, as noted by Field: “It is part of the ethos of our profession to share know-
ledge. We are not natural competitors like those within the business world. (Men-
toring) is an excellent way for professionals to leverage their expertise and serves
as a mechanism to continue their own professional growth” (Field, 2001, p.273).
Mentors can also foster an understanding of the relevance of generic capabilities in
the workplace, such as problem solving and critical thinking as well as lifelong
learning, to be able to deal with a range of complex situations, ethical and moral
principles. The program is therefore an example of a strategy designed to meet the
need for more elaborate induction programs for new professionals “with greater
obligations on the professions to participate in professional education through
coaching and mentoring programs – in association with universities” (Gonczi,
2001, p.2). At the same time, the industry practitioners personally gain a great deal
by being introduced to the current approaches to learning at QUT which include the
focus on reflective practice and evaluation.
Through the learning tasks themselves, industry practitioners and employers
offer a fertile context for students to apply the skills and knowledge they are
acquiring within the academic confines of the MIM. Fieldwork placements and
industry based projects are an invaluable source of linking theory to practice within
an authentic learning environment. They also provide the opportunity for students
to begin to think critically about the skills, knowledge and attributes that they are
personally developing as they progressively acquire the conceptual structures and
thinking processes of working information professionals.
421
It should be noted that the MIM teaching team believes that the primary aim of
the MIM is to prepare graduates for their roles as future library and information
practitioners, rather than as academic researchers. The MIM, like many other LIS
education programs in Australia, is a course work program. Whilst QUT does
offer both a Masters by Research and a PhD program, and students are actively
encouraged to pursue these avenues at some point in their career, QUT is very much
aware that academic research is not a path that the majority of MIM graduates
initially wish to follow. Consequently, the MIM has a focus on fostering skills in
evidence based practice or research in practice, rather than academic research. To
this end the teaching of research skills has been embedded in the context of the
discipline knowledge itself.
Research skills are specifically introduced to students within the second
semester unit, ITN276 Information Services. Students learn about the range of
research methodologies that can be applied within the working environment. They
are asked to undertake a major group project which requires them to gather sound
evidence that will allow for a critical evaluation of an existing (real) information
service. Students work with the industry practitioners who host the assignment to
consider the research methodology which is best suited to the evaluative tasks they
undertake. This assignment is valued by students as it gives them the opportunity to
develop sound foundational skills which they can use once employed in industry.
For those students interested in further developing and refining their research skills
an elective unit – ITN315 Information Management Project – is available for students
to undertake industry based projects that require the student to draw on the wide
spectrum of skills and knowledge they have been developing in the MIM, including
research skills or evidence based practice. Increasingly, libraries and information
agencies in the region are contacting QUT staff to initiate interesting and challenging
project work that enables students to become directly involved in authentic research
activities.
The focus of the major assignment in ITN276 is primarily on the process of
research rather than on the final product itself. Students are asked to reflect on their
learning through the tasks they have completed and to consider how they would
improve on the approach taken in a future scenario. Reflective practice is increa-
singly identified as a core skill required by all professionals. For many students
entering the MIM, reflective practice is a novel and unexplored – and often chal-
lenging – domain. Taking this into consideration the MIM program has been designed
to provide students the opportunity over the three semesters to progressively gain
both theoretical understanding and practical experience in reflective practice.
Four units over the three semester long program have been developed to provide the
context for the students to learn about, and experience reflective practice first hand:
422
• ITN273 Information Retrieval (Semester One) provides the opportunity for
students to develop a theoretical understanding on reflective practice and to
begin using reflective practice as a tool for self evaluation as they develop their
information literacy skills.
• ITN275 Information Organisation (Semester Two) allows students to consider
the role of reflective practice as a vehicle for self directed learning as they
compose a reflective learning journal to support the construction of their own
understanding about bibliographic database development.
• ITN276 Information Services (Semester Two) allows students to learn about
the role reflective practice can have as a tool for professional development
in other skills such as teamwork project management and informed decision
making in the context of the information service evaluation.
• ITN280 Professional Practice (Semester Three) provides the students the
opportunity to observe and use reflective practice within the context of
‘real life’ information work as they complete their fieldwork placements.
Their studies conclude with the creation of a professional portfolio which
presents their reflections on their own role as an information professional.
Table 4 provides a brief overview on the learning outcomes for students over the
course of the three semesters as they develop their skill and knowledge of reflective
practice.
Semester One
Semester Two
423
Semester Three
Discussion
Evidence based practice can be regarded as one of the most significant contem-
porary developments for the library and information profession. At the IFLA
conference in 2003, Tord Hoivik suggested that “evidence based [information]
practice represents something different: a deliberative approach to change” (p.5)
and that by embracing evidence based practice the LIS profession is acknowledging,
and reaffirming, that it is a “learning profession” (p.6). But how does the LIS
profession embrace and foster a culture of evidence based practice? How does
it commit itself to becoming a “learning profession”?
The issue of professional learning and how a professional evolves has been
considered by Boshuizen, Bromme and Gruber (2004). This work provides an
interesting insight into the broader areas of professional development and prepa-
ration. The authors propose that a professional, regardless of their discipline, pro-
gresses from the status of novice to that of expert by “a process of continually
424
transforming the repertoire of knowledge and skills that make up expertise”. In
short, they suggest that lifelong learning is the key to a professional become an
expert in their own field. According to Boshuizen et al, a professional must develop
both academic knowledge and professional knowledge, with academic knowledge
imparted via formal training in a university and subsequently transformed into pro-
fessional knowledge by learning in the workplace.
Booth (2002) observed that one of the main assumptions in fostering a culture
of evidence based practice is that “practitioners are enlightened enough to want to
practice evidence based practice”. For EBP to succeed therefore, library and infor-
mation practitioners need to be willing to develop the skills and knowledge essential
for evidence based practice and to be motivated to use these within the context of
their day-to-day work. Whilst current LIS education can help to foster the birth
of a new breed of evidence based information professional, ultimately it is up to the
new professional working in industry to put into place the skills they have learned
during their academic studies. It is also the responsibility of those practitioners who
have been in industry for some time, and who have not had the opportunity to learn
about EBP via their formal library studies, to develop the necessary skills, knowledge
and understanding of EBP by undertaking professional development (PD) activities.
However, the individual practitioner clearly cannot succeed in developing a
culture of evidence based practice without the support of both their employer and
their professional association. Employers have a responsibility to provide an environ-
ment that encourages and rewards EBP and to provide access to the resources and
training needed to implement EBP within the work context. Professional associ-
ations have a responsibility to encourage, enable and reward the development of
EBP skills and knowledge within the profession as well as developing and arti-
culating the profession’s EBP policies and future directions.
These views suggest that, whilst formal LIS education has a vital role to play in
fostering a culture of evidence based practice (be it as advocated via the QUT model
through the development of reflective practitioners or through any alternative
models employed by other LIS educators) within the library and information
profession, success will only be achieved when all stakeholders in the profession
actively work together to build the desired culture. For the LIS profession this means
cooperation and collaboration between library practitioners, library educators, library
employers and the professional associations. Table 5 illustrates the contribution that
could feasibly be made by each of the different stakeholders in pursuing the EBP goal.
In 2004 Peter Macauley, a librarian at Deakin University challenged Australian
LIS practitioners and educators to reconsider what is relevant and necessary training
and education for the profession in terms of research skills. Macauley argues that
the “PhD has a place in professional practice”. He suggests that the doctorate is the
425
Table 5: Stakeholders’ roles and responsibilities.
426
“ultimate in professional development” for the library and information professional.
It “is a flexible, multi-vocational form of training, and is well suited to professionals
undertaking applied (and theoretical) research in the workplace” (p.6). Macauley
suggests that the benefits of a doctorate are many “including an opening of your
mind – and hopefully the minds of others; getting out of your comfort zone; the
ability to critique the work of others, and for others to critique yours; and impor-
tantly, to make a contribution to Australia’s knowledge base” (p.6). Macauley con-
cludes by proposing that “undertaking a doctoral program of study will make a
significant contribution to professional practice and in doing so enhance Australian’s
reputation as a knowledge economy” (p.6). Macauley argues that the LIS profession
cannot – and should not - rely on practice alone. Practice should be based on the
evidence gathered through our own research activities.
In the US the ALA shows its support of EBP by the inclusion of research skills
within its Standards for Accreditation of Masters Program in Library and Infor-
mation Studies. LIS Programs should reflect “the importance of research to the
advancement of the field’s knowledge base” (1992, p.3). A direct reference to the
important role of EBP within the profession in Australia can be found in the
Association’s research statement which asserts that ALIA:
strives for best practice by promoting research which underpins innovation
and by fostering a research culture where applied workplace research and the
communication of outcomes support improvement and effectiveness in the
provision of library and information services. (ALIA, 2002, para. 3)
In commitment to these goals, ALIA launched the Research and Exchange Partnership
(REAP) as a partnership which will “enable the Association to become more pro-
427
active in the support and encouragement of Australian library and information
(LIS) research, particularly research based in information practice”. REAP has
been established as “a network of peers working together to exchange ideas and
information… to bring library and services practitioners and researchers together,
both face-to-face and online to share ideas, information and experiences about
doing research and using results of research” (ALIA, 2005, para, 2&3).
However, despite the rhetoric, at this point in time the achievements of REAP
remain low key and require a considerable injection of energy to stimulate a greater
level of collaborative activity. As an association, ALIA is challenged to build on the
initial REAP program to truly promote and encourage research as a key driver for
professional development. By hosting the 3rd Evidence Based Librarianship
Conference to be held in Brisbane, Australia, in October 2005, ALIA has a chance
in the near future to play an important role in encouraging a better understanding
of the issues, as well as encouraging a stronger degree of commitment on the part
of practitioners and employers. Whilst LIS education can adopt a proactive stance
in fostering EBP within the profession by including relevant and necessary skills
within the LIS curriculum, an evidence based culture within the library and infor-
mation profession will not be achieved unless all stakeholders are actively and
proactively engaged with the process.
Conclusion
The QUT teaching and learning model presented in this paper is just one possible
approach to embedding EBP within LIS education. The model adopted by QUT reflects
the belief that fostering a culture of evidence based practice requires LIS education
to serve as the cornerstone to equip library professionals with the necessary skills
and understanding to become reflective practitioners in an evidence based industry,
with the aim of progressing professional knowledge. Accordingly, QUT strives to
develop a curriculum which focuses on content that is topical and relevant, but
which at the same time helps develop the individual dimensions of the students so
that they graduate with a sound understanding of the full spectrum of professional
and personal attributes that they will need for successful careers as LIS professionals.
It would be beneficial for LIS education, and for the future of the library and
information profession in general, if other teaching and learning models were
presented and critically discussed. This profession requires an informed discussion
at both the national and international levels about the specific skills and knowledge
required by the evidence based library professional, about the best manner teaching
and learning approaches that will help to prepare and educate future evidence
based professionals, and about ways to firmly establish an evidence based culture
within the profession, so that the profession itself truly has a future.
428
References
American Library Association (ALA) (1992). Standards for accreditation of
Master’s programs in Library and Information Studies. Retrieved on 1 May
2005: http://www.ala.org/ala/accreditation/accredstandards/standards.htm
Anderson, R. K. (1998). Inaugural address in Proceedings of the Ninety-seventh
annual meeting, Medical Library Association, Seattle, USA, May 23-28, 1997.
Bulletin of the Medical Library Association 1998 86(1), 117-143.
Australian Library and Information Association (ALIA) (1998). Education
statement no 2: Continuing professional development. Retrieved on 1 May
2005: http://www.alia.org.au/policies/education/continuing.professional.
development.html
Australian Library and Information Association (ALIA) (2002). Statement on
ALIA’s role in research. Retrieved on 1 May 2005:
http://www.alia.org.au/policies/role.in.research.html
Australian Library and Information Association (ALIA) (2003). The library and
information sector: core knowledge, skills and attributes. Retrieved on 10 May
2005: http://alia.org.au/policies/core.knowledge.html
Australian Library and Information Association (ALIA) (2005). The ALIA
Research and Exchange Partnership (REAP). Retrieved on 1 May 2005:
http://www.alia.org.au/research/
Booth, A. (2002). From EBM to EBL: two steps forward or one step back?
Medical Reference Services Quarterly, 21(3): 51-64.
Booth, A. (2003). Bridging the research-practice gap? The role of evidence based
librarianship. The New Review of Information and Library Research,
9(1): 3-23.
Booth, A. (2003). Where systems meet services: towards evidence based
information practice. Vine, 33(2): 65-71.
Booth, A. and Brice, A. (Eds) (2004). Evidence based practice for information
professionals: a handbook. London: Facet Publishing.
Boshuizen, H. P. A., Bromme, R. and Gruber, H. (2004). Professional learning:
gaps and transitions on the way from novice to expert. Dordrecht: Kluwer
Academic Publishers.
Bowden, J. and Marton, F. (1998). The university of learning. London:
Kogan Page.
Brice, A., Booth, A., Crumley, E., Koufogiannakis, and Eldredge, J. (2004).
A future for evidence based information practice? In Andrew Booth and
Anne Brice (eds.) Evidence based practice for information professionals:
a handbook. London: Facet Publishing, 279-292.
429
Brice, A. and Hill, A. (2004). A brief history of evidence-based practice.
In Andrew Booth and Anne Brice (eds) Evidence based practice for information
professionals: a handbook. London: Facet Publishing.
Clayton, P. (1999) Bridging the research gap: research and practice in librarian-
ship. In Peter Clayton and Russell McCaskie (eds.) Priorities for the future.
Proceedings of the First National Reference and Information Service
Conference and the University, College and Research Libraries Section
Workshop on Research. Victoria: ALIA Thorpe.
Crumley, E. and Koufogiannakis, D. (2002). Developing evidence based librarian-
ship: practical steps for implementation. Health Information and Libraries
Journal, 19: 61-70.
Day, J. (1997). Curriculum change and development. In J. Elkin and T. Wilson
(Eds.), The education of library and information professionals in the United
Kingdom. Mansell: Continuum International Publishing Group, pp. 31-52
Eldredge, J. D. (1997). Evidence based librarianship: a commentary for
Hypothesis. Hypothesis, 11(3): 4-7
Eldredge, J. D. (2002). Evidence based librarianship: an overview. Bulletin of the
Medical Library Association, 88(4): 289-302.
Field, J. (2001). Mentoring: a natural act for information professionals?
New Library World, 102(1166/1167), 269-273.
Gonczi, A. (2001). Advances in educational thinking and their implications
for professional education. Research Centre for Vocational Education and
Training (RCVET) Working Paper 01-04. Sydney: University of Sydney,
Research Centre for Vocational Education and Training. Retrieved May 4,
2005: http://www.oval.uts.edu.au/working_papers/2001WP/0114gonczi.pdf
Gray, J., A., M. (2001). Evidence based health care, 2nd ed. London: Churchill
Livingstone.
Hallam, G. & Partridge, H. (2002). Generic capabilities and the information
professional. Embedding generic capabilities into the QUT’s library and
information studies curriculum. In Building Learning Communities through
Education. Proceedings of the 2nd International Lifelong Learning Conference.
16-19th June 2002. Rockhampton, Australia.
Hallam, G. & Partridge, H. (2003) Changing a triangle into a circle: developing
the new information professionals. International Conference on Challenges
and Opportunities for Libraries and Information Professionals in Knowledge
Management and the Digital Age, 20-22 March 2003, Chiang Mai, Thailand
430
Harvey, R. (2001). Introduction. In Kirsty Williamson (ed.) Research methods
for students, academics and professionals: information management and
systems. 2nd ed. Wagga Wagga, NSW: Centre for Information Studies,
Charles Sturt University. pp. xiii – xvii.
Hoivik, T. (2003) Why is quality control so hard? Reference studies and reference
quality in public libraries: the case of Norway. World Library and Information
Congress and 69th IFLA General Conference and Council, 1-9 August, 2003,
Berlin. Retrieved on 4 May 2005 from
http://www.ifla.org/IV/ifla69/papers/131e-Hoivik.pdf
Juznic, P., and Urbanija, J. (2003). Developing research skills in library and
information studies. Library Management, 24(6/7), 324-31.
Kolb, D.A. (1984). Experiential learning: experience as the source of learning
and development. Englewood Cliffs, N.J.: Prentice-Hall.
Kourogiannakis, D., and Crumley, E. (2002). Evidence based librarianship.
Feliciter, 3, 112-114.
Macauley, P. (2004) Challenging librarians: the relevance of the doctorate in
professional practice. Challenging ideas. Australian Library and Information
Association (ALIA) Biennial Conference, Gold Coast, Australia, 21-24
September 2004. Retrieved on 10 May 2005:
http://conferences.alia.org.au/alia2004/pdfs/macauley.p.paper.pdf
McNicol, S. and Nankivell, C. (2001). The LIS research landscape: a review and
prognosis. Center for Information Research, Retrieved on 1 May 2005:
http://www.ebase.uce.ac.uk/cirtarchive/projects/past/LISlandscape_final%20report.pdf
Partridge, H. & Hallam, G. (2003a). For the times, they are a’ changin’…
Educating the library and information professional for the twenty-first century.
In Learning for an Unknown Future. Proceedings from the Higher Education
and Research Development Society of Australasia Annual Conference.
5-9 July 2003, Christchurch, New Zealand. Retrieved on 1 May 2005:
http://surveys.canterbury.ac.nz/herdsa03/ano.htm#P
Partridge, H. & Hallam, G. (2003b). Technology and the human dimension:
using web-based technology to develop and record generic capabilities.
A library and information studies case study. In the Proceedings of the
Informing Science and IT Education Joint Conference. 24-27 June 2003,
Pori, Finland.
Partridge, H. and Hallam, G. (2004) The Double Helix: A Personal Account
of the Discover of the Structure of [the Information Professional’s] DNA.
Australian Library and Information Association (ALIA) Biennial Conference,
Gold Coast, Australia, 21-24 September 2004. Retrieved on 10 May 2005:
http://conferences.alia.org.au/alia2004/pdfs/partridge.h.paper.pdf
431
Queensland University of Technology (QUT) (2005). IT70 Master of Information
Management. Retrieved on 28 April 2005: http://www.courses.qut.edu.au/cgi-
bin/WebObjects/Courses.woa/wa/select/MajorFrom
Ritchie, A. (1999). Evidence based decision making. InCite, 12, Retrieved from
the World Wide Web on 10 May 2005:
http://www.alia.org.au/publishing/incite/1999/12/appraisal.html.
Schön, D. (1991). The reflective practitioner: how professionals think in action.
Ashgate: England.
Schrader, A. M. (2003). The three cultures of librarianship: a personal odyssey
through education, research and service. Bibliotheca Medica Canadiana,
24(4): 169-174.
SLA Research Committee and Gard Marshall, J. (2003). Influencing our
professional practice by putting our knowledge to work. Information
Outlook, 7(1): 40-44
Todd, R. (2002). Learning in the information age school: opportunities, outcomes
and options. International Association of School Librarianship (IASL) 2003
Annual Conference, Durban, South Africa, 7-11 July 2003. Retrieved on 1
May 2005: http://www.iasl-slo-org/conerence2003-virtualpap.html.
Toohey, S. (1999). Beliefs, values and ideologies in course design. In: Designing
courses for higher education (pp.44-69). Buckingham: Society for Research
into Higher Education and Open University Press.
Williamson, K., Burstein, F. and McKemmish, S. (2001). Introduction to research
in relation to professional practice. In Kirsty Williamson (ed.) Research
methods for students, academics and professionals: information manage-
ment and systems. 2nd ed. Wagga Wagga, NSW: Centre for Information
Studies, Charles Sturt University. pp. 5-23.
Abstract
Evidence Based Practice (EBP) has recently emerged as a topic of discussion amongst
professionals within the library and information industry. Simply stated, EBP is the
process of using formal research skills and methods to assist in decision making and
establishing best practice. The emerging interest in the EBP within the library
context serves to remind the library profession that research skills and methods will
ensure that the library industry remains current and relevant in a rapidly changing
environment. The future of EBP within the library context relies upon effective
cooperation between industry professionals, library science educators and pro-
fessional associations. This paper will consider the role of library science education
in ensuring the future of EBP within librarianship. Aware of its role to industry as
432
a supplier of employees to the marketplace, the Queensland University of Technology
(QUT) is continually reviewing its library science curriculum to more readily embrace
the needs of current industry practice. This paper will discuss the teaching and
learning model that is being at the Queensland University of Technology to foster
student awareness and understanding of EBP and its practical role in the library and
information industry. The paper examines the experiences of both the teaching staff
and the students in practicing EBP within an industry context and considers the con-
tribution the course makes in developing an EBP culture within the Australian
library and information profession.
433
Measuring and Mapping the Invisible: Alternative
procedures to understand users’ approaches to
information in a university library
Gildas Illien
Head of the Public Services Department,
Paris 8 University Library, Saint-Denis,
France (2003-2005) ;
now in charge of the
Web Legal Deposit Project,
National Library of France
434
The Saint-Denis University Library was the first institution to benefit from
the Millenium National Plan for the modernisation of French universities in the
early 90’s. As a result, it does not suffer the usual problems which affect too many
French libraries: no budget or staff cuts, no opening hours “wars”, no space
saturation nor degradation. Six years after its spectacular opening, the library is
indeed proud of its success : in 2004, over 62 % of the students were registered
library users and borrowed at least one book, and everyday between 3 500 and
6 000 people come to the library to borrow, browse, copy or print documents and
use its various services. Most statistics show a quantitative rise in library activities
while the University population has remained stable in the past years1.
435
Fig. 1
436
Number of 11.2 10.5 22.3 16.7 14.8
books per
student
Number of 0.7 0.56 0.35 0.4 0.43
new books
per student
% of books 58.7 60.4 16.8 31.4 46.7
in open
access
Overall, time has come to question the impact of the library on its public and to
renew our practises in providing information and assistance : and we now need new
sorts of data to analyze these service questions and to elaborate an alternative
strategy for the development of public services. To sum up, our librarians need
to collect information in order to:
- question the ways they work with users and make decisions for change in
that respect;
- improve communication with staff;
- improve communication with the academic community.
A first step towards developing new evaluation procedures was to define a list of
priorities for which we felt we needed, if not exhaustive and objective data, at least
some food for thought: information literacy programs ; staff training schemes;
daily management of information services (information desks, mediation, assis-
tance…); space organisation, signage and classification schemes; development of
the library OPAC, website and implementation of a new information system…
These were the key issues which required some strategic exploration.
Although these various projects involve specific skills, functions and people in
the library, all of them fulfilled the need to gather information to answer the fol-
lowing questions:
- What really goes on between users and librarians? What do librarians do
behind their desks? - Should they be working differently? Should they still
be on the front-line rather than in the backstage of the library?
- What do users actually do in the library? How do they circulate in the
building and navigate on the computers? What are they looking for….
and can they find it?
437
These questions are, of course, rather dangerous, not only because honest answers
could seriously disturb the institution and destabilize librarians, but also because
the issues addressed are terribly human ones. Measuring human interaction, learning,
cultural appropriation in a library is much more difficult than merely counting
books or web sessions. It also requires skills that are usually not familiar to most
librarians.
What makes such considerations even more complex in France is the lack of an
evaluation and marketing culture in public services in general and in libraries in
particular. Things have been slowly changing in the past ten years thanks to
structural reforms at the governmental level and to the generation renewal of the pool
of active librarians. Librarians now receive education in these marketing fields. How-
ever, our cultural and professional context is not necessarily the most encouraging
one when it comes to measuring such factors, as well as considering the public
otherwise than a sacred and indivisible “whole”, doomed to absolute ignorance
without the divine intervention of a librarian.
The executive staff of the library has accepted the challenge of involving itself in
the testing of new techniques to observe the public and to learn from their own per-
ceptions and practises. The goal is to escape narrow visions of what a library
should be and to adjust its services to the local needs. What we wanted overall
was to get closer to reality. Of course we were at the same time both excited and
scared about what we would find.
It must be said that we did not start from scratch. Quantitative analysis and
statistics have been part of the library management culture for over a decade and
have already provided useful data for the monthly and annual reports. For instance,
we post every month a “library services chart” on information boards and on the
library Intranet as well.
This type of document provides a visual representation of the activity of the
library. It proves to be a useful tool to communicate and discuss collectively issues
and decisions regarding work organisation. For instance, if we observe on the chart
(see fig. 2) a high number of absences for the staff (many people got sick or went on
holidays at the same time) while student attendance was very high in the library
(during term exams for instance), it could explain why everyone working during
that month felt exhausted and was not able to complete the expected acquisition
or cataloguing work. This may seem somewhat amusing, but it helps management
realise and negotiate things as obvious as: “it’s better for the library if employees
take holidays when public attendance is low”. As for sick people, it goes without
saying that charts are of little help.
438
Fig.2: Public services work organisation chart for January 2004 (excerpt):
- 12 hours of planned service could not be done for lack of staff
- 37 people needed to be replaced
- 145 days of absence, which makes an average of 1, 9 days per employee
During one week, at every information desk, as well as for “flying librarians”2,
librarians counted questions they had been asked (or asking) and classified them
according to the nature of the information that had been shared or of the service
that had been offered. The grids used to collect this information are as follows:
439
Fig. 3
Fig. 4
440
Limits
The procedure has, of course, many limits to take into account when interpreting
the collected data. Two weeks only over one year are not necessarily representative.
Moreover, it is important to note specific events which may occur during the testing
period that could affect attendance, for example a strike in public transportation or
a failure of the information system. Overall, data will start to become truly signifi-
cant only when compared over several years to observe long-term trends. Another
important limit is that the whole protocol relies on staff acceptation and under-
standing of the procedure. Question counting implies a strong collective and indi-
vidual discipline. Questions classification consistency depends on staff subjectivity
and appreciation, for what the procedure actually measures is the staff’s own repre-
sentation of their mediation work rather than the actual work itself. Restricting the
grid to a selected list of items illustrated with very concrete examples and good com-
munication with the librarians before the testing period proved helpful in obtaining
more homogeneous and reliable data.
441
Fig. 5
442
Fig. 6
bibliographical and documentary assistance in the second semester for all students
engaged in exams preparation and writing of term papers.
443
Priorities we identified to improve service accessibility
The need for more accessible library tools was made obvious through the survey.
Many of the results taught us that a significant part of the student questions were
not bound to a lack of education in the field of documentation, but to a lack of
“legibility” and accessibility of the library as a whole. The results of the testing
weeks lead us to work on a better accessibility of both material and electronic
resources by improving the physical orientation of users in the building and between
shelves (classification, signals, signboards…) on the one hand and on the ergo-
nomics of our OPAC and Information system on the other hand. These issues being
totally strategic in the context of the library very specific architecture (which is
beautiful but complex) and of our already old-fashioned information system, we
decided to conduct a specific survey on this theme, which will be presented after-
wards.
444
4. Geography in the library, the travel journal test: an attempt to map students’ paths
This second procedure relies on the evidence that librarianship can learn and
benefit in many ways from techniques drawn from geography. For several years
now, public libraries have been using tools such as information geographical sys-
tems to represent the activity of library networks over territories. For instance, one
can represent on the map of a neighbourhood, a city or a district the spots and
zones where library users are located. This tool is used to identify densities and
gaps showing library activity and impact on the population. Such representations
are of great help to make decisions and to negotiate the development of the library
network with local administrators, including the construction or the closing of
libraries, the circulation of mobile libraries or the choice of opening hours in
relation to the organization of public transportation, for example.
Our main idea concerning the second procedure is that it is possible to apply
a similar thinking and similar tools to the building of the library itself, which can
therefore be considered a territory of its own. Especially in a big building like the
Saint-Denis University Library (15 000 sq. meters) with heavy traffic (several
thousands of visitors everyday) and a complex architecture, the library space can be
compared to a mini-city. Circulation, social life and the organisation of services in
this half-public/ half-private space can tell a lot about users’ needs and practises and
therefore help librarians adjust their service policy to the way the building and the
collections are used by individuals and communities.
We worked together with scholars, professors and students from the Geography
Department of our University to set up a survey protocol which focused on the
spatial use of the library in relation with user’s demographic and academic charac-
teristics. We expected this survey to provide information about the accessibility of
the various spaces and equipments of the building and the way they were identified
by our patrons. In addition, we wanted the survey to question the satisfaction of users
not by asking them “are you satisfied with the library” (for we know users can be
satisfied or unsatisfied for reasons which have nothing to do with the library’s
missions) but by asking them a series of questions related to precise items, intentions
and destinations. We basically wanted to ask the public:
- what are you planning to do and where are you planning to go?
(when entering the library)
- where did you go, what did you do, were you successful in your trip?
(when leaving the library)
And compare the answers to these two questions.
445
Fig. 7
Others
After the first part of the questionnaire has been filled up, users are
given a badge (name tag) that they accept to wear during their stay
at the library. They are also given a travel journal where indicati-
ons of the places they’ve been in the library will be noted by libra-
ry staff and volunteers contributing to the survey. Library staff and
volunteers are posted in 16 different spots of the library. Each time
a user with a badge goes somewhere, a sticker with a space mark
(colour, code) is put on his travel journal.
When leaving the library and coming back to the main entrance
Hall, users return their badge and their travel journal and they
answer the second part of the questionnaire.
4. What have you done today?
Patrons chose between all previous items (Point 2.), with additio-
nal questions giving indication of success / satisfaction.
5. Can you show us on this map of the library where you have
been?
446
Limits
320 users accepted to participate in the survey. This represents a bit more than 1%
of the total population the library is supposed to reach (27 800 students, 1200
scholars and faculty). Our geography experts, who had a solid expertise in demo-
graphics and statistics, agreed that the sample wasn’t very large but tested its
representativeness by comparing the age and gender of the sample population those
of the total population who visited the library during these days. On the ground of
their observations, the sample turned out to be representative, but only to a certain
extent: according to the geographers, it was big enough to extrapolate observations
made during the survey provided they concerned the totality of the sample. For
example: it made sense to look at the global circulation of users in the various
spaces of the library, or their global interest in some services rather than others,
but it wasn’t possible to draw further conclusions such as: favourite destinations
or motivations of the Law or Arts students. Indeed, 10 to 20 students from the
Law or Arts departments had been answering the survey, and this wasn’t enough
to represent the whole population of the Law or Arts departments.
As a result, we couldn’t use the data as far as we would have liked, nor could we
get the full picture for other sub-segments of the student population. We therefore
restricted interpretation to what could possibly be analysed without ignoring basic
statistical rules regarding sample representativeness.
After we collected the data, and even though 320 questionnaires aren’t so hard
to process, we realised that data computing was long and heavy considering the
many questions we had asked in the questionnaire and the little resources we could
use from our staff to do this job. It took six months to go through the data and find
the best strategy to use it. The results were probably not worth the heavy protocol
we had to settle to run this project. The benefit we drew from the survey might,
however, and as we will see, not come only from the data we actually collected.
Results
As this paper is being written, many of the results are unfortunately still unavai-
lable. First of all, we made a numeric map of the library. Then we worked really
hard on the technical aspects involved in interfacing the collected data with the
numeric map and the Information geographical system. We are about to “map”
most of the results and therefore visualise the paths of our patrons over the library
territory - but cannot show here what it looks like yet.
The most interesting results we have been able to collect so far relate to student
activity in the library. 34% declared having searched academic information, to
which one should add the 14% who declared having searched documents which
had been recommended by professors. Overall, almost half of the motivations of
447
the students who came to the library were related to the primary documentary
mission of the library. This figure is almost identical to the conclusions of the testing
week and similar considerations can be applied. Moreover, 45% of the students
declared having used the catalogue. We thought the catalogue was seriously competed
by the Internet and other electronic resources, but we realized it still played an
important role in the everyday use of the library. On the contrary, surfing the Web
turned out to represent only 5% from student declared priority when entering the
library. We should of course be careful with such declarations. But here again, we
were puzzled by the results, which were rather positive and reassuring for the staff.
Fig. 8
Conclusions
At this stage of our project with the geographers, the points to keep in mind aren’t
so much the results themselves than the spatial frame of the procedure and its posi-
tive impact both on staff and users during and after the survey. We realized that
a map of the library was the most effective media to discuss both intentions and
results either with staff or students, because all have a tendency to identify their
professional or academic identity with a specific space of the place where they
work, especially when the space outside (in our case, a grey suburb) remains rather
hostile and anonymous. Also, we observed that collective practises were very strong
in the library due to the strength of communities in the population: maps are an
appropriate media to represent group activity. It is easier to represent where people
meet and connect on a map. As for staff, discussing activity and results over a map
proved much easier than when using text, figures or graphs.
We therefore believe that the “mapping approach” is very promising to answer
some of our initial concerns : student information literacy ; daily management ;
448
communication with staff ; and, of course, space organisation and intelligibility.
As a final conclusion to this paper, I would like to say that most of these experi-
ments are being run in collaboration with an interdisciplinary team of scholars from
the University of Paris 8 whose expertise covers a wide range of disciplines: geo-
graphy, information technology, psychology, education sciences, psycho-ergonomics.
This partnership is, of course, a way to cross-examine qualitative results from dif-
ferent academic perspectives and to open up the usual “librarian vision” of the
library to broader approaches. From a political perspective, it is also an opportunity
to change the status of the library inside the University from a mere technical service
of documentation to a potential field of research worth of interest for the local
scientific community. We hope the academic valorisation of the work undertaken on
library users’ practises together with our colleagues from faculty will contribute to
promote the library services and overall its image among the academic community.
Notes
1. Paris 8 University Library 2004 Annual Report, available online
:http://www-bu.univ-paris8.fr/web/bibliotheque/bilan2004.pdf
Local and national indicators for French university libraries are published
by the Ministry of Higher Education and available online :
http://www.sup.adc.education.fr/asibu/
2. « Flying librarians » are librarians who are not posted behind a desk but
circulate in the library to offer assistance to the students. Our library has
been experimenting this form of service for 5 years. It proves to be very
useful, especially in areas of the library which are not equipped with a
dedicated reference desk. It requires a motivated, flexible and highly
committed staff.
Abstract
This paper focuses on experimentations run in 2004 at the Paris 8 University
Library (Saint-Denis, France) in the field of qualitative measurement of library
information, assistance and educational services. Statistics may show positive
trends in the global activity of library services, but they don’t say much about the
actual impact of the library among the academic population, especially for infor-
mation literacy. The article reports on two case studies which attempt to explore
new methodologies and new tools for evaluation, communication, management
and decision-making for service administration. The goal of a first procedure called
testing week is to collect data about the interaction between users and librarians
during sample weeks. A second procedure relies on a survey and the use of a geo-
graphical information system to visualise and analyse the paths of students in the
449
library rooms. Both reports include the description of methodological protocols
and concrete examples.
Résumé
A partir d’une étude de cas centrée sur l’organisation des services au public à la
Bibliothèque universitaire de Paris 8 (Saint-Denis, France), cet article rend compte
d’expérimentations engagées dans cet établissement en 2004 pour appréhender autre-
ment les usages des lecteurs et les activités de médiation, de renseignement et de
formation. Si les statistiques d’activité de la bibliothèque démontrent un usage
croissant des services, il est en effet devenu essentiel d’évaluer de manière plus
qualitative les pratiques du public et l’impact du travail des bibliothécaires postés à
son service. Deux méthodes d’évaluation qualitative sont ici présentées. La première
repose sur l’organisation de « semaines-test » durant lesquelles les questions du
public sont systématiquement comptées et analysées dans les différents espaces de la
bibliothèque. La seconde s’appuie sur une enquête et propose l’utilisation d’un
système d’information géographique comme outil d’exploitation des données
recueillies et de visualisation des trajectoires des lecteurs. Les protocoles méthodo-
logiques illustrés d’exemples concrets sont présentés.
450
Libraries Building Communities: the vital contributi-
on of Victoria’s public libraries – A report on a major
research project of the Library Board of Victoria and
the Victorian public library network
Debra Rosenfeldt
State Library of Victoria,
Australia
Introduction
Libraries are our best chance to create a centre of community spirit and activity
The most important thing to a community is reading, and what better place
to encourage this in the young than a library
It is the holder of much of the knowledge about the local area and gives us a
link to our past, present and future
Civic pride and fondness is generated by a well-used and friendly library
environment
The role of public libraries as key players at a community level in building
learning communities, and helping to form skilled and information-literate
communities is fundamental to the future wellbeing of Australian society
These are powerful statements about the role and value of public libraries and they
don’t come from librarians, or academics, or politicians, or other particularly eminent
people. They are the words of some of the 10,000 fairly typical Australian residents,
many but not all of them public library users, who participated in the Libraries
Building Communities project, which is the subject of this Paper.
Libraries Building Communities is a collaborative project of the Victorian public
library network and the State Library of Victoria. It has been a groundbreaking piece
of research in terms of both its size and complexity - the first comprehensive study of
the value that public libraries add to their communities. The project commenced in
April 2002, the reports were published in February 2005, and the work is ongoing.
451
From the beginning it was our intention that the reports would become an
essential tool for all those engaged in advocating for public library services to
decision-makers. It was also intended that the reports would help drive the strategic
direction of public library services in Victoria; that they would be a practical plan-
ning aid to library managers; and that they would act as inspiration to all Victorian
public library staff.
This Paper provides an overview of the research model and presents the main
findings. It begins with a little background about the Victorian public library net-
work and the political context for the Libraries Building Communities project.
Political context
The State Library is funded by the State Government. Public libraries are funded
by both State Government and local government authorities. Until the early 1980’s
local government authorities and the State Government shared this cost almost
452
equally. Over the years the balance has changed. State Government funding has
declined significantly as a proportion. Local government now provides around 80%
of the funding to public libraries. The funding environment in which public libraries
are placed has become difficult and this has been one of the drivers for the Libraries
Building Communities project.
Another driver has been government policy. The past ten years have seen the
ideas and practice of community building emerge as a key policy theme for western
governments as they seek ways to address the increasingly complex issues facing
contemporary society. The Victorian Government has identified the need to nurture
more resilient, active and confident communities as one of its most important stra-
tegic directions. The Government has approached this task by focusing on the
potential already available in the community. Rather than emphasise the deficits
and problems, and respond to these with needs-based services, the Government’s
community building activities draw instead on the strengths that exist within
communities. Its approach is based on listening to local experience, supporting local
connections, providing responsive services and investing in the infrastructure which
makes communities good places to live and work.
If public libraries are not to be overlooked by local and State Government it is
imperative that they demonstrate the strong synergies that exist between their work
and the Government goal of creating resilient, active and confident communities.
They must be able to show clearly how they engage with the whole community,
especially disadvantaged and vulnerable groups. And they must be able to show
how they help to achieve the community strengthening outcomes that the govern-
ment has specified. These include improved skills in the community, greater
access to services, more people participating in cultural events and celebrations,
increased partnerships between community, business and government, community
facilities being used for a greater range of purposes, an increased sense of belonging
in a community, and people feeling safe at home and in public.
453
using public libraries, or what value they add to the lives of people and the com-
munities they serve. During the scoping of the Libraries Building Communities
research many library service managers echoed the comment that senior government
decision-makers still have ‘a stereotypical image of the library – and it revolves around
books.’
There was a clear need for rigorously collected new data about public library
services giving a greatly expanded view of their activities and usage. The data was
needed for individual public library services and on a statewide basis. It was essen-
tial for it to be interpreted and presented in a way that was both easily accessible
and talked the language of Government policy, if public libraries were to continue
to be seen as relevant and their potential realised. So – What data did was gathered?
How was gather it gathered? And what conclusions were drawn from the analysis
of the data? First – the ‘how’.
Research methodology
An independent market research company was employed for the development and
implementation of the methodology. Data was gathered using a variety of techni-
ques. The data is both quantitative and qualitative and it is both statistical and in
the form of comments from research participants. The survey samples are very large.
Members of the community from culturally and linguistically diverse back-
grounds were well represented, as were both metropolitan and rural residents. The
majority of the data collection was carried out between May and December 2003.
It commenced with 24 focus groups conducted across Victoria with library staff,
library users and non-users to identify the main themes, issues, opportunities and
barriers. Thirty-five face-to-face interviews were conducted with community leaders
across the State. These included local councilors, business people, school principals,
and leaders of religious and other community groups. Data was collected on what
public libraries currently do well, where the gaps are in services, and how community
leaders see the role of public libraries in community development both now and into
the future.
A telephone survey was then carried out with 400 randomly sampled Victorians,
both library users and non-users. These interviews provided demographic data
about library users and were instrumental in quantifying and validating the extent
to which some of the qualitative issues raised in the focus groups and interviews were
significant within the broader community. Finally, an online survey was used to
collect data from users in every public library service in the state. Benchmark data
was captured relating to library usage patterns; importance of and satisfaction
with various services provided by libraries; social capital information, and demo-
graphic data. A massive 8,602 surveys were completed. This is the first time that
454
comprehensive and consistent data of this kind has been collected from public
libraries across the state. Much of the data gathered from the online survey could
be cross-checked with the data gathered from the telephone survey to strengthen
the robustness of the results.
During the first half of 2004 additional information was gathered in the form
of 34 case studies that demonstrate the innovative ways that public libraries in
Victoria are meeting the needs of their communities. The case studies describe the
approaches that have been used by libraries, the outcomes they achieved, benefits
that have arisen for the community, how the practice links to community building
principles, and the key lessons for the library service.
455
their patterns of public library usage, including frequency of use and the range of
services used. Twenty-eight separate services were identified. These ranged from the
obvious services of loans of library materials, access to PCs and the Internet,
availability of daily newspapers and opportunities for children to attend storytimes
and school holiday activities, through to seminars and language and literacy classes;
special services for people with disabilities, Indigenous people and the business com-
munity; access to local community information and services; local history services;
use of meeting rooms by community groups, and opportunities to volunteer.
It was found that many people used the public library for social interaction.
Seventy-one percent of users like to talk with staff when they visit the library, 34
percent talk with other library users, 22 percent talk with people who would not
normally be their friend, and 18 percent meet new people. Public libraries are
clearly seen to be safe and comfortable places for people to gather, a focal point for
the community. They have an important role to play in helping people to connect
with others, especially those users who are not in the labour force and live alone,
and in this way they help to build social capital.
456
Main findings
Percolating out of the data gathering, and the subsequent analysis and report writing
during March to November 2004, the Libraries Building Communities research
concludes that public libraries in Victoria make a vital contribution in four key areas
and that they must continue to develop their services along these lines.
457
Convenient and comfortable places of learning
The third area in which public libraries make a vital contribution to community
building is through provision of a friendly environment in which residents can
learn the basic skills they need to take part in the economic, social and cultural
life of their community. The Libraries Building Communities research has shown
that public libraries are greatly valued because they provide comfortable study spaces
as well as learning programs, many of which are targeted at ‘vulnerable’ learners,
those community members who are keen to learn but are not comfortable in more
formal learning institutions or with the formality of accredited learning. These
programs include English language and literacy classes for residents from non-English
speaking backgrounds; topical lectures and seminars; and Homework Clubs for
13 to 16 year olds.
458
potential to expand the range of services that could be delivered from these exis-
ting facilities.
459
Victorian public library network, similar national and international studies mea-
suring the value of public libraries, the project objectives and the methodology.
Report 2, Logging the Benefits, discusses who is using public libraries, the benefits
of public libraries, the most important services offered and the future role of the
public library. Report 3, Bridging the Gaps, provides information about who is not
using public libraries and the barriers to use, identifies potential new users, and sug-
gests strategies for enhancing their engagement. Report 4, Showcasing the Best,
provides 34 case studies of exemplary and innovative Victorian public library
programs and activities that illustrate the many ways in which public libraries
strengthen their communities.
460
Library – it’s one thing the whole family can do together
The library is an ‘alive’ place for people to interact – not just for
collection users, but for the wider community
Abstract
Libraries Building Communities is a research project that evaluates the contribution
of public libraries to community strengthening in the Australian State of Victoria
and provides recommendations that will help drive the strategic direction of the
State’s public library services for the next several years. Victoria has a population of
approximately 5 million people. It has 43 public library services and a network
of 238 branch libraries and 30 mobile libraries.
Although developed with an awareness of other research that has been conducted
in this area globally, the Libraries Building Communities project is groundbreaking
in its scale and complexity.
Information was gathered from: 8,600 online surveys; 400 telephone interviews with
library users and non-users; 35 in depth face-to-face interviews with key influencers
in the community; and 24 focus groups with library users, non-users and staff.
public libraries.
461
The Libraries Building Communities findings are presented in a series of reports.
462
K · G · Saur Verlag
IFLA Publications
Edited by Sjoerd Koopman
111
Preparing for the Worst, Planning for the Best:
Protecting our Cultural Heritage from Disaster
Proceedings of a conference sponsored by the IFLA Preservation and Conservation Section, the IFLA
Core Activity for Preservation and Conservation and the Council on Library and Information Re-
sources, Inc. with the Akademie der Wissenschaften and the Staatsbibliothek zu Berlin, Germany,
July 30 - August 1, 2003
Edited by Johanna G. Wellheiser and Nancy E. Gwinn
2004. 192 pages. Hardbound
€ 78.00 (for IFLA members: € 58.00)
ISBN 3-598-21842-7
112-114
World Guide to Library, Archive and Information Science Associations
2nd edition. 2005. 510 pages. Hardbound
€ 168.00 (for IFLA members: € 131.00)
ISBN 3-598-21840-0
115
e-Learning for Management and Marketing in Libraries
e-Formation pour le marketing et le management des bibliothèques
Papers presented at the IFLA Satellite Meeting, Section Management & Marketing / Management &
Marketing Section, Geneva, Switzerland, July 28 - 30, 2003
Edited by / Edité par Daisy McAdam
2005. 165 pages. Hardbound
€ 74.00 (for IFLA members: € 55.50)
ISBN 3-598-21843-5
www.saur.de
116
Continuing Professional Development - Preparing for New Roles in Libraries:
A Voyage of Discovery
Sixth World Conference on Continuing Professional Development and Workplace Learning for
the Library and Information Professions
Edited by Paul Genoni and Graham Walton
2005. 307 pages. Hardbound
€ 78.00 (for IFLA members: € 58.00)
ISBN 3-598-21844-3
117
The Virtual Customer: A New Paradigm for Improving Customer Relations
in Libraries and Information Services / O cliente virtual: um novo para-
digma para melhorar o relacionamento entre clientes e serviços de infor-
mação e bibliotecas / Le usager virtuel: un nouveau paradigme pour
améliorer le service à la clientèle dans les bibliothèques et services d'infor-
mation / El cliente virtual: un nuevo paradigma para mejorar el relaciona-
mento entre clientes y servicios de información y biblioteca
Satellite Meeting Sao Paulo, Brazil, August 18-20,2004
Edited by Sueli Mara Soares Pinto Ferreira and Réjean Savard
2005. XVIII, 385 pages. Hardbound
€ 128.00 (for IFLA members: € 96.00)
ISBN 3-598-21845-1
118
International Newspaper Librarianship for the 21st Century
Edited by Hartmut Walravens
2006. 298 pages. Hardbound
€ 78.00 (for IFLA members: € 58.00)
ISBN 3-598-21846-X
119
Networking for Digital Preservation. Current Practice in 15 National Libraries
Ingeborg Verheul
2006. 269 pages. Hardbound
€ 78.00 (for IFLA members: € 58.00)
ISBN 3-598-21847-8
www.saur.de