MASTER THESIS

Systematic review of scientific

literature published on the topic

of public procurement between the

years 1997 and 2012

Sandra Lange

Submitted in fulfillment of the require-

ments for the degree of Master of Sci-

ence (MSc.) in Business Administra-

tion of the School of Management and

Governance (MB)

Examination Committee:
Prof. Dr. Jan Telgen

Dr. Fredo Schotanus

June 13, 2014

 Acknowledgements

This project has been a real challenge to me. As both the field of public pro-
curement as the conduct of a systematic review were new to me, I was required to
continuously learn new things, as well as to further develop previously obtained
knowledge. While at times I wondered, if I was capable of the task, I am glad that
I pulled through and am proud of the knowledge and skills I was able to develop.

For supporting me I am grateful to my supervisors Prof. Dr. Jan Telgen and

Dr. Fredo Schotanus. I thank Mr. Telgen for not giving up on the idea that a
student researcher can handle this research and giving me the opportunity to give
it a go. He was actively involved in many, critical stages of the review and I learned
a lot from his expertise on the field. I thank Mr. Telgen for organizing two extra
student researchers to collaborate with me during the relevance assessment stages.
This contributed to making the review more objective, as it also sped the process.
I thank Fredo for his high accessibility and qualitative feedbacks. His experience
on systematic reviews was very valuable for designing an objective review process
and decomposing it into manageable parts. I specifically thank Fredo for searching
and requesting articles, which were inaccessible to me. Without this, this review
would not have become as representative a study as I hope it is. I believe that
it was the best choice for me to have two researchers, who already collaborated
before, as supervisors, since this resulted in a coherent research agenda and thus
for me a better understanding of the objectives. Finally, I want to thank both of
them for their re-assuring feedbacks and comments, which motivated me.

ii
 I also thank the assistant researchers Caroline Epping and Justus Gätjen for
helping in the relevance assessment of retrieved articles. Both were very reliable
collaborates and our group discussions led to valuable refinements of the review’s
criteria for in- and exclusion.

On a personal note I want to thank my family and friends, for believing in me

and supporting me. I especially want to thank my closest companion during the
years of this “Holland experience” Simon for motivating me to continue at rough
times and for lightning my mood at almost all times. I want to thank my mother
for being there for me and explaining to me how the local public agency she works
for conducts procurements, which helped me in understanding the subject matter
better. I want to thank my friends and family in general, as all of them have
contributed to the successful completion of this work, by sharing their free times
and knowledge with me.

Sandra Lange

iii
 Abstract

Background and objective: Public procurement is considered a powerful

tool to increase government efficiencies, both directly by decreasing public
expenditures, as indirectly by fostering economies. While the field is frag-
mented in many sub-fields, lack of existing synthesis inhibits deriving at
definite findings, which both disables the field to develop to a mature state,
as it also hampers practical application. To fill this gap, this systematic re-
view provides an overview of the most influential literature on the field, its
most prominent subjects, as well as research designs and study character-
istics. The findings are aimed at providing other researchers with relevant
information to synthesize existing findings and develop research by utilizing
previously neglected research approaches.
Methodology: The databases Scopus and Web of Science were searched
for search terms previously tested for relevance. Searches were limited to
English articles, published between January 1, 1997 and December 31, 2012
in peer-reviewed journals. Search results were assessed for relevance in a
three-step process of comparing title, abstract and the full text against stip-
ulated criteria for in- and exclusion. The remaining 378 articles were then
coded against eleven main categories and subsequently anaylzed by means
of descriptive statistics using the software SPSS. Analysis focused on de-
scribing the literature in terms of publications, research designs and topics,
as well as on discovering trends and assessing differences across countries
and the scientific impact of articles.
Findings The findings suggest that public procurement research is a ma-
turing field, which is receiving increasing attention from diverse scientific
disciplines. The USA and UK are most productive publishers, while Eu-
ropean countries have become increasingly active in recent years. While a

1
wide spectrum of research designs have been utilized, the reviewed research
articles focused on few. For example, although articles addressed twenty-
two different topics, eleven of those were only studied once, while 61.4%
of papers researched the topic of procurement strategies. The second most
important topic was selection, followed by contracting. Considerable vari-
ations were observed across countries, indicating different research foci, as
well as varying levels of maturity per research characteristic.
Discussion Public procurement practices vary across countries, influenced
by differences in legal regimes and institutional settings. We found that
22.5% of papers studied the US and a further 20.4% the UK, while the
majority of other countries were only studied in less than 2% of reviewed
articles. This indicates that obtained research findings should not be gen-
eralized to other countries with very different public procurement designs.
Practical applicability of research findings is inhibited by the detected im-
precision of research: 56.1% of reviewed articles did not specify the procur-
ing government level, a further 28.6% were unspecific with respect to the
procured type of product and 60.6% of papers did not address a particular
private industry or sector.
Further, reviewed research has underused existing scientific knowledge in
that both synthesis research strategies of literature study and meta-study
were only utilized in 13.2% and 5% of papers respectively. This under-
utilization of existing, scholarly knowledge inhibits maturation of the field
to a state of definite findings and shared paradigms.
The findings that 79.1% of authors published only one article on public
procurement, while publishing journals come from diverse scientific disci-
plines other than public administration, such as construction, finances or
ethics, indicates that only few researchers are specialized on the field, but

2
that instead it is composed of streams from various backgrounds. Although
inter-disciplinarity in research is beneficial in that it utilizes complimentary
knowledge, research gains quality from researchers who are more literate on
the field.
The articles reviewed applied narrowly focused research designs: while thirty-
two different industries and sectors were studied, 20.6% of papers studied
the construction industry, where the second most often researched sector,
health, was only studied in 6.9% of articles and a further nineteen industries
and sectors were merely assessed once. Further, in the final years 2009 - 2012
65% of articles studied the topic of procurement strategies, while the other
ten topics with the exception of contracting were studied continuously less
frequently over the years.
Research on the procurement strategy e-procurement, although the 4th most
often studied strategy of twenty, was found to be least developed in that it
was never assessed against any specific industry or sector, and was exclu-
sively researched by survey research and case studies.

3
Contents

1. Introduction 6

2. Literature review 8

3. Methodology 14
3.1. Operationalization . . . . . . . . . . . . . . . . . . . . . . . . . . 14
3.2. Search strategy . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

4. Findings 27
4.1. Status of public procurement research . . . . . . . . . . . . . . . . 27
4.2. Predominant study characteristics . . . . . . . . . . . . . . . . . . 36
4.3. Predominant research designs . . . . . . . . . . . . . . . . . . . . 47
4.4. Topics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56

5. Review limitations 71

6. Directions for future research 72

7. Summary and conclusion 75

A. Documentation of search process v

B. Classification scheme vi

C. Analysis viii
C.1. Authorships . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viii
C.2. Journals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x
C.3. Publishing countries . . . . . . . . . . . . . . . . . . . . . . . . . xxvi

4
 C.4. Government levels . . . . . . . . . . . . . . . . . . . . . . . . . . . xxxi
C.5. Product types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxxiii
C.6. Industries and sectors . . . . . . . . . . . . . . . . . . . . . . . . . xxxv
C.7. Studied countries . . . . . . . . . . . . . . . . . . . . . . . . . . . xxxix
C.8. Methodologies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . li
C.9. Time dimensions . . . . . . . . . . . . . . . . . . . . . . . . . . . liii
C.10. Data collection methods . . . . . . . . . . . . . . . . . . . . . . . lv
C.11. Research strategies . . . . . . . . . . . . . . . . . . . . . . . . . . lix
C.12. Topics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . lxiii
C.13. Study characteristics per topic . . . . . . . . . . . . . . . . . . . . lxvi
C.14. Research designs per topic . . . . . . . . . . . . . . . . . . . . . . lxxii
C.15. High impact papers per topic . . . . . . . . . . . . . . . . . . . . lxxx

References ccxviii

5
1. Introduction

Public procurement is widely regarded as a powerful tool to make governments

more efficient. It accounts for 13% to 20% of worldwide GDP [4], meaning that a
significant proportion of all produced products and services are bought by govern-
ments. Good public procurement policies and practices lower public expenditures
and free them up to be allocated to other areas [16]. While governments aspire
cost savings, they need to assure high quality standards. Many of its products
have a long life cycle (e.g. infrastructure, buildings, etc.). In providing domestic
inhabitants with such social services as health care, education, security, infras-
tructure and a free labour market, governments aim to make their countries more
productive, increase the GDP and become competitive on the international mar-
ket. Many researchers emphasized the powerful effects that public procurement
can have on fostering innovation [7] [21], and green production [19] [25]. To achieve
such socially desirable outcomes, governments operate as both regulators, passing
laws and regulations, and market participants [16] [31]. And in times of global
supply chains public procurement is not only a means to improve upon social out-
comes on domestic markets, but also internationally [31].

While public procurement is a highly fragmented field, a systematic overview

of research is still lacking. Crossan and Apaydin (2010) state that “fragmenta-
tion of the field prevents us from seeing the relations between these facets and
ultimately impedes consolidation of the field.” [17, p. 1154]. An ever increasing
amount of research activities face scientists with the tedious task of filtering out
the most relevant publications and conclusive findings on which to ground their
works. Without such overview, they run the risk of conducting redundant studies

6
or base their researches on inconclusive findings. Providing an overview of the field
is a key first step in contributing to practice. Both by showing which topics have
been addressed until now, and to what extent, detecting possibly understudied, as
well as mature sub-fields, and by enabling researchers with the tools to conduct
syntheses on findings for sub-fields, the field is developed to a new state of more
clarity and unification. The practical impact of this work is therefore indirect, by
stimulating and enabling a research agenda to derive at generalizable findings.

This literature review provides an overview of the most influential scientific lit-
erature published on the topic of public procurement (PP). Moreover, the overall
state of PP research is assessed, providing insights into the maturity of the field.
According to Cheon et al. (1993) mature research fields are characterized by study-
ing a variety of different topics and applying various research methods instead of
narrowly focusing on few [15]. Therefore, this review focuses on addressed topics,
as well as employed methodologies and their development over time. The litera-
ture review is focused on the past sixteen years (1997 to 2012).

To guide the systematic review, the following main research question was formu-
lated: “How did worldwide research on public procurement develop over the time
period 1997 to 2012?”

We formulated four sub-questions. The first three sub-questions are descriptive

in nature, the last one is content related:

1. What is the current status of public procurement research and how did it
evolve over the past 15 years?

7
 2. What are the predominant study characteristics?

3. What are the predominant research designs?

4. What are the main subjects dealt with in research on public procurement
and how did those change over time?

The paper is structured as follows. At first, we describe what differentiates a

systematic literature review from a traditional one and how it should be carried out
according to literature. Section 3 describes the methodological approach taken,
followed by the findings in section 4. Section 5 presents a critical assessment of the
limitations of this review. Section 6 then discusses directions for future research
and section 7 concludes.

2. Literature review

Systematic reviews provide objective summaries of what has been written and
found out about research topics. This is especially valuable in wide research areas,
where many publications exist, each focusing on a narrow aspect of the field [11].
Systematic literature reviews differ fundamentally from traditional ones. Rousseau
et al. (2008) state that the main difference lies in their representativeness: while
traditional reviews tend to be “cherrypicking studies” [39, p. 476], systematic re-
views aim to provide a full overview of research conducted on a specific field until
the present date. All research procedures have to be made explicit before the ac-
tual conduct of the review to make the process objective and replicable.

To conduct a systematic review, Tranfield et al. (2003) propose a three stage

process of planning, conducting and reporting [43]. In the planning phase, a review

8
panel should be formed, consisting of experts in the field, who will together assess
the research subject, formulate clear criteria for in- and excluding literature and
develop a review protocol. Criteria for in- or excluding specific literature manifest
the research focus and also point to its limits [9]. While Tranfield et al. do not
define a suited or minimum size of the review panel, Wynstra (2010) [46] and
Carter and Ellram (2003) [13] utilized teams of two reviewers. The review activi-
ties should according to Tranfield et al. not be planned with too much rigour, but
leave room for flexibility to adjust during the review. This is also supported by
Moher et al. (2009), who state that amendments to the review protocol should be
viewed as inherent to the process itself [33].

In the second stage of conducting the review, search terms are to be formulated
on the basis of scoping studies and discussions within the review panel. A scoping
study is a preliminary assessment of the research field aimed at mapping the scope
and size of it. For formulating suitable search terms, the Centre for Reviews and
Dissemination’s (CRD) 2009 guideline for systematic reviews suggests to consult
the main research question [35]. For searching electronic databases, the guide-
line recommends to also consider “synonyms, abbreviations and spelling variants”
(p. 243). Bettany-Saltikov (2010) highlights that sources other than electronic
databases should be searched, too, since even well-known research articles may
not be enlisted in all databases [9]. Both Bettany-Saltikov and the CRD guideline
recommend utilization of articles’ reference lists to detect relevant literature, hand
searching important journals, contacting researchers on the field, as well as con-
sulting citation analysis to discover articles that cite already included literature.
While these non-random snowball sampling techniques are suitable for unknown

9
populations, which are difficult to access, their results are highly biased [8, p. 185],
which is in direct conflict with the need for objectivity.

After the formulation of search terms, a search strategy should be developed.

The search strategy encompasses all measures taken to detect literature relevant
to answer the research question and is thereby very critical to the success of the
review and the validity of its findings [9]. Kable et al. (2012) have developed a
structured approach for formulating and documenting a search strategy [28]. The
main focus of the 12-step framework presented by the authors is on what should
be documented in the review manuscript so that the followed search strategy be-
comes replicable to other researchers. The twelve steps of the Kable framework are
documented in Table 1. The authors state that a thorough documentation of the
search strategy helps readers to better grasp the rationale and focus of the review.
A further benefit of the model is that it guides reviewers through the strategy de-
velopment phase and ensures that no important aspects are left out. Therefore, the
framework is viewed to be an especially valuable tool for inexperienced researchers.

It is generally considered important to include grey literature in the review to

develop a more complete overview [43] [39] [27] [30]. Grey literature refers to “mul-
tiple document types produced on all levels of government, academics, business,
and organization in electronic and print formats not controlled by commercial pub-
lishing i.e. where publishing is not the primary activity of the producing body.”
[1]. Due to its nature, grey literature is difficult to locate and can be abundant,
which would have exceeded the time range of this review. Moreover, this type of
literature does not satisfy the research aim of presenting an overview of only the

10
 Step
1) Purpose statement
2) Databases, search engines used
3) Search limits
4) Inclusion and exclusion criteria
5) Search terms
6) Exact searches per database, search engine and the results
7) Relevance assessment of retrieved literature
8) Table reporting literature included in the review, accompanied with
key data such as title, author, but also research subject and findings
9) Document final number of search results
10) Quality assessment of retrieved literature
11) Review
12) Accurate, complete reference list

Table 1: Kable et al. (2012) 12-step framework

most influential scientific literature.

With respect to assessing the relevance of retrieved literature at the end of the
search process, Bettany-Saltikov proposes to conduct a first, quick assessment by
means of reading only the titles and abstracts and compare them against the cri-
teria for in- and exclusion. Only those papers classified as relevant or likely to
be relevant after this first assessment should then be read in full during a second
assessment stage. The benefit of this approach is that potentially large bulks of
literature can be assessed rather quickly. Each literature should be assessed by at
least two individual reviewers who compare their results and solve discrepancies
through discussions and potential amendments to the in- and exclusion criteria.
While this group approach will yield a highly representative review, it is a time
consuming effort, requiring multiple researchers to collaborate over time. The
time and resource limitations of this review did not allow for the full inclusion of
other researchers. This makes the review vulnerable to be subjectively biased and

11
thereby not a representative overview of the current status of research. While a
representative review is aspired and needed by science, this paper shall give other
researchers a thorough basis for replicating the research process and testing its
findings.

At the end of the relevance assessment stages, all included literature must un-
dergo a quality appraisal to ensure reliability of its findings. Quality appraisal
should according to Bettany-Saltikov be conducted with respect to internal and
external validity, as well as suitability of the employed data analysis methods.
While the author does not provide guidelines as to how the validity can be eval-
uated, the book by Shadish, Cook and Campbell (2002) [40] provides extensive
examples of threats to validity, which may be utilized in assessing literatures’
quality. Peer-reviewed journal articles do according to Mol and Wynstra (2008)
not require quality appraisal since they “provide validated knowledge, and give
a good estimate of accepted topics and methodologies” [34, p. 15]. Opposed to
this, many have critiqued peer-review to be an obscure process, which guidelines
are kept confidential and differ between journals and even between different re-
viewers of the same journal [5]. Moreover, reviewers may be biased by knowing
the identity of the author [38]. However, the limitations of this research did not
allow for a quality appraisal of each included article. Therefore, it is believed that
peer-review was the best available measure to have some quality appraisal in place.

When extracting information from the literature, a data extraction form should
be used to reduce error and bias. It lists all information needed to answer the
research question, and enables researchers to scan the included literature for those

12
specific information. The review paper by Wynstra (2010) [46] provides practi-
cal examples of categories for the data extraction form that are relevant to this
review. For reviewing the Journal of Purchasing and Supply Management’s publi-
cations of the years 1994 to 2009 he developed an extensive list of categories each
article was classified into. The main categories employed by Wynstra are: topic,
research strategy, data collection, data analysis, type of product, type of purchase,
as well industry and sector. With respect to the topics, the author classified each
article into a maximum of three subject categories, while another, similar review
conducted by Carter and Ellram (2003) on the Journal of Supply Chain Manage-
ment categorized each article into only one subject category which summarized
the article’s focus the best [13]. We believe that Wynstra’s approach yields a more
accurate representation of research topics, since procurement subjects are often
researched against a clear background and therefore categorization into only one
subject field will under-represent the other(s). Each of the main categories was fur-
ther divided by Wynstra into sub-categories. He also gathered general article data
including publication year, contributing authors, institutions and citations. Both
Wynstra as Carter and Ellram conducted time series analyses by sub-dividing the
years of research into time intervals of five years. In the Wynstra paper, the first
interval was six years long, and only the following two intervals five years. This
disparity obscures comparability, especially with regard to publication counts per
interval.

The final step of the review is the synthesis, which summarizes the findings of
the review. Two synthesis methods are presented by Tranfield et al., the narrative
and meta-analysis. Whereas the narrative synthesis summarizes and concludes the

13
main topics addressed by research, meta-analysis is used to pool data of research
findings, thereby increasing the statistical power of findings. As this review aims
at generating an overview of the status of PP at large with all its diverse sub-
fields, noting findings of each subject would have exceeded the research limitations.
Accordingly, the narrative synthesis is suited to our research objective.

3. Methodology

This section presents the operationalization of the research questions, as well as

the developed search strategy.

3.1. Operationalization

The sub-questions’ operationalizations were informed by Wynstra (2010) [46]. All

main categories employed in his research were adopted with the exception of “type
of purchase”, as a scoping study of the PP field had revealed that this category was
irrelevant. While the main categories were mostly adopted, the sub-categories were
modified. His topic sub-categories were to a great extent not applicable to this
review, since his research mainly focused on private sector procurements. The re-
search strategies were all adopted except for “expert interviews/Focus group” and
“laboratory experiment”, which were instead grouped as data collection methods.
Wynstra’s subcategories for data collection are very specific, such as distinguishing
between four kinds of questionnaires. As this level of specificity may falsely create
the impression of variety, the subcategories were simplified. The same applies to
his thirty-nine items list of data analysis techniques, which was simplified to only
distinguish between quantitative and qualitative research. The product types were

14
amended to account for works while the product type combination “good/service”
was omitted. Nine industry and sector categories were adopted from the Wynstra
classification scheme yet further extended during the data extraction stage of the
review. Instead of collecting institute data, the country of the institute was noted
per article. While institutional data would have provided interesting insights into
institutional collaborations as well as most active institutions on the field, this
review adopted a global perspective limited to cross-country as opposed to cross-
institutional differences. Finally, his categorizations were extended with data on
studied country/ies, publishing journal and the procuring government level. This
latter study characteristic is specific to public procurement and inclusion in the
review provided valuable information on the context of conducted research. Spec-
ifying the research context is according to Denyer et al. (2008) supportive to
practical relevance [20]. The complete classification scheme used for this review
can be found in Appendix B. The classification scheme was directly transcribed
into an SPSS data extraction form, which was later used to conduct the analyses.

These categorizations were then utilized to operationalize the research sub-

questions.

• Sub-question 1, pertaining to the status of public procurement research, was

operationalized as yearly publication counts. Publication counts are an ef-
fective outcome measure to assess the scientific importance of a research field
[17], and their development is a reliable indication whether the relevance of
the field changed. To further characterize the time developments, publishing
countries and journals were assessed over time as well as authorships. It
is believed that these variables provide a meaningful overview of the main

15
 stakeholders of the field.

• Sub-question 2, regarding predominant study characteristics, was assessed

against the industries and sectors from which the government procures, the
procuring government level, studied country/ies and types of products pro-
cured. There was no limitation for those categories with regard to maximum
sub-categories per article.

• Sub-question 3, which seeks to discover employed research strategies, was

assessed against the research methodology, time dimension, research strategy
and data collection methods. While there was no limit as to how many
data collection methods each article was grouped into, the other categories
hold mutually exclusive sub-categories. This exclusiveness was only breached
when articles clearly articulated to have utilized more than one strategy.

• Sub-question 4, pertaining to the research subjects addressed, was assessed

based on most common topics and their developments over time. Each paper
was categorized as addressing a maximum of two subjects. As mentioned in
section 2, it is believed that categorizing into more than one subject field
better enables contextualization, such as studying the selection process for
PPP projects. While Wynstra (2010) categorized into a maximum of three
categories, we believe that two categories suffice to both capture the main
subject focus of the article as the context against which it was assessed.

To detect developments over time, the sixteen years of research have been
subdivided into equal time intervals of four years each, inspired by Wynstra
(2010) and Carter and Ellram (2003) [13].

16
3.2. Search strategy

For developing an effective search strategy the framework developed by Kable et

al. (2012) [28] was applied. As was discussed in section 2, the 12-step framework
presents a valuable tool for documenting a systematic review’s employed search
strategy while also guiding researchers to consider all aspects required for locating
relevant literature. To enhance readability and enable readers to quickly find
certain steps, this section presents each of the twelve steps consecutively.

3.2.1. Purpose statement

The purpose was formulated together with the principal and project supervisor,
Prof. Dr. Jan Telgen. As a member of the editorial review board of the Journal
of Purchasing and Supply Management and the Journal of Public Procurement, as
well as a public procurement advisor of municipalities, government advisors and
the Dutch parliament [3], he is an expert on the field. The purpose was stipulated
as discovering how scientific research on public procurement developed during the
years 1997 to 2012, and which research trends emerged. An all-encompassing
overview of the developments was to be derived, instead of a focus on limited
research topics.

3.2.2. Databases

We searched in the databases Scopus and Web of Science. Both databases are
well-established, multi-disciplinary research platforms, holding a wide variety of
peer-reviewed journals, and they are being kept up to date. We chose for two
databases to ensure all relevant papers are included, since it is possible that one
database omits relevant research [17].

17
3.2.3. Search limits

The following search limits have been applied to our searches:

• Peer-reviewed journal articles in English language

We limited searches to peer-reviewed journals. “Peer-reviewed journal arti-

cles provide validated knowledge, and give a good estimate of accepted topics
and methodologies.” [34, p. 15]. For the peer-reviewed journal articles it is
assumed that high impact research on the subject of public procurement
will have been translated into English. Therefore, it is believed that no high
impact papers will be disregarded from the review based on the language
restriction.

• Published between January 1, 1997 and December 31, 2012

This is the time frame chosen for the systematic review. Around the millen-
nium a number of initiatives have been launched by the National Institute of
Governmental Purchasing, Inc. (NIGP) to foster academia to pay more at-
tention to the largely neglected field of public procurement [42] [14]. Those
included, beyond others, under a partnership agreement with the Florida
Atlantic University (FAU) the establishment of the Public Procurement Re-
search Center, as well as the launch of the first scholarly journal on the field,
the Journal of Public Procurement. We decided on setting the cut-off year
for this review a few years before the launch of those initiatives to, among
other things, be able to assess their impact on the field. The final year of
consideration, 2012, was the most current research year when this system-
atic review was initiated in 2013 and was thus chosen to represent the most
current developments.

18
 • Search within

For the database Scopus, the search for the search terms was restricted to
title, abstract and keywords of the article. The proximity operator of W/5
was included between two consecutive search terms to include results where
the two search terms appear within five words. Scopus advises researchers to
use a proximity operator of either 3, 4 or 5, if they wished to find the search
terms within phrases [2]. To lower the threat of falsely omitting relevant
literature, we utilized the widest of the advised proximity operators. For the
Web of Science database searches were restricted to the topic subject and
title. In line with the Scopus searches, the proximity operator NEAR/5 was
used.

• Subject area

For the Scopus database searches were restricted to the subject area of Social
Sciences & Humanities. For the Web of Science database searches were
restricted to the subject areas Science Citation Index Expanded and Social
Sciences Citation Index.

3.2.4. Relevance assessment

Criteria for in- or excluding retrieved articles have been formulated in conjunc-
tion with the project supervisor Prof. Dr. Jan Telgen. The main rationale was
that we only wanted to include articles that were strictly on the topic of public
procurement and which provided exemplars of current practices, best or worst,
as well as guidelines for practice and research. The criteria were tested on three
batches of twenty articles regarding their relevance, as well as understandability
and practicality. Having two researchers develop and test the criteria makes the

19
article retrieval process more objective [43] [39].

Inclusion criteria

• Public procurement methods and tools

Methods and tools include, beyond others, e-procurement, green procure-

ment, auctions, as well as supplier selection and appraisal tools.

• Effects of a public procurement method or tool

Effects may be positive, such as increased innovation, or negative, such as

decreased transparency.

• Impact of legislation, legal system, legal framework on public pro-

curement

Positive or negative effects that a legislation, legal system or legal framework

has on public procurement.

• Public procurement as a concept

Examples of conceptualizations of public procurement are descriptions and

definitions of the field, as well as comparing and delineating its characteristics
from private sector procurements. Literature reviews on sub-fields of public
procurement research also fall into this category.

• How to achieve a public procurement related goal

Objectives can be directly procurement related, such as lowering expendi-

tures or fostering competition between suppliers. But they can also be indi-
rectly related but imposed upon public procurement such as fostering par-

20
 ticipation of small and medium enterprises (SMEs) in biddings to serve the
domestic economy.

• Outsourcing, privatization, PPP and PFI

In the context of motivations and pre-conditions for, as well as effects, usefulness

and best practices thereof.

Exclusion criteria

• Public procurement is not the main subject and focus

This is the most essential exclusion criterion, which also lies at the centre of
most of the following exclusion criteria. Relevant articles need to focus on
PP and not just discuss it in the context of another issue.

• Public buying entity is only meaningful due to its size and/or buy-
ing power

An example is the article by Arnold & Whitford (2006), which discusses

ways to influence private firms to act more environmentally friendly [6]. One
approach proposed by the authors is that governments should make private
companies’ participation in biddings for public contracts contingent upon the
environmental friendliness of those companies. Thus, the focus is really on
private companies and public procurement agencies are only meaningful in
that they present lucrative business partners for private firms. This criterion
is in essence the same as the previous in that it excludes articles where public
procurement is not the focus. Yet, during the relevance assessment stage
of this review, where other researchers were assisting, it became apparent

21
 that it needs to be added to make researchers assess the role that public
procurement plays in the respective article more critically.

• Procurements which are not strictly public

Procurements that are not strictly public include, beyond others, utilities
as well as hospitals’ and educational institutions’ procurements. In general,
those articles were excluded when they clearly referred to the private sector
or when they put the purchased product at their focus. But articles about
those products were included, if they focused on public procurement, its
methods, effects, good or bad practices. The general principle is that this
review is not on what is bought, but on how it is bought.

Also, most procurement tools are equally applied by private companies. In-
cluded were only those articles, which either focused exclusively on the appli-
cation of those tools by public entities, or which compared their application
in the two fields so as to develop guidelines for public procurement.

• Degree of implementation of a legal regime

When a legal regime is the research focus, its degree of implementation across
regions as well as obstacles to its successful implementation, the research
article was excluded.

• General effects of a legal regime

Unless those are specific to public procurement. However, articles are still to
be excluded if an effect on public procurement is just one of several effects,
thus where impacts on public procurement are not the main interest.

22
 • Development of a legal regime

Articles that discuss the current status of a legal regime or framework and
possible suggestions for further adaptations were excluded, even if those
specifically pertained to public procurement. While those amendments will
possibly have an effect on public procurement, if they were implemented,
their impact is theoretical as long as they are merely proposed and until
then are rather associated with legal research.

• Single rulings with no effect on public procurement at large

A single, standalone court ruling, which has no effect on any other but the
included parties.

• Procurements without a money transaction

Such as donations.

• Uncontrollable factors

Such as political leadership having an influence on which public procurement

practices are used.

3.2.5. Search terms

The search terms were developed in collaboration with both project supervisors,
Prof. Dr. Jan Telgen and Dr. Fredo Schotanus. Both researchers were familiar
with the PP field beforehand and were better able to develop effective search terms
than the author would have been on his own due to unfamiliarity with the field of
research. Batches of twenty articles corresponding to each individual search term
were tested for relevance through the author and Prof. Dr. Jan Telgen. Each
search included two search terms, consisting of variations of public + variations

23
of procurement, i.e. “government commissioning”. While many search terms were
disregarded after the test batches had revealed that they did not add any new or
relevant results, the following are the final search terms utilized:

• Variations of public: public; government

• Variations of procurement: procurement; purchasing; contracting; buy-

ing; commissioning

3.2.6. Documentation of search process

Appendix A shows the exact search queries conducted for each of the two databases
and the results.

3.2.7. Test relevance of retrieved articles

Relevance of found articles was assessed in a three step process based on Bettany-
Saltikov (2010) [9] by evaluating them against the criteria for in- and exclusion.
First, all titles were assessed. Assessment of only the titles has the advantage that
papers that do not meet the rationale of the research can be eliminated within a
relatively short time. If a title held too limited information to judge its relevance,
it was included. The title assessment was conducted in a team of four, consist-
ing of the author, Prof. Dr. Jan Telgen, and two other researchers. Each title
was assessed by two researchers. After the first batch, disagreements between re-
searchers were dissolved through group discussions, which led to refinements of the
criteria, which included both reformulation to make them more understandable,
as extending the list with criteria previously unaware of. In the consecutive title
batches, disagreements between two researchers were solved by having the title in
question be re-assessed by a third researcher. In this first screening process, the

24
initial batch of 3,501 articles could be decreased to 1,317.

In the second screening step, all remaining 1,317 articles’ abstracts were read
and assessed against the criteria for in- and exclusion. Full articles with less infor-
mative abstracts were included. This process initially started with the same team
that had assessed the titles. The other three researchers could not finish all batches
due to personal agendas that no longer allowed for the time intensive effort. As a
result, the first batch of 303 articles was assessed with the whole team. Batches
three to five (in total 734 articles) were assessed in a team of three, and the final
batch (280 articles) by the author alone. At the end of this second screening stage,
535 articles remained.

The third screening process was conducted during the data extraction stage of
the research when full articles were screened. Another 157 articles were excluded
from the analysis in this final assessment stage, yielding a final batch of 378 articles
included in this review.

3.2.8. Summary table of included articles

On request, the complete list of included articles can be gathered from the authors.

3.2.9. Retrieved articles at end of the search process

Initially, 5,111 articles were found in the search processes. Excluding duplicates a
batch of 3,501 remained. The high amount of duplicates is due to the fact that
two databases were used.

25
3.2.10. Quality appraisal of retrieved articles

Quality assessment is crucial to ensure that findings of papers are correct [37]. For
this literature review only peer-reviewed articles were included, which excludes the
need for a further quality assessment.

3.2.11. Critical review

The critical review entails the three processes of data extraction, analysis and
synthesis.

Data extraction To extract relevant data from included literature, a data ex-
traction form was developed in collaboration with the project supervisor, which
categorizes each article into the categories shown in the classification scheme in
Appendix B. The completed data extraction form can be obtained on request from
the authors. Following this data extraction form, each article was screened for
relevant information, which eliminated the need to read all papers completely.
This process was undertaken by the main author alone, resulting in a potential
subjectivity bias.

Data analysis The retrieved data were then analyzed to answer the main re-
search and sub-questions. The complete analyses can be found in Appendix C.

Synthesis Finally, the findings were summarized in a narrative synthesis. The

synthesis is presented in the following chapter.

26
3.2.12. Check the reference list for accuracy

The 378 articles included in this review were not referenced in a separate list due
to the amount of articles studied. A complete list may be requested from the
authors.

4. Findings

This chapter presents and discusses the findings from the conducted analyses. The
complete analyses can be found in Appendix C.

4.1. Status of public procurement research

4.1.1. Annual publications

As shown in Figure 1 the amount of annual publications on the topic of public

procurement almost sextupled over the sixteen years. Publications stagnated be-
tween 1997 and 2002 and only started to increase by the year 2003. The increase
was most remarkable at the beginning of the fourth time interval, year 2009, when
the yearly publications almost doubled. Overall, this development shows that aca-
demic interest in the field rose considerably. The fact that publications stagnated
between 1997 and 2002 and then experienced a significant increase from 2003 on
may be a sign that the initiatives launched by the NIGP and FAU have suc-
ceeded in stimulating research activity in the field. The second boost in 2009 may
be attributable to the global financial crisis, which shook economies around the
globe. PP as a major cost function of governments is a powerful tool in decreasing
economies’ expenditures, as also for strengthening businesses through such means
as preferential buying.

27
Figure 1: Publication trend

4.1.2. Authorships

To control for false duplicates, initials were checked which appeared to lend them-
selves to wrong individual listings. Besides controlling for slight differences in
initials to ensure no false duplicates, common initials, such as J. Smith, were also
checked to ensure no two authors would falsely be categorized as one. Filtering
out duplicate author listings yields 624 individual authors contributing to the 378
articles. The majority of authors published only one article on PP (79.1%). Of the
seventy-nine authors that published more than one article, the majority published
two (73.4%). The two authors Potoski, M. and Brown, TL are the most produc-
tive authors in the field, each having published seven articles of relevance to this
review, followed by Warner, ME and Chan, APC, each of which published six rele-
vant papers. A list of the most influential authors can be found in Appendix C.1.2.

28
 Authorship Frequency Percent
Single author 131 34.7%
Two authors 151 39.9%
Three authors 66 17.5%
Four authors 24 6.3%
Five authors 4 1.1%
Six authors 1 0.3%
Seven authors 1 0.3%
Total 378 100.0%

Table 2: Authorships 1997 - 2012

As shown in Table 2, over the sixteen years of research most papers were pub-
lished by two authors (39.9%), followed by single authorship (34.7%) and co-
authorship between three authors (17.5%). While still 6.3% of papers were pub-
lished in collaboration between four authors, authorships between more than four
authors were unpopular, in total pursued by only six papers. The highest amount
of authors contributing to one research paper were seven and could be observed in
just one paper. As the time series analysis (Appendix C.1.1) shows, co-authorship
between two authors only became most prominent in the fourth time interval 2009
to 2012. While in the first quartile single authorship was most prominent, the
two forms of authorship were almost on the same level during quartiles two and
three. Co-authorships between four and more authors increased over time making
up 10% of all papers in the fourth interval compared to 2.4% in the first.

The high amount of individual authors who only published one or two articles
poses to a scattered field and indicates that only few top publishing researchers are
specialized on the field. The increase in co-authorships is a trend, which has also

29
been observed for other research fields [32]. In general, as more researchers become
interested in a field, the easier it is for them to find collaborators. Reasons for
collaboration include the exchange of complimentary knowledge and experience.
This is especially needed when the field is approached from many different disci-
plines. Moreover, it may be a sign that research problems are gaining complexity,
while at the same time research needs to be finished quicker so that its findings
will still be relevant. Having a team of researchers collaborate speeds the research
process. Moreover, universities are increasingly promoting research collaborations
to increase their reputation. In general, cooperation is easier today due to the
technical developments, which enable short communication ways. According to
Shin et al. (2013), collaboration is more likely in developed systems [41] and thus
its increase poses to a growing maturity level of PP research.

4.1.3. Journals

All journal titles starting with a “the” were cross-checked to ensure they were not
double listed without the definite article. Moreover, publications of the European
Journal of Purchasing and Supply Management were grouped under the Journal
of Purchasing and Supply Management, since the journal changed its name to the
latter. While the other journals that published public procurement research were
not investigated regarding name changes, a potential limitation of this analysis is
that some journals’ relevance for the field may be undervalued.

The analysis revealed a scattered image of 199 different journals (Appendix C.2.1).
The majority of journals, 68.5%, published only one article over the sixteen years,
and a further 14.5% published two. The top ten journals combined published one

30
quarter of the public procurement research. Still, none of them can be regarded as
clearly the most productive, each accounting for a maximum of 3.7% of all papers
included in this review.

Over the four time intervals the amount of journals publishing PP research in-
creased. Moreover, publishing journals come from various scientific backgrounds,
such as finances, construction, health and many more. The tables listing journal
publications descending per time interval (Appendix C.2.2 to C.2.5) show that the
top five journals that published most papers over the time period 1997 to 2012
have been active publicists over all four time intervals.

The top six to ten journals only became more knowledgeable in later time inter-
vals. To further investigate this, a cross tabulation was generated displaying the
publications of these top ten journals, see Table 3. There it can be seen that even
the top journals often merely published one or two relevant articles in four years.
The top six to ten journals show notable gaps in activity in that they have not pub-
lished relevant research over complete quartiles. The most surprising publication
history can be observed for the Journal of Public Procurement: while the journal
published the fourth highest amount of PP papers it apparently did so only in the
final quartile. Due to the fact that the journal was already founded in 2001 and
is regarded as a highly influential publisher on the field, this discovery was unex-
pected. A further analysis showed that the Journal of Public Procurement was not
listed in the Web of Science database at all, while Scopus only lists publications
from 2012 onwards. To clarify the underlying reason for this finding, we contacted
the customer support of both databases, as well as Dr. Khi V. Thai, the journal’s

31
chief editor. While the customer supports could not answer our request, Dr. Khi
V. Thai explained that the journal was rejected by the Web of Science due to too
low citations. The journal’s application with Scopus was a long process due to the
demanding requirements that had to be met. The fact that the journal only got ac-
cepted at Scopus in 2012 and was rejected by the Web of Science altogether, poses
some thoughts: on the one side, the strict requirements stipulated by the databases
can be regarded as a strength of this review in that only high standard journals’
articles were considered. On the other side, it indicates that systematic litera-
ture reviews for emerging fields should not be limited to databases with such high
standards, as specialized journals may not have accumulated the requirements yet.

The overall result from the journal analysis is that public procurement is of
interest to researchers of various backgrounds. PP research does not operate in
an independent environment, which is only relevant to public administration, but
instead it is influenced by various fields that interface with the field.

4.1.4. Publishing countries

Each paper originated from at least one and a maximum of seven countries de-
pending on authorship. Eleven papers included no author information so that
no originating country could be determined. Those articles were categorized un-
der “unknown origin”. Some author information included different institutions
and countries they were associated with. In that case, only the first country was
noted, assuming that the institutions were listed in order of their relevance to the
author. Frequency analysis over the sixteen years of research (Appendix C.3.1)
reveals that research originated in forty-eight different countries, excluding the

32
 Journal 1997 - 2000 2001 - 2004 2005 - 2008 2009 - 2012 Total
Journal of Purchasing and Supply Management 1 2 7 4 14
Public Administration 2 3 5 1 11
Public Administration Review 1 3 4 3 11
Australian Journal of Public Administration 4 1 2 3 10
International Journal of Public Sector Management 3 1 2 4 10
Journal Of Construction Engineering And Management 4 3 3 10
International Journal of Industrial Organization 1 2 5 8
Journal of Public Procurement 8 8
Public Money & Management 2 2 4 8
International Journal of Project Management 5 1 6
Total 14 14 32 36 96

Table 3: Top 10 Journals’ publications per time interval

33
category of unknown origin. The USA and UK are the most important publish-
ers, combined contributing to 83.1% of published papers, followed by Australia
(14%), while thirty-one contributing countries each only have a share of less than
2%. Ten of the top sixteen publishing countries, which published more than ten
articles, are European countries, the most important being Spain, contributing to
9% of all relevant papers. Splitting the analysis into four equal time intervals (Ap-
pendix C.3.2 to C.3.5) shows that the USA and UK have been the top publishers
throughout all four quartiles, although the UK used to be the top publisher in the
first interval, and were only surpassed by the US in the second interval. USA’s in-
crease in publications by almost one third may be reasoned in the NIGP initiatives.

Publishing country Frequency Percent

USA 179 47.4%
UK 135 35.7%
Australia 53 14.0%
Spain 34 9.0%
Germany 24 6.3%
Italy 24 6.3%
Hong Kong 23 6.1%
Netherlands 23 6.1%
France 21 5.6%
Sweden 21 5.6%
Canada 20 5.3%
Norway 18 4.8%
China 17 4.5%
Finland 15 4.0%
Denmark 14 3.7%
Taiwan 14 3.7%

Table 4: Top 16 publishing countries 1997 - 2012

The time analysis further reveals that countries other than the US and UK

34
gained importance in the field over time: Finland, as the fourteenth most impor-
tant publisher overall, only became active in PP research in the third interval.
Denmark only became active in the fourth interval and yet is the fifteenth most
important publisher. It can be observed that publications for the top European
countries increased considerably in the fourth interval. For instance, the Nether-
lands, the eighths most important publisher over the sixteen years, published one
relevant article in the first interval, followed by five in the third and seventeen
in the fourth. This development is similar with all of the other top European
publishers. Overall, while the publications increased per time interval so did the
countries: thirty-nine of the forty-eight contributing countries published relevant
research papers in the final interval, while twenty-six countries published in the
third quartile, twenty-one in the second and ten in the first.

These findings show that the PP field is highly dominated by the US and UK,
while Europe’s relevance is increasing rapidly. Based on this finding it can be
expected that Europe’s activity on the field will further increase in the upcom-
ing years, potentially making the region more scientifically competitive to the US
and UK. While the amount of other countries publishing PP research increased
over time, their comparative relevance remained low. These findings are likely to
be biased by restricting the review to English publications, as it has been shown
that non-English research articles tend to be translated only when significant re-
sults have been achieved [22] [23]. Nonetheless, the overall increase in publishing
countries is a sign that public procurement gained in global relevance over the
course of the sixteen years. While restrictive use of few databases could also pose
a selection bias, this threat can be ruled out for this review, since the majority of

35
included papers were retrieved from the Scopus database, which is internationally
oriented [10] [45], while only nine of the included articles were exclusively listed in
the Web of Science database, which has been reported to be biased towards North
American and Western European publications [45].

4.2. Predominant study characteristics

4.2.1. Government levels

As shown in Table 5, more than half of the papers (56.1%) did not address partic-
ular government levels. The time series analysis (Appendix C.4.1) further shows
that this proportion remained this high throughout all four time intervals. The
most prominent studied government level over the sixteen years is the local one,
studied by 25.1% of papers. The federal and municipal levels were studied by 13%
and 14.3% of papers respectively. The time series analysis shows that while the
local level remained stable over the four time intervals, municipal governments
gained in importance, while the federal level’s relevance to public procurement
research decreased.

Government level Frequency Percent

Governmental 49 13.0%
Municipal 54 14.3%
Local 95 25.1%
No government level 212 56.1%
Total 410 108.5%

Table 5: Government levels 1997 - 2012

To investigate whether publishing countries differ with regard to studied govern-

36
ment levels, a cross tabulation was generated, which juxtaposes these two variables
(Appendix C.4.2). The table lists only the top sixteen originating countries, which
each have published more than ten papers over the complete time span under con-
sideration. As the other countries published less than ten papers no conclusions
could have been drawn for the small categories and therefore they were disregarded
from any further cross analyses. It can be seen that most of the top sixteen pub-
lishing countries applied an imbalanced approach with varying proportions per
government level. Taiwan and Germany can be regarded as most balanced, fol-
lowed by China and Hong Kong. While the latter two countries only studied two
of the three government levels, the other levels were studied in an almost equal
proportion of papers. As according to Cheon et al. (1993) mature research is char-
acterized by variation in research approaches [15], these countries can be regarded
as the most mature with respect to government levels.

A further conducted cross analysis discovers whether high impact papers did
things differently than low and medium impact papers with respect to studied gov-
ernment levels (Appendix C.4.3). Since observations of single papers would have
been impossible to generalize, citation counts were grouped into decadic categories
of 0 - 10, 10.5 - 20, and so on, up to the highest citation of this review, 135. As with
the other cross tables generated for this review, the amount of papers falling into
each category were given in brackets to enable readers to assess the meaning of
proportions. It can be seen that the majority of research papers received between
zero and ten citations, corresponding to 74.6% of the 378 papers. 17.9% of papers
accumulated 10.5 - 30 citations, and only 7.5% received more than 30 citations.
There is one exceptionally high impact paper with 135 citations. This is the paper

37
“The allocation of risk in PPP/PFI construction projects in the UK” written by
Bing L., Akintoye A., Edwards P.J., and Hardcastle C., published in 2004. As
stated in the operationalization of sub-question 2 (section 3.1), there were no lim-
its as to the maximum categories per government level. As a result, some sums
of the table are greater than 100%. In this regard, it can be seen that while all
three low impact categories of 0 - 30 citations contain papers that addressed more
than one government level, none of the top five categories of ≥ 60.5 citations did.
This can be interpreted as high impact papers being more focused. Addressing
one particular context makes research more specific and its findings more directly
transferable to business problems. Further, most of the high impact papers did
not specify a government level, while the municipal level was studied most often.
Low impact papers’ dispersion over government levels are almost precisely as the
overall dispersion. Almost all citation categories specified no government level in
the majority of papers, and the second most often the local level. The only true
difference is made by the four papers holding 40.5 - 50 citations: half of these stud-
ied the federal level, while the other half studied the local and municipal level.
None of them did not address a particular level.

As mentioned before, lack of context inhibits practical adaptation. Moreover,

not specifying the context disables other researchers to detect reasons for contra-
dictions with other papers’ findings. An explanation for the high proportion of
none-specified government levels might be that procurements at different levels of
government do not differ much. The prominence of the local and municipal level
accompanied with a decreasing relevance of the federal level reflect fiscal federalism
and the trend to decentralize the purchase function.

38
4.2.2. Product types

Most papers studied services over the sixteen years of research (see Table 6). The
second most papers did not specify product types but referred to public procure-
ment in general. The two least important product categories were works, studied
by 21.4% of papers, and goods, studied by 18% of papers. Only one paper stud-
ied land. While land was originally no product class included in this review, the
paper was relevant in that it met the inclusion criteria and therefore this extra
category was required. The fact that land was studied could indicate that PP
research is developing to a new state where topics really specific to public buying
are addressed. The time analysis in Appendix C.5.1 shows that services’ relative
importance decreased from a 61.9% level in quartile one to 42.2% in the final four
years. While the number of papers studying services steadily increased over the
four intervals, the increase was not as great as for all other product categories.
Most remarkably, the proportions for works almost tripled. Goods’ relevance for
public procurement research fluctuated over time, and the proportions of papers
researching public procurement in general without referring to particular products
slightly increased over the four quartiles.

Product type Frequency Percent

Goods 68 18.0%
Services 180 47.6%
Works 81 21.4%
Land 1 0.3%
no product specified 108 28.6%
Total 438 115.9%

Table 6: Product types 1997 - 2012

39
 Conclusively, with regard to product types the PP field evolved to a more di-
versified state: where the field was mainly dominated by services in the early
years, the proportions became more balanced in the later years. The rapid in-
crease of works’ relevance for research reflects governments’ increasing interest in
contracting-out works. As works require costly tools as well as storage place for
them, their contracting-out yields substantial savings to governments, which go
beyond employment costs.

While all countries except for France and Hong Kong addressed all product
types, the degrees with which each country’s publications researched different
product types are imbalanced (Appendix C.5.2). More importantly so, the top
sixteen publishing countries focused on different product types: each product is
the focus of at least one country. However, the overall image gathered from the
table is that indeed services were most prominent due to the fact that all countries
studied them, and the majority did so in 40% of papers and more.

The first three citation categories of 0 - 30 citations behave according to the

overall dispersion of product types (Appendix C.5.3). High impact papers that
accumulated ≥ 60.5 citations almost exclusively studied services, while goods were
only studied by one high impact paper, works were never studied and a further
one of the high impact papers did not specify a product type.

4.2.3. Industries and sectors

Public procurement research studied thirty-two different industries and sectors in

total. Nineteen of those were only studied once and were thus grouped under

40
the pooled category “other”. As the additional nineteen industries and sectors
would have added complexity while each being of no importance to PP research
at large, this category was disregarded from further analysis. Excluding these
nineteen industries, PP research focused on thirteen industries and sectors. Some
papers did not specify an industry or sector. Whenever those papers referred to
services, they were grouped under the pooled category “services, not specified”.
Whenever articles referred to either goods or did not specify a product type while
not specifying an industry or sector, they were categorized under “private sector,
not specified”. As shown in Appendix C.6.1 the categories “private sector, not
specified” and “services, not specified” were the most prominent over the sixteen
years of research. Construction was the most often studied industry, whereas the
other twelve industry and sector categories were studied far less frequently. The
education sector was the least often studied, only followed by the industries and
sectors grouped into the pooled category “other”.

As the time series analysis depicted in Figure 2 shows, the top categories,
“private sector, not specified” and “services, not specified” were most prominent
throughout all quartiles. While the construction industry was less important in
quartile one, having been studied equally often as the health sector and social
services, its importance to research increased notably by the second interval and
remained high in the following years. From quartile three on, the pooled services
category decreased in relevance, which, accompanied with the increase of the con-
struction industry, reflects the developments of the product types services and
works. The health sector had been most relevant in the first two intervals and its
proportions halved in the last two. Social services were studied most often in the

41
first quartile. The pooled industry and sector category “other” was utilized most
in the final four years. This could pose to a trend of public procurement research
opening up to more industries. Likely the industry dispersions would look very
different, if this assessment was conducted for the years after 2012.

Public procurement research’s main emphasis on one industry, construction,

shows that the field is still in its infancy. While a wide spectrum of other in-
dustries have been addressed during the past sixteen years, they remained com-

Figure 2: Industry proportions per time interval

42
paratively understudied. To increase practical relevance, research should adopt a
more balanced approach of studying all industries and sectors, which are relevant
to practice. This need is further substantiated by the fact that journals from a
wide range of fields showed an interest in PP. A further shortcoming with respect
to practical impact is the fact that the majority of papers did not specify the in-
dustrial or sectoral context. As stated earlier, contextualization is paramount for
evidence-based management.

Appendix C.6.3 shows that the three top publishers USA, UK and Australia,
as well as Sweden addressed between ten and twelve of the sixteen industry and
sector categories, while most other countries studied between four and six. None
of the countries studied all categories. Accordingly, the top publishers and Sweden
are the most diversified and show greater maturation. While the USA, UK and
Australia still show a clear preference towards the three top categories, Sweden
is equally focused on the transportation industry, which was studied by 28.6% of
its papers compared to 23.8% of the construction industry and 19% of the pooled
services and products categories. It can thus be concluded that Sweden’s approach
to the PP field is the most diversified from all countries.

Of the nine high impact papers that studied services, seven referred to services
in general and did not further specify the service industry (Appendix C.6.4). The
other two papers referred to social services. The rest two papers, of which one
did not specify the product type and the other studied goods, also did not specify
an industry or sector and were therefore grouped into the pooled category “pri-
vate sector, not specified”. This corresponds to 90% of the high impact papers

43
being unspecific about the supplying industry or sector. Since practitioners de-
mand specificity to apply research findings to their strategic decision making, it is
assumed that the high impact papers were of greater value for science than prac-
tice. In line with this argumentation, low impact papers addressed all industries
and sectors and therefore may have accumulated more citations from non-scientific
sources, such as trade magazines and books. Other researchers are encouraged to
conduct a citation analysis for the low impact papers on Google Scholar or any
comparable database that includes non-academic citations.

The decrease in relevance of other industries and sectors may be attributable to

the trend of remunicipalisation of previously privatized public services [26] [12].

4.2.4. Studied countries

Each paper studied between zero and twenty countries. Eighty-five different coun-
tries have been studied overall, which are almost twice as many as publishing
countries. While the EU is a union of states, some papers stated to have studied
the EU instead of specifying particular countries. This choice was most likely mo-
tivated by the fact that public procurement in different member states of the EU is
regulated by supranational laws and directives and therefore procurement methods
show great similarities across European countries. Appendix C.7.1 shows that over
the sixteen years, the USA, UK and Australia were the top three studied countries,
followed by European countries, as well as Canada and Hong Kong. The top three
studied countries remained consistent over the four time intervals (Appendix C.7.2
to C.7.5). When looking at the proportions per country over the complete time,
it can be seen that even the top studied countries were mostly studied by merely

44
3% or less of papers, whereas research was strongly dominated by the US and UK,
each of which have a share of around 20% of papers. It can further be observed
that the UK’s proportionate importance halved by the second interval, a trend
which was followed by the USA in the third interval. This decrease resulted from
an increase in other countries’ importance previously not studied, such as Bulgaria
and Denmark which were only studied in the fourth time interval. This develop-
ment poses a trend of detachment from focusing on few highly studied countries
to a more global perspective. This is an important development, especially since
public procurement practices are country specific, embedded in different institu-
tional contexts, and thus findings from other countries can only be applied with
great caution.

The top ten studied countries (Table 7) appear very similar to the top ten pub-
lishing countries. To investigate whether there is an association between country
of origin and studied countries, a cross tabulation was created, which confronts
publishing countries with studied countries (Appendix C.7.6). For this analysis
only the matching proportions were included in the table to enhance readability.
Further, while forty-eight different countries published research, the two papers
published by Singaporean authors did not study any specific country and there-
fore Singapore was excluded. Moreover, thirty-seven countries were studied, which
did not publish relevant research themselves. Those additional countries were ex-
cluded since they do not add information to this analysis. The cross table shows
that, in fact, researchers have focused on their home countries, or the countries
of their associated institutions. Twenty-one of the forty-seven countries studied
their home country in all their papers. It must be noted that a 100% rate for their

45
home country does not mean that the country did not study any other country,
since many papers studied more than one country. For instance, if a country only
published one relevant paper, which researched public procurement in the context
of five different countries, then each of those countries would have been studied in
100% of the country’s publications.

Studied country Frequency Percent

USA 85 22.5%
UK 77 20.4%
Australia 28 7.4%
Sweden 17 4.5%
EU 15 4.0%
Canada 12 3.2%
Italy 11 2.9%
Hong Kong 10 2.6%
Spain 10 2.6%
Finland 9 2.4%

Table 7: Top 10 Studied countries 1997 - 2012

Only seven papers studied their home country in less than 50% of papers, of
which three exclusively studied other countries. Those three countries are Colom-
bia, which studied the EU, Bosnia-Herzegovina, which studied Croatia, and Lux-
embourg, which focused on the EU. All three of these countries only published one
relevant paper. It must further be noted that each contributing author’s country
of institute was included in this analysis. The one paper published by Colombia
was published in co-authorship with six other authors, of which two are associated
with Mexico, three with Spain and one with Brazil. The three Spanish co-authors
may be the explanation why Latin American researchers would study the EU, es-
pecially after the analysis revealed that home bias is the norm. A further insight
that is gained from including each co-author’s country as an individual publisher

46
 Methodology Frequency Percent
Qualitative 234 61.9%
Quantitative 154 40.7%
Total 388 102.6%

Table 8: Methodologies 1997 - 2012

and finding that researchers are home biased is that co-authorships tend to be do-
mestic as opposed to global. In line with the annotation that public procurement
systems vary across countries, this home bias seems logical. However, the differ-
ences across countries may provide researchers invaluable insights into alternatives
and foster thinking outside the institutional box.

4.3. Predominant research designs

4.3.1. Methodologies

While it was aspired to only group each paper into either the qualitative or quan-
titative category, ten papers clearly followed a mixed approach and were therefore
categorized as applying both methods. The most frequently applied methods over-
all (Table 8) were of qualitative nature (61.9%) and they continued to stay most
important throughout the time intervals one to three (Appendix C.8.1). In the
fourth time interval, however, quantitative methods’ application almost quadru-
pled, which led to a decrease in importance of qualitative methods by almost 30%.
As a result, both methods were of almost equal importance in the final four years.

What becomes apparent from the country analysis of employed methodologies

(Appendix C.8.2) is that application of qualitative and quantitative research meth-

47
ods varied across countries. The overall tendency to prefer qualitative research is
followed by five of the sixteen countries: Australia, Canada, Sweden, UK and
especially the Netherlands, which adopted the qualitative approach in 87% of pa-
pers. Three countries preferred the quantitative methodology: Spain, Taiwan and
foremost China, which applied the quantitative approach in 94.1% of papers. For
the other eight countries adoption of both research methods is close to balanced.

All citation categories conducted qualitative analysis more often than quantita-
tive, with the exception of papers falling into the category of 30.5 - 40 citations,
which applied both methodologies equally often (Appendix C.8.3).

4.3.2. Time dimensions

As can be seen in Table 9, the majority of papers designed their research cross-
sectional and not longitudinal. This preference for the snapshot perspective stayed
relatively stable through all four quartiles, and was highest during the years 2005
to 2008, when 87.6% applied it (Appendix C.9.1). Some countries relied exclu-
sively on the snapshot perspective (Appendix C.9.2), namely Canada, Germany,
Hong Kong and Norway. Taiwan and Finland applied both time dimensions close
to equally often. None of the sixteen top publishing countries preferred the lon-
gitudinal study design. Overall, Taiwan applied this design proportionately most
often.

According to Appendix C.9.3 all citation categories mainly relied on the cross-
sectional approach and no apparent differences can be observed between low,
medium and high impact papers. The second highest citation category of 100.5

48
 Time dimension Frequency Percent
Cross-sectional 301 79.6%
Longitudinal 77 20.4%
Total 378 100.0%

Table 9: Time dimensions 1997 - 2012

to 110 citations utilized the longitudinal design in 66.7% of papers. But as the
category consists of three papers only, this cannot be interpreted as a sign of highly
cited research making a difference. According to Babbie (2006) [8], generalizations
should only be made with great caution from cross-sectional studies. Therefore,
public procurement researchers are advised to adopt the longitudinal design more
frequently to make findings meaningful to other contexts.

4.3.3. Data collection methods

As shown in Appendix C.10.1, reviews of non-academic literature have been the

most prominent data collection method over the sixteen years, utilized by 39.2%
of papers. Literature was characterized as non-academic when it pertained to non-
scientific literature, such as books, law texts, business reports, websites, manuals,
contracts and similar written sources. Interviews were utilized the second most
often. The third highest proportion of papers did not specify their data sources.
Specifying data sources makes research more transparent and enables other re-
searchers to test the findings. Accordingly, all researchers are advised to articulate
their data sources clearly to develop the PP research field to a more system-
atic science. Questionnaires were applied the fourth often, followed by secondary
analysis and reviews of academic literature. Observations, focus groups and ex-
periments were rarely utilized. The time analysis depicted in Figure 3 shows that

49
this relevance dispersion remained stable through the four time intervals (detailed
proportions can be found in Appendix C.10.2). Usage of questionnaires, however,
increased significantly: while this method was used by 7.1% of papers in the first
quartile, 23.3% of papers used them in the final four years. While interviews
remained the second most used data collection method over all intervals, their
share increased from 19% in quartile one to 30.6% in quartile four. Both academic
and non-academic literature reviews’ importance decreased over time. The three
least common collection tools observation, focus group and experiment were uti-
lized more frequently in the later time spans, which may pose to a trend of these
methods becoming more important for PP research in the upcoming years. Most
noticeably, the share of papers not specifying their data sources almost halved over
the course of years, which is hoped to be an ongoing trend towards more specificity
in PP research.

With respect to country specific differences (Appendix C.10.3), it can be ob-

served that except for Canada and Germany all countries studied non-academic
literature more frequently than academic literature for the data collection. While
usage of scientific literature may pose to a more scientific approach, high usage
of non-scientific literature can be regarded as a sign of highly practice oriented
research. Canada, Germany and France are the countries with the highest pro-
portion of unspecified data sources. Questionnaires were utilized most often in
Taiwan (64.3%). This high proportion may be reasoned in the fact that Taiwan
was also the country that adopted a longitudinal approach most often. Question-
naires conducted over several moments in time are an adequate collection tool
to assess changes in opinion over time. Overall, focus groups, observations and

50
Figure 3: Data collection methods per time interval

experiments are rarely used data collection tools. Clearly sticking out is China,
which used focus groups in 23.5% of papers, and Denmark, which conducted ob-
servations in 21.4% of papers. The USA is most diversified in its data collection
methods in that all methods have been applied by its authors. The UK is a close
follower, having applied all of the data collection methods except for experiments.
However, even these top diverse publishers show great variations in the applica-
tion of different data sources, as do all of the other top countries. It can thus be
concluded that even as researchers are beginning to utilize an increasing amount
of methods, which poses to a maturing field, this maturation is still in its infancy
as each country still has clear favorites.

51
 As shown in Appendix C.10.4, low impact papers with ≤ 20 citations applied all
collection methods, with non-academic literature reviews as the most prominent
collection tool, followed by interviews and questionnaires. While high impact pa-
pers focused on few, highly utilized sources, the low impact papers’ utilization of
the underused collection methods observation, focus group and experiment may
be attributable to the fact that low impact papers are more likely to have been
published in the later years of this review when those methods became more im-
portant. Further, low impact papers have high proportions of unspecified data
sources. Here the top impact papers made a real difference in that all of the top
ten papers cited by ≥ 60.5 articles specified their sources. While a conclusion
can only be drawn with caution due to the different category sizes, this confirms
the previously made annotation that good research is specific. All but one of
these high impact papers collected their data by means of literature reviews, both
academic and non-academic. Secondary analysis and interviews were utilized by
three of the high impact papers while the one top impact paper with 135 citations
relied exclusively on questionnaires. None of the high impact papers conducted
experiments, observations or focus groups.

Overall, the high importance of non-academic literature, as well as the survey

methods interview and questionnaire indicate that PP research has been more
practice than theory oriented. Surveys of randomly sampled populations can pro-
vide findings with higher generalizability than any other observational study [8],
which contributes to the field’s practical relevance and to what van Aken (2004)
calls design sciences: sciences directed at solving real life problems as opposed to
science for the sake of developing theories [44]. Focus groups, which have been

52
rarely used, could provide researchers a deeper understanding as they enable dis-
covery of unanticipated factors due to the rather unrestricted dynamic of group
discussions [8]. A shortcoming of survey methods is that they record self-reports,
and therefore can be biased by several factors, such as respondents’ experience
level. Podsokoff and Organ (1986) describe the main problems of self-reports to
be the consistency motif, social desirability and non-verifiability [36, pp. 533 - 535].
Non-scientific literature, too, can hold whitewashed, non-verifiable information,
such as corporate websites or business reports. Accordingly, PP researchers are
advised to keep those shortcomings in mind and to either resolve to other, more
reliable measures, such as observations, or to assess the validity of reported infor-
mation with other sources. Academic literature reviews and secondary analyses
utilize past researchers’ efforts and findings and are thereby important in devel-
oping the field to a state of proven findings and generally accepted paradigms.
The establishment of accepted research paradigms is a further indicator of mature
fields [15]. In this regard, PP researchers are advised to utilize those tools more
often.

4.3.4. Research strategies

Appendix C.11.1 shows that case studies were greatly utilized in PP research:
single case studies were the most often pursued research strategy (28.3%), and
multiple case studies were conducted the third often over the sixteen years of re-
search, in 18.8% of papers. Multiple case studies, survey research and quantitative
modelling were utilized almost equally often, each between 17.7% and 19.8%. Lit-
erature studies were conducted the second least often, by 13.2% of papers. As
the time series analysis of Figure 4 shows, literature studies used to be of greater

53
Figure 4: Research strategies per time interval

importance in the first four years of analysis. Meta-studies were conducted the
least often, both overall, as per time interval, although their share tripled until
the fourth time interval when 6.1% of papers conducted them (for a more detailed
overview of proportions per quartile, see Appendix C.11.2). Survey research and
quantitative modelling gained in relevance over the passage of the four intervals:
while both were the third important strategies pursued in the first quartile with
a share of 14.3% of papers each, they were applied the second most often in the
final four years, each by 22.8% of papers.

Although overall, literature study has been the second least applied research, it
was conducted by most of the Australian papers (Appendix C.11.3). For Canada

54
the proportions per strategy are equally spread, exceptions being that meta-studies
were never conducted and survey research in merely 5% of papers, translating to
one paper. China is noticeably specialized in quantitative modelling, applied by
52.9% of papers, which is in line with their high proportion of quantitative research
(94.1%). While also adopting survey research in 35.3% of papers and to a lesser
extent single case studies (11.8%), China’s publications disregarded literature and
meta-studies, as well as multiple case studies. Finland (20%) and the Netherlands
(17.4%) conducted meta-studies the most often, while this strategy is the least im-
portant for all other countries. Overall, survey researches are the most prominent
on a global level, having been applied by all countries, followed by single case stud-
ies (exception Hong Kong) and multiple case studies (exceptions are Taiwan and
China). Some countries’ papers applied a mix of consecutively pursued strategies.
As a result, some research strategy proportions add up to sums greater than 100%.

Looking at the proportions for the different citation categories (Appendix C.11.4)
shows that high impact papers do differ from low and medium impact papers:
none of the high impact papers with citations greater than 60 adopted three of
the top research strategies, namely case studies and quantitative modelling. In-
stead, literature- and meta-studies were most prominent with high impact papers,
which were overall the two least commonly applied strategies. Conclusively, high
impact papers utilized existing knowledge to generate new insights through syn-
thesis, while low and medium impact papers did not orientate themselves by past
research. This is in line with the earlier made annotation that literature reviews
and meta-analyses are more scientific strategies.

55
 The high prominence of case studies further supports the notion that PP re-
search is very practice oriented. Case studies are valuable in developing an un-
derstanding of one particular phenomenon or event holistically. A shortcoming of
single case studies is their generalizability to other units, as the information gath-
ered is strongly embedded in the constructs of the unit of analysis [29]. Multiple
case studies improve generalizability since findings can be compared, analyzed and
contrasted [24]. The overall low prominence of literature studies and meta-studies
shows that research findings have rarely been synthesized in the past sixteen years.
As synthesis delivers generalizable findings, PP researchers are advised to begin
applying both strategies more frequently.

4.4. Topics

4.4.1. Topics

The topics uncovered during a scoping study were included in the data extrac-
tion form and extended during the screening process. In total, the 378 reviewed
research papers addressed twenty-two sub-fields, including eleven that were only
studied once or twice and which were grouped into a pooled category entitled “oth-
ers”. Table 10 shows the overall relevance of each topic. Procurement strategies
were studied by the majority of papers, 61.4%, while the second most often stud-
ied topic, selection, was assessed by a comparatively much lower share of 17.2% of
papers. This high difference in relative share shows that public procurement re-
search was very focused on the topic of procurement strategies. PP status overview
articles assessed in an exploratory manner the procurement practices applied by
governments. What differentiates these articles from the others is that they do not
focus on one specific aspect, but provide an overview of what is current practice

56
in public procurement at large. Effects of PP, studied in 5.8% of articles, refer
to unsought effects in that the effect, negative or positive, was not intended when
designing and applying the procurement method. Intended effects, on the con-
trary, may include a positive impact on the environment after pursuing a green
strategy (GPP). Those effects will have been presented in the context of the pro-
curement strategy GPP and therefore were not included in the effects category.
Trade discrimination and anti-corruption were studied in 3.7% and 2.6% of papers
respectively. When discrimination was an unsought effect it was categorized un-
der “effects of PP”, whereas active discrimination was grouped under either trade
discrimination or anti-corruption. Although the two topics of anti-corruption and
trade discrimination are closely related, they can be viewed as the positive and
negative ends of the same line: articles grouped under trade discrimination ana-
lyze reasons and positive effects, for instance on domestic economies, for actively
discriminating against particular suppliers. Anti-corruption papers focus on the
negative effects that corrupt behaviour has, such as decreased competition.

The time series analysis depicted in Figure 5 shows that procurement strate-
gies have been the most often studied topic throughout all four time intervals,
gaining more relevance with every quartile (for a more detailed overview see Ap-
pendix C.12.1). The topic selection was most important in the first four years,
when 31% addressed this topic, making it a comparatively close follower of the top
studied topic procurement strategy, then studied by 45.2% of articles. In quartile
four, however, only 18.9% of papers studied the selection process, making the topic
still the second most important subject, yet of far less importance than procure-
ment strategies, which were then studied by 65% of papers. Overall, all topics

57
 Topic Frequency Percent
Procurement strategy 232 61.4%
Selection 65 17.2%
Contracting 53 14.0%
Make-or-buy/outsourcing 31 8.2%
PP status overview 27 7.1%
Legal aspects 26 6.9%
Supplier relations 25 6.6%
Effect of procurement 22 5.8%
Trade discrimination 14 3.7%
Anti-corruption 10 2.6%
PP tool 7 1.9%
Others 11 2.9%
Total 523 138.4%

Table 10: Topics 1997 - 2012

but procurement strategy, contracting, PP tools and anti-corruption decreased in

relative importance between the intervals one to four. The result is that in the
final interval the three top studied topics procurement strategy, selection and con-
tracting were studied in 97.8% of papers. As noted in the operationalization of
sub-question 4 in section 3.1, each paper was categorized as addressing a maximum
of two subjects. Accordingly, the sums of all topic proportions are greater than
100%.

A further table was created showing how many countries researched each topic
(Table 11). The motivation was that it was suspected that the top publishers UK
and USA and to a lesser extent Australia dominated PP research that much that
their most important topics merely appear to be of overall high relevance, while in
fact the less important publishing countries may have had very different research
foci. This suspicion was, however, not confirmed, but individual topics’ relevance

58
Figure 5: Topics per time interval

remained mostly unaffected with mere slight changes. Still, two differences be-
come apparent through this analysis: the topics of supplier relations and effect of
procurement were of medium importance in the previous analysis, while both were
the least important topics based on this analysis, each only having been studied
by seven and eight of the forty-nine countries including the category of unknown
origin.

In conclusion, PP research is highly focused on one topic: public procurement

strategies. To enable practitioners to consult scientific findings, research should
be more versatile. An explanation for the low and decreasing share of other topics
might be that many subjects are also discussed in general procurement research

59
 Topic Amount of countries
Procurement strategy (232) 40
Selection (65) 25
Make-or-buy (31) 17
Contracting (53) 17
Legal aspects (26) 14
PP status overview (27) 12
Anti-corruption (10) 9
Trade discrimination (14) 9
Others (11) 9
PP tool (7) 8
Effect of procurement (22) 8
Supplier relations (25) 7

Table 11: Topics’ global relevance 1997 - 2012

and that their similarity to the private sector may not require specialized research.
But it is believed that practitioners are confronted with more problems that could
be assessed scientifically. A dialogue between scientists and practitioners could
provide useful insights into other relevant topics.

4.4.2. Procurement strategies

The highly studied topic category “procurement strategy” was further analyzed
with regard to addressed types of strategies. In total, twenty different strategies
have been studied (Table 12). Contracting-out, and PPP were top studied strate-
gies, accounting for 32.3% and 31.9% of strategy papers. On the third rank, but
with much lower proportionate share, is the green public procurement strategy
(GPP). GPP is followed by e-procurement and innovation procurement. All other
sixteen strategies were rarely studied: while joint procurement was addressed by
five articles, followed by de-/centralization studied by three, the other strategies

60
 Procurement strategy Frequency Percent
Contracting-out 75 32.3%
PPP 74 31.9%
GPP 29 12.5%
e-Procurement 16 6.9%
Innovation procurement 12 5.2%
Joint procurement 5 2.2%
De- / centralization 3 1.3%
Lean PP 2 0.9%
Prime contracting 2 0.9%
Market-based PP 2 0.9%
Emergency contracting 2 0.9%
Mixed service delivery 2 0.9%
Early contractor involvement 1 0.4%
Shared services 1 0.4%
PP Partnerships 1 0.4%
Social procurement 1 0.4%
Eminent domain vs. purchase of land 1 0.4%
Offsets 1 0.4%
Promoting SMEs 1 0.4%
Dual sourcing 1 0.4%
Total 232 100.0%

Table 12: Procurement strategies 1997 - 2012

were only studied once or twice.

The time series analysis (Appendix C.12.2) shows that PPP continuously gained
in importance over the four time intervals, while the top studied topic of contracting-
out decreased notably in importance, from a 78.9% level in quartile one to 22.2%
in the final four years. This decrease may be attributable to many countries’ re-
municipalisation efforts. These developments led to PPP becoming the most often
studied strategy in quartile three, while in the previous eight years of research
contracting-out was most often assessed. While GPP was overall the third most

61
often studied strategy it only became important to the field in the third time inter-
val, while it was never studied in the first four years and only once in the second.
This reflects the more recent awareness that governments can foster the worldwide
efforts to lower economies’ ecological footprints. Innovation procurement, overall
the fifth important strategy, only became of relevance in the third interval, when
one paper focused on this strategy, and of importance in the final interval, when
9.4% of papers studying procurement strategies assessed the topic. This could be
a result of the global financial crisis, which weakened economies worldwide: in-
creased innovation has the potential to foster economies by increasing efficiency
in processes, and by stimulating exports of innovative products. E-procurement
and joint procurement research was published throughout the last three quartiles
with stable shares. The time series analysis further shows that, whereas each of
the other studied strategies were only studied once or twice, the total amount of
papers researching other strategies than the top six increased over time. This in-
dicates that PP research, while still being mainly focused upon few strategies, is
widening its research focus.

To investigate whether the top publishing countries influenced the importance

rankings of studied procurement strategies, Table 13 shows how many countries
studied each strategy. It can be observed that the importance rankings are mostly
the same and that the top publishing countries only influenced the previous find-
ings slightly.

62
 Procurement strategy Amount of countries
Contracting-out (75) 23
PPP (74) 20
GPP (29) 12
e-Procurement (16) 12
Innovation procurement (12) 8
Mixed service delivery (2) 4
De- / centralization (3) 3
Lean PP (2) 2
Joint procurement (5) 2
Prime contracting (2) 2
Market-based PP (2) 2
Early contractor involvement (1) 1
Shared services (1) 1
Emergency contracting (2) 1
PP Partnerships (1) 1
Social procurement (1) 1
Eminent domain vs. purchase of land (1) 1
Offsets (1) 1
Promoting SMEs (1) 1
Dual sourcing (1) 1

Table 13: Procurement strategies’ global relevance 1997 - 2012

4.4.3. Procurement tools

Table 14 shows that each of the seven papers on PP tools studied a different tool.
Accordingly, no time series analysis was conducted. It was already observed in the
time series analysis conducted on studied topics (Appendix C.12.1) that PP tools
were studied in the last three intervals with a stable share of total publications.
What can be observed from this table is that all tools are aimed at systematizing
procurement decisions by means of models that mathematically determine the best
alternative. This is believed to be reasoned in the fact that public procurement
agents are required to make rational decisions at a high level of transparency.

63
 Tool Frequency Percent
Decision technological solutions (to make procurement 1 14.3%
processes more transparent)
Data mining model 1 14.3%
Discrimination assessment tool 1 14.3%
Annuity model to assign PPP project risks 1 14.3%
Model for calculating optimal concession period 1 14.3%
Priority ranking scheme for green procurement 1 14.3%
e-Government Procurement Observatory Maturity 1 14.3%
Model (eGPO-MM)
Total 7 100.0%

Table 14: Public procurement tools 1997 - 2012

4.4.4. Procurement effects

From the articles on unsought effects of PP, effects on the economy played the
biggest role (Table 15), studied by 45.5% of papers that studied effects. The
other effects were far less important: effects on human rights and the society at
large were studied by 13.6%, effects on SMEs, as well as on PP efficiency and
the private contracting party by 9.1%, corresponding to two articles per subject.

Effect Frequency Percent

Economy 10 45.5%
Human rights, society 3 13.6%
SMEs 2 9.1%
PP efficiency 2 9.1%
Private contractor 2 9.1%
Ethics 1 4.5%
Quality 1 4.5%
Government accountability 1 4.5%
Total 22 100.0%

Table 15: Effects of public procurement 1997 - 2012

64
Finally, effects on ethics, product quality, and government accountability were only
studied once each, corresponding to 4.5%. It must be noted, though, that the topic
of government accountability was researched more often. But instead of discussing
it as an unsought effect, other papers researched it in the context of how to account
for this through contracting. As the time series analysis shows (Appendix C.12.3),
economical effects were studied in all intervals with equal importance, but with
a slight decrease in the third quartile. The high relevance of economic effects
is in line with the role that PP plays in strengthening economies. Noticeable
is that even the other low relevance effects with two or three articles had each
one article published over multiple intervals. This shows that these effects were
deemed unimportant by researchers throughout the sixteen years and were not
more important in specific intervals, as they neither can be expected to increase
in relevance in the years succeeding 2012. Still, most effects were studied in the
last two quartiles, which poses a trend of research becoming more concerned with
PP effects overall.

4.4.5. Less relevant topics

Table 16 displays the topics that were less relevant to PP research over the past
sixteen years and have only been studied by a maximum of two papers each. Those
topics were grouped under the category “others” in the previous topic analyses.
Each of the topics had little overall relevance and was therefore not further ana-
lyzed. However, future researchers may be interested in developing these sub-fields.

65
4.4.6. Study characteristics per topic

This section investigates whether the topics addressed by research show differences
in study characteristics. The pooled categories “procurement strategy”, “type of
effects” and “others” were split up for these analyses so that characteristics per
topic can be observed, which provides more insights than if the categories remained
pooled. The pooled category PP tools was not split up, since each tool was only
studied once. While these cross analyses provide insights into what is common
practice in research, the main aim is to provide other researchers interested in par-
ticular sub-fields with a clear overview of how research has been conducted in the
past and which designs may have been underused and therefore pose to potential
gaps in generalizability of findings. No time analyses were conducted for the cross
tabulations, as this would have exceeded the time and capacity limitations of this
research. However, other researchers are encouraged to use the data provided in
this work and analyze the cross tabulations regarding time trends.

Topic Frequency Percent

Purchase shocks 2 18.2%
Public versus private procurement 1 9.1%
PP cost drivers 1 9.1%
SMEs 1 9.1%
PP markets 1 9.1%
Ethics in PP 2 18.2%
Project based procurement routes 1 9.1%
Organization of PP function 1 9.1%
Critique of PP research practice 1 9.1%
Total 11 100.0%

Table 16: Other topics 1997 - 2012

66
 As shown in Appendix C.13.1, research on the top studied topics did not ad-
dress a government level in the majority of papers, the highest proportion can
be observed for research published on the subject of PPP (77%). Besides this
limitation, the top subjects were researched against all government levels, which
indicates maturation and fosters practical relevance. All but articles on legal as-
pects and trade discrimination studied the local level most frequently. From the
top topics e-procurement research studied the local level most often, in 43.8% of
papers. Legal aspects were most often assessed against the background of munic-
ipal procurements, whereas trade discrimination articles most often studied the
federal level. With the exception of trade discrimination, PPP and innovation
procurement, the federal level was least prominent with all of the top subjects.
Noticeable is that research on make-or-buy decisions and on GPP studied the fed-
eral level in only one research paper each.

With respect to studied product types (Appendix C.13.2) it can be observed

that PPP research mainly focused on the procurement of works (51.4%), and least
from all top topics on the procurement of goods (1.4%) Works were studied least
often by the topics innovation procurement (8.3%), contracting-out (4%), GPP
(6.9%), e-procurement (6.3%), trade discrimination (7.1%) and by papers on anti-
corruption, which never studied works, nor services, but instead exclusively focused
on goods (30%), while not specifying product types in 70% of papers. Research
on contracting-out studied goods proportionately least often and focused on ser-
vices in 86.7% of papers. Moreover, it was the most specific sub-field with the
lowest share of unspecified products. Innovation and green procurement are the
only topics that were mostly researched in the context of goods (66.7% and 41.4%

67
respectively).

Contracting, PPP and contracting-out were researched against thirteen of the

sixteen industry and sector categories, including the two pooled categories (Ap-
pendix C.13.3). As the other top studied topics were researched against less
backgrounds, those three sub-fields can be regarded as the most developed. E-
procurement was only researched against three categories, namely the pooled cat-
egories, as well as one paper against SMEs. This finding indicates that research
on this sub-field is very limited, as well as unspecific with respect to industrial and
sectoral context and needs to be approached against more diverse industry and
sector contexts.

4.4.7. Research designs per topic

Whereas according to the analysis on methodologies employed (section 4.3.1), qual-

itative research was most common, the juxtaposition displayed in Appendix C.14.1
shows that the approach taken is strongly dependent on research topic: for instance
71% of the thirty-one papers on make-or-buy decisions applied the quantitative
method. Given that make-or-buy decisions are to a large extent of an economic
kind, this distribution appears logical. The distribution is similar for papers on the
topic of selection. Here, too, decisions are often characterized by economic assess-
ments of the best supplier or partner. According to Babbie (2006), quantification
makes findings more “explicit” [8, p. 23], while also fostering syntheses, thus the
comparison and pooling with other findings. It is, however, believed that research
on these two sub-fields of PP could gain from employing both methodologies more
equally, since this will yield a more complete understanding of phenomena. Op-

68
posed to this, researches on the topic of e-procurement have almost equally applied
both the qualitative and quantitative research methods.

For the cross tabulation time dimensions per topic (Appendix C.14.2) the pic-
ture is clearer in that most topics studied by more than two papers show a clear
favoritism towards cross-sectional research. Papers on the topic of e-procurement
exclusively relied on the snapshot perspective. Both time dimensions were applied
almost equally often by papers on the topic of innovation procurement, PP status
overview and trade discrimination. These topics can accordingly be regarded as
most developed with respect to the time perspective.

With respect to data sources, Appendix C.14.2 shows that the top topics utilized
close to all data collection methods, although with differing proportions. Legal as-
pects rarely utilized the overall very prominent survey methods: 3.8% of its papers
report findings of questionnaires and 7.7% of interviews. Instead, 69.2% of papers
on the topic reviewed non-academic literature. This high proportion is attributed
to the study of law texts and directives, which informed those researches. We
believe that this sub-field could gain interesting insights from practitioners’ expe-
riences with legal directives and frameworks. Neglecting personal experiences may
otherwise result in research of little or detrimental practical relevance.

Seven of the fifteen top studied topics utilized all research strategies (Appendix
C.14.2), namely make-or-buy, selection, contracting, legal aspects, PPP, innovation
procurement and contracting-out. Although the proportionate share per strategy
varies per subject, this is an indication of maturing sub-fields. Most of the other top

69
topics applied five of the strategies, the only exception being e-procurement, which
used only half of them. This finding reinforces the previously made observation
that research on e-procurement is still very underdeveloped and needs to adopt a
more versatile perspective.

4.4.8. High impact papers per topic

Appendix C.15 holds tables per research topic listing all papers that addressed
the topic descending by mean citations. These tables are especially addressed at
researchers of the different sub-fields of public procurement research to enable them
to quickly detect the most influential papers. A shortcoming of citation analysis is
that recent papers have had less time to accumulate citations. However, one paper
from 2010 is still the 21st most often cited paper overall, and the third most cited
article in its research sub-field. Therefore, it is believed that while acknowledging
the discrimination against recent papers, research with high relevance to science
will have gathered notable citations in the past least one year (status March 2014).
The citation analysis is based on mean scores of the Scopus and Web of Science
citation counts. We included both databases’ citation counts as citations differ
per database and therefore reliance on only one source may over- or undervalue
individual papers. A mean citation count is believed to provide a more realistic
assessment of each paper’s scientific impact. Also, not every paper is enlisted
in both databases, therefore considering only one of them could mean that some
papers could not be assigned an impact assessor although they may be of value to
research. One paper, for instance, was not listed in the Web of Science database
but accumulated a citation count of 55 in Scopus, making it the eleventh most
cited paper overall and the third important research publication on the highly

70
studied topic of PPP. The citations were extracted from the databases Scopus and
Web of Science on the 15th and 16th of March, 2014. In case a paper was not listed
in one of the databases the cell for this database was left blank for the article and
the mean citation count was set equal to the citations of the database holding
the article. A zero means that the article was listed in the database but did not
receive any citations, in which case the mean citation count was the mean of both
databases. Each paper was categorized as addressing at least one and a maximum
of three research topics. Accordingly, many papers will be included in more than
one subject table.

5. Review limitations

A limitation of this review is that the categorizations of all included articles were
done by the main author alone. Next to the relevance assessments, which were
mostly conducted in a team, the data extraction stage is crucial to the validity
of findings and their correct representation of the field. As this limitation was
known at the beginning of the research project, this paper aimed at making the
review process highly transparent to enable other researchers to test the findings.
While replication is both personally desired, it is also necessary to make this work
relevant to PP research. Since numerous interesting findings were discovered, it is
considered to be a loss, if they were never published.

A further limitation regards the exclusion of articles published in other languages

than English. Egger et al. (1997) found that for medical sciences researches were
more likely to be translated in English, if they found significant results [23]. This
limitation both negatively affects findings from any further syntheses conducted

71
on sub-fields on the basis of this review, as it also bears the possibility that more
topics have been addressed by research than have been reported in this review.

Restricting the search for relevant papers to only two databases may have omit-
ted relevant papers, since even the renowned databases Scopus and Web of Science
do not hold all relevant articles. This apprehension was confirmed by the fact that
ten years of publications from the Journal of Public Procurement were missed be-
cause the journal was rejected by Thomson Reuters, and only accepted by Scopus
in 2012.

Grey literature, which is advised to be included in systematic literature reviews,

was disregarded. Given that this review, too, will become grey literature, ex-
emplifies the kind of information that might have been missed out by excluding
unpublished literature and books. Moreover, including only published articles in
this review may bias future researchers’ efforts in synthesizing findings of sub-fields
on the basis of the articles provided in this review, since according to Davies (2000)
the publication bias may negatively affect validity of findings as journals tend to
favour publishing positive results [18].

6. Directions for future research

During analysis, an ever increasing amount of interesting research questions be-

came apparent. But the research frame of this review had been formulated before-
hand and there was a limitation as to what can be achieved within a limited time
period. It is believed that the data provided in this review provides a valuable
source for further investigations and the authors would be glad, if other researchers

72
utilized them in that way. Some suggestions for future research are presented here.

To address this review’s limitations, other researchers are encouraged to repli-

cate the work, either partially or in full, to validate the discovered findings. Full
replications should take account of the limitations of this review such as conduct-
ing it alone and restricting it to published, English articles, listed in two databases
with quality requirements, which may be too strict for a field that is still in its
infancy.

As was shown by the fact that meta-studies, as well as literature reviews of

scientific literature were rarely utilized in PP research, researchers are strongly en-
couraged to begin to apply those measures more often, since synthesis of existing
knowledge fosters maturation and enables development of definite findings.

While this review has provided a detailed overview of researched topics and the
designs applied to study them, researchers should take these findings into account
when designing upcoming studies. To increase versatility and increase generaliz-
ability of findings, subjects should be assessed against different backgrounds and
by different means. As shown in the topic analyses, increase in versatility is espe-
cially needed for research on e-procurement, which was approached highly limited
in the past.

A general note to researchers is to make their studies more transparent by defin-

ing employed methodologies, such as data sources, explicitly. Moreover, as the
prevailing lack of context with regard to government levels, product types, as well

73
as industries and sectors hampers both practical relevance, as scientific assessment
of reasons for contradicting findings, researchers should place their works against
clear contextual backgrounds.

While this systematic literature review concentrated upon cross-country differ-

ences, it would be interesting to detect most active institutions on the field, as
well as inter-institutional collaborations.

The high amount of 199 individual journals publishing relevant research may
be analyzed with regard to most prominent backgrounds to detect which scientific
fields are the main stakeholders of PP research.

This review does not include an analysis of most relevant topics per publishing
country. Since public procurement practices are embedded in local system con-
texts, such analyses may provide interesting insights as to how PP focuses differ
globally.

The citation analysis conducted in this review was limited to citations of Scopus
and Web of Science. As PP is very practice oriented, it is likely that paper im-
pacts differ when non-scientific citations are included. Such analysis could provide
valuable insights into the potential differences in topics’ relevance to practitioners.
Potentially observed differences could then inform future research topics, which
would both make the field more diverse, as it would also increase practical rele-
vance.

74
 Finally, replication of this review in a few years time is encouraged to assess how
the field developed after 2012. Since recent trends have been observed, such as
the study of more diverse industries and sectors in the later time intervals, and an
increasing relevance of European publishers, the research field may appear quite
different in the years after 2012.

7. Summary and conclusion

This review analyzed the status of public procurement research and how it devel-
oped globally between the years 1997 and 2012. We found that the relevance of
the field, assessed by annual publications, increased significantly over the years, a
raise which began in 2003. High individual authors, who only published one or
two articles, as well as the fact that 199 different journals were the publishers of
the 378 articles included in this review, highlight that public procurement is no
isolated research field, but instead highly cross-disciplinary.

Forty-eight countries published relevant articles, while eighty-five were studied.

While this poses to variation, our analyses revealed that most influential countries,
both publishing as - due to a strong home bias of researchers - studied, are mainly
the USA and UK, while all other countries have very low relative shares. Yet, the
importance of the top publishers decreased greatly, as more countries entered the
field over the course of time. Especially European countries have rapidly increased
their research activities in the later years. If this trend is continued, they could
become more knowledgeable on the field and PP research could mature to a state
where phenomena are studied against more versatile backgrounds.

75
 PP research is highly practice oriented, which manifests itself both through em-
ployed research strategies, which were mostly case studies and survey researches,
as through utilized data sources, of which reviews of non-academic literature, and
survey methods were most prominent. Shortcomings of these trends refer, para-
doxically, to practical relevance as all those measures have limited reliability and
their findings are difficult to generalize. The mostly neglected measures to pool
findings (meta-analyses) or apply them to further analyses (literature studies)
disable the field from deriving at definite findings, which can be applied by prac-
titioners. What further inhibits practical application is that research was very
unspecific with respect to context variables: 56.1% of papers did not specify a
government level, 28.6% no product, and 60.6% of articles were grouped into the
pooled categories of unspecified industries and sectors from which the public pro-
cures. Moreover, 20.6% of papers did not specify their data sources, which poses
to dubious scientificity as findings cannot be verified by others.

The field addressed a wide range of twenty-two different topics. However, topics
have been addressed by uneven proportions of papers: while the top studied topic
of procurement strategies was studied in 61.4% of papers, the second most promi-
nent topic, selection, was merely studied by 17.2% of the articles. Even more so,
other topics’ relevance decreased over time, while procurement strategies’ contin-
ued to grow. Further, of the twenty different procurement strategies addressed,
research mainly focused on contracting-out and PPP, which combined were stud-
ied in 64.2% of strategy papers. This apparent, yet fallacious, versatility was also
observed for studied industrial and sectoral contexts: while thirty-two different

76
industries and sectors were studied, research mainly focused on the construction
industry, studied in 20.6% of papers, while the second most often studied sector,
the health sector, was only studied by 6.9%.

The review concentrated on discovering prominent research designs and study

characteristics. Overall, services were the most often studied product type, al-
though over time their proportionate relevance decreased as particularly works
became increasingly popular. The most frequently studied government level is
the local one. Over the sixteen years, the municipal level was researched increas-
ingly more often, while the federal level slightly decreased in scientific relevance.
Whereas during the years 1997 and 2008 the majority of articles conducted quan-
titative research, qualitative methods gained more attention in the final four years,
resulting in both methodologies being applied almost equally often. This achieved
status is a sign of maturity in that no method is under- nor overused. With respect
to time dimension it was shown that PP research was focused on cross-sectional
research, which inhibits generalizability of findings [8]. While on the global level
overall favorites per research variable could be detected, cross-country, as well as
cross-topic comparisons showed great variations.

High impact papers did not show noticeably differences to low impact papers
with respect to contextual imprecision. A noticeable distinctiveness observed is
that while low and medium impact papers focused on the more practice oriented
research strategies of case studies and survey research, while mostly neglecting
literature studies and meta-studies, the high impact papers exclusively relied on
the latter strategies as well as on survey research. This shows that high impact

77
research utilized existing, scientific knowledge, which is important in developing
the PP field to maturity.

The overall conclusion with respect to the maturity level of PP research is that
while various different paths have been laid, researchers continued to walk the
main roads. To develop the field further, researchers are strongly advised to re-
search the field from more diverse angles. The data provided in this review can
provide them with the needed information as to which designs have been under-
used until today. Moreover, scientists should synthesize past findings for the sake
of deriving at definite conclusions. Only when research findings are tested against
various backgrounds and when past findings are validated, can definite findings be
developed, which can eventually be consulted by practitioners.

78
A. Documentation of search process

Date of search Database Search terms Results

24.03.2013 Scopus public procurement 655
24.04.2013 Scopus public purchasing 335
24.04.2013 Scopus public contracting 238
24.04.2013 Scopus public buying 60
24.04.2013 Scopus public commissioning 44
24.04.2013 Scopus government procurement 360
24.04.2013 Scopus government purchasing 201
24.04.2013 Scopus government contracting 183
24.04.2013 Scopus government buying 25
24.04.2013 Scopus government commissioning 19
Sub-total 2,120
24.03.2013 Web of Science public procurement 362
24.04.2013 Web of Science public purchasing 197
24.04.2013 Web of Science public contracting 609
24.04.2013 Web of Science public buying 91
24.04.2013 Web of Science public commissioning 339
24.04.2013 Web of Science government procurement 196
24.04.2013 Web of Science government purchasing 224
24.04.2013 Web of Science government contracting 518
24.04.2013 Web of Science government buying 55
24.04.2013 Web of Science government commissioning 400
Sub-total 2,991
Total 5,111

v
B. Classification scheme

General information Literature review, non- De-/centralization

Title academic Public procurement part-
Publication year Focus group nerships
Journal None specified Social procurement
Citations Web of Science, Eminent domain vs. pur-
Scopus chase of land
Author(s) Topic Mixed service delivery
Publishing country/ies Supplier relations Offsets
Studied country/ies Make-or-buy Promoting small and
Selection medium enterprises
Contracting (SMEs)
Time dimension Legal aspect
Cross-sectional Dual sourcing
Procurement strategy
Longitudinal Procurement tool
- Type of tool (uncoded) Topic: PP effects
Type of product Effect(s) of procurement Economy
Good Anti-corruption Human rights, society
Service Trade discrimination SMEs
Work PP status overview Ethics
Land Other Procurement efficiency
None specified Private contractor
Quality
Topic: Procurement Government accountabil-
Research strategy strategy ity
Survey research Public Private Partner-
Literature study ships
Meta-study Government level
Innovation procurement Governmental
Single case study Contracting-out
Multiple case study Municipal
Green public procurement Local
Quantitative modelling e-procurement None specified
Early contractor involve-
Data collection ment
Questionnaire Lean procurement Data analysis
Interview Shares services Qualitative
Secondary analysis Joint procurement Quantitative
Experiment Prime contracting
Observation Market-based procure- Industry / sector
Literature review, aca- ment Construction
demic Emergency contracting ICT

vi
Health Social services Private sector, not speci-
Education Child welfare fied
Defence Transportation Waste collection, disposal,
Facility services Small and Medium enter- recycling
Professional services prises (SMEs) Other
Manufacturing Services, not specified

vii
 Authorship 1997 - 2000 2001 - 2004 2005 - 2008 2009 - 2012
Freq. Percent Freq. Percent Freq. Percent Freq. Percent
Single author 20 47.6% 25 42.4% 38 39.2% 48 26.7%
Two authors 15 35.7% 26 44.1% 35 36.1% 75 41.7%
Three authors 6 14.3% 6 10.2% 15 15.5% 39 21.7%
Four authors 1 2.4% 1 1.7% 7 7.2% 15 8.3%
Five authors 1 1.7% 1 1.0% 2 1.1%
Six authors 1 0.6%
C. Analysis

Seven authors 1 1.0%

C.1. Authorships

Total 42 100.0% 59 100.0% 97 100.0% 180 100.0%

C.1.1. Authorships four time intervals

viii
C.1.2. Most active authors

Author Publications
Potoski, M 7
Brown, TL 7
Warner, ME 6
Chan, APC 6
Hefetz, A 5
Cheung E. 5
Van Slyke, DM 4
Rolfstam, M 4
Preuss, L 4
Lember, V 4
Kajewski S. 4
Hartley K. 4
Vaidya K. 3
Reeves E. 3
Parikka-Alhola, K 3
Murray J.G. 3
McCue, CP 3
Loader, K 3
Johnston, JM 3
Walker H. 3
Davis, G 3

ix
C.2. Journals
C.2.1. Journal publications 1997 - 2012

Journal Publications Percent

Journal of Purchasing and Supply 14 3.7%
Management
Public Administration 11 2.9%
Public Administration Review 11 2.9%
Australian Journal of Public Adminis- 10 2.6%
tration
International Journal of Public Sector 10 2.6%
Management
Journal Of Construction Engineering 10 2.6%
And Management
International Journal of Industrial Or- 8 2.1%
ganization
Journal of Public Procurement 8 2.1%
Public Money & Management 8 2.1%
International Journal of Project Man- 6 1.6%
agement
Transportation Research Record 6 1.6%
Administration & Society 5 1.3%
Journal of Public Administration Re- 5 1.3%
search and Theory
Local Government Studies 5 1.3%
Public Administration and Develop- 5 1.3%
ment
Review of Industrial Organization 5 1.3%
Building Research & Information 4 1.1%
Construction Management and Eco- 4 1.1%
nomics
International Review of Administrative 4 1.1%
Sciences
Journal of Business Ethics 4 1.1%
The American Review of Public Ad- 4 1.1%
ministration
Environment and Planning C: Govern- 3 0.8%
ment and Policy
Government Information Quarterly 3 0.8%
Health policy 3 0.8%
International Public Management 3 0.8%
Journal
Journal of Management in Engineering 3 0.8%
Journal of Professional Issues in Engi- 3 0.8%
neering Education and Practice
Natural Resources Forum 3 0.8%
Continued on next page

x
Journal publications 1997 - 2012 – continued from previous page
Journal Publications Percent
Public Management Review 3 0.8%
Public Performance & Management 3 0.8%
Review
Research Policy 3 0.8%
The Economic Journal 3 0.8%
Transportation Research Part A 3 0.8%
Administrative Law Review 2 0.5%
American Behavioral Scientist 2 0.5%
Annals of Public and Cooperative Eco- 2 0.5%
nomics
Business Strategy and the Environ- 2 0.5%
ment
Canadian Journal of Civil Engineering 2 0.5%
Canadian Public Administration 2 0.5%
Children and Youth Services Review 2 0.5%
Decision Support Systems 2 0.5%
Defence and Peace Economics 2 0.5%
Ecological Economics 2 0.5%
Economic Affairs 2 0.5%
European Journal of Operational Re- 2 0.5%
search
European Journal of Political Economy 2 0.5%
European Planning Studies 2 0.5%
Expert Systems with Applications 2 0.5%
Governance 2 0.5%
Halduskultuur - Administrative Cul- 2 0.5%
ture
Innovation: The European Journal of 2 0.5%
Social Science Research
International Journal of Production 2 0.5%
Economics
International Journal Of Strategic 2 0.5%
Property Management
Journal of Cleaner Production 2 0.5%
Journal of Economic Surveys 2 0.5%
Journal of Public Child Welfare 2 0.5%
Journal of Public Economics 2 0.5%
Lecture Notes in Computer Science 2 0.5%
Public Choice 2 0.5%
Regional Studies 2 0.5%
Supply Chain Management: An Inter- 2 0.5%
national Journal
The Journal of Industrial Economics 2 0.5%
Clinical Therapeutics 1 0.3%
Common Market Law review 1 0.3%
Continued on next page

xi
Journal publications 1997 - 2012 – continued from previous page
Journal Publications Percent
Computer Law and Security Review: 1 0.3%
The International Journal of Technol-
ogy and Practice
Contemporary Economic Policy 1 0.3%
Corporate Social Responsibility and 1 0.3%
Environmental Management
Decision Analysis 1 0.3%
Disaster Prevention Management 1 0.3%
Economic Development and Cultural 1 0.3%
Change
Economic Development Quarterly 1 0.3%
Economics Letters 1 0.3%
Electronic Library 1 0.3%
Energy 1 0.3%
Energy Economics 1 0.3%
Energy Policy 1 0.3%
Engineering, Construction and Archi- 1 0.3%
tectural Management
ERA Forum 1 0.3%
European Economic Review 1 0.3%
European Journal of Industrial Engi- 1 0.3%
neering
European Journal Of Information Sys- 1 0.3%
tems
European Law Journal 1 0.3%
European Management Journal 1 0.3%
Europhysics Letters 1 0.3%
Fiscal Studies 1 0.3%
Forest Science 1 0.3%
Gazi University Journal of Science 1 0.3%
Health Economics 1 0.3%
Health Information & Libraries Journal 1 0.3%
Healthcare management Forum 1 0.3%
Human resources for health 1 0.3%
ICE Civil Engineering 1 0.3%
Industrial and Corporate Change 1 0.3%
Industrial Marketing Management 1 0.3%
Industrial Relations 1 0.3%
Int. J. of Business Information Systems 1 0.3%
Int. J. of Technology Management 1 0.3%
International Advances in Economic 1 0.3%
Research
International Game Theory Review 1 0.3%
International Journal of Constitutional 1 0.3%
Law
International Journal Of Health Care 1 0.3%
Finance & Economics
Continued on next page

xii
Journal publications 1997 - 2012 – continued from previous page
Journal Publications Percent
International Journal of Operations 1 0.3%
and Production
Oxford Review of Economic Policy 1 0.3%
Policy Studies Journal 1 0.3%
Proceedings of the Institution of Civil 1 0.3%
Engineers: Engineering Sustainability,
Proceedings of the Institution of Mech- 1 0.3%
nical Engineers Part F: Journal of Rail
and Rapid Transit
Public Finance Review 1 0.3%
Public Organization Review 1 0.3%
Regional Science And Urban Eco- 1 0.3%
nomics
Regulation & Governance 1 0.3%
Review Of Central And East European 1 0.3%
Law
Review of Economic Design 1 0.3%
Review of European Community & In- 1 0.3%
ternational Environmental Law
Science and Public Policy 1 0.3%
Social Policy and Administration 1 0.3%
Social Science & Medicine 1 0.3%
Society and Economy 1 0.3%
Structural Survey 1 0.3%
Technovation 1 0.3%
Telecommunications Policy 1 0.3%
The American Economic Review 1 0.3%
The American Journal of Comparative 1 0.3%
Law
The China Nonprofit Review 1 0.3%
The Economic and Labour Relations 1 0.3%
Review
The Electronic Journal on Information 1 0.3%
Systems in Developing Countries
The International Journal of Life Cycle 1 0.3%
Assessment
The Journal of Federalism 1 0.3%
The Journal of Law and Economics 1 0.3%
The Quarterly Journal of Economics 1 0.3%
The Review of Economics and Statis- 1 0.3%
tics
The Service Industries Journal 1 0.3%
Transport 1 0.3%
Transport Policy 1 0.3%
Transport Reviews 1 0.3%
Transportation 1 0.3%
Continued on next page

xiii
Journal publications 1997 - 2012 – continued from previous page
Journal Publications Percent
Transportation Research Part B 1 0.3%
Urban Forestry & Urban Greening 1 0.3%
Urban Studies 1 0.3%
Utilities Policy 1 0.3%
World Economy 1 0.3%
World Trade Review 1 0.3%
International Journal of Productivity 1 0.3%
and Performance Management
International Journal of Public Admin- 1 0.3%
istration
International Journal of Public Policy 1 0.3%
International Journal of Services Tech- 1 0.3%
nology and Management
International Journal of Software Engi- 1 0.3%
neering and Knowledge Engineering
International Journal of Value Chain 1 0.3%
Management
International Tax and Public Finance 1 0.3%
Jordan Journal of Pharmaceutical Sci- 1 0.3%
ences
Journal of Applied Business Research 1 0.3%
Journal of Applied Economics 1 0.3%
Journal of Balkan and Near Eastern 1 0.3%
Studies
Journal of Civil Engineering and Man- 1 0.3%
agement
Journal Of Cleaner Production 1 0.3%
Journal of Competition Law and Eco- 1 0.3%
nomics
Journal of Development Economics 1 0.3%
Journal of Enterprise Information Man- 1 0.3%
agement
Journal of Environmental Law 1 0.3%
Journal of Environmental Management 1 0.3%
Journal Of Environmental Planning 1 0.3%
And Management
Journal of European Social Policy 1 0.3%
Journal of Infrastructure Systems 1 0.3%
Journal of Integrative Environmental 1 0.3%
Sciences
Journal of Oublic Health Management 1 0.3%
and Practice
Journal of Planning Education and Re- 1 0.3%
search
Journal of Policy Analysis and Manage- 1 0.3%
ment
Continued on next page

xiv
Journal publications 1997 - 2012 – continued from previous page
Journal Publications Percent
Journal Of Policy Modeling 1 0.3%
Journal of Property Investment & Fi- 1 0.3%
nance
Journal of Public Economic Theory 1 0.3%
Journal of Public Policy 1 0.3%
Journal of the American Planning As- 1 0.3%
sociation
Journal of the Operational Research 1 0.3%
Society
Journal of Transport Geography 1 0.3%
Lecture Notes in Artificial Intelligence 1 0.3%
Mediterranean Politics 1 0.3%
Milbank Quarterly 1 0.3%
Military Medicine 1 0.3%
Municipal Engineer 1 0.3%
Nonprofit Management and Leadership 1 0.3%
Open Economies Review 1 0.3%
Oxford Economic Papers 1 0.3%
Abacus 1 0.3%
Accounting Auditing & Accountability 1 0.3%
Journal
Acta Politica 1 0.3%
Administration and Policy in Mental 1 0.3%
Health and Mental Health Services Re-
search
Administration in Social Work 1 0.3%
American Journal of Preventive 1 0.3%
Medicine
Architectural engineering and design 1 0.3%
management
Asian Journal of Information Technol- 1 0.3%
ogy
Atlantic Economic Journal 1 0.3%
Australian Accounting Review 1 0.3%
Australian Economic History Review 1 0.3%
Australian Economic Papers 1 0.3%
B E Journal Of Theoretical Economics 1 0.3%
British Food Journal 1 0.3%
Business & Politics 1 0.3%
Canadian Public Policy 1 0.3%
Civil Engineering Special Issue 1 0.3%
Climate Policy 1 0.3%
Total 378 100.0%

xv
C.2.2. Journal publications time interval 1

Journal Publications Percent

Australian Journal of Public Adminis- 4 9.5%
tration
International Journal of Public Sector 3 7.1%
Management
Administrative Law Review 2 4.8%
American Behavioral Scientist 2 4.8%
Defence and Peace Economics 2 4.8%
Local Government Studies 2 4.8%
Public Administration 2 4.8%
Public Administration and Develop- 2 4.8%
ment
Public Money & Management 2 4.8%
Regional Studies 2 4.8%
Transportation Research Record 2 4.8%
Administration and Policy in Mental 1 2.4%
Health and Mental Health Services Re-
search
American Journal of Preventive 1 2.4%
Medicine
Australian Economic History Review 1 2.4%
Building Research & Information 1 2.4%
Decision Support Systems 1 2.4%
Governance 1 2.4%
Health policy 1 2.4%
International Advances in Economic 1 2.4%
Research
International Journal of Industrial Or- 1 2.4%
ganization
Journal of Business Ethics 1 2.4%
Journal of Public Economics 1 2.4%
Journal of Purchasing and Supply 1 2.4%
Management
Military Medicine 1 2.4%
Oxford Review of Economic Policy 1 2.4%
Proceedings of the Institution of Mech- 1 2.4%
nical Engineers Part F: Journal of Rail
and Rapid Transit
Public Administration Review 1 2.4%
World Economy 1 2.4%
Total 42 100.0%

xvi
C.2.3. Journal publications time interval 2

Journal Publications Percent

Journal Of Construction Engineering 4 6.8%
And Management
Building Research & Information 3 5.1%
Public Administration 3 5.1%
Public Administration Review 3 5.1%
Administration & Society 2 3.4%
International Review of Administrative 2 3.4%
Sciences
Journal of Public Administration Re- 2 3.4%
search and Theory
Journal of Purchasing and Supply 2 3.4%
Management
Public Administration and Develop- 2 3.4%
ment
Administration in Social Work 1 1.7%
Annals of Public and Cooperative Eco- 1 1.7%
nomics
Australian Journal of Public Adminis- 1 1.7%
tration
Canadian Journal of Civil Engineering 1 1.7%
Canadian Public Administration 1 1.7%
Canadian Public Policy 1 1.7%
Children and Youth Services Review 1 1.7%
Construction Management and Eco- 1 1.7%
nomics
Economic Development and Cultural 1 1.7%
Change
Electronic Library 1 1.7%
Environment and Planning C: Govern- 1 1.7%
ment and Policy
European Economic Review 1 1.7%
Expert Systems with Applications 1 1.7%
Fiscal Studies 1 1.7%
Government Information Quarterly 1 1.7%
Health Economics 1 1.7%
Health policy 1 1.7%
ICE Civil Engineering 1 1.7%
Industrial and Corporate Change 1 1.7%
Industrial Relations 1 1.7%
International Journal of Production 1 1.7%
Economics
International Journal of Public Sector 1 1.7%
Management
International Tax and Public Finance 1 1.7%
Continued on next page

xvii
Journal publications time interval 2 – continued from previous page
Journal Publications Percent
Journal of Environmental Law 1 1.7%
Journal of European Social Policy 1 1.7%
Journal of Oublic Health Management 1 1.7%
and Practice
Journal Of Policy Modeling 1 1.7%
Lecture Notes in Computer Science 1 1.7%
Milbank Quarterly 1 1.7%
Natural Resources Forum 1 1.7%
Policy Studies Journal 1 1.7%
Regional Science And Urban Eco- 1 1.7%
nomics
Review of Economic Design 1 1.7%
The American Review of Public Ad- 1 1.7%
ministration
The Economic Journal 1 1.7%
The Journal of Federalism 1 1.7%
Total 59 100.0%

xviii
C.2.4. Journal publications time interval 3

Journal Publications Percent

Journal of Purchasing and Supply 7 7.2%
Management
International Journal of Project Man- 5 5.2%
agement
Public Administration 5 5.2%
Public Administration Review 4 4.1%
Journal Of Construction Engineering 3 3.1%
And Management
Journal of Professional Issues in Engi- 3 3.1%
neering Education and Practice
Australian Journal of Public Adminis- 2 2.1%
tration
International Journal of Industrial Or- 2 2.1%
ganization
International Journal of Public Sector 2 2.1%
Management
International Public Management 2 2.1%
Journal
International Review of Administrative 2 2.1%
Sciences
Journal of Business Ethics 2 2.1%
Journal of Cleaner Production 2 2.1%
Journal of Economic Surveys 2 2.1%
Journal of Public Administration Re- 2 2.1%
search and Theory
Public Money & Management 2 2.1%
The American Review of Public Ad- 2 2.1%
ministration
Administration & Society 1 1.0%
Annals of Public and Cooperative Eco- 1 1.0%
nomics
Australian Accounting Review 1 1.0%
Business Strategy and the Environ- 1 1.0%
ment
Canadian Journal of Civil Engineering 1 1.0%
Canadian Public Administration 1 1.0%
Children and Youth Services Review 1 1.0%
Climate Policy 1 1.0%
Common Market Law review 1 1.0%
Construction Management and Eco- 1 1.0%
nomics
Corporate Social Responsibility and 1 1.0%
Environmental Management
Continued on next page

xix
Journal publications time interval 3 – continued from previous page
Journal Publications Percent
Energy Policy 1 1.0%
European Journal Of Information Sys- 1 1.0%
tems
European Journal of Political Economy 1 1.0%
European Management Journal 1 1.0%
Government Information Quarterly 1 1.0%
Health Information & Libraries Journal 1 1.0%
Healthcare management Forum 1 1.0%
International Game Theory Review 1 1.0%
International Journal of Constitutional 1 1.0%
Law
International Journal of Operations 1 1.0%
and Production
International Journal of Productivity 1 1.0%
and Performance Management
International Journal of Value Chain 1 1.0%
Management
Journal of Applied Economics 1 1.0%
Journal Of Cleaner Production 1 1.0%
Journal Of Environmental Planning 1 1.0%
And Management
Journal of Management in Engineering 1 1.0%
Journal of Planning Education and Re- 1 1.0%
search
Journal of Policy Analysis and Manage- 1 1.0%
ment
Journal of Public Economic Theory 1 1.0%
Journal of Public Policy 1 1.0%
Lecture Notes in Artificial Intelligence 1 1.0%
Lecture Notes in Computer Science 1 1.0%
Local Government Studies 1 1.0%
Municipal Engineer 1 1.0%
Natural Resources Forum 1 1.0%
Public Choice 1 1.0%
Public Management Review 1 1.0%
Public Organization Review 1 1.0%
Research Policy 1 1.0%
Social Science & Medicine 1 1.0%
Technovation 1 1.0%
The Economic Journal 1 1.0%
The International Journal of Life Cycle 1 1.0%
Assessment
The Journal of Industrial Economics 1 1.0%
Transport Policy 1 1.0%
Transportation Research Part A 1 1.0%
Transportation Research Record 1 1.0%
Continued on next page

xx
Journal publications time interval 3 – continued from previous page
Journal Publications Percent
Total 97 100.0%

xxi
C.2.5. Journal publications time interval 4

Journal Publications Percent

Journal of Public Procurement 8 4.4%
International Journal of Industrial Or- 5 2.8%
ganization
Review of Industrial Organization 5 2.8%
International Journal of Public Sector 4 2.2%
Management
Journal of Purchasing and Supply 4 2.2%
Management
Public Money & Management 4 2.2%
Australian Journal of Public Adminis- 3 1.7%
tration
Journal Of Construction Engineering 3 1.7%
And Management
Public Administration Review 3 1.7%
Public Performance & Management 3 1.7%
Review
Transportation Research Record 3 1.7%
Administration & Society 2 1.1%
Construction Management and Eco- 2 1.1%
nomics
Ecological Economics 2 1.1%
Economic Affairs 2 1.1%
Environment and Planning C: Govern- 2 1.1%
ment and Policy
European Journal of Operational Re- 2 1.1%
search
European Planning Studies 2 1.1%
Halduskultuur - Administrative Cul- 2 1.1%
ture
Innovation: The European Journal of 2 1.1%
Social Science Research
International Journal Of Strategic 2 1.1%
Property Management
Journal of Management in Engineering 2 1.1%
Journal of Public Child Welfare 2 1.1%
Local Government Studies 2 1.1%
Public Management Review 2 1.1%
Research Policy 2 1.1%
Supply Chain Management: An Inter- 2 1.1%
national Journal
Transportation Research Part A 2 1.1%
Abacus 1 0.6%
Accounting Auditing & Accountability 1 0.6%
Journal
Continued on next page

xxii
Journal publications time interval 4 – continued from previous page
Journal Publications Percent
Acta Politica 1 0.6%
Architectural engineering and design 1 0.6%
management
Asian Journal of Information Technol- 1 0.6%
ogy
Atlantic Economic Journal 1 0.6%
Australian Economic Papers 1 0.6%
B E Journal Of Theoretical Economics 1 0.6%
British Food Journal 1 0.6%
Business & Politics 1 0.6%
Business Strategy and the Environ- 1 0.6%
ment
Civil Engineering Special Issue 1 0.6%
Clinical Therapeutics 1 0.6%
Computer Law and Security Review: 1 0.6%
The International Journal of Technol-
ogy and Practice
Contemporary Economic Policy 1 0.6%
Decision Analysis 1 0.6%
Decision Support Systems 1 0.6%
Disaster Prevention Management 1 0.6%
Economic Development Quarterly 1 0.6%
Economics Letters 1 0.6%
Energy 1 0.6%
Energy Economics 1 0.6%
Engineering, Construction and Archi- 1 0.6%
tectural Management
ERA Forum 1 0.6%
European Journal of Industrial Engi- 1 0.6%
neering
European Journal of Political Economy 1 0.6%
European Law Journal 1 0.6%
Europhysics Letters 1 0.6%
Expert Systems with Applications 1 0.6%
Forest Science 1 0.6%
Gazi University Journal of Science 1 0.6%
Governance 1 0.6%
Government Information Quarterly 1 0.6%
Health policy 1 0.6%
Human resources for health 1 0.6%
Industrial Marketing Management 1 0.6%
Int. J. of Business Information Systems 1 0.6%
Int. J. of Technology Management 1 0.6%
International Journal Of Health Care 1 0.6%
Finance & Economics
International Journal of Production 1 0.6%
Economics
Continued on next page

xxiii
Journal publications time interval 4 – continued from previous page
Journal Publications Percent
International Journal of Project Man- 1 0.6%
agement
International Journal of Public Admin- 1 0.6%
istration
International Journal of Public Policy 1 0.6%
International Journal of Services Tech- 1 0.6%
nology and Management
International Journal of Software Engi- 1 0.6%
neering and Knowledge Engineering
International Public Management 1 0.6%
Journal
Jordan Journal of Pharmaceutical Sci- 1 0.6%
ences
Journal of Applied Business Research 1 0.6%
Journal of Balkan and Near Eastern 1 0.6%
Studies
Journal of Business Ethics 1 0.6%
Journal of Civil Engineering and Man- 1 0.6%
agement
Journal of Competition Law and Eco- 1 0.6%
nomics
Journal of Development Economics 1 0.6%
Journal of Enterprise Information Man- 1 0.6%
agement
Journal of Environmental Management 1 0.6%
Journal of Infrastructure Systems 1 0.6%
Journal of Integrative Environmental 1 0.6%
Sciences
Journal of Property Investment & Fi- 1 0.6%
nance
Journal of Public Administration Re- 1 0.6%
search and Theory
Journal of Public Economics 1 0.6%
Journal of the American Planning As- 1 0.6%
sociation
Journal of the Operational Research 1 0.6%
Society
Journal of Transport Geography 1 0.6%
Mediterranean Politics 1 0.6%
Natural Resources Forum 1 0.6%
Nonprofit Management and Leadership 1 0.6%
Open Economies Review 1 0.6%
Oxford Economic Papers 1 0.6%
Proceedings of the Institution of Civil 1 0.6%
Engineers: Engineering Sustainability
Continued on next page

xxiv
Journal publications time interval 4 – continued from previous page
Journal Publications Percent
Public Administration 1 0.6%
Public Administration and Develop- 1 0.6%
ment
Public Choice 1 0.6%
Public Finance Review 1 0.6%
Regulation & Governance 1 0.6%
Review Of Central And East European 1 0.6%
Law
Review of European Community & In- 1 0.6%
ternational Environmental Law
Science and Public Policy 1 0.6%
Social Policy and Administration 1 0.6%
Society and Economy 1 0.6%
Structural Survey 1 0.6%
Telecommunications Policy 1 0.6%
The American Economic Review 1 0.6%
The American Journal of Comparative 1 0.6%
Law
The American Review of Public Ad- 1 0.6%
ministration
The China Nonprofit Review 1 0.6%
The Economic and Labour Relations 1 0.6%
Review
The Economic Journal 1 0.6%
The Electronic Journal on Information 1 0.6%
Systems in Developing Countries
The Journal of Industrial Economics 1 0.6%
The Journal of Law and Economics 1 0.6%
The Quarterly Journal of Economics 1 0.6%
The Review of Economics and Statis- 1 0.6%
tics
The Service Industries Journal 1 0.6%
Transport 1 0.6%
Transport Reviews 1 0.6%
Transportation 1 0.6%
Transportation Research Part B 1 0.6%
Urban Forestry & Urban Greening 1 0.6%
Urban Studies 1 0.6%
Utilities Policy 1 0.6%
World Trade Review 1 0.6%
Total 180 100.0%

xxv
C.3. Publishing countries
C.3.1. Publishing countries 1997 - 2012

Publishing country Frequency Percent

USA 179 47.4%
UK 135 35.7%
Australia 53 14.0%
Spain 34 9.0%
Germany 24 6.3%
Italy 24 6.3%
Hong Kong 23 6.1%
Netherlands 23 6.1%
France 21 5.6%
Sweden 21 5.6%
Canada 20 5.3%
Norway 18 4.8%
China 17 4.5%
Finland 15 4.0%
Denmark 14 3.7%
Taiwan 14 3.7%
Unknown 11 2.9%
Estonia 9 2.4%
Belgium 7 1.9%
Brazil 7 1.9%
India 7 1.9%
Greece 6 1.6%
Hungary 6 1.6%
Israel 6 1.6%
Jordan 6 1.6%
Turkey 6 1.6%
Mexico 5 1.3%
Portugal 5 1.3%
Chile 4 1.1%
Ireland 4 1.1%
Japan 4 1.1%
Czech Republic 3 .8%
New Zealand 3 .8%
Slovenia 3 .8%
Switzerland 3 .8%
Thailand 3 .8%
Austria 2 .5%
Korea 2 .5%
Singapore 2 .5%
Slovakia 2 .5%
Bosnia-Herzegovina 1 .3%
Bulgaria 1 .3%
Colombia 1 .3%
Croatia 1 .3%
Ethiopia 1 .3%
Luxembourg 1 .3%
Continued on next page

xxvi
 Publishing countries 1997 - 2012 – continued from previous page
Publishing country Frequency Percent
Malaysia 1 .3%
Pakistan 1 .3%
South Africa 1 .3%
Total 760 201.1%

C.3.2. Publishing countries time interval 1

Publishing country Frequency Percent

UK 29 69.0%
USA 17 40.5%
Australia 9 21.4%
Hungary 4 9.5%
Italy 3 7.1%
Unknown 3 7.1%
Canada 2 4.8%
France 2 4.8%
Greece 1 2.4%
Korea 1 2.4%
Norway 1 2.4%
Total 72 171.4%

xxvii
C.3.3. Publishing countries time interval 2

Publishing country Frequency Percent

USA 34 57.6%
UK 16 27.1%
Canada 10 16.9%
Taiwan 8 13.6%
Hong Kong 5 8.5%
Australia 3 5.1%
France 3 5.1%
Greece 3 5.1%
Israel 3 5.1%
New Zealand 3 5.1%
Austria 2 3.4%
Chile 2 3.4%
Spain 2 3.4%
Switzerland 2 3.4%
Unknown 1 1.7%
Korea 1 1.7%
Belgium 1 1.7%
Estonia 1 1.7%
Germany 1 1.7%
Ireland 1 1.7%
Netherlands 1 1.7%
Sweden 1 1.7%
Total 104 176.3%

xxviii
C.3.4. Publishing countries time interval 3

Publishing country Frequency Percent

USA 51 52.6%
UK 46 47.4%
Germany 12 12.4%
Australia 10 10.3%
Norway 10 10.3%
Spain 9 9.3%
Sweden 6 6.2%
Canada 5 5.2%
France 5 5.2%
Netherlands 5 5.2%
Hong Kong 4 4.1%
Finland 4 4.1%
Taiwan 3 3.1%
Ireland 3 3.1%
Thailand 3 3.1%
Belgium 2 2.1%
Hungary 2 2.1%
Italy 2 2.1%
China 2 2.1%
India 2 2.1%
Slovakia 2 2.1%
Israel 1 1.0%
Switzerland 1 1.0%
Czech Republic 1 1.0%
Singapore 1 1.0%
South Africa 1 1.0%
Total 193 199.0%

xxix
C.3.5. Publishing countries time interval 4

Publishing country Frequency Percent

USA 77 42.8%
UK 44 24.4%
Australia 31 17.2%
Spain 23 12.8%
Italy 19 10.6%
Netherlands 17 9.4%
China 15 8.3%
Sweden 14 7.8%
Hong Kong 14 7.8%
Denmark 14 7.8%
Germany 11 6.1%
France 11 6.1%
Finland 11 6.1%
Estonia 8 4.4%
Norway 7 3.9%
Unknown 7 3.9%
Brazil 7 3.9%
Jordan 6 3.3%
Turkey 6 3.3%
India 5 2.8%
Mexico 5 2.8%
Portugal 5 2.8%
Belgium 4 2.2%
Japan 4 2.2%
Canada 3 1.7%
Taiwan 3 1.7%
Slovenia 3 1.7%
Israel 2 1.1%
Czech Republic 2 1.1%
Greece 2 1.1%
Chile 2 1.1%
Singapore 1 0.6%
Bosnia-Herzegovina 1 0.6%
Bulgaria 1 0.6%
Colombia 1 0.6%
Croatia 1 0.6%
Ethiopia 1 0.6%
Luxembourg 1 0.6%
Malaysia 1 0.6%
Pakistan 1 0.6%
Total 391 217.2%

xxx
 1997 - 2000 2001 - 2004 2005 - 2008 2009 - 2012
Government level Freq. Percent Freq. Percent Freq. Percent Freq. Percent
Governmental 8 19.0% 7 11.9% 8 8.2% 26 14.4%
Municipal 3 7.1% 8 13.6% 9 9.3% 34 18.9%
Local 11 26.2% 12 20.3% 23 23.7% 49 27.2%
No government 23 54.8% 35 59.3% 59 60.8% 95 52.8%
level
Total 45 107.1% 62 105.1% 99 102.1% 204 113.3%
C.4. Government levels
C.4.1. Government levels four time intervals

xxxi
C.4.2. Government levels per top 16 publishing countries

Publishing country Govern- Municipal Local No gov-

mental ernment
level
Australia (53) 5.7% 13.2% 18.9% 73.6%
Canada (20) 25.0% 5.0% 70.0%
China (17) 23.5% 35.3% 64.7%
Denmark (14) 7.1% 50.0% 21.4% 28.6%
Finland (15) 20.0% 80.0%
France (21) 9.5% 23.8% 66.7%
Germany (24) 20.8% 20.8% 16.7% 50.0%
Hong Kong (23) 8.7% 8.7% 82.6%
Italy (24) 8.3% 37.5% 12.5% 50.0%
Netherlands (23) 8.7% 26.1% 4.3% 60.9%
Norway (18) 5.6% 27.8% 66.7%
Spain (34) 5.9% 11.8% 82.4%
Sweden (21) 9.5% 23.8% 28.6% 47.6%
Taiwan (14) 21.4% 21.4% 35.7% 50.0%
UK (135) 11.9% 6.7% 34.8% 52.6%
USA (179) 19.0% 17.9% 29.6% 46.4%

C.4.3. Government levels per paper impact

Citations Govern- Municipal Local No gov-

mental ernment
level
0 - 10 (282) 13.1% 14.5% 26.2% 56.0%
10.5 - 20 (49 10.2% 8.2% 22.4% 63.3%
20.5 - 30 (19) 15.8% 10.5% 15.8% 63.2%
30.5 - 40 (8) 12.5% 12.5% 37.5% 37.5%
40.5 - 50 (4) 50.0% 25.0% 25.0%
50.5 - 60 (6) 16.7% 16.7% 33.3% 50.0%
60.5 - 70 (2) 50.0% 50.0%
70.5 - 80 (2) 100.0%
90.5 - 100 (2) 100.0%
100.5 - 110 (3) 33.3% 33.3% 33.3%
135 (1) 100.0%

xxxii
 1997 - 2000 2001 - 2004 2005 - 2008 2009 - 2012
Product type Freq. Percent Freq. Percent Freq. Percent Freq. Percent
Goods 6 14.3% 7 11.9% 21 21.6% 34 18.9%
Services 26 61.9% 34 57.6% 44 45.4% 76 42.2%
Works 4 9.5% 10 16.9% 22 22.7% 45 25.0%
Land 1 0.6%
No product 9 21.4% 14 23.7% 28 28.9% 57 31.7%
specified
Total 45 107.1% 65 110.2% 115 118.6% 213 118.3%
C.5. Product types
C.5.1. Product types four time intervals

xxxiii
C.5.2. Product types per top 16 publishing countries

Publishing country Goods Services Works Land no product

specified
Australia (53) 3.8% 49.1% 24.5% 34.0%
Canada (20) 5.0% 80.0% 10.0% 10.0%
China (17) 11.8% 23.5% 23.5% 52.9%
Denmark (14) 14.3% 42.9% 14.3% 35.7%
Finland (15) 53.3% 46.7% 26.7% 33.3%
France (21) 47.6% 42.9% 33.3%
Germany (24) 50.0% 33.3% 8.3% 29.2%
Hong Kong (23) 52.2% 69.6% 17.4%
Italy (24) 54.2% 41.7% 41.7% 12.5%
Netherlands (23) 4.3% 21.7% 26.1% 52.2%
Norway (18) 33.3% 16.7% 22.2% 27.8%
Spain (34) 11.8% 11.8% 61.8% 14.7%
Sweden (21) 28.6% 66.7% 14.3% 9.5%
Taiwan (14) 7.1% 21.4% 50.0% 28.6%
UK (135) 20.7% 43.7% 17.0% 34.8%
USA (179) 12.8% 57.5% 16.8% .6% 22.3%

C.5.3. Product types per paper impact

Citations Goods Services Works Land no product

specified
0 - 10 (282) 20.6% 46.1% 22.7% .4% 28.4%
10.5 - 20 (49) 14.3% 53.1% 16.3% 24.5%
20.5 - 30 (19) 5.3% 26.3% 21.1% 52.6%
30.5 - 40 (8) 62.5% 25.0% 25.0%
40.5 - 50 (4) 25.0% 75.0% 25.0% 25.0%
50.5 - 60 (6) 33.3% 33.3% 33.3%
60.5 - 70 (2) 50.0% 50.0%
70.5 - 80 (2) 50.0% 100.0%
90.5 - 100 (2) 100.0%
100.5 - 110 (3) 100.0%
135 (1) 100.0%

xxxiv
C.6. Industries and sectors
C.6.1. Industries and sectors 1997 - 2012

Industry / sector Frequency Percent

Private sector, not specified 144 38.1%
Services, not specified 85 22.5%
Construction 78 20.6%
Health sector 26 6.9%
Social services 18 4.8%
ICT 13 3.4%
Defense sector 9 2.4%
Manufacturing 8 2.1%
Professional services 8 2.1%
Transportation 8 2.1%
Waste collection, disposal, recycling services 8 2.1%
Facility services 6 1.6%
SMEs 6 1.6%
Child welfare services 5 1.3%
Education 4 1.1%
Other 19 5.0%
Total 445 117.7%

xxxv
 1997 - 2000 2001 - 2004 2005 - 2008 2009 - 2012
Industry / sector Freq. Percent Freq. Percent Freq. Percent Freq. Percent
Private sector - not specified 12 28.6% 18 30.5% 36 37.5% 78 43.6%
Services - not specified 11 26.2% 17 28.8% 23 24.0% 34 19.0%
Construction 4 9.5% 10 16.9% 23 24.0% 41 22.9%
Health sector 4 9.5% 6 10.2% 5 5.2% 11 6.1%
Social 4 9.5% 3 5.1% 4 4.2% 7 3.9%
ICT 1 2.4% 2 3.4% 6 6.3% 4 2.2%
Defense sector 2 4.8% 1 1.7% 4 4.2% 2 1.1%
Professional services 1 2.4% 4 4.2% 3 1.7%
Manufacturing not specified 2 4.8% 1 1.0% 5 2.8%
Transportation 1 2.4% 7 3.9%
Waste collection, disposal, 3 5.1% 2 2.1% 3 1.7%
recycling
Facility services 1 2.4% 2 2.1% 3 1.7%
SMEs 1 1.7% 2 2.1% 3 1.7%
Child Welfare 1 1.7% 2 2.1% 2 1.1%
Education 1 1.7% 3 3.1%
Other 1 2.4% 2 2.1% 16 8.9%
Total 44 104.8% 63 106.8% 119 124.0% 219 122.3%
Note: Two articles studied the public procurement function in general, without referring to any
C.6.2 Industries and sectors four time intervals

procurements. They were not categorized into any industry or sector and therefore for this analysis
there were 96 relevant papers in interval 3 and 179 in interval 4.

xxxvi
C.6.3. Industries and sectors per top 16 publishing countries

Publishing Construc- ICT Health Education Defense Facility Profes- Services - Private Manufac- Other Social Child Transpor- SMEs Waste
country tion sector sector ser- sional not speci- sector turing Wel- tation collec-
vices ser- fied - not fare tion,
vices speci- ...
fied
Australia (53) 24.5% 5.7% 7.5% 1.9% 26.4% 34.0% 1.9% 7.5% 3.8% 1.9%
Canada (20) 25.0% 10.0% 45.0% 20.0%
China (17) 23.5% 17.6% 64.7% 5.9%
Denmark (14) 15.4% 7.7% 15.4% 23.1% 30.8% 23.1%
Finland (15) 13.3% 20.0% 66.7% 6.7% 13.3% 13.3%
France (21) 4.8% 9.5% 33.3% 61.9% 4.8% 4.8%
Germany (24) 8.3% 25.0% 8.3% 16.7% 70.8%
Hong Kong 69.6% 4.3% 4.3% 4.3% 4.3% 4.3% 47.8% 21.7% 4.3%
(23)
Italy (24) 12.5% 33.3% 66.7% 16.7% 4.2%
Netherlands 27.3% 4.5% 54.5% 13.6% 4.5%
(23)
Norway (18) 22.2% 16.7% 16.7% 44.4%
Spain (34) 61.8% 5.9% 26.5% 5.9% 8.8%
Sweden (21) 23.8% 9.5% 9.5% 9.5% 9.5% 19.0% 19.0% 4.8% 9.5% 28.6% 4.8%
Taiwan (14) 50.0% 14.3% 28.6% 7.1%
UK (135) 15.6% 6.7% 1.5% 5.2% 3.0% 2.2% 26.7% 38.5% 8.1% .7% .7% 3.7%
USA (179) 15.1% 1.7% 11.7% 1.1% 2.2% 22.9% 31.3% 6.7% 8.4% 6.1% 5.0% 6.1%

xxxvii
C.6.4. Industries and sectors per paper impact

Citations Construc- ICT Health Education Defense Facility Profes- Services, Private Manufac- Other Social Child Transpor- SMEs Waste
tion sector sector ser- sional not spec- sector, turing Wel- tation collec-
vices ser- ified not fare tion,
vices speci- ...
fied
0 - 10 (282) 21.4% 4.3% 6.1% 1.1% 2.1% 1.4% 1.1% 21.4% 38.6% 2.1% 6.1% 4.6% 1.4% 2.5% 1.8% .7%
10.5 - 20 (49) 14.3% 10.2% 2.0% 4.1% 22.4% 40.8% 2.0% 2.0% 4.1% 2.0% 4.1%
20.5 - 30 (19) 26.3% 5.3% 10.5% 5.3% 5.3% 5.3% 5.3% 5.3% 52.6% 5.3% 5.3% 5.3% 5.3%
30.5 - 40 (8) 37.5% 25.0% 12.5% 25.0% 25.0% 12.5% 12.5% 37.5%
40.5 - 50 (4) 25.0% 25.0% 25.0% 50.0% 25.0%
50.5 - 60 (6) 33.3% 16.7% 33.3% 16.7%
60.5 - 70 (2) 50.0% 50.0%
70.5 - 80 (2) 100.0% 50.0%
90.5 - 100 (2) 50.0% 50.0%
100.5 - 110 66.7% 33.3%
(3)
135 (1) 100.0%

xxxviii
C.7. Studied countries
C.7.1. Studied countries 1997 - 2012

Studied country Frequency Percent

USA 85 22.5%
UK 77 20.4%
Australia 28 7.4%
Sweden 17 4.5%
EU 15 4.0%
Canada 12 3.2%
Italy 11 2.9%
Hong Kong 10 2.6%
Spain 10 2.6%
Finland 9 2.4%
Netherlands 9 2.4%
China 7 1.9%
France 7 1.9%
Japan 7 1.9%
Denmark 6 1.6%
Norway 6 1.6%
Taiwan 6 1.6%
Germany 5 1.3%
India 5 1.3%
Ireland 5 1.3%
New Zealand 5 1.3%
Austria 4 1.1%
Estonia 4 1.1%
Malaysia 4 1.1%
Portugal 4 1.1%
South Africa 4 1.1%
Brazil 3 0.8%
Greece 3 0.8%
Hungary 3 0.8%
Mexico 3 0.8%
Singapore 3 0.8%
Thailand 3 0.8%
Turkey 3 0.8%
Argentina 3 0.8%
Belgium 2 0.5%
Bulgaria 2 0.5%
Chile 2 0.5%
Jordan 2 0.5%
Korea 2 0.5%
Pakistan 2 0.5%
Slovakia 2 0.5%
Slovenia 2 0.5%
Switzerland 2 0.5%
Croatia 2 0.5%
Ghana 2 0.5%
Mozambique 2 0.5%
Nepal 2 0.5%
Nordic Baltic Sea Region 2 0.5%
Poland 2 0.5%
Worldwide 2 0.5%
Continued on next page

xxxix
Studied countries 1997 - 2012 – continued from previous page
Studied country Frequency Percent
Columbia 2 0.5%
Uganda 2 0.5%
Peru 2 0.5%
Phillipines 2 0.5%
Bosnia-Herzegovina 1 0.3%
Czech Republic 1 0.3%
Ethiopia 1 0.3%
Antigua 1 0.3%
Asia 1 0.3%
Indonesia 1 0.3%
Kenya 1 0.3%
Ukraine 1 0.3%
Former Yugoslav Republic of Macedonia 1 0.3%
Nicaragua 1 0.3%
Paraguay 1 0.3%
Serbia 1 0.3%
Zambia 1 0.3%
Uruguay 1 0.3%
Western Europe 1 0.3%
Albania 1 0.3%
Rwanda 1 0.3%
Eastern Eurpoe 1 0.3%
Malawi 1 0.3%
Scandinavia 1 0.3%
Other unspecified regions 1 0.3%
Jamaica 1 0.3%
Honduras 1 0.3%
Haiti 1 0.3%
Grenada 1 0.3%
Guatemala 1 0.3%
El Salvador 1 0.3%
Ecuador 1 0.3%
Dominican Republic 1 0.3%
Costa Rica 1 0.3%
Bolivia 1 0.3%
Total 457 120.9%

xl
C.7.2. Studied countries time interval 1

Studied country Frequency Percent

UK 12 28.6%
USA 10 23.8%
Australia 4 9.5%
EU 3 7.1%
New Zealand 2 4.8%
Mozambique 2 4.8%
Hungary 1 2.4%
Italy 1 2.4%
Ghana 1 2.4%
Uganda 1 2.4%
Total 37 88.1%

xli
C.7.3. Studied countries time interval 2

Studied country Frequency Percent

USA 19 32.2%
UK 10 16.9%
Australia 4 6.8%
Canada 3 5.1%
Taiwan 3 5.1%
EU 3 5.1%
China 2 3.4%
Austria 1 1.7%
Chile 1 1.7%
Estonia 1 1.7%
Finland 1 1.7%
Greece 1 1.7%
Hong Kong 1 1.7%
India 1 1.7%
Ireland 1 1.7%
Japan 1 1.7%
Korea 1 1.7%
Malaysia 1 1.7%
New Zealand 1 1.7%
Singapore 1 1.7%
South Africa 1 1.7%
Spain 1 1.7%
Sweden 1 1.7%
Thailand 1 1.7%
Asia 1 1.7%
Ghana 1 1.7%
Ukraine 1 1.7%
Worldwide 1 1.7%
Peru 1 1.7%
Phillipines 1 1.7%
Total 67 113.6%

xlii
C.7.4. Studied countries time interval 3

Studied country Frequency Percent

UK 23 23.7%
USA 21 21.6%
Australia 7 7.2%
Canada 6 6.2%
Hong Kong 4 4.1%
Sweden 4 4.1%
EU 4 4.1%
France 3 3.1%
Ireland 3 3.1%
Italy 3 3.1%
South Africa 3 3.1%
Finland 2 2.1%
Germany 2 2.1%
Hungary 2 2.1%
India 2 2.1%
Japan 2 2.1%
Malaysia 2 2.1%
Netherlands 2 2.1%
Norway 2 2.1%
Singapore 2 2.1%
Slovakia 2 2.1%
Spain 2 2.1%
Thailand 2 2.1%
Argentina 2 2.1%
Austria 1 1.0%
Belgium 1 1.0%
China 1 1.0%
Czech Republic 1 1.0%
Estonia 1 1.0%
Greece 1 1.0%
Korea 1 1.0%
Mexico 1 1.0%
Switzerland 1 1.0%
Taiwan 1 1.0%
Indonesia 1 1.0%
Poland 1 1.0%
Columbia 1 1.0%
Peru 1 1.0%
Phillipines 1 1.0%
Total 122 125.8%

xliii
C.7.5. Studied countries time interval 4

Studied country Frequency Percent

USA 35 19.4%
UK 32 17.8%
Australia 13 7.2%
Sweden 12 6.7%
Italy 7 3.9%
Netherlands 7 3.9%
Spain 7 3.9%
Denmark 6 3.3%
Finland 6 3.3%
Hong Kong 5 2.8%
EU 5 2.8%
China 4 2.2%
France 4 2.2%
Japan 4 2.2%
Norway 4 2.2%
Portugal 4 2.2%
Brazil 3 1.7%
Canada 3 1.7%
Germany 3 1.7%
Turkey 3 1.7%
Austria 2 1.1%
Bulgaria 2 1.1%
Estonia 2 1.1%
India 2 1.1%
Jordan 2 1.1%
Mexico 2 1.1%
New Zealand 2 1.1%
Pakistan 2 1.1%
Slovenia 2 1.1%
Taiwan 2 1.1%
Croatia 2 1.1%
Nepal 2 1.1%
Nordic Baltic Sea Region 2 1.1%
Belgium 1 0.6%
Bosnia-Herzegovina 1 0.6%
Chile 1 0.6%
Ethiopia 1 0.6%
Greece 1 0.6%
Ireland 1 0.6%
Malaysia 1 0.6%
Switzerland 1 0.6%
Antigua 1 0.6%
Argentina 1 0.6%
Kenya 1 0.6%
Poland 1 0.6%
Worldwide 1 0.6%
Columbia 1 0.6%
Former Yugoslav Republic of Macedonia 1 0.6%
Nicaragua 1 0.6%
Uganda 1 0.6%
Paraguay 1 0.6%
Serbia 1 0.6%
Continued on next page

xliv
Studied countries time interval 4 – continued from previous page
Studied country Frequency Percent
Zambia 1 0.6%
Uruguay 1 0.6%
Western Europe 1 0.6%
Albania 1 0.6%
Rwanda 1 0.6%
Eastern Eurpoe 1 0.6%
Malawi 1 0.6%
Scandinavia 1 0.6%
Other unspecified regions 1 0.6%
Jamaica 1 0.6%
Honduras 1 0.6%
Haiti 1 0.6%
Grenada 1 0.6%
Guatemala 1 0.6%
El Salvador 1 0.6%
Ecuador 1 0.6%
Dominican Republic 1 0.6%
Costa Rica 1 0.6%
Bolivia 1 0.6%
Total 231 128.3%

xlv
 Publishing Studied country
country
Australia Austria Belgium Bosnia- Brazil Bulgaria Canada Chile China
Herzegovina
Australia 76.1%
Austria 100.0%
Belgium 100.0%
Bosnia- -
Herzegovina
Brazil 100.0%
Bulgaria 100.0%
Canada 88.9%
Chile 100.0%
China 90.0%
C.7.6. Publishing versus studied countries

xlvi
 Publishing Studied country
country
Colombia Croatia Czech Denmark Estonia Ethiopia Finland France Germany
Republic
Colombia -

Croatia 100.0%
Czech Republic 50.0%
Denmark 39.1%
Estonia 44.4%
Ethiopia 100.0%
Finland 86.7%
France 64.3%
Germany 80.0%

xlvii
 Publishing Studied country
country
Greece Hong Hungary India Ireland Israel Italy Japan Jordan Korea
Kong
Greece 60.0%
Hong Kong 76.5%
Hungary 100.0%
India 100.0%
Ireland 100.0%
Israel -

Italy 81.0%
Japan 75.0%
Jordan 100.0%
Korea 50.0%

xlviii
 Publishing Studied country
country
Luxem- Malaysia Mexico Nether- New Norway Pakistan Portugal Slovakia
bourg lands Zealand
Luxembourg -

Malaysia 100.0%
Mexico 40.0%
Netherlands 77.3%
New Zealand 100.0%
Norway 100.0%
Pakistan 100.0%
Portugal 100.0%
Slovakia 100.0%

xlix
 Publishing Studied country
country
Slovenia South Spain Sweden Switzerland Taiwan Thailand Turkey UK USA
Africa
Slovenia 100.0%
South Africa 100.0%
Spain 71.0%
Sweden 90.5%
Switzerland 50.0%
Taiwan 100.0%
Thailand 33.3%
Turkey 100.0%
UK 77.5%
USA 87.7%

l
 1997 - 2000 2001 - 2004 2005 - 2008 2009 - 2012
Methodology Freq. Percent Freq. Percent Freq. Percent Freq. Percent
Qualitative 32 76.2% 41 69.5% 73 75.3% 88 48.9%
Quantitative 10 23.8% 19 32.2% 26 26.8% 99 55.0%
Total 42 100.0% 60 101.7% 99 102.1% 187 103.9%
C.8. Methodologies
C.8.1. Methodologies four time intervals

li
C.8.2. Methodologies per top 16 publishing country

Publishing country Qualitative Quantitative

Australia (53) 75.5% 24.5%
Canada (20) 75.0% 25.0%
China (17) 35.3% 94.1%
Denmark (14) 57.1% 42.9%
Finland (15) 53.3% 46.7%
France (21) 47.6% 52.4%
Germany (24) 45.8% 54.2%
Hong Kong (23) 56.5% 43.5%
Italy (24) 50.0% 50.0%
Netherlands (23) 87.0% 17.4%
Norway (18) 55.6% 61.1%
Spain (34) 38.2% 61.8%
Sweden (21) 76.2% 23.8%
Taiwan (14) 21.4% 78.6%
UK (135) 71.1% 31.1%
USA (179) 50.8% 52.5%

C.8.3. Methodologies per paper impact

Citation category Qualitative Quantitative

0 - 10 (282) 59.2% 42.9%
10.5 - 20 (49) 71.4% 32.7%
20.5 - 30 (19) 78.9% 31.6%
30.5 - 40 (8) 50.0% 50.0%
40.5 - 50 (4) 50.0% 50.0%
50.5 - 60 (6) 83.3% 16.7%
60.5 - 70 (2) 50.0% 50.0%
70.5 - 80 (2) 100.0%
90.5 - 100 (2) 50.0% 50.0%
100.5 - 110 (3) 66.7% 33.3%
135 (1) 100.0%

lii
 1997 - 2000 2001 - 2004 2005 - 2008 2009 - 2012
Time dimension Freq. Percent Freq. Percent Freq. Percent Freq. Percent
Cross-sectional 28 66.7% 45 76.3% 85 87.6% 143 79.4%
Longitudinal 14 33.3% 14 23.7% 12 12.4% 37 20.6%
Total 42 100.0% 59 100.0% 97 100.0% 180 100.0%
C.9. Time dimensions
C.9.1. Time dimensions four time intervals

liii
C.9.2. Time dimensions per top 16 publishing country

Publishing country Cross-sectional Longitudinal

Australia (53) 81.1% 18.9%
Canada (20) 100.0%
China (17) 94.1% 5.9%
Denmark (14) 78.6% 21.4%
Finland (15) 53.3% 46.7%
France (21) 95.2% 4.8%
Germany (24) 100.0%
Hong Kong (23) 100.0%
Italy (24) 95.8% 4.2%
Netherlands (23) 69.6% 30.4%
Norway (18) 100.0%
Spain (34) 88.2% 11.8%
Sweden (21) 81.0% 19.0%
Taiwan (14) 50.0% 50.0%
UK (135) 80.7% 19.3%
USA (179) 77.1% 22.9%

C.9.3. Time dimensions per paper impact

Citation category Cross-sectional Longitudinal

study
0 - 10 (282) 80.1% 19.9%
10.5 - 20 (49) 77.6% 22.4%
20.5 - 30 (19) 94.7% 5.3%
30.5 - 40 (8) 62.5% 37.5%
40.5 - 50 (4) 50.0% 50.0%
50.5 - 60 (6) 100.0%
60.5 - 70 (2) 100.0%
70.5 - 80 (2) 100.0%
90.5 - 100 (2) 100.0%
100.5 - 110 (3) 33.3% 66.7%
135 (1) 100.0%

liv
C.10. Data collection methods
C.10.1. Data collection methods 1997 - 2012

Data collection method Frequency Percent

Literature review - non-academic 148 39.2%
Interview 113 29.9%
none specified 77 20.4%
Questionnaire 71 18.8%
Secondary analysis 57 15.1%
Literature review 53 14.0%
Observation 18 4.8%
Focus group 8 2.1%
Experiment 6 1.6%
Total 551 145.8%

lv
 1997 - 2000 2001 - 2004 2005 - 2008 2009 - 2012
Data collection method Freq. Percent Freq. Percent Freq. Percent Freq. Percent
Questionnaire 3 7.1% 10 16.9% 16 16.5% 42 23.3%
Interview 8 19.0% 17 28.8% 33 34.0% 55 30.6%
Secondary analysis 6 14.3% 10 16.9% 8 8.2% 33 18.3%
Experiment 4 4.1% 2 1.1%
Observation 2 4.8% 1 1.7% 6 6.2% 9 5.0%
Literature review 8 19.0% 10 16.9% 14 14.4% 21 11.7%
Literature review - non-academic 20 47.6% 18 30.5% 39 40.2% 71 39.4%
Focus group 1 1.7% 1 1.0% 6 3.3%
none specified 12 28.6% 12 20.3% 20 20.6% 33 18.3%
Total 42 100.0% 59 100.0% 97 100.0% 180 100.0%
C.10.2. Data collection methods four time intervals

lvi
 Publishing Question- Interview Secondary Experi- Obser- Literature Literature Focus none
country naire analysis ment va- review review - group speci-
tion non- fied
academic
Australia 20.8% 30.2% 7.5% 43.4% 56.6% 1.9%
(53)
Canada 5.0% 15.0% 40.0% 20.0% 40.0%
(20)
China (17) 35.3% 29.4% 5.9% 5.9% 29.4% 23.5% 35.3%
Denmark 21.4% 64.3% 14.3% 21.4% 21.4% 85.7%
(14)
Finland 13.3% 20.0% 20.0% 6.7% 46.7% 13.3%
(15)
France (21) 9.5% 19.0% 4.8% 9.5% 28.6% 33.3% 38.1%
Germany 20.8% 25.0% 4.2% 12.5% 16.7% 12.5% 37.5%
(24)
Hong Kong 34.8% 43.5% 4.3% 26.1% 26.1%
(23)
Italy (24) 16.7% 37.5% 33.3% 4.2% 4.2% 16.7%
Netherlands 17.4% 21.7% 47.8% 8.7% 47.8% 8.7%
(23)
Norway 11.1% 27.8% 16.7% 11.1% 55.6% 22.2%
(18)
Spain (34) 29.4% 35.3% 20.6% 8.8% 8.8% 26.5% 8.8% 8.8%
Sweden (21) 9.5% 38.1% 19.0% 4.8% 14.3% 38.1% 14.3%
Taiwan (14) 64.3% 28.6% 14.3% 21.4%
UK (135) 20.0% 37.0% 11.9% 3.7% 11.1% 41.5% 4.4% 19.3%
C.10.3. Data collection methods per top 16 publishing countries

USA (179) 28.5% 33.0% 24.0% 1.7% 6.1% 7.3% 38.5% 1.7% 13.4%

lvii
 Citation Question- Interview Secondary Experi- Obser- Literature Literature Focus none
naire analysis ment va- review review, group speci-
tion non- fied
academic
0 - 10 (282) 18.8% 27.0% 13.8% 1.8% 5.0% 13.1% 39.7% 2.1% 22.3%
10.5 - 20 18.4% 38.8% 16.3% 2.0% 6.1% 16.3% 36.7% 14.3%
(49)
20.5 - 30 26.3% 57.9% 5.3% 15.8% 47.4% 5.3% 10.5%
(19)
30.5 - 40 25.0% 37.5% 50.0% 25.0% 12.5% 12.5%
(8)
40.5 - 50 25.0% 50.0% 25.0% 25.0% 25.0%
(4)
50.5 - 60 16.7% 16.7% 16.7% 16.7% 50.0%
(6)
60.5 - 70 50.0% 50.0%
(2)
70.5 - 80 100.0% 50.0%
(2)
90.5 - 100 50.0% 50.0% 100.0%
C.10.4. Data collection methods per paper impact

(2)
100.5 - 110 33.3% 33.3% 33.3% 66.7%
(3)
135 (1) 100.0%

lviii
C.11. Research strategies
C.11.1. Research strategies 1997 - 2012

Research strategy Frequency Percent

Single case study 107 28.3%
Survey research 75 19.8%
Multiple case study 71 18.8%
Quantitative modelling 67 17.7%
Literature study 50 13.2%
Meta-study 19 5.0%
Total 389 102.9%

lix
 1997 - 2000 2001 - 2004 2005 - 2008 2009 - 2012
Research strategy Freq. Percent Freq. Percent Freq. Percent Freq. Percent
Survey research 6 14.3% 11 18.6% 17 17.5% 41 22.8%
Literature study 9 21.4% 7 11.9% 16 16.5% 18 10.0%
Meta-study 1 2.4% 3 5.1% 4 4.1% 11 6.1%
Single case study 15 35.7% 20 33.9% 23 23.7% 49 27.2%
Multiple case study 5 11.9% 11 18.6% 30 30.9% 25 13.9%
Quantitative modelling 6 14.3% 9 15.3% 11 11.3% 41 22.8%
Total 42 100.0% 61 103.4% 101 104.1% 185 102.8%
C.11.2. Research strategies four time intervals

lx
 Publishing Survey Literature Meta- Single Multiple Quantitative
country research study study case study case study modelling
Australia (53) 26.4% 37.7% 3.8% 18.9% 9.4% 3.8%
Canada (20) 5.0% 25.0% 25.0% 20.0% 25.0%
China (17) 35.3% 11.8% 52.9%
Denmark (14) 21.4% 14.3% 35.7% 35.7% 7.1%
Finland (15) 13.3% 20.0% 20.0% 33.3% 13.3%
France (21) 9.5% 9.5% 9.5% 28.6% 42.9%
Germany (24) 20.8% 8.3% 4.2% 8.3% 16.7% 41.7%
Hong Kong (23) 52.2% 21.7% 17.4% 26.1%
Italy (24) 16.7% 37.5% 12.5% 33.3%
Netherlands (23) 13.0% 13.0% 17.4% 17.4% 30.4% 8.7%
Norway (18) 11.1% 22.2% 16.7% 16.7% 33.3%
Spain (34) 23.5% 5.9% 8.8% 32.4% 29.4%
Sweden (21) 14.3% 23.8% 57.1% 4.8%
Taiwan (14) 64.3% 7.1% 28.6%
UK (135) 21.5% 13.3% 2.2% 34.8% 21.5% 10.4%
USA (179) 26.8% 7.3% 10.6% 25.1% 15.1% 15.1%
C.11.3. Research strategies per top 16 publishing countries

lxi
 Citation Survey Literature Meta- Single Multiple Quantitative
category research study study case study case study modelling
0 - 10 (282) 19.9% 11.3% 4.6% 29.4% 17.4% 19.9%
10.5 - 20 (49) 14.3% 20.4% 2.0% 32.7% 20.4% 14.3%
20.5 - 30 (19) 31.6% 15.8% 15.8% 36.8% 10.5%
30.5 - 40 (8) 25.0% 12.5% 25.0% 25.0% 12.5%
40.5 - 50 (4) 25.0% 25.0% 25.0% 25.0%
50.5 - 60 (6) 16.7% 16.7% 33.3% 33.3%
60.5 - 70 (2) 50.0% 50.0%
70.5 - 80 (2) 100.0%
90.5 - 100 (2) 50.0% 50.0%
100.5 - 110 (3) 33.3% 33.3% 33.3%
135 (1) 100.0%
C.11.4. Research strategies per paper impact

lxii
 1997 - 2000 2001 - 2004 2005 - 2008 2009 - 2012
Topic Freq. Percent Freq. Percent Freq. Percent Freq. Percent
Supplier relations 5 11.9% 4 6.8% 10 10.3% 6 3.3%
Make-or-buy 4 9.5% 9 15.3% 6 6.2% 12 6.7%
Selection 13 31.0% 9 15.3% 9 9.3% 34 18.9%
Contracting 4 9.5% 9 15.3% 15 15.5% 25 13.9%
Legal aspects 5 11.9% 3 5.1% 5 5.2% 13 7.2%
C.12. Topics

Procurement strategy 19 45.2% 37 62.7% 59 60.8% 117 65.0%

PP tool 1 1.7% 4 4.1% 2 1.1%
Effect of procurement 4 9.5% 4 6.8% 6 6.2% 8 4.4%
Anti-corruption 1 1.7% 4 4.1% 5 2.8%
Trade discrimination 3 7.1% 2 3.4% 2 2.1% 7 3.9%
PP status overview 3 7.1% 5 8.5% 10 10.3% 9 5.0%
Other 1 2.4% 3 3.1% 7 3.9%
Total 61 145.2% 84 142.4% 133 137.1% 245 136.1%
C.12.1. Topics four time intervals

lxiii
 1997 - 2000 2001 - 2004 2005 - 2008 2009 - 2012
Procurement strategy Freq. Percent Freq. Percent Freq. Percent Freq. Percent
PPP 2 10.5% 11 29.7% 19 32.2% 42 35.9%
Innovation procurement 1 1.7% 11 9.4%
Contracting-out 15 78.9% 19 51.4% 15 25.4% 26 22.2%
GPP 1 2.7% 10 16.9% 18 15.4%
e-Procurement 2 5.4% 5 8.5% 9 7.7%
Early contractor involve- 1 0.9%
ment
Lean PP 2 1.7%
Shared services 1 0.9%
Joint procurement 1 2.7% 2 3.4% 2 1.7%
Prime contracting 1 5.3% 1 1.7%
Market-based PP 1 1.7% 1 0.9%
Emergency contracting 1 1.7% 1 0.9%
De- / centralization 1 5.3% 1 1.7% 1 0.9%
PP Partnerships 1 1.7%
Social procurement 1 2.7%
Eminent domain ... 1 0.9%
Mixed service delivery 1 2.7% 1 1.7%
Offsets 1 2.7%
Promoting SMEs 1 0.9%
Dual sourcing 1 1.7%
Total 19 100.0% 37 100.0% 59 100.0% 117 100.0%
C.12.2. Procurement strategies four time intervals

lxiv
 1997 - 2000 2001 - 2004 2005 - 2008 2009 - 2012
Effect Freq. Percent Freq. Percent Freq. Percent Freq. Percent
Economy 2 50.0% 2 50.0% 2 33.3% 4 50.0%
Human rights, society 1 25.0% 1 16.7% 1 12.5%
SMEs 1 16.7% 1 12.5%
Ethics 1 12.5%
PP efficiency 1 25.0% 1 16.7% 0.0%
Private contractor 1 25.0% 1 16.7% 0.0%
Quality 1 12.5%
Government accountability 1 25.0% 0.0%
Total 4 100.0% 4 100.0% 6 100.0% 8 100.0%
C.12.3. PP effects four time intervals

lxv
C.13. Study characteristics per topic
C.13.1. Government levels per topic

Topic Govern- Municipal Local no govern-

mental ment level
Supplier relations (25) 8.0% 8.0% 28.0% 56.0%
Make-or-buy (31) 3.2% 19.4% 35.5% 41.9%
Selection (65) 9.2% 12.3% 26.2% 61.5%
Contracting (53) 13.2% 13.2% 30.2% 52.8%
Legal aspects (26) 7.7% 19.2% 11.5% 76.9%
PPP (74) 8.1% 6.8% 12.2% 77.0%
Innovation procurement 25.0% 8.3% 33.3% 41.7%
(12)
Contracting-out (75) 14.7% 20.0% 28.0% 45.3%
GPP (29) 3.4% 24.1% 27.6% 48.3%
e-Procurement (16) 12.5% 12.5% 43.8% 43.8%
Early contractor involve- 100.0%
ment (1)
Lean PP (2) 50.0% 50.0%
Shared services (1) 100.0%
Joint procurement (5) 20.0% 80.0%
Prime contracting (2) 50.0% 50.0%
Market-based PP (2) 50.0% 50.0% 100.0%
Emergency contracting (2) 50.0% 50.0%
De- / centralization (3) 66.7% 33.3% 33.3%
PP Partnerships (1) 100.0%
Social procurement (1) 100.0%
Eminent domain vs. pur- 100.0%
chase of land (1)
Mixed service delivery (2) 50.0% 50.0%
Offsets (1) 100.0%
Promoting SMEs (1) 100.0%
Dual sourcing (1) 100.0%
PP tool (7) 28.6% 14.3% 57.1%
Effect: Economy (10) 10.0% 10.0% 50.0% 40.0%
Effect: Human rights, soci- 33.3% 66.7%
ety (3)
Effect: SMEs (2) 100.0%
Effect: Ethics (1) 100.0%
Effect: PP efficiency (2) 50.0% 50.0%
Effect: Private contractor 100.0%
(2)
Effect: Quality (1) 100.0%
Effect: Government ac- 100.0%
countability (1)
Anti-corruption (10) 10.0% 10.0% 30.0% 70.0%
Trade discrimination (14) 21.4% 7.1% 14.3% 57.1%
PP status overview (27) 14.8% 18.5% 33.3% 44.4%
Purchase shocks (2) 100.0%
Continued on next page

lxvi
 Government levels per topic – continued from previous page
Topic Govern- Municipal Local no govern-
mental ment level
Public versus private pro- 100.0%
curement (1)
PP cost drivers (1) 100.0% 100.0% 100.0%
SMEs (1) 100.0%
PP markets (1) 100.0%
Ethics in PP (2) 50.0% 50.0% 50.0%
Project based procurement 100.0%
routes (1)
Organization of PP function 100.0%
(1)
Critique of PP research 100.0% 100.0% 100.0%
practice (1)

lxvii
C.13.2. Product types per topic

Topic Goods Services Works Land none specified

Supplier relations (25) 8.0% 60.0% 12.0% 28.0%
Make-or-buy (31) 9.7% 61.3% 12.9% 19.4%
Selection (65) 15.4% 41.5% 35.4% 27.7%
Contracting (53) 11.3% 67.9% 15.1% 17.0%
Legal aspects (26) 19.2% 34.6% 11.5% 53.8%
PPP (74) 1.4% 31.1% 51.4% 25.7%
Innovation procurement 66.7% 41.7% 8.3% 33.3%
(12)
Contracting-out (75) 1.3% 86.7% 4.0% 9.3%
GPP (29) 41.4% 34.5% 6.9% 41.4%
e-Procurement (16) 25.0% 31.3% 6.3% 62.5%
Early contractor involve- 100.0%
ment (1)
Lean PP (2) 100.0%
Shared services (1) 100.0%
Joint procurement (5) 80.0% 20.0%
Prime contracting (2) 50.0% 50.0%
Market-based PP (2) 50.0% 100.0% 50.0%
Emergency contracting (2) 50.0% 50.0% 50.0% 50.0%
De- / centralization (3) 100.0% 66.7%
PP Partnerships (1) 100.0%
Social procurement (1) 100.0%
Eminent domain vs. pur- 100.0%
chase of land (1)
Mixed service delivery (2) 100.0% 50.0%
Offsets (1) 100.0%
Promoting SMEs (1) 100.0% 100.0%
Dual sourcing (1) 100.0%
PP tool (7) 14.3% 42.9% 42.9%
Effect: Economy (10) 50.0% 70.0% 10.0% 30.0%
Effect: Human rights, soci- 33.3% 33.3% 33.3%
ety (3)
Effect: SMEs (2) 50.0% 50.0% 50.0%
Effect: Ethics (1) 100.0%
Effect: PP efficiency (2) 50.0% 50.0% 50.0%
Effect: Private contractor 100.0%
(2)
Effect: Quality (1) 100.0%
Effect: Government ac- 100.0%
countability (1)
Anti-corruption (10) 30.0% 70.0%
Trade discrimination (14) 28.6% 21.4% 7.1% 57.1%
PP status overview (27) 14.8% 59.3% 29.6% 11.1%
Purchase shocks (2) 100.0%
Public versus private pro- 100.0%
curement (1)
PP cost drivers (1) 100.0%
Continued on next page

lxviii
 Product types per topic – continued from previous page
Topic Goods Services Works Land none specified
SMEs (1) 100.0% 100.0% 100.0%
PP markets (1) 100.0% 100.0%
Ethics in PP (2) 50.0% 50.0%
Project based procurement 100.0%
routes (1)
Organization of PP function 100.0%
(1)
Critique of PP research 100.0%
practice (1)

lxix
C.13.3. Industries and sectors per topic

Topic Construc- ICT Health Education Defense Facility Profes- Services, Private Manufac- Other Social Child Transpor- SMEs Waste
tion sector sector ser- sional not spec- sector, turing welfare tation collec-
vices ser- ified not tion,
vices speci- ...
fied
Supplier relations (25) 12.0% 4.0% 8.0% 20.0% 32.0% 8.0% 16.0% 4.0% 4.0%
Make-or-buy (31) 19.4% 3.2% 9.7% 3.2% 3.2% 35.5% 22.6% 6.5% 3.2% 6.5% 6.5%
Selection (65) 27.7% 4.6% 1.5% 3.1% 3.1% 20.0% 43.1% 1.5% 4.6% 4.6% 3.1% 3.1%
Contracting (53) 17.0% 7.5% 11.3% 1.9% 1.9% 1.9% 22.6% 20.8% 1.9% 9.4% 11.3% 5.7% 7.5%
Legal aspects (26) 11.5% 3.8% 23.1% 73.1% 3.8%
PPP (74) 51.4% 4.1% 2.7% 1.4% 2.7% 2.7% 14.9% 29.7% 2.7% 1.4% 1.4% 1.4% 1.4%
Innovation procurement 18.2% 27.3% 18.2% 18.2% 45.5% 27.3% 9.1%
(12)
Contracting-out (75) 5.3% 17.3% 1.3% 2.7% 1.3% 38.7% 9.3% 1.3% 6.7% 17.3% 4.0% 2.7% 4.0%
GPP (29) 6.9% 3.4% 3.4% 20.7% 69.0% 3.4% 6.9% 3.4% 3.4%
e-Procurement (16) 31.3% 87.5% 6.3%
Early contractor involve- 100.0%
ment (1)
Lean PP (2) 100.0%
Shared services (1) 100.0%
Joint procurement (5) 40.0% 40.0% 20.0%
Prime contracting (2) 50.0% 50.0%
Market-based PP (2) 50.0% 50.0% 50.0% 50.0%
Emergency contracting (2) 50.0% 50.0%
De- / centralization (3) 33.3% 100.0%
PP Partnerships (1) 100.0% 100.0%
Social procurement (1) 100.0%
Eminent domain vs. pur- 100.0%
chase of land (1)
Mixed service delivery (2) 50.0% 50.0% 100.0%
Offsets (1) 100.0%
Promoting SMEs (1) 100.0%
Dual sourcing (1) 100.0%
PP tool (7) 42.9% 57.1%
Effect: Economy (10) 10.0% 10.0% 40.0% 70.0%
Effect: Human rights, soci- 33.3% 33.3% 33.3%
ety (3)
Effect: SMEs (2) 100.0%
Effect: Ethics (1) 100.0%
Effect: PP efficiency (2) 50.0% 100.0%
Effect: Private contractor 50.0% 50.0%
(2)
Effect: Quality (1) 100.0%
Effect: Government ac- 100.0%
countability (1)
Anti-corruption (10) 20.0% 10.0% 80.0%
Trade discrimination (14) 7.1% 14.3% 71.4% 7.1% 7.1%
Continued on next page

lxx
 Industries and sectors per topic – continued from previous page
Topic Construc- ICT Health Education Defense Facility Profes- Services, Private Manufac- Other Social Child Transpor- SMEs Waste
tion sector sector ser- sional not spec- sector, turing welfare tation collec-
vices ser- ified not tion,
vices speci- ...
fied
PP status overview (27) 29.6% 3.7% 3.7% 3.7% 7.4% 48.1% 18.5% 3.7%
Purchase shocks (2) 100.0%
Public versus private pro- 100.0%
curement (1)
PP cost drivers (1) 100.0%
SMEs (1) 100.0%
PP markets (1) 100.0%
Ethics in PP (2) 50.0% 50.0%
Project based procurement 100.0%
routes (1)
Organization of PP function
(1)
Critique of PP research 100.0%
practice (1)

lxxi
C.14. Research designs per topic
C.14.1. Methodologies per topic

Topic Qualitative Quantitative

Supplier relations (25) 72.0% 28.0%
Make-or-buy (31) 29.0% 71.0%
Selection (65) 41.5% 61.5%
Contracting (53) 67.9% 35.8%
Legal aspects (26) 76.9% 30.8%
PPP (74) 71.6% 32.4%
Innovation procurement (12) 91.7% 8.3%
Contracting-out (75) 73.3% 29.3%
GPP (29) 79.3% 24.1%
e-Procurement (16) 50.0% 56.3%
Early contractor involvement (1) 100.0%
Lean PP (2) 50.0% 50.0%
Shared services (1) 100.0%
Joint procurement (5) 60.0% 40.0%
Prime contracting (2) 100.0%
Market-based PP (2) 100.0%
Emergency contracting (2) 100.0%
De- / centralization (3) 33.3% 66.7%
PP Partnerships (1) 100.0%
Social procurement (1) 100.0%
Eminent domain vs. purchase of land (1) 100.0%
Mixed service delivery (2) 100.0%
Offsets (1) 100.0%
Promoting SMEs (1) 100.0%
Dual sourcing (1) 100.0%
PP tool (7) 71.4% 42.9%
Effect: Economy (10) 30.0% 70.0%
Effect: Human rights, society (3) 66.7% 33.3%
Effect: SMEs (2) 50.0% 50.0%
Effect: Ethics (1) 100.0%
Effect: PP efficiency (2) 50.0% 50.0%
Effect: Private contractor (2) 100.0%
Effect: Quality (1) 100.0%
Effect: Government accountability (1) 100.0%
Anti-corruption (10) 60.0% 50.0%
Trade discrimination (14) 21.4% 85.7%
PP status overview (27) 70.4% 29.6%
Purchase shocks (2) 100.0%
Public versus private procurement (1) 100.0%
PP cost drivers (1) 100.0%
SMEs (1) 100.0%
PP markets (1) 100.0%
Ethics in PP (2) 100.0%
Project based procurement routes (1) 100.0%
Organization of PP function (1) 100.0%
Critique of PP research practice (1) 100.0%

lxxii
C.14.2. Time dimensions per topic
Topic Cross-sectional Longitudinal
Supplier relations (25) 80.0% 20.0%
Make-or-buy (31) 71.0% 29.0%
Selection (65) 86.2% 13.8%
Contracting (53) 83.0% 17.0%
Legal aspects (26) 73.1% 26.9%
PPP (74) 83.8% 16.2%
Innovation procurement (12) 91.7% 8.3%
Contracting-out (75) 72.0% 28.0%
GPP (29) 82.1% 17.9%
e-Procurement (16) 100.0%
Early contractor involvement (1) 100.0%
Lean PP (2) 50.0% 50.0%
Shared services (1) 100.0%
Joint procurement (5) 40.0% 60.0%
Prime contracting (2) 100.0%
Market-based PP (2) 100.0%
Emergency contracting (2) 100.0%
De- / centralization (3) 66.7% 33.3%
PP Partnerships (1) 100.0%
Social procurement (1) 100.0%
Eminent domain vs. purchase of land 100.0%
(1)
Mixed service delivery (2) 50.0% 50.0%
Offsets (1) 100.0%
Promoting SMEs (1) 100.0%
Dual sourcing (1) 100.0%
PP tool (7) 71.4% 28.6%
Effect: Economy (10) 80.0% 20.0%
Effect: Human rights, society (3) 100.0%
Effect: SMEs (2) 100.0%
Effect: Ethics (1) 100.0%
Effect: PP efficiency (2) 50.0% 50.0%
Effect: Private contractor (2) 100.0%
Effect: Quality (1) 100.0%
Effect: Government accountability (1) 100.0%
Anti-corruption (10) 80.0% 20.0%
Trade discrimination (14) 57.1% 42.9%
PP status overview (27) 59.3% 40.7%
Purchase shocks (2) 50.0% 50.0%
Public versus private procurement (1) 100.0%
PP cost drivers (1) 100.0%
SMEs (1) 100.0%
PP markets (1) 100.0%
Ethics in PP (2) 100.0%
Project based procurement routes (1) 100.0%
Organization of PP function (1) 100.0%
Critique of PP research practice (1) 100.0%

lxxiii
 Topic Question- Interview Secondary Experi- Obser- Literature Literature Focus none
naire analysis ment va- review review, group speci-
tion non- fied
academic
Supplier rela- 32.0% 44.0% 4.0% 4.0% 8.0% 8.0% 40.0% 20.0%
tions (25)
Make-or-buy 19.4% 16.1% 38.7% 16.1% 19.4% 16.1%
(31)
Selection (65) 20.0% 23.1% 12.3% 4.6% 3.1% 10.8% 27.7% 1.5% 29.2%
Contracting (53) 17.0% 37.7% 11.3% 9.4% 18.9% 43.4% 3.8% 20.8%
Legal aspects 3.8% 7.7% 26.9% 15.4% 69.2% 11.5%
(26)
PPP (74) 17.6% 29.7% 4.1% 6.8% 13.5% 39.2% 4.1% 32.4%
Innovation pro- 16.7% 50.0% 16.7% 41.7% 66.7% 8.3% 8.3%
curement (12)
C.14.3 Data collection methods per topic

Contracting-out 17.3% 36.0% 17.3% 9.3% 18.7% 45.3% 10.7%

(75)
GPP (29) 20.7% 44.8% 13.8% 3.4% 10.3% 44.8% 3.4% 3.4%
e-Procurement 43.8% 31.3% 18.8% 18.8% 6.3% 31.3%
(16)
Early contractor 100.0% 100.0% 100.0%
involvement (1)
Lean PP (2) 50.0% 50.0%
Shared services 100.0%
(1)
Joint procure- 40.0% 40.0% 20.0%
ment (5)
Prime contract- 50.0% 50.0% 50.0%
ing (2)
Continued on next page

lxxiv
 Data collection methods per topic – continued from previous page
Topic Question- Interview Secondary Experi- Obser- Literature Literature Focus none
naire analysis ment va- review review, group speci-
tion non- fied
academic
Market-based 100.0% 50.0% 100.0%
PP (2)
Emergency con- 50.0% 50.0%
tracting (2)
De- / centraliza- 33.3% 33.3% 33.3%
tion (3)
PP Partnerships 100.0%
(1)
Social procure- 100.0%
ment (1)
Eminent domain 100.0%
vs. purchase of
land (1)
Mixed service 50.0% 50.0%
delivery (2)
Offsets (1) 100.0%
Promoting 100.0%
SMEs (1)
Dual sourcing 100.0%
(1)
PP tool (7) 14.3% 28.6% 14.3% 57.1% 14.3% 28.6%
Effect: Economy 20.0% 10.0% 60.0% 20.0% 20.0%
(10)
Effect: Human 33.3% 66.7% 33.3%
rights, society
(3)
Effect: SMEs (2) 50.0% 50.0% 50.0%
Continued on next page

lxxv
 Data collection methods per topic – continued from previous page
Topic Question- Interview Secondary Experi- Obser- Literature Literature Focus none
naire analysis ment va- review review, group speci-
tion non- fied
academic
Effect: Ethics 100.0%
(1)
Effect: PP effi- 50.0% 50.0%
ciency (2)
Effect: Private 50.0% 50.0% 50.0%
contractor (2)
Effect: Quality 100.0%
(1)
Effect: Gov- 100.0%
ernment ac-
countability
(1)
Anti-corruption 30.0% 20.0% 20.0% 10.0% 10.0% 30.0% 10.0% 40.0%
(10)
Trade discrimi- 7.1% 14.3% 35.7% 7.1% 35.7% 7.1% 35.7%
nation (14)
PP status 22.2% 18.5% 22.2% 3.7% 33.3% 37.0% 3.7% 7.4%
overview (27)
Purchase shocks 50.0% 50.0%
(2)
Public versus 100.0% 100.0%
private procure-
ment (1)
PP cost drivers 100.0%
(1)
SMEs (1) 100.0%
PP markets (1) 100.0%
Ethics in PP (2) 50.0% 50.0% 50.0%
Continued on next page

lxxvi
 Data collection methods per topic – continued from previous page
Topic Question- Interview Secondary Experi- Obser- Literature Literature Focus none
naire analysis ment va- review review, group speci-
tion non- fied
academic
Project based 100.0%
procurement
routes (1)
Organization of 100.0%
PP function (1)
Critique of PP 100.0%
research practice
(1)

lxxvii
 Topic Survey Literature Meta- Single Multiple Quantitative
research study study case case mod-
study study elling
Supplier relations (25) 36.0% 8.0% 24.0% 28.0% 8.0%
Make-or-buy (31) 22.6% 6.5% 16.1% 9.7% 9.7% 35.5%
Selection (65) 23.1% 12.3% 6.2% 16.9% 13.8% 33.8%
Contracting (53) 15.1% 13.2% 1.9% 30.2% 18.9% 20.8%
Legal aspects (26) 3.8% 23.1% 0.0% 46.2% 15.4% 11.5%
PPP (74) 21.6% 16.2% 2.7% 29.7% 20.3% 14.9%
Innovation procurement (12) 8.3% 25.0% 8.3% 33.3% 33.3% 8.3%
Contracting-out (75) 20.0% 14.7% 6.7% 32.0% 21.3% 5.3%
GPP (29) 27.6% 10.3% 3.4% 41.4% 17.2%
e-Procurement (16) 37.5% 50.0% 18.8%
Early contractor involvement (1) 100.0%
C.14.4 Research strategies per topic

Lean PP (2) 50.0% 50.0%

Shared services (1) 100.0%
Joint procurement (5) 20.0% 60.0% 20.0%
Prime contracting (2) 50.0% 50.0%
Market-based PP (2) 50.0% 50.0%
Emergency contracting (2) 50.0% 50.0%
De- / centralization (3) 33.3% 33.3% 33.3%
PP Partnerships (1) 100.0%
Social procurement (1) 100.0%
Eminent domain vs. purchase of 100.0%
land (1)
Mixed service delivery (2) 50.0% 50.0%
Offsets (1) 100.0%
Promoting SMEs (1) 100.0%
Dual sourcing (1) 100.0%
PP tool (7) 14.3% 71.4% 14.3% 14.3%
Effect: Economy (10) 20.0% 10.0% 10.0% 30.0% 30.0%
Effect: Human rights, society (3) 33.3% 33.3% 33.3%

lxxviii
Continued on next page
 Research strategies per topic – continued from previous page
Topic Survey Literature Meta- Single Multiple Quantitative
research study study case case mod-
study study elling
Effect:SMEs (2) 50.0% 50.0%
Effect:Ethics (1) 100.0%
Effect:PP efficiency (2) 50.0% 50.0%
Effect:Private contractor (2) 50.0% 50.0%
Effect:Quality (1) 100.0%
Effect:Government accountabil- 100.0%
ity (1)
Anti-corruption (10) 30.0% 30.0% 20.0% 20.0%
Trade discrimination (14) 7.1% 14.3% 14.3% 14.3% 57.1%
PP status overview (27) 18.5% 29.6% 11.1% 25.9% 14.8%
Purchase shocks (2) 100.0%
Public versus private procure- 100.0%
ment (1)
PP cost drivers (1) 100.0%
SMEs (1) 100.0%
PP markets (1) 100.0%
Ethics in PP (2) 50.0% 50.0%
Project based procurement routes 100.0%
(1)
Organization of PP function (1) 100.0%
Critique of PP research practice 100.0%
(1)

lxxix
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Agents or stewards: 2007 Journal of Public 100 90 95 Van Slyke, DM
Using theory to under- Administration Re-
stand the government- search and Theory
nonprofit social service
contracting relation-
ship
Relationship man- 2007 International Jour- 55 55 Smyth H., Ed-
agement in the man- nal of Project Man- kins A.
C.15.1. Supplier relations

agement of PFI/PPP agement

projects in the UK
Transaction costs, rela- 2003 Journal of Pur- 51 51 Parker D.
tional contracting and chasing and Supply
public private partner- Management
ships: A case study of
UK defence
The economics of part- 1997 European Journal 48 48 Parker D.,
C.15. High impact papers per topic

nership sourcing ver- of Purchasing and Hartley K.

sus adversarial compe- Supply Manage-
tition: A critique ment
Partnerships and 2002 Public Administra- 43 28 35.5 Erridge, A,
public procurement: tion Greer, J
Building social cap-
ital through supply
relations
Continued on next page

lxxx
 Supplier relations – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The dynamics of con- 2008 Journal of Pur- 27 27 Zheng J.,
tractual and relational chasing and Supply Roehrich J.K.,
governance: Evidence Management Lewis M.A.
from long-term public-
private procurement
arrangements
Partnering on defense 2002 Journal Of Con- 29 21 25 Glagola, CR,
contracts struction Engineer- Sheedy, WM
ing And Manage-
ment
Asymmetry in procure- 2006 The Economic 14 16 15 Flambard, V,
ment auctions: Evi- Journal Perrigne, I
dence from snow re-
moval contracts
From long-term to 2001 Public Administra- 15 15 Lane, JE
short-term contracting tion
Contractual manage- 2006 Journal of Pro- 18 6 12 Edkins A.J.,
ment in PPP projects: fessional Issues Smyth H.J.
Evaluation of legal in Engineering
versus relational con- Education and
tracting for service Practice
delivery
Trust and contract 2007 Local Government 13 10 11.5 Brown, TL, Po-
completeness in the Studies toski, M, Van
public sector Slyke, DM
Trust-based rela- 1997 Public Money & 12 9 10.5 Davis, H,
tionships in local Management Walker, B
government contract-
ing
Continued on next page

lxxxi
 Supplier relations – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The Effectiveness 2010 Nonprofit Manage- 7 7 Chen, B,
of Nonprofit Lead- ment and Leader- Graddy, EA
Organization Networks ship
for Social Service
Delivery
The effectiveness of re- 2007 Public Administra- 7 7 7 Davis, P
lational contracting in tion
a temporary public or-
ganization: Intensive
collaboration between
an English local au-
thority and private con-
tractors
Legal issues associated 2006 Journal of Pro- 9 4 6.5 Pryke S.D.
with emergent actor fessional Issues
roles in innovative U.K. in Engineering
procurement: Prime Education and
contracting case study Practice
Perspectives on con- 1999 Local Government 6 7 6.5 Walker, B,
tractual relationships Studies Davis, H
and the move to
best value in local
authorities
Contracting in ten En- 2000 International Jour- 6 6 Darwin J., Du-
glish local authorities: nal of Public Sector berley J., John-
Preferences and prac- Management son P.
tices
Continued on next page

lxxxii
 Supplier relations – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
From bilateral to tri- 2005 Public Administra- 4 3 3.5 West, K
lateral governance in tion
local government con-
tracting in France
Building public health 1998 American Jour- 3 3 3 Rosnick, M
goals into the purchas- nal of Preventive
ing process: Managed Medicine
care perspective
Sustainable part- 2011 Natural Resources 3 3 3 Otsuki K.
nerships for a green Forum
economy: A case study
of public procurement
for home-grown school
feeding
Satisfaction of contract 2006 Children and 4 1 2.5 Barton, WH,
provider agencies with Youth Services Folaron, G,
a State’s Child Welfare Review Busch, M,
Agency Hostetter, C
The impact of sustain- 2012 Industrial Market- 2 0 2 Oruezabala G.,
able public procure- ing Management Rico J.-C.
ment on supplier man-
agement - The case of
French public hospitals
Institutional sources of 2009 Public Manage- 2 2 Saz-Carranza
distrust in government ment Review A., Serra A.
contracting: A com-
parison between home-
based and residential
social services in Spain
Continued on next page

lxxxiii
 Supplier relations – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Bidder asymmetry in 2010 Review of Indus- 3 1 2 Estache A.,
infrastructure procure- trial Organization Iimi A.
ment: Are there any
fringe bidders?
To Trust or Not to 2012 Journal of Public 0 0 Lamothe, M,
Trust? What Matters Administration Re- Lamothe, S
in Local Government- search and Theory
Vendor Relationships?

lxxxiv
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Privatization and its re- 2004 Journal of Public 117 99 108 Hefetz, A,
verse: Explaining the dy- Administration Re- Warner, M
namics of the government search and Theory
C.15.2 Make-or-buy

contracting process
Transaction costs and in- 2003 Journal of Public 100 88 94 Brown, TL, Po-
stitutional explanations for Administration Re- toski, M
government service produc- search and Theory
tion decisions
Contracting for government 2010 The Journal of In- 47 33 40 Levin J., Tadelis
services: Theory and evi- dustrial Economics S.
dence from U.S. cities
Rural-urban differences in 2003 Environment and 40 37 38.5 Warner M.,
privatization: Limits to the Planning C: Gov- Hefetz A.
competitive state ernment and Policy
Ownership and production 2003 Fiscal Studies 37 38 37.5 Ohlsson, H.
costs: Choosing between
public production and
contracting-out in the case
of Swedish refuse collection
Urban rail transit PPPs: 2007 Transport Policy 25 15 20 Phang S.-Y.
Survey and risk assessment
of recent strategies
Outsourcing: Uncovering 2007 International Pub- 13 13 Young S.
the complexity of the deci- lic Management
sion Journal
Continued on next page

lxxxv
 Make-or-buy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Comparative performance 2010 Construction Man- 13 13 Raisbeck P.,
of PPPs and traditional agement and Eco- Duffield C., Xu
procurement in Australia nomics M.
Which contract state? 1997 Australian Journal 12 13 12.5 Hood, C
Four perspectives on over- of Public Adminis-
outsourcing for public tration
services
Exploring Variations in 2008 The American Re- 12 8 10 Fernandez,
Contracting for Services view of Public Ad- S, Ryu, JE,
Among American Local ministration Brudney, JL
Governments Do Politics
Still Matter?
Public versus private own- 2010 Journal of Public 9 8 8.5 Hoppe, EI,
ership: Quantity contracts Economics Schmitz, PW
and the allocation of invest-
ment tasks
Solid-waste contracting- 2001 Canadian Public 6 9 7.5 McDavid, JC
out, competition, and Administration
bidding practices among
Canadian local governments
Public-private Partnerships 2009 International Jour- 10 4 7 de Bettignies,
and the privatization of fi- nal of Industrial JE, Ross, TW
nancing: An incomplete Organization
contracts approach
Continued on next page

lxxxvi
 Make-or-buy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Transit service contracting 1998 Transportation 10 3 6.5 McCullough,
and cost-efficiency Research Record; WS, Taylor, BD,
Transit Planning, Wachs, M
Management,
Marketing, New
Technology, Capac-
ity, And Qual
An incomplete contract per- 2005 Journal of Eco- 6 6 6 Martimort, D,
spective on public good pro- nomic Surveys De Donder, P,
vision de Villemeur,
EB
A comparison of construc- 2009 Review of Indus- 10 2 6 Blanc-Brude F.,
tion contract prices for tra- trial Organization Goldsmith H.,
ditionally procured roads Valila T.
and public-private partner-
ships
The politics and admin- 2004 Policy Studies 9 3 6 Nicholson-
istration of privatization: Journal Crotty, S
Contracting out for correc-
tions management in the
United States
Insourcing and outsourcing: 2012 Journal of the 6 3 4.5 Warner M.E.,
The dynamics of privatiza- American Planning Hefetz A.
tion among U.S. Municipal- Association
ities 2002-2007
The determinants of pub- 2009 International Jour- 5 4 4.5 David, G, Chi-
lic versus private provision nal of Industrial ang, AJ
of Emergency Medical Ser- Organization
vices
Continued on next page

lxxxvii
 Make-or-buy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Contracting between public 1997 Administration 4 3 3.5 Libby A.M.
and private providers: A and Policy in Men-
survey of mental health ser- tal Health and
vices in California Mental Health
Services Research
The present and future of 2000 Public Administra- 5 2 3.5 Anderson J.,
public sector extension in tion and Develop- Van Crowder L.
Africa: Contracting out or ment
contracting in?
Public sector comparators 2010 Transportation 3 3 3 Bain R.
for UK PFI roads: Inside
the black box
Limiting aspects of con- 2004 Public Administra- 3 2 2.5 Lember, V
tracting out in transitional tion and Develop-
countries: The case of Esto- ment
nian prisons
Australian public-sector 2008 Australian Ac- 2 2 2 Bisman J.E.
outsourcing in the ’Golden counting Review
Era’: Cost savings evidence
or anecdote?
Contracting out by local 2001 Administration & 1 1 1 Brown, TL
governments in transition- Society
ing nations - The role
of technical assistance in
Ukraine
Choosing Whether to Buy 2011 Social Policy and 1 0 0.5 Plantinga M,
or Make: The Contracting Administration de Ridder K.,
Out of Employment Rein- Corra, A.
tegration Services by Dutch
Municipalities

lxxxviii
Continued on next page
 Make-or-buy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Cost performance compar- 2007 Journal of Manage- 1 0 0.5 Kuprenas, JA,
ison of two public sector ment in Engineer- Nasr, EB
project procurement tech- ing
niques
Electronic government: 2003 Lecture Notes in 0 0 0 Scholl, HJ
Make or buy? Computer Science
Using commercial discipline 2012 Contemporary 0 0 0 Markowski S.,
to improve australian de- Economic Policy Wylie R.
fence procurement: Mis-
placed enthusiasm?
Ownership and Cost- 2012 Australian Eco- 0 0 0 Dalen, DM,
Sharing Contracts nomic Papers Moen, ER
Internal or External Pro- 2011 Local Government 0 0 0 Hansen, JR,
duction and Satisfaction Studies Mols, NP,
with the Chosen Sourcing Villadsen, AR
in Danish Municipali-
ties: Different Theoretical
Explanations

lxxxix
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Competitive tendering in lo- 1998 Public Administra- 56 46 51 Boyne, GA
cal government: A review of tion
C.15.3 Selection

theory and evidence

Public-private partnerships 2004 Construction Man- 38 38 Ahadzi M.,
and contract negotiations: agement and Eco- Bowles G.
An empirical study nomics
Exploring success factors 2004 Government Infor- 36 22 29 Chu, PY, Hsiao,
for Taiwan’s government mation Quarterly N, Lee, FW,
electronic tendering system: Chen, CW
behavioral perspectives
from end users
The selection of manage- 1998 International Jour- 23 23 Corcoran J.,
ment consultants: How are nal of Public Sector McLean F.
governments dealing with Management
this difficult decision? An
exploratory study
Discriminatory public pro- 1998 Journal of Public 27 15 21 Naegelen F.,
curement policy and cost re- Economics Mougeot M.
duction incentives
Towards an e-Government 2007 European Journal 26 13 19.5 Hackney, R,
efficiency agenda: the Of Information Jones, S, Losch,
impact of information and Systems A
communication behaviour
on e-Reverse auctions in
public sector procurement
Continued on next page

xc
 Selection – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Transacting under a 2008 Transportation Re- 22 11 16.5 Hensher, DA,
performance-based con- search Part A Stanley, J
tract: The role of nego-
tiation and competitive
tendering
Public-private partner- 2006 Journal of Pur- 15 15 Zitron J.
ship projects: Towards a chasing and Supply
model of contractor bidding Management
decision-making
Public sector restructuring 2000 Regional Studies 15 13 14 Pinch, PL, Pat-
and regional development: terson, A
The impact of compulsory
competitive tendering in the
UK
A study on the effective- 2006 International Jour- 13 13 Tzeng W.-L., Li
ness of the most advanta- nal of Project Man- J.C.-C., Chang
geous tendering method in agement T.-Y.
the public works of Taiwan
Contract service firms in lo- 1999 Regional Studies 15 10 12.5 Reimer, S
cal authorities: Evolving ge-
ographies of activity
Auction procedures and 2009 Utilities Policy 16 8 12 Amaral, M,
competition in public ser- Saussier, S,
vices: The case of urban Yvrande-Billon,
public transport in France A
and London
Contractor selection in gov- 2009 European Journal 13 10 11.5 Padhi, SS, Mo-
ernment procurement auc- of Industrial Engi- hapatra, PKJ
tions: a case study neering
Continued on next page

xci
 Selection – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Using a DEA-cross effi- 2012 European Journal 13 10 11.5 Falagario M.,
ciency approach in public of Operational Re- Sciancalepore
procurement tenders search F., Costantino
N., Pietroforte
R.
Trust-based relationships in 1997 Public Money & 12 9 10.5 Davis, H,
local government contract- Management Walker, B
ing
Improving concession- 2004 Journal Of Con- 13 7 10 Zhang, XQ
aire selection protocols in struction Engineer-
public/private partnered ing And Manage-
infrastructure projects ment
Corruption in public con- 2006 Annals of Public 10 10 Boehm F.,
tracting auctions: The role and Cooperative Olaya J.
of transparency in bidding Economics
processes
Environmental criteria in 2009 Ecological Eco- 12 7 9.5 Nissinen A.,
the public purchases above nomics Parikka-Alhola
the EU threshold values K., Rita H.
by three Nordic countries:
2003 and 2005
Evaluation of tenders in in- 2000 Decision Support 13 5 9 Rapcsak, T,
formation technology Systems Sagi, Z, Toth, T,
Ketszeri, L
Transaction costs in trans- 2010 Transport Reviews 11 7 9 Sollno A.S., de
port public-private partner- Santos P.G.
ships: Comparing procure-
ment procedures
Continued on next page

xcii
 Selection – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Effects of transparency in 2009 Review of Indus- 11 6 8.5 Ohashi H.
procurement practices on trial Organization
government expenditure: A
case study of municipal
public works
The challenge of competi- 2007 Public Money & 11 6 8.5 Loader K.
tive procurement: Value for Management
money versus small business
support
Contracting and negotia- 1998 Public Administra- 9 8 8.5 Gooden, V
tion: Effective practices tion Review
of successful human service
contract managers
Post-objective determi- 2010 European Journal 7 6 6.5 Lorentziadis
nation of weights of the of Operational Re- P.L.
evaluation factors in public search
procurement tenders
SMES and public procure- 2003 Review of Eco- 6 6 Morand P.-H.
ment policy nomic Design
Procurement contract- 2011 The Quarterly 6 6 6 Lewis G., Bajari
ing with time incentives: Journal of Eco- P.
Theory and evidence nomics
Full disclosure of tender 2010 Journal of Pur- 6 5 5.5 Mateus, R, Fer-
evaluation models: Back- chasing and Supply reira, JA, Car-
ground and application in Management reira, J
Portuguese public procure-
ment
Continued on next page

xciii
 Selection – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Purchasing UK public sec- 2001 European Journal 5 5 Hoxley M.
tor property and construc- of Purchasing and
tion professional services: Supply Manage-
Competition v quality ment
Bribery and public pro- 2008 Public Choice 5 4 4.5 Buchner, S,
curement: an experimental Freytag, A,
study Gonzalez, LG,
Guth, W
Competitive tendering and 1998 Australian Journal 5 3 4 Rimmer, S
outsourcing - Initiatives and of Public Adminis-
methods tration
Mitigating contractual haz- 2008 Construction Man- 4 4 Waara F.
ards in public procurement: agement and Eco-
A study of Swedish local au- nomics
thorities
Opening up Public Services 2003 Annals of Public 4 4 Bance P.
to Competition by Putting and Cooperative
Them Out to Tender: An Economics
Evaluation
Public sector comparators 2010 Transportation 3 3 3 Bain R.
for UK PFI roads: Inside
the black box
An ANP- and AHP-based 2010 Journal of the Op- 3 2 2.5 Pastor-
approach for weighting cri- erational Research Ferrando, JP,
teria in public works bid- Society Aragones-
ding Beltran, P,
Hospitaler-
Perez, A,
Garcia-Melon,
M

xciv
Continued on next page
 Selection – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
A multiattribute sealed-bid 2011 Decision Analysis 3 2 2.5 Simon J., Melese
procurement auction with F.
multiple budgets for govern-
ment vendor selection
The role of the discount rate 2010 Transportation Re- 2 2 2 Vassallo, JM
in tendering highway con- search Part A
cessions under the LPVR
approach
Public procurement incen- 2009 Architectural engi- 2 2 Sporrong J.,
tives for sustainable design neering and design Brochner J.
services: Swedish experi- management
ences
Towards a pan-european 2012 International Jour- 3 1 2 Alvarez J.M.,
e-procurement platform nal of Software Labra J.E.,
to aggregate, publish and Engineering and Cifuentes F.,
search public procurement Knowledge Engi- Alor-Hernandez
notices powered by linked neering G., Sanchez C.,
open data: The moldeas Luna J.A.G.
approach
Reputation, competition, 2012 International Jour- 1 2 1.5 Spagnolo G.
and entry in procurement nal of Industrial
Organization
Regulating joint bidding in 2009 Journal of Compe- 2 1 1.5 Albano G.L.,
public procurement tition Law and Eco- Spagnolo G.,
nomics Zanza M.
A public procurement com- 2011 Decision Support 3 0 1.5 Chen, J, Huang,
binatorial auction mecha- Systems H, Kauffman,
nism with quality assign- RJ
ment
Continued on next page

xcv
 Selection – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Balancing the additional 2012 Journal of Pur- 2 1 1.5 Costantino, N,
costs of purchasing and the chasing and Supply Dotoli, M, Fala-
vendor set dimension to Management gario, M, Scian-
reduce public procurement calepore, F
costs
Government concession 2004 Economic Develop- 1 2 1.5 Paredes, RD,
contracts in Chile: The ment and Cultural Sanchez, JM
role of competition in the Change
bidding process
Best value concessionaire 2009 Expert Systems 1 1 1 Zhang, XQ
selection through a fuzzy with Applications
logic system
Public Procurement at the 2003 Expert Systems 1 1 Obermann G.,
Local Level in Austria: The with Applications Kostal T.
Economic Consequences
of Compulsory Competi-
tive Tendering for Public
Services
Public procurement design: 2012 International Jour- 2 0 1 Tadelis, S
Lessons from the private nal of Industrial
sector Organization
Are public sector procure- 2011 Public Money & 1 1 1 Loader K.
ment models and prac- Management
tices hindering small and
medium suppliers?
Combinatorial auctions in 2012 Journal of Public 1 1 Lunander A.,
public procurement: Expe- Procurement Lundberg S.
riences from Sweden
Continued on next page

xcvi
 Selection – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Tendering procedures and 1999 International Ad- 1 1 Mardas D.
buy-national policies vances in Economic
Research
Perceived benefits related 2012 Asian Journal of 1 1 Neupane A.,
to anti-corruption from e- Information Tech- Soar J., Vaidya
tendering system in Nepal nology K.
Striking a balance between 1998 Administrative 1 1 1 Heifetz, KR
government efficiency and Law Review
fairness to contractors: Past
performance evaluations in
government contracts
Publishing construction 2012 Civil Engineering 1 1 1 Kenny, C
contracts to improve effi- Special Issue
ciency and governance
Correlating Bid Price with 2010 Transportation Re- 1 1 1 Shrestha, PP,
the Number of Bidders and search Record Pradhananga, N
Final Construction Cost of
Public Street Projects
Determinants of the number 2010 Energy Economics 1 1 1 Hattori, T
of bidders in the competi-
tive procurement of electric-
ity supply contracts in the
Japanese public sector
Public Procurement Auc- 2012 Review of Indus- 1 0 0.5 Onur, I, Ozcan,
tions and Competition in trial Organization R, Tas, BKO
Turkey
How does Government Pro- 2004 Building Research 1 0 0.5 Perng, YH,
curement Law affect bid- & Information Chang, CL
ding price competition in
Taiwan?

xcvii
Continued on next page
 Selection – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Risk assessment of com- 1998 Transportation Re- 1 0 0.5 Crowley L.G.,
petitive procurement on search Record 1649 Madewell J.L.
Alabama highway projects
with Texas comparisions
Free Riding in Combinato- 2009 B E Journal Of 1 0 0.5 Marechal, F,
rial First-Price Sealed-Bid Theoretical Eco- Morand, PH
Auctions nomics
The Politics of Transaction 1999 Public Money & 1 0 0.5 Choi Y.-C.
Costs Management
Is Competitive Contract- 2012 International Pub- 1 0 0.5 Jing, YJ, Chen,
ing Really Competitive? lic Management B
Exploring Government Journal
Nonprofit Collaboration in
China
An Optimization Model- 2012 Forest Science 0 0 0 Snyder, SA,
ing Approach to Awarding Stockmann, KD,
Large Fire Support Wildfire Morris, GE
Helicopter Contracts from
the US Forest Service
Selection of contractors for 2011 Gazi University 0 0 Yilmaz A., Er-
middle-sized projects in Journal of Science gonul S.
Turkey
Environmental impacts and 2012 Journal of Public 0 0 Parikka-Alhola
the most economically ad- Procurement K., Nissinen A.
vantageous tender in public
procurement
Quality or Price? Evidence 2012 Public Finance Re- 0 0 Estache A., Iimi
from ODA-Financed Public view A.
Procurement
Continued on next page

xcviii
 Selection – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Welfare loss in linear price- 2007 International Game 0 0 Koh W.T.H.
preference procurement Theory Review
auctions

xcix
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The allocation of risk in 2005 International Jour- 135 135 Bing L., Ak-
PPP/PFI construction nal of Project Man- intoye A.,
projects in the UK agement Edwards P.J.,
C.15.4 Contracting

Hardcastle C.
Contract-management ca- 2003 Public Administra- 68 61 64.5 Brown, TL, Po-
pacity in municipal and tion Review toski, M
county governments
Good project governance 2006 International Jour- 53 53 Abednego M.P.,
for proper risk allocation in nal of Project Man- Ogunlana S.O.
public-private partnerships agement
in Indonesia
Managing the public service 2004 Public Administra- 36 35 35.5 Brown, TL, Po-
market tion Review toski, M
Preferred risk allocation in 2010 International Jour- 34 24 29 Ke, YJ, Wang,
China’s public-private part- nal of Project Man- SQ, Chan, APC,
nership (PPP) projects agement Lam, PTI
Performance-based con- 2007 The American Re- 27 28 27.5 Heinrich, CJ,
tracting in social welfare view of Public Ad- Choi, Y
programs ministration
Ensuring accountability in 2002 The American Re- 27 23 25 Dicke, LA
human services contracting view of Public Ad-
- Can stewardship theory fill ministration
the bill?
Continued on next page

c
 Contracting – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Contracting for manage- 2006 Journal of Policy 21 21 21 Brown, T, Poto-
ment: Assessing manage- Analysis and Man- ski, M
ment capacity under alter- agement
native service delivery ar-
rangements
The practice of contract- 2008 Public Administra- 18 15 16.5 Reeves E.
ing in public private part- tion
nerships: Transaction costs
and relational contracting
in the Irish schools sector
Transacting under a 2008 Transportation Re- 22 11 16.5 Hensher, DA,
performance-based con- search Part A Stanley, J
tract: The role of nego-
tiation and competitive
tendering
Contracts in the real world: 2005 Social Science & 14 16 15 Palmer N., Mills
Case studies from Southern Medicine A.
Africa
Performance measurement: 2006 International Jour- 15 15 Greiling D.
A remedy for increasing the nal of Productivity
efficiency of public services? and Performance
Management
The role of contract design 2004 Children and 15 12 13.5 Unruh, JK,
in privatization of child wel- Youth Services Hodgkin, D
fare services: the Kansas ex- Review
perience
Trust and contract com- 2007 Local Government 13 10 11.5 Brown, TL, Po-
pleteness in the public sec- Studies toski, M, Van
tor Slyke, DM
Continued on next page

ci
 Contracting – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Rediscovering implementa- 2001 Australian Journal 9 11 10 Chalmers J.,
tion: Public sector contract- of Public Adminis- Davis G.
ing and human services tration
Outcome-orientation in per- 2007 International 9 9 9 Proeller, I
formance contracts: empiri- Review of Admin-
cal evidence from Swiss lo- istrative Sciences
cal governments
Performance-based con- 2002 Milbank Quarterly 9 8 8.5 Chapin, J, Fet-
tracting in Wisconsin ter, B
public health: Transform-
ing state-local relations
Contracting and negotia- 1998 Public Administra- 9 8 8.5 Gooden, V
tion: Effective practices tion Review
of successful human service
contract managers
Contracting capacity and 2009 Public Administra- 8 8 8 Yang, K., Hsieh,
perceived contracting per- tion Review J.Y., Li, T.S.
formance: Nonlinear effects
and the role of time
Public procurement as an 2009 Science and Public 8 8 Rolfstam M.
innovation policy tool: The Policy
role of institutions
Proactive contracting in 2009 International Jour- 9 7 8 Tieva, A, Jun-
Finnish PPP projects nal Of Strategic nonen, JM
Property Manage-
ment
Contract renewal and incen- 2006 International Jour- 9 4 6.5 Dalen, DM,
tives in public procurement nal of Industrial Moen, ER, Riis,
Organization C
Continued on next page

cii
 Contracting – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Government-to-government 2008 International Pub- 7 6 6.5 Marvel, MK,
contracting: Stewardship, lic Management Marvel, HP
agency, and substitution Journal
Applying principles for 2004 Journal of public 7 6 6.5 Honore P.A.,
outcomes-based contracting health management Simoes E.J.,
in a public health program. and practice Moonesinghe R.,
Kirbey H.C.,
Renner M.
Complex management con- 1999 Public Administra- 5 5 5 Hubbard, M,
tracts: the case of customs tion and Develop- Delay, S, Devas,
administration in Mozam- ment N
bique
SHAPING THE PROVI- 2009 Public Performance 5 5 Marvel, MK,
SION OF OUTSOURCED & Management Re- Marvel, HP
PUBLIC SERVICES Incen- view
tive Efficacy and Service
Delivery
Long term risk sharing con- 2010 Telecommunications 5 5 Fredebeul-
tracts as an approach to es- Policy Krein, M,
tablish public-private part- Knoben, W
nerships for investment into
next generation access net-
works
Modeling offset policy in 2003 Journal Of Policy 7 2 4.5 Taylor, TK
government procurement Modeling
Contracting-out in urban 2009 Urban Forestry & 4 4 4 Lindholst A.C.
green-space management: Urban Greening
Instruments, approaches
and arrangements
Continued on next page

ciii
 Contracting – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The changing nature of con- 2010 Abacus 4 3 3.5 English L., Bax-
tracting and trust in public- ter J.
private partnerships: The
case of Victorian PPP pris-
ons
Green public procurement: 2010 Review of Euro- 3 3 Palmujoki, A,
Analysis on the use of en- pean Community & Parikka-Alhola,
vironmental criteria in con- International Envi- K, Ekroos, A
tracts ronmental Law
Flexible build-operate- 2012 Transportation Re- 3 3 3 Tan, ZJ, Yang,
transfer contracts for road search Part B H
franchising under demand
uncertainty
Risk management in pub- 2010 Innovation: The 4 2 3 Kalvet, T, Lem-
lic procurement for innova- European Journal ber, V
tion: the case of Nordic- of Social Science
Baltic Sea cities Research
Breaking Down the Silos: 2012 Journal of Public 3 3 Kearney K.A.,
Lessons Learned From the Child Welfare Bloom-Ellis B.,
Expansion of Performance- Thompson R.
Based Contracting to Res-
idential Treatment Services
in Illinois
Government concession 2004 Economic Develop- 1 2 1.5 Paredes, RD,
contracts in Chile: The ment and Cultural Sanchez, JM
role of competition in the Change
bidding process
Continued on next page

civ
 Contracting – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Bureaucrats as purchasers 2011 Public Administra- 2 1 1.5 Zaidi S., May-
of health services: Limita- tion and Develop- hew S.H.,
tions of the public sector for ment Palmer N.
contracting
The implication of open 2012 Disaster Preven- 1 1 1 Wang, J.-J.
contract to emergency plan- tion Management
ning
Effectiveness of safety- 2012 Transportation Re- 1 1 1 Rangel, T, Vas-
based incentives in Public search Part A sallo, JM, Are-
Private Partnerships: Ev- nas, B
idence from the case of
Spain
Public goods and the hold- 2012 Economics Letters 1 1 1 Schmitz, PW
up problem under asymmet-
ric information
Public procurement design: 2012 International Jour- 2 0 1 Tadelis, S
Lessons from the private nal of Industrial
sector Organization
Shared services: An outline 2010 Computer Law and 1 1 Turle M.
of key contractual issues Security Review:
The International
Journal of Technol-
ogy and Practice
Government and the 2007 Journal of Public 1 0 0.5 Wickelgren,
reverse-holdup problem Economic Theory A.L.
Government contracting op- 1999 Defence and Peace 1 0 0.5 Keating, EG
tions: A model and applica- Economics
tion
Continued on next page

cv
 Contracting – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Reforming social services 2008 Australian Journal 0 0 0 Wong, H.K.
in Hong Kong: The role of Public Adminis-
of contracting and perfor- tration
mance management in the
non-profit sector
How Hollow Can We Go? A 2012 The American Re- 0 0 0 Yang, KF, Van-
Case Study of the Florida’s view of Public Ad- Landingham, G
Efforts to Outsource Over- ministration
sight of Privatized Child
Welfare Services
Good Rules or bad rules in 2012 Halduskultuur - 0 0 Rolfstam M.
public procurement of inno- Administrative
vation: But is it really the Culture
(right) question?
Allocation of control rights 2009 International Jour- 0 0 0 Zhang, Z, Jia,
and cooperation efficiency nal Of Health M, Wan, DF
in public-private partner- Care Finance &
ships: theory and evidence Economics
from the Chinese pharma-
ceutical industry
Contractual uncertainty, 2005 Journal of Public 0 0 Lonsdale C.
power and public contract- Policy
ing
Ownership and Cost- 2012 Australian Eco- 0 0 0 Dalen, DM,
Sharing Contracts nomic Papers Moen, ER
Contracting: The Queens- 1997 Australian Eco- 0 0 Hollander, R
land Housing Commission nomic History
experience, 1945-1957 Review
Continued on next page

cvi
 Contracting – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The diffusion of risks in 2012 Accounting Audit- 0 0 0 Demirag, I,
public private partnership ing & Accountabil- Khadaroo, I,
contracts ity Journal Stapleton, P,
Stevenson, C
Purchasing public services: 2009 The China Non- 0 0 Le Y.
The contract-oriented profit Review
model for cooperation
between government and
civil organizations - The
case of shanghai dapuqiao
community culture services
center
Managerial challenges in 2011 Public Administra- 0 0 0 Lindholst A.C.,
public service contracting: tion Bogetoft P.
Lessons in green-space man-
agement

cvii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Making the market work for 2003 Journal of Environ- 11 11 Kunzlik, P
the environment: Accep- mental Law
tance of (some) ’green’ con-
tract award criteria in pub-
C.15.5 Legal aspects

lic procurement
The economic impact of 1998 World Economy 8 11 9.5 Gordon H., Rim-
the European Union regime mer S., Arrow-
on public procurement: smith S.
Lessons for the WTO
Protecting the environment 2008 Natural Resources 11 7 9 Bolton P.
through public procure- Forum
ment: The case of South
Africa
Public procurement direc- 1999 Public Administra- 9 7 8 Martin S., Hart-
tives in the European union: tion ley K., Cox A.
A study of local authority
purchasing
Full disclosure of tender 2010 Journal of Pur- 6 5 5.5 Mateus, R, Fer-
evaluation models: Back- chasing and Supply reira, JA, Car-
ground and application in Management reira, J
Portuguese public procure-
ment
Privatization, public goods, 2007 Administration & 5 6 5.5 Gerbasi, J,
and the ironic challenge of Society Warner, ME
free trade agreements
Continued on next page

cviii
 Legal aspects – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Public-private partnerships 2010 Review Of Cen- 5 5 5 Ticar B., Zajc K.
in Slovenia: Recent devel- tral And East
opments and perspectives European Law
Developing public procure- 2006 Common Market 6 2 4 Bovis, CH
ment regulation: Jurispru- Law review
dence and its influence on
law making
Contract compliance: sub- 2002 Journal of Euro- 3 3 3 Fee, R
national and European in- pean Social Policy
fluences in Northern Ireland
Public-Private Partnerships 2010 The American 3 3 Custos, D, Re-
Journal of Com- itz, J
parative Law
Law, economics, and the 1998 Administrative 1 5 3 Kovacic, WE
reinvention of public admin- Law Review
istration: Using relational
agreements to reduce the
cost of procurement regula-
tion and other forms of gov-
ernment intervention in the
economy
Public functions and private 2008 International 2 2 Palmer, S.
services: A gap in human Journal of Consti-
rights protection tutional Law
The transformation of 2007 Journal of Business 2 2 2 Lennerfors T.T.
transparency - On the act Ethics
on public procurement
and the right to appeal in
the context of the war on
corruption

cix
Continued on next page
 Legal aspects – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Effects of the law reform- 2000 Building Research 2 1 1.5 Bologna, R, Del
ing public works contracts & Information Nord, R
on the Italian building pro-
cess
Corruption and public pro- 2010 Journal of Balkan 3 0 1.5 Ateljevic J., Bu-
curement: Example from and Near Eastern dak J.
Croatia Studies
Corruption and accession: 2011 Public Manage- 1 1 Pashev, K:V.
Evidence from public pro- ment Review
curement in Bulgaria
Contracting out: Dutch 2010 Local Government 1 1 1 Wassenaar
municipalities reject the so- Studies M.C., Dijkgraaf
lution for the VAT distor- E., Gradus
tion R.H.J.M.
Green public procurement 2011 Society and Econ- 1 1 Fet A.,
in practice - The case of omy Michelsen O.,
Norway Boer L.
Striking a balance between 1998 Administrative 1 1 1 Heifetz, KR
government efficiency and Law Review
fairness to contractors: Past
performance evaluations in
government contracts
Public procurement design: 2012 International Jour- 2 0 1 Tadelis, S
Lessons from the private nal of Industrial
sector Organization
How does Government Pro- 2004 Building Research 1 0 0.5 Perng, YH,
curement Law affect bid- & Information Chang, CL
ding price competition in
Taiwan?
Continued on next page

cx
 Legal aspects – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Services procurement under 2011 World Trade Re- 0 0 Shingal, A
the WTO’s Agreement on view
Government Procurement:
whither market access?
Stabilization and Associa- 2010 Atlantic Economic 0 0 Mardas D.
tion Agreements (SAAs), Journal
Europe Agreements, and
public procurement
A reflection on the Dutch 2012 Journal of Integra- 0 0 0 Melissen, F,
Sustainable Public Procure- tive Environmental Reinders, H
ment Programme Sciences
EU Enlargement and the 2011 European Law 0 0 0 Engelbrekt, K
Emboldening of Institu- Journal
tional Integrity in Central
and Eastern Europe: The
’Tough Test’ of Public
Procurement
Bypassing public procure- 2011 Regulation & Gov- 0 0 0 Hansson L.,
ment regulation: A study of ernance Holmgren J.
rationality in local decision
making

cxi
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The allocation of risk in 2005 International Jour- 135 135 Bing L., Ak-
PPP/PFI construction nal of Project Man- intoye A.,
projects in the UK agement Edwards P.J.,
Hardcastle C.
Privatization and its re- 2004 Journal of Public 117 99 108 Hefetz, A,
verse: Explaining the dy- Administration Re- Warner, M
namics of the government search and Theory
C.15.6 Procurement strategy

contracting process
The mythology of privatiza- 2003 Public Administra- 115 92 103.5 Van Slyke, DM
tion in contracting for social tion Review
services
Contracting out by the pub- 1997 Oxford Review of 111 94 102.5 Domberger S.,
lic sector: theory, evidence, Economic Policy Jensen P.
prospects
Agents or stewards: Using 2007 Journal of Public 100 90 95 Van Slyke, DM
theory to understand the Administration Re-
government-nonprofit social search and Theory
service contracting relation-
ship
Managing public service 2006 Public Administra- 84 67 75.5 Brown T.L., Po-
contracts: Aligning values, tion Review toski M., Van
institutions, and markets Slyke D.M.
Public procurement and in- 2007 Research Policy 85 61 73 Edler J.,
novation - Resurrecting the Georghiou
demand side L.
Continued on next page

cxii
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Public-private partnerships: 2004 International 76 57 66.5 Bovaird, T
from contested concepts to Review of Admin-
prevalent practice istrative Sciences
Contract-management ca- 2003 Public Administra- 68 61 64.5 Brown, TL, Po-
pacity in municipal and tion Review toski, M
county governments
Relationship management 2007 International Jour- 55 55 Smyth H., Ed-
in the management of nal of Project Man- kins A.
PFI/PPP projects in the agement
UK
The formation of public- 2005 Public Administra- 65 42 53.5 Koppenjan,
private partnerships: tion JFM
Lessons from nine transport
infrastructure projects in
the Netherlands
Good project governance 2006 International Jour- 53 53 Abednego M.P.,
for proper risk allocation in nal of Project Man- Ogunlana S.O.
public-private partnerships agement
in Indonesia
The challenging business 2006 Public Administra- 55 47 51 Bloomfield, P
of long-term public-private tion Review
partnerships: Reflections on
local experience
Transaction costs, rela- 2003 Journal of Pur- 51 51 Parker D.
tional contracting and chasing and Supply
public private partnerships: Management
A case study of UK defence
Continued on next page

cxiii
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Developing new forms of 2006 Public Administra- 55 44 49.5 Bovaird T.
partnership with the ’Mar- tion
ket’ in the procurement of
public services
An e-procurement system 2004 International Jour- 56 36 46 Panayiotou,
for governmental purchas- nal of Production NA, Gayialis,
ing Economics SP, Tatsiopou-
los, IP
Exploring and explaining 2005 Journal of Public 49 43 46 Brudney, JL,
contracting out: Patterns Administration Re- Fernandez,
among the American states search and Theory S, Ryu, JE,
Wright, DS
Managing markets for pub- 2008 Public Administra- 48 29 38.5 Warner M.E.,
lic service: The role of tion Review Hefetz A.
mixed public-private deliv-
ery of city services
Public-private partnerships 2004 Construction Man- 38 38 Ahadzi M.,
and contract negotiations: agement and Eco- Bowles G.
An empirical study nomics
Using public procurement 2004 Natural Resources 47 27 37 McCrudden C.
to achieve social outcomes Forum
Using bargaining-game the- 2007 Journal Of Con- 28 30 29 Shen, LY, Bao,
ory for negotiating conces- struction Engineer- H, Wu, YZ, Lu,
sion period for BOT-type ing And Manage- WS
contract ment
Exploring success factors 2004 Government Infor- 36 22 29 Chu, PY, Hsiao,
for Taiwan’s government mation Quarterly N, Lee, FW,
electronic tendering system: Chen, CW
behavioral perspectives
from end users

cxiv
Continued on next page
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Preferred risk allocation in 2010 International Jour- 34 24 29 Ke, YJ, Wang,
China’s public-private part- nal of Project Man- SQ, Chan, APC,
nership (PPP) projects agement Lam, PTI
Build-operate-transfer-type 2002 Journal Of Con- 36 20 28 Kumaraswamy,
procurement in Asian struction Engineer- MM, Morris,
megaprojects ing And Manage- DA
ment
Profiling a methodology for 2005 Technovation 36 19 27.5 Carayannis
economic growth and con- E.G., Popescu
vergence: Learning from the D.
EU e-procurement experi-
ence for central and eastern
European countries
Performance-based con- 2007 The American Re- 27 28 27.5 Heinrich, CJ,
tracting in social welfare view of Public Ad- Choi, Y
programs ministration
Paving the way for public- 2005 Journal Of Con- 28 23 25.5 Zhang, XQ
private partnerships in in- struction Engineer-
frastructure development ing And Manage-
ment
Partnering on defense con- 2002 Journal Of Con- 29 21 25 , CR, Sheedy,
tracts struction Engineer- WM
ing And Manage-
ment
Ensuring accountability in 2002 The American Re- 27 23 25 Dicke, LA
human services contracting view of Public Ad-
- Can stewardship theory fill ministration
the bill?
The economics of public- 2004 Canadian Public 27 22 24.5 de Bettignies,
private partnerships Policy JE, Ross, TW

cxv
Continued on next page
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
E-government policy and 2008 Government Infor- 30 19 24.5 Hardy C.A.,
practice: A theoretical and mation Quarterly Williams S.P.
empirical exploration of
public e-procurement
Addressing sustainable de- 2009 Supply Chain Man- 28 18 23 Preuss L.
velopment through public agement: An Inter-
procurement: The case of national Journal
local government
PPPs: The passage of time 2009 Economic Affairs 23 23 Hodge G.A.,
permits a sober reflection Greve C.
The hurdle analysis. A self- 2006 Corporate Social 22 22 Gunther E.,
evaluation tool for munic- Responsibility and Scheibe L.
ipalities to identify, anal- Environmental
yse and overcome hurdles to Management
green procurement
Fostering sustainability 2008 Journal of Cleaner 25 18 21.5 Walker, H,
through sourcing from Production Preuss, L
small businesses: public
sector perspectives
Contracting for manage- 2006 Journal of Policy 21 21 21 Brown, T, Poto-
ment: Assessing manage- Analysis and Man- ski, M
ment capacity under alter- agement
native service delivery ar-
rangements
Urban rail transit PPPs: 2007 Transport Policy 25 15 20 Phang S.-Y.
Survey and risk assessment
of recent strategies
Contracting out and ac- 1997 Australian Journal 21 19 20 Mulgan, R
countability of Public Adminis-
tration

cxvi
Continued on next page
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Incentives and the efficiency 2005 Journal of Eco- 19 21 20 Jensen, PH,
of public sector-outsourcing nomic Surveys Stonecash, RE
contracts
Towards an e-Government 2007 European Journal 26 13 19.5 Hackney, R,
efficiency agenda: the Of Information Jones, S, Losch,
impact of information and Systems A
communication behaviour
on e-Reverse auctions in
public sector procurement
Procurement protocols for 2001 Journal Of Con- 24 13 18.5 Zhang X.Q.,
public-private partnered struction Engineer- Kumaraswamy
projects ing And Manage- M.M.
ment
Sustainable procurement in 2007 Journal Of En- 21 15 18 Thomson, J,
practice: Lessons from local vironmental Jackson, T
government Planning And
Management
Contracting for health ser- 2004 Health policy 19 16 17.5 Ashton, T,
vices in a public health sys- Cumming, J,
tem: the New Zealand ex- McLean, J
perience
Purchase-of-service con- 1998 American Behav- 18 17 17.5 Nowland-
tracting, voluntary organi- ioral Scientist Foreman, G
zations, and civil society -
Dissecting the goose that
lays the golden eggs?
Continued on next page

cxvii
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The practice of contract- 2008 Public Administra- 18 15 16.5 Reeves E.
ing in public private part- tion
nerships: Transaction costs
and relational contracting
in the Irish schools sector
Buying into our future: 2007 Business Strategy 16 16 Preuss L.
Sustainability initiatives in and the Environ-
local government procure- ment
ment
Developing priorities for 2005 Journal Of Cleaner 19 13 16 Swanson, M,
greener state government Production Weissman,
purchasing: a California A, Davis, G,
case study Socolof, ML,
Davis, K
An economic analysis of Ire- 2004 International Jour- 15 15 Hurst C., Reeves
land’s first public private nal of Public Sector E.
partnership Management
Experiences with greening 2008 Journal of Cleaner 17 12 14.5 Bala A., Munoz
suppliers. The Universitat Production P., Rieradevall
Autonoma de Barcelona J., Ysern P.
Governance of public- 2007 International 20 9 14.5 Johnston, J,
private partnerships: Review of Admin- Gudergan, SP
lessons learnt from an istrative Sciences
Australian case?
Innovation on demand-Can 2009 Research Policy 14 13 13.5 Aschhoff, B,
public procurement drive Sofka, W
market success of innova-
tions?
Continued on next page

cxviii
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The role of contract design 2004 Children and 15 12 13.5 Unruh, JK,
in privatization of child wel- Youth Services Hodgkin, D
fare services: the Kansas ex- Review
perience
Comparative performance 2010 Construction Man- 13 13 Raisbeck P.,
of PPPs and traditional agement and Eco- Duffield C., Xu
procurement in Australia nomics M.
Implications of private- 2006 Journal of Planning 10 16 13 Siemiatycki M.
public partnerships on the Education and Re-
development of urban pub- search
lic transit infrastructure:
The case of Vancouver,
Canada
Contract service firms in lo- 1999 Regional Studies 15 10 12.5 Reimer, S
cal authorities: Evolving ge-
ographies of activity
Understanding the Innova- 2010 European Planning 16 9 12.5 Uyarra, E,
tion Impacts of Public Pro- Studies Flanagan, K
curement
Contracting-out health 1999 Health policy 15 9 12 Vining, AR,
care services: a conceptual Globerman, S
framework
Green procurement in Nor- 2009 Journal of Envi- 13 11 12 Michelsen, O, de
way; a survey of practices ronmental Manage- Boer, L
at the municipal and county ment
level
Continued on next page

cxix
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Auction procedures and 2009 Utilities Policy 16 8 12 Amaral, M,
competition in public ser- Saussier, Sal-
vices: The case of urban varez J.M.,
public transport in France Yvrande-Billon,
and London A
Contractual management in 2006 Journal of Pro- 18 6 12 Edkins A.J.,
PPP projects: Evaluation fessional Issues Smyth H.J.
of legal versus relational in Engineering
contracting for service de- Education and
livery Practice
Getting the fundamentals 2004 Public Administra- 14 9 11.5 Awortwi, N
wrong: woes of public- tion and Develop-
private partnerships in solid ment
waste collection in three
Ghanaian cities
Making the market work for 2003 Journal of Environ- 11 11 Kunzlik, P
the environment: Accep- mental Law
tance of (some) ’green’ con-
tract award criteria in pub-
lic procurement
Traffic revenue risk man- 2006 International Jour- 11 11 Boeing Singh L.,
agement through Annuity nal of Project Man- Kalidindi S.N.
Model of PPP road projects agement
in India
Cost efficiency in primary 2004 Health Economics 11 10 10.5 Puig-Junoy, J,
care contracting: a stochas- Ortun, V
tic frontier cost function ap-
proach
Continued on next page

cxx
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Centralized vs. decentral- 2000 International Jour- 12 9 10.5 Vagstad, S
ized procurement: Does nal of Industrial
dispersed information call Organization
for decentralized decision-
making?
Contract governance and 2003 Industrial Rela- 12 9 10.5 Ilcan, SM,
the Canadian public sector tions O’Connor, DM,
Oliver, ML
Greener public purchasing: 2006 Climate Policy 11 9 10 van Asselt, H,
opportunities for climate- van der Grijp, N,
friendly government pro- Oosterhuis, F
curement under WTO and
EU rules
Does dual sourcing lower 2006 The Journal of In- 10 10 10 Lyon, TP
procurement costs? dustrial Economics
Public-private partnership- 2005 Journal of Pur- 10 10 Essig M., Batran
Development of long-term chasing and Supply A.
relationships in public pro- Management
curement in Germany
Rediscovering implementa- 2001 Australian Journal 9 11 10 Chalmers J.,
tion: Public sector contract- of Public Adminis- Davis G.
ing and human services tration
The role of nonprofit hu- 2004 Administration in 5 14 9.5 Schmid, H
man service organizations in Social Work
providing social services: A
prefatory essay
Procurement methods for 2002 Building Research 13 6 9.5 Pietroforte, R,
US infrastructure: Histori- & Information Miller, JB
cal perspectives and recent
trends

cxxi
Continued on next page
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Environmental criteria in 2009 Ecological Eco- 12 7 9.5 Nissinen A.,
the public purchases above nomics Parikka-Alhola
the EU threshold values K., Rita H.
by three Nordic countries:
2003 and 2005
Transaction costs in trans- 2010 Transport Reviews 11 7 9 Sollno A.S., de
port public-private partner- Santos P.G.
ships: Comparing procure-
ment procedures
The ’externalisation’ of lo- 2010 International Jour- 9 9 Argento D.,
cal public service delivery: nal of Public Policy Grossi G.,
Experience in Italy and Tagesson T.,
Sweden Collin S.-O.
Protecting the environment 2008 Natural Resources 11 7 9 Bolton P.
through public procure- Forum
ment: The case of South
Africa
Innovative practices in pub- 2005 Journal of Pur- 9 9 Lawther W.C.,
lic procurement partner- chasing and Supply Martin L.L.
ships: The case of the Management
United States
Problems with contracting 2004 Industrial and Cor- 10 7 8.5 Boardman, AE,
out government services: porate Change Hewitt, ES
lessons from orderly services
at SCGH
Contracting and negotia- 1998 Public Administra- 9 8 8.5 Gooden, V
tion: Effective practices tion Review
of successful human service
contract managers
Continued on next page

cxxii
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
A life cycle approach to 2011 Energy 10 6 8 Tarantini, M,
Green Public Procurement Loprieno, AD,
of building materials and el- Porta, PL
ements: A case study on
windows
Government Contracts and 2012 Administration & 9 7 8 Johnston, JM,
“Managing the Market”: Society Girth, AM
Exploring the Costs of
Strategic Management
Responses to Weak Vendor
Competition
Contracting-in manage- 2009 Health policy 8 8 8 Loevinsohn,
ment to strengthen publicly B, ul Haq, I,
financed primary health Couffinhal, A,
services-The experience of Pande, A
Punjab, Pakistan
Contracting-out in public 1998 International Jour- 8 8 Larbi G.A.
health and water services in nal of Public Sector
Ghana Management
Contracting capacity and 2009 Public Administra- 8 8 8 Yang, K., Hsieh,
perceived contracting per- tion Review J.Y., Li, T.S.
formance: Nonlinear effects
and the role of time
Public procurement as an 2009 Science and Public 8 8 Rolfstam M.
innovation policy tool: The Policy
role of institutions
Privatization morphs into 2003 Public Administra- 7 8 7.5 Sellers, MP
’publicization’: Businesses tion
look a lot like government
Continued on next page

cxxiii
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Impact of the capital 2011 Journal Of Con- 8 6 7 Regan M.,
market collapse on public- struction Engineer- Smith J., Love
private partnership infras- ing And Manage- P.E.D.
tructure projects ment
An empirical analysis 2010 International Jour- 7 7 Wirtz B., Lutje
of the acceptance of e- nal of Public Ad- S., Schierz P.G.
procurement in the German ministration
public sector
Enabling development of 2010 Journal Of Con- 9 5 7 Garvin M.J.
the transportation public- struction Engineer-
private partnership market ing And Manage-
in the United States ment
Life cycle approach in the 2006 The International 8 6 7 Hochschorner,
procurement process: The Journal of Life E, Finnveden, G
case of defence materiel Cycle Assessment
The Effectiveness of Non- 2010 Nonprofit Manage- 7 7 Chen, B,
profit Lead-Organization ment and Leader- Graddy, EA
Networks for Social Service ship
Delivery
The effects of administra- 2009 Governance 6 7 6.5 Bhatti Y., Olsen
tive professionals on con- A.L., Pedersen
tracting out L.H.
The case for public-private 2008 Canadian Public 8 5 6.5 Murphy, TJ
partnerships in infrastruc- Administration
ture
The challenges of con- 2004 The Journal of Fed- 8 5 6.5 Johnston, JM,
tracting and accountability eralism Romzek, BS,
across the federal system: Wood, CH
From ambulances to space
shuttles

cxxiv
Continued on next page
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Procurement of design- 2009 Journal of Public 7 6 6.5 Migliaccio G.C.,
build services: Two-phase Child Welfare Gibson G.E.,
selection for highway O’Connor J.T.
projects
Legal issues associated with 2006 Journal of Pro- 9 4 6.5 Pryke S.D.
emergent actor roles in fessional Issues
innovative U.K. procure- in Engineering
ment: Prime contracting Education and
case study Practice
Applying principles for 2004 Journal of public 7 6 6.5 Honore P.A.,
outcomes-based contracting health management Simoes E.J.,
in a public health program. and practice Moonesinghe R.,
Kirbey H.C.,
Renner M.
Public procurement of in- 2011 International Jour- 6 6 Rolfstam M.,
novations, diffusion and en- nal of Public Sector Phillips W.,
dogenous institutions Management Bakker E.
From welfare state to Op- 1999 American Behav- 4 8 6 Rom, MC
portunity, Inc. Public- ioral Scientist
private partnerships in wel-
fare reform
Outsourced services and 2006 European Manage- 6 6 Walker H.,
’imbalanced’ supply mar- ment Journal Knight L.,
kets Harland C.M.
Procurement as a shared 2008 International Jour- 6 6 Murray J.G.,
service in English local gov- nal of Public Sector Rentell P.G.,
ernment Management Geere D.
Empirical evaluation of 2008 International Jour- 6 6 Assar S.,
public e-procurement nal of Value Chain Boughzala
platforms in France Management I.

cxxv
Continued on next page
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Public-private partnerships 2010 International Jour- 6 6 6 Chen, BR, Chiu,
Task interdependence and nal of Industrial YS
contractibility Organization
Is there a future for con- 1998 Australian Journal 6 6 6 Davis G., Wood
tracting in the Australian of Public Adminis- T.
public sector? tration
Public sector e- 2011 International Jour- 6 6 Johnson M.
procurement: A study nal of Services
of benefits from e-markets Technology and
in the local government Management
sector
The politics and admin- 2004 Policy Studies 9 3 6 Nicholson-
istration of privatization: Journal Crotty, S
Contracting out for correc-
tions management in the
United States
Contracting in ten English 2000 International Jour- 6 6 Johnson
local authorities: Prefer- nal of Public Sector P.Darwin J.,
ences and practices Management Duberley J.
Innovation in public-private 2010 Public Money & 6 5 5.5 Rangel, T; Gal-
partnerships (PPPs): the Management ende, J
Spanish case of highway
concessions
Piloting public-private part- 2007 Public Money & 8 3 5.5 Reeves E., Ryan
nerships: Expensive lessons Management J.
from Ireland’s schools’ sec-
tor
Privatization, public goods, 2007 Administration & 5 6 5.5 Gerbasi, J,
and the ironic challenge of Society Warner, ME
free trade agreements

cxxvi
Continued on next page
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
A structure for govern- 2001 Canadian Journal 4 6 5 Abdel-Aziz,
ment requirements in of Civil Engineer- AM, Russell,
public-private partnerships ing AD
Private operation with pub- 2010 Public Choice 5 5 5 Cabral, S, Laz-
lic supervision: evidence of zarini, SG, de
hybrid modes of governance Azevedo, PF
in prisons
Suitability of procuring 2010 Engineering, Con- 5 5 Cheung E.,
large public works by PPP struction and Chan A.P.C.,
in Hong Kong Architectural Kajewski S.
Management
The impact of the aus- 2007 Australian Journal 5 5 5 Rogers, C
tralian government job net- of Public Adminis-
work contracting on not-for- tration
profit service providers
Inter-organisational in- 2011 Int. J. of Busi- 5 5 Vaidya K., Hyde
formation systems as- ness Information M.
similation: An empirical Systems
evaluation in light of the
diffusion of innovation
theory
Economic culture and 1997 Local Government 3 7 5 Mackintosh, M
quasi-markets in local Studies
government: The case of
contracting for social care
Reasons for implementing 2009 Journal of Property 5 5 Cheung E.,
public private partnership Investment & Fi- Chan A.P.C.,
projects: Perspective from nance Kajewski S.
Hongkong, Australian and
British practitioners

cxxvii
Continued on next page
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The public sector’s perspec- 2010 Journal of Civil En- 6 4 5 Cheung E.,
tive on procuring public gineering and Man- Chan A.P.C.,
works projects - Comparing agement Kajewski S.
the views of practitioners in
Hong Kong and Australia
Complex management con- 1999 Public Administra- 5 5 5 Hubbard, M,
tracts: the case of customs tion and Develop- Delay, S, Devas,
administration in Mozam- ment N
bique
SHAPING THE PROVI- 2009 Public Performance 5 5 Marvel, MK,
SION OF OUTSOURCED & Management Re- Marvel, HP
PUBLIC SERVICES Incen- view
tive Efficacy and Service
Delivery
Long term risk sharing con- 2010 Telecommunications 5 5 Fredebeul-
tracts as an approach to es- Policy Krein, M,
tablish public-private part- Knoben, W
nerships for investment into
next generation access net-
works
Insourcing and outsourcing: 2012 Journal of the 6 3 4.5 Warner M.E.,
The dynamics of privatiza- American Planning Hefetz A.
tion among U.S. Municipal- Association
ities 2002-2007
Competing agendas in pub- 2011 Environment and 6 3 4.5 Pickernell, D,
lic procurement: an empir- Planning C: Gov- Kay, A, Pack-
ical analysis of opportuni- ernment and Policy ham, G, Miller,
ties and limits in the UK for C
SMEs
Continued on next page

cxxviii
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Release the power of the 2006 Energy Policy 5 4 4.5 Borg N., Blume
public purse Y., Thomas
S., Irrek W.,
Faninger-Lund
H., Lund P.
Is local authority procure- 2010 Journal of Pur- 7 2 4.5 Loader, K
ment ’lean’ ? An explo- chasing and Supply
ration to determine if ’lean’ Management
can provide a useful expla-
nation of practice
Modeling offset policy in 2003 Journal Of Policy 7 2 4.5 Taylor, TK
government procurement Modeling
Infrastructure procure- 2011 Environment and 4 4 4 Regan M.,
ment: Learning from Planning C: Gov- Smith J., Love
private-public partnership ernment and Policy P.E.D.
experiences ’down under’
Public-private partnerships 2009 Journal of Develop- 4 4 4 Roy, J, Chowd-
in micro-finance: Should ment Economics hury, PR
NGO involvement be re-
stricted?
Urban competitiveness and 2011 Urban Studies 6 2 4 Lember V., Kal-
public procurement for in- vet T., Kattel R.
novation
Opening up Public Services 2003 Annals of Public 4 4 Bance P.
to Competition by Putting and Cooperative
Them Out to Tender: An Economics
Evaluation
Public-private partnerships 2009 Economic Affairs 4 4 Klijn E.-H.
in the Netherlands: Policy,
projects and lessons

cxxix
Continued on next page
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Contracting-out in urban 2009 Urban Forestry & 4 4 4 Lindholst A.C.
green-space management: Urban Greening
Instruments, approaches
and arrangements
Motivations and impedi- 2001 Administration & 4 3 3.5 Ugboro I.O.,
ments to service contract- Society Obeng K.,
ing, consolidations, and Talley W.K.
strategic alliances in public
transit organizations
Comparing Risk Transfers 2011 International Jour- 4 3 3.5 Witt E., Liias R.
under Different Procure- nal Of Strategic
ment Arrangements Property Manage-
ment
The provider/purchaser 1998 Governance 5 2 3.5 Ormsby, MJ
split: A report from New
Zealand
Government contracts and 2006 Journal of Business 4 3 3.5 Berrios, R
contractor behavior Ethics
Contracting private sector 2009 Human resources 3 4 3.5 Nigenda G.H.,
providers for public sector for health Gonzalez L.M.
health services in Jalisco,
Mexico: Perspectives of sys-
tem actors
The changing nature of con- 2010 Abacus 4 3 3.5 English L., Bax-
tracting and trust in public- ter J.
private partnerships: The
case of Victorian PPP pris-
ons
Continued on next page

cxxx
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Eminent Domain versus 2010 The Journal of Law 3 3 3 Shavell, S
Government Purchase of and Economics
Land Given Imperfect
Information about Owners’
Valuations
Early contractor involve- 2012 Journal of Public 3 3 Lenferink S.,
ment in Dutch infrastruc- Procurement Arts J., Tillema
ture development: Initial T., van Valken-
experiences with parallel burg M., Nijsten
procedures for planning and R.
procurement
Demand-orientated policy 2010 Int. J. of Technol- 3 3 3 Myoken Y.
on leading-edge industry ogy Management
and technology: Public
procurement for innovation
Market-Based Government 2010 Administration & 2 4 3 Adams, GB,
and the Decline of Organi- Society Balfour, DL
zational Ethics
Public libraries and the con- 2003 Electronic Library 5 1 3 Ball, D
sortium purchase of elec-
tronic resources
Contracting out public ser- 2010 Oxford Economic 3 3 3 Bennett J., Iossa
vice provision to not-for- Papers E.
profit firms
Evaluation model for assess- 2011 Journal of Manage- 4 2 3 Cheung E.,
ing the suitability of public- ment in Engineer- Chan A.P.C.
private partnership projects ing
Continued on next page

cxxxi
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Developing an analytical 2009 The Economic and 3 3 Chung D.
framework for analysing Labour Relations
and assessing public-private Review
partnerships: A hospital
case study
E-Government procure- 2012 Government Infor- 4 2 3 Concha, G,
ment observatory, maturity mation Quarterly Astudillo, H,
model and early measure- Porrua, M,
ments Pimenta, C
Public-Private Partnerships 2010 The American 3 3 Custos, D, Re-
Journal of Com- itz, J
parative Law
Contracting out and trust 2005 Public Organiza- 3 3 Huque A.S.
in the public sector: Cases tion Review
of management from Hong
Kong
A study of e-market adop- 2012 Journal of Enter- 3 3 Johnson M.
tion barriers in the local prise Information
government sector Management
Outsourcing Public Service 2012 Public Administra- 3 3 3 Girth, AM,
Delivery: Management Re- tion Review Hefetz, A,
sponses in Noncompetitive Johnston, JM,
Markets Warner, ME
Building public health goals 1998 American Jour- 3 3 3 Rosnick, M
into the purchasing process: nal of Preventive
Managed care perspective Medicine
Continued on next page

cxxxii
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Sustainable partnerships for 2011 Natural Resources 3 3 3 Otsuki K.
a green economy: A case Forum
study of public procurement
for home-grown school feed-
ing
Green public procurement: 2010 Review of Euro- 3 3 Palmujoki, A,
Analysis on the use of en- pean Community & Parikka-Alhola,
vironmental criteria in con- International Envi- K, Ekroos, A
tracts ronmental Law
Flexible build-operate- 2012 Transportation Re- 3 3 3 Tan, ZJ, Yang,
transfer contracts for road search Part B H
franchising under demand
uncertainty
Risk management in pub- 2010 Innovation: The 4 2 3 Kalvet, T, Lem-
lic procurement for innova- European Journal ber, V
tion: the case of Nordic- of Social Science
Baltic Sea cities Research
Breaking Down the Silos: 2012 Journal of Public 3 3 Kearney K.A.,
Lessons Learned From the Child Welfare Bloom-Ellis B.,
Expansion of Performance- Thompson R.
Based Contracting to Res-
idential Treatment Services
in Illinois
The new public man- 2010 Public Money & 3 2 2.5 Ortiz, C.
agement of security: the Management
contracting and manage-
rial state and the private
military industry
Continued on next page

cxxxiii
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Contracting out in Korean 2004 International 2 3 2.5 Park, SJ
local governments: cur- Review of Admin-
rent situation and chal- istrative Sciences
lenges ahead
Psychological barriers in the 2011 Business Strategy 3 2 2.5 Preuss L.,
road to sustainable develop- and the Environ- Walker H.
ment: Evidence from public ment
sector procurement
An institutional approach 2012 Innovation: The 2 3 2.5 Rolfstam, M
to research on public pro- European Journal
curement of innovation of Social Science
Research
The relationship between 2012 International Jour- 3 2 2.5 Walker H.,
sustainable procurement nal of Production Brammer S.
and e-procurement in the Economics
public sector
Public-private partnership 2011 The Service Indus- 3 2 2.5 Navarro-
and regional productivity in tries Journal Espigares J.L.,
the UK Martin-Segura
J.A.
Estimating the cost ef- 2011 Journal of Pur- 3 2 2.5 Karjalainen, K
fects of purchasing chasing and Supply
centralization-Empirical Management
evidence from framework
agreements in the public
sector
Public Procurement for 2012 Research Policy 3 2 2.5 Edquist,
Innovation as mission- C; Zabala-
oriented innovation policy Iturriagagoitia,
JM

cxxxiv
Continued on next page
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Private-Public Partnerships 2008 Transportation Re- 3 2 2.5 Juan, C, Olmos,
as Strategic Alliances Con- search Record F, Johnston,
cession Contracts for Port JM, Ashke-
Infrastructures boussi, R
Satisfaction of contract 2006 Children and 4 1 2.5 Barton, WH,
provider agencies with Youth Services Folaron,
a State’s Child Welfare Review GLamothe,
Agency M, Busch, M,
Hostetter, C
Public functions and private 2008 International 2 2 Palmer, S.
services: A gap in human Journal of Consti-
rights protection tutional Law
The role of the discount rate 2010 Transportation Re- 2 2 2 Vassallo, JM
in tendering highway con- search Part A
cessions under the LPVR
approach
Public-private agreements, 2009 Review of Indus- 4 0 2 Saussier S.,
institutions, and competi- trial Organization Staropoli C.,
tion: When economic the- Yvrande-Billon
ory meets facts A.
Barriers to addressing2011 Proceedings of 3 1 2 Sourani, A, So-
sustainable construction the Institution hail, M
in public procurement of Civil Engi-
strategies neers: Engineering
Sustainability
Public procurement incen- 2009 Architectural engi- 2 2 Sporrong J.,
tives for sustainable design neering and design Brochner J.
services: Swedish experi- management
ences
Continued on next page

cxxxv
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Developing Key Per- 2012 Journal of Manage- 3 1 2 Yuan, JF, Wang,
formance Indicators for ment in Engineer- C, Skibniewski,
Public-Private Partnership ing MJ, Li, QM
Projects: Questionnaire
Survey and Analysis
Channel Tunnel Rail Link: 2003 Civil Engineering 3 1 2 Bayley M.
Financing and risk transfer
E-procurement: Myth or re- 2012 Journal of Public 2 2 McCue C., Ro-
ality? Procurement man A.V.
Promoting, developing and 2011 Transport 2 2 2 Fenwick, P, Jes-
procuring the New Tyne sett, C, Ding-
Crossing wall, D, Hailey,
N
Towards a pan-european 2012 International Jour- 3 1 2 Alvarez J.M.,
e-procurement platform nal of Software Labra J.E.,
to aggregate, publish and Engineering and Cifuentes F.,
search public procurement Knowledge Engi- Alor-Hernandez
notices powered by linked neering G., Sanchez C.,
open data: The moldeas Luna J.A.G.
approach
Use of E-procurement in 2010 European Planning 2 2 2 Cabras I.
local authorities’ purchas- Studies
ing and its effects on local
economies: Evidence from
Cumbria, UK
Continued on next page

cxxxvi
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Institutional sources of dis- 2009 Public Manage- 2 2 Saz-Carranza
trust in government con- ment Review A., Serra A.
tracting: A comparison be-
tween home-based and res-
idential social services in
Spain
One-Year assessment of 2009 Clinical Therapeu- 2 1 1.5 Al-Abbadi I.,
joint procurement of phar- tics Qawwas A.,
maceuticals in the public Jaafreh M.,
health sector in Jordan Abosamen T.,
Saket M.
Simultaneous public and 2003 International Tax 1 2 1.5 Boadway, R,
private provision of ser- and Public Finance Marchand, M,
vices, asymmetric informa- Tremblay, JF
tion and innovation
Bureaucrats as purchasers 2011 Public Administra- 2 1 1.5 Zaidi S., May-
of health services: Limita- tion and Develop- hew S.H.,
tions of the public sector for ment Palmer N.
contracting
Public-private partnerships: 2007 Healthcare man- 1 1 1 Philpott T.G.
A Canadian hospital’s per- agement Forum
spective
Best value concessionaire 2009 Expert Systems 1 1 1 Zhang, XQ
selection through a fuzzy with Applications
logic system
State and Local Govern- 2008 Public Administra- 2 0 1 Potoski, M
ment Procurement and the tion Review
Winter Commission
Continued on next page

cxxxvii
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
What factors influence the 2012 Ecological Eco- 1 1 1 Testa F., Iraldo
uptake of GPP (green pub- nomics F., Frey M.,
lic procurement) practices? Daddi T.
New evidence from an Ital-
ian survey
Development and Distor- 2010 Australian Journal 2 0 1 Beh, LS
tion of Malaysian Public- of Public Adminis-
Private Partnerships - Pa- tration
tronage, Privatised Profits
and Pitfalls
Procurement for sustain- 2012 International Jour- 1 1 Nijaki L.K.,
able local economic develop- nal of Public Sector Worrel G.
ment Management
Value for money analysis in 2009 Transportation Re- 1 1 1 Morallos D.,
U.S. transportation public- search Record Amekudzi A.,
private partnerships Ross C., Meyer
M.
An integrated approach in 2005 Lecture Notes in 1 1 1 Federici, T
healthcare e-procurement: Artificial Intelli-
The case-study of the ASL gence
of Viterbo
Sustainability and local 2012 Food Journal 2 0 1 Lehtinen, U
food procurement: a case
study of Finnish public
catering
Public-private partnerships 2010 ERA Forum 1 1 Bovis C.
in the 21st century
Continued on next page

cxxxviii
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Government Supports in 2012 Journal of Infras- 1 1 1 Brandao, LE,
Public-Private Partnership tructure Systems Bastian-Pinto,
Contracts: Metro Line 4 of C, Gomes, LL,
the Sao Paulo Subway Sys- Labes, M
tem
Green public procurement 2011 Society and Econ- 1 1 Fet A.,
in practice - The case of omy Michelsen O.,
Norway Boer L.
Emergency contracting 2008 Journal of Pro- 1 1 1 Jeffrey, JT,
strategies for federal fessional Issues Menches, CL
projects in Engineering
Education and
Practice
The impact of sustainable 2012 Industrial Market- 2 0 1 Oruezabala G.,
public procurement on sup- ing Management Rico J.-C.
plier management - The
case of French public hospi-
tals
Effectiveness of safety- 2012 Transportation Re- 1 1 1 Rangel, T, Vas-
based incentives in Public search Part A sallo, JM, Are-
Private Partnerships: Ev- nas, B
idence from the case of
Spain
Shared services: An outline 2010 Computer Law and 1 1 Turle M.
of key contractual issues Security Review:
The International
Journal of Technol-
ogy and Practice
Continued on next page

cxxxix
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Harnessing market competi- 2010 Australian Journal 1 0 0.5 Mols F.
tion in PPP procurement: of Public Adminis-
The importance of periodi- tration
cally taking a strategic view
The Politics of Transaction 1999 Public Money & 1 0 0.5 Choi Y.-C.
Costs Management
Delivering Local Infrastruc- 2012 Journal Of Con- 1 0 0.5 da Cruz, NF,
ture through PPPs: Evi- struction Engineer- Marques, RC
dence from the School Sec- ing And Manage-
tor ment
Understanding and tracing 2012 Public Performance 0 1 0.5 Diggs S.N., Ro-
accountability in the pub- & Management Re- man A.V.
lic procurement process: In- view
terpretations, performance
measurements, and the pos-
sibility of developing public-
private partnerships
Measuring the performance 2012 Public Performance 1 0 0.5 Koontz, TM,
of public-private partner- & Management Re- Thomas, CW
ships A Systematic Method view
for Distinguishing Outputs
from Outcomes
Cost performance compar- 2007 Journal of Manage- 1 0 0.5 Kuprenas, JA,
ison of two public sector ment in Engineer- Nasr, EB
project procurement tech- ing
niques
Continued on next page

cxl
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Initial success and sub- 1997 Military Medicine 0 0 0 Rembold, JM,
stantial government savings Berry, TR
may mandate prime vendor
contracts for table of organi-
zation and equipment units
and deployment support
Public finance expenditure 2011 Journal of Applied 0 0 Setnikar-Cankar
and awarding work to ex- Business Research S., Seljak J.,
ternal contractors - Case of Petkovsek V.
Slovenia
Innovation procurement as 2012 Journal of Public 0 0 Yeow J., Edler J.
projects Procurement
Environmental impacts and 2012 Journal of Public 0 0 Parikka-Alhola
the most economically ad- Procurement K., Nissinen A.
vantageous tender in public
procurement
Lean thinking within pub- 2012 Journal of Public 0 0 Waterman J.,
lic sector purchasing depart- Procurement McCue C.
ment: The case of the U.K
public service
Sustainable procurement in 2012 Public Money & 0 0 0 Erridge A., Hen-
health and social care in Management nigan S.
Northern Ireland
Purchase-of-service con- 2010 Halduskultuur - 0 0 Lember V., Kriz
tracting in Estonia Administrative K.A.
Culture
A reflection on the Dutch 2012 Journal of Integra- 0 0 0 Melissen, F,
Sustainable Public Procure- tive Environmental Reinders, H
ment Programme Sciences
Continued on next page

cxli
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Evaluating the anti- 2012 The Electronic 0 0 Neupane A.,
corruption capabilities of Journal on Infor- Soar J., Vaidya
public eprocurement in a mation Systems K.
developing country in Developing
Countries
The Northern Line train 2000 Proceedings of the 0 0 0 Harding, A,
service contract Institution of Me- Watts, P
chanical Engineers
Part F: Journal
of Rail and Rapid
Transit
Let’s stick together: Collab- 2008 Health Information 0 0 0 Marriott R.
orative purchasing of elec- & Libraries Journal
tronic journals in the Na-
tional Health Service
Contracting out at local 2007 Public Manage- 0 0 Nemec J.,
government level in Slovakia ment Review Merickova B.,
and the Czech Republic Sumpikova M.F.
Cost impact of purchasing 2011 Jordan Journal of 0 0 Alabbadi I.
pharmaceuticals jointly in Pharmaceutical
the public health sector in Sciences
Jordan
After Katrina: Compar- 2012 Journal of Public 0 0 Atkinson C.L.,
isons of post-disaster pub- Procurement Sapat A.K.
lic procurement approaches
and outcomes in the New
Orleans area
Continued on next page

cxlii
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Comparison of Public- 2012 Transportation 0 0 0 Chasey, AD,
Private Partnerships and Research Record: Maddex, WE,
Traditional Procurement Journal of the Bansal, A
Methods in North American Transportation
Highway Construction Research Board
The researcher’s perspective 2010 Structural Survey 0 0 Cheung E.,
on procuring public works Chan A.P.C.,
projects Kajewski S.
Adapting to liberalization: 2012 Journal of Trans- 0 0 0 Eriksson, M,
government procurement port Geography Pettersson, T
of interregional passenger
transports in Sweden,
1989-2008
Contract Management Ca- 2012 Public Administra- 0 0 0 Joaquin, ME,
pacity Breakdown? An tion Review Greitens, TJ
Analysis of U.S. Local Gov-
ernments
The Neoliberal Transforma- 2012 Mediterranean Pol- 0 0 0 Kadirbeyoglu,
tion of Local Government in itics Z, Sumer, B
Turkey and the Contracting
Out of Municipal Services:
Implications for Public Ac-
countability
Delivery of Public Services 2012 Australian Journal 0 0 0 Housego, A,
by Non-Government Organ- of Public Adminis- O’Brien, T
isations tration
To Trust or Not to Trust? 2012 Journal of Public 0 0 Lamothe, M,
What Matters in Local Administration Re- Lamothe, S
Government-Vendor Rela- search and Theory
tionships?

cxliii
Continued on next page
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Reforming social services 2008 Australian Journal 0 0 0 Wong, H.K.
in Hong Kong: The role of Public Adminis-
of contracting and perfor- tration
mance management in the
non-profit sector
How Hollow Can We Go? A 2012 The American Re- 0 0 0 Yang, KF, Van-
Case Study of the Florida’s view of Public Ad- Landingham, G
Efforts to Outsource Over- ministration
sight of Privatized Child
Welfare Services
Good Rules or bad rules in 2012 Halduskultuur - 0 0 Rolfstam M.
public procurement of inno- Administrative
vation: But is it really the Culture
(right) question?
Contracting: The Queens- 1997 Australian Eco- 0 0 Hollander, R
land Housing Commission nomic History
experience, 1945-1957 Review
The diffusion of risks in 2012 Accounting Audit- 0 0 0 Demirag, I,
public private partnership ing & Accountabil- Khadaroo, I,
contracts ity Journal Stapleton, P,
Stevenson, C
Purchasing public services: 2009 The China Non- 0 0 Le Y.
The contract-oriented profit Review
model for cooperation
between government and
civil organizations - The
case of Shanghai Dapuqiao
community culture services
center
Continued on next page

cxliv
 Procurement strategy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Managerial challenges in 2011 Public Administra- 0 0 0 Lindholst A.C.,
public service contracting: tion Bogetoft P.
Lessons in green-space man-
agement

cxlv
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The allocation of risk in 2005 International Jour- 135 135 Bing L., Ak-
PPP/PFI construction nal of Project Man- intoye A.,
projects in the UK agement Edwards P.J.,
Hardcastle C.
Public-private partnerships: 2004 International 76 57 66.5 Bovaird, T
from contested concepts to Review of Admin-
prevalent practice istrative Sciences
Relationship management 2007 International Jour- 55 55 Smyth H., Ed-
in the management of nal of Project Man- kins A.
PFI/PPP projects in the agement
C.15.7 Procurement strategy: PPP

UK
The formation of public- 2005 Public Administra- 65 42 53.5 Koppenjan,
private partnerships: tion JFM
Lessons from nine transport
infrastructure projects in
the netherlands
Good project governance 2006 International Jour- 53 53 Abednego M.P.,
for proper risk allocation in nal of Project Man- Ogunlana S.O.
public-private partnerships agement
in Indonesia
The challenging business 2006 Public Administra- 55 47 51 Bloomfield, P
of long-term public-private tion Review
partnerships: Reflections on
local experience
Continued on next page

cxlvi
 Procurement strategy: PPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Transaction costs, rela- 2003 Journal of Pur- 51 51 Parker D.
tional contracting and chasing and Supply
public private partnerships: Management
A case study of UK defence
Public-private partnerships 2004 Construction Man- 38 38 Ahadzi M.,
and contract negotiations: agement and Eco- Bowles G.
An empirical study nomics
Using bargaining-game the- 2007 Journal Of Con- 28 30 29 Shen, LY, Bao,
ory for negotiating conces- struction Engineer- HJ, Wu, YZ, Lu,
sion period for BOT-type ing And Manage- WS
contract ment
Preferred risk allocation in 2010 International Jour- 34 24 29 Ke, YJ, Wang,
China’s public-private part- nal of Project Man- SQ, Chan, APC,
nership (PPP) projects agement Lam, PTI
Build-operate-transfer-type 2002 Journal Of Con- 36 20 28 Kumaraswamy,
procurement in Asian struction Engineer- MM, Morris,
megaprojects ing And Manage- DA
ment
Paving the way for public- 2005 Journal Of Con- 28 23 25.5 Zhang, XQ
private partnerships in in- struction Engineer-
frastructure development ing And Manage-
ment
The economics of public- 2004 Canadian Public 27 22 24.5 de Bettignies,
private partnerships Policy JE, Ross, TW
PPPs: The passage of time 2009 Economic Affairs 23 23 Hodge G.A.,
permits a sober reflection Greve C.
Urban rail transit PPPs: 2007 Transport Policy 25 15 20 Phang S.-Y.
Survey and risk assessment
of recent strategies
Continued on next page

cxlvii
 Procurement strategy: PPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Procurement protocols for 2001 Journal Of Con- 24 13 18.5 Zhang X.Q.,
public-private partnered struction Engineer- Kumaraswamy
projects ing And Manage- M.M.
ment
The practice of contract- 2008 Public Administra- 18 15 16.5 Reeves E.
ing in public private part- tion
nerships: Transaction costs
and relational contracting
in the Irish schools sector
An economic analysis of Ire- 2004 International Jour- 15 15 Hurst C., Reeves
land’s first public private nal of Public Sector E.
partnership Management
Governance of public- 2007 International 20 9 14.5 Johnston, J,
private partnerships: Review of Admin- Gudergan, SP
lessons learnt from an istrative Sciences
Australian case?
Comparative performance 2010 Construction Man- 13 13 Raisbeck P.,
of PPPs and traditional agement and Eco- Duffield C., Xu
procurement in australia nomics M.
Implications of private- 2006 Journal of Planning 10 16 13 Siemiatycki M.
public partnerships on the Education and Re-
development of urban pub- search
lic transit infrastructure:
The case of Vancouver,
Canada
Auction procedures and 2009 Utilities Policy 16 8 12 Amaral, M,
competition in public ser- Saussier, S,
vices: The case of urban Yvrande-Billon,
public transport in France A
and London

cxlviii
Continued on next page
 Procurement strategy: PPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Contractual management in 2006 Journal of Pro- 18 6 12 Edkins A.J.,
PPP projects: Evaluation fessional Issues Smyth H.J.
of legal versus relational in Engineering
contracting for service de- Education and
livery Practice
Getting the fundamentals 2004 Public Administra- 14 9 11.5 Awortwi, N
wrong: woes of public- tion and Develop-
private partnerships in solid ment
waste collection in three
Ghanaian cities
Traffic revenue risk man- 2006 International Jour- 11 11 Boeing Singh L.,
agement through Annuity nal of Project Man- Kalidindi S.N.
Model of PPP road projects agement
in India
Public-private partnership- 2005 Journal of Pur- 10 10 Essig M., Batran
Development of long-term chasing and Supply A.
relationships in public pro- Management
curement in Germany
Procurement methods for 2002 Building Research 13 6 9.5 Pietroforte, R,
US infrastructure: Histori- & Information Miller, JB
cal perspectives and recent
trends
Transaction costs in trans- 2010 Transport Reviews 11 7 9 Sollno A.S., de
port public-private partner- Santos P.G.
ships: Comparing procure-
ment procedures
Impact of the capital 2011 Journal Of Con- 8 6 7 Regan M.,
market collapse on public- struction Engineer- Smith J., Love
private partnership infras- ing And Manage- P.E.D.
tructure projects ment

cxlix
Continued on next page
 Procurement strategy: PPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Enabling development of 2010 Journal Of Con- 9 5 7 Garvin M.J.
the transportation public- struction Engineer-
private partnership market ing And Manage-
in the United States ment
The case for public-private 2008 Canadian Public 8 5 6.5 Murphy, TJ
partnerships in infrastruc- Administration
ture
Procurement of design- 2009 Journal of Public 7 6 6.5 Migliaccio G.C.,
build services: Two-phase Child Welfare Gibson G.E.,
selection for highway O’connor J.T.
projects
From welfare state to Op- 1999 American Behav- 4 8 6 Rom, MC
portunity, Inc. Public- ioral Scientist
private partnerships in wel-
fare reform
Public-private partnerships 2010 International Jour- 6 6 6 Chen, BR, Chiu,
Task interdependence and nal of Industrial YS
contractibility Organization
Innovation in public-private 2010 Public Money & 6 5 5.5 Rangel, T; Gal-
partnerships (PPPs): the Management ende, J
Spanish case of highway
concessions
Piloting public-private part- 2007 Public Money & 8 3 5.5 Reeves E., Ryan
nerships: Expensive lessons Management J.
from Ireland’s schools’ sec-
tor
A structure for govern- 2001 Canadian Journal 4 6 5 Abdel-Aziz,
ment requirements in of Civil Engineer- AM, Russell,
public-private partnerships ing AD
Continued on next page

cl
 Procurement strategy: PPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Suitability of procuring 2010 Engineering, Con- 5 5 Cheung E.,
large public works by PPP struction and Chan A.P.C.,
in Hong Kong Architectural Kajewski S.
Management
Reasons for implementing 2009 Journal of Property 5 5 Cheung E.,
public private partnership Investment & Fi- Chan A.P.C.,
projects: Perspective from nance Kajewski S.
Hongkong, Australian and
British practitioners
The public sector’s perspec- 2010 Journal of Civil En- 6 4 5 Cheung E.,
tive on procuring public gineering and Man- Chan A.P.C.,
works projects - Comparing agement Kajewski S.
the views of practitioners in
Hong Kong and Australia
Long term risk sharing con- 2010 Telecommunications 5 5 Fredebeul-
tracts as an approach to es- Policy Krein, M,
tablish public-private part- Knoben, W
nerships for investment into
next generation access net-
works
Infrastructure procure- 2011 Environment and 4 4 4 Regan M.,
ment: Learning from Planning C: Gov- Smith J., Love
private-public partnership ernment and Policy P.
experiences ’down under’
Public-private partnerships 2009 Journal of Develop- 4 4 4 Roy, J, Chowd-
in micro-finance: Should ment Economics hury, PR
NGO involvement be re-
stricted?
Continued on next page

cli
 Procurement strategy: PPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Public-private partnerships 2009 Economic Affairs 4 4 Klijn E.-H.
in the netherlands: Policy,
projects and lessons
Comparing Risk Transfers 2011 International Jour- 4 3 3.5 Witt E., Liias R.
under Different Procure- nal Of Strategic
ment Arrangements Property Manage-
ment
The changing nature of con- 2010 Abacus 4 3 3.5 English L., Bax-
tracting and trust in public- ter J.
private partnerships: The
case of Victorian PPP pris-
ons
Evaluation model for assess- 2011 Journal of Manage- 4 2 3 Cheung E.,
ing the suitability of public- ment in Engineer- Chan A.P.C.
private partnership projects ing
Developing an analytical 2009 The Economic and 3 3 Chung D.
framework for analysing Labour Relations
and assessing public-private Review
partnerships: A hospital
case study
Public-Private Partnerships 2010 The American 3 3 Custos, D, Re-
Journal of Com- itz, J
parative Law
Flexible build-operate- 2012 Transportation Re- 3 3 3 Tan, ZJ, Yang,
transfer contracts for road search Part B H
franchising under demand
uncertainty
Continued on next page

clii
 Procurement strategy: PPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Breaking Down the Silos: 2012 Journal of Public 3 3 Kearney K.A.,
Lessons Learned From the Child Welfare Bloom-Ellis B.,
Expansion of Performance- Thompson R.
Based Contracting to Res-
idential Treatment Services
in Illinois
Public-private partnership 2011 The Service Indus- 3 2 2.5 Navarro-
and regional productivity in tries Journal Espigares J.L.,
the UK Martin-Segura
J.A.
Private-Public Partnerships 2008 Transportation Re- 3 2 2.5 Juan, C, Olmos,
as Strategic Alliances Con- search Record F, Ashkeboussi,
cession Contracts for Port R
Infrastructures
Public-private agreements, 2009 Review of Indus- 4 0 2 Saussier S.,
institutions, and competi- trial Organization Staropoli C.,
tion: When economic the- Yvrande-Billon
ory meets facts A.
Developing Key Per- 2012 Journal of Manage- 3 1 2 Yuan, JF, Wang,
formance Indicators for ment in Engineer- C, Skibniewski,
Public-Private Partnership ing MJ, Li, QM
Projects: Questionnaire
Survey and Analysis
Channel Tunnel Rail Link: 2003 ICE Civil Engineer- 3 1 2 Bayley M.
Financing and risk transfer ing
Promoting, developing and 2011 Transport 2 2 2 Fenwick, P, Jes-
procuring the New Tyne sett, C, Ding-
Crossing wall, D, Hailey,
N
Continued on next page

cliii
 Procurement strategy: PPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Public-private partnerships: 2007 Healthcare man- 1 1 1 Philpott T.G.
A Canadian hospital’s per- agement Forum
spective
Best value concessionaire 2009 Expert Systems 1 1 1 Zhang, XQ
selection through a fuzzy with Applications
logic system
Development and Distor- 2010 Australian Journal 2 0 1 Beh, LS
tion of Malaysian Public- of Public Adminis-
Private Partnerships - Pa- tration
tronage, Privatised Profits
and Pitfalls
Value for money analysis in 2009 Transportation Re- 1 1 1 Morallos D.,
U.S. transportation public- search Record Amekudzi A.,
private partnerships Ross C., Meyer
M.
Public-private partnerships 2010 ERA Forum 1 1 Bovis C.
in the 21st century
Government Supports in 2012 Journal of Infras- 1 1 1 Brandao, LE,
Public-Private Partnership tructure Systems Bastian-Pinto,
Contracts: Metro Line 4 of C, Gomes, LL,
the Sao Paulo Subway Sys- Labes, M
tem
Effectiveness of safety- 2012 Transportation Re- 1 1 1 Rangel, T, Vas-
based incentives in Public search Part A sallo, JM, Are-
Private Partnerships: Ev- nas, B
idence from the case of
Spain
Continued on next page

cliv
 Procurement strategy: PPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Harnessing market competi- 2010 Australian Journal 1 0 0.5 Mols F.
tion in PPP procurement: of Public Adminis-
The importance of periodi- tration
cally taking a strategic view
Delivering Local Infrastruc- 2012 Journal Of Con- 1 0 0.5 da Cruz, NF,
ture through PPPs: Evi- struction Engineer- Marques, RC
dence from the School Sec- ing And Manage-
tor ment
Understanding and tracing 2012 Public Performance 0 1 0.5 Diggs S.N., Ro-
accountability in the pub- & Management Re- man A.V.
lic procurement process: In- view
terpretations, performance
measurements, and the pos-
sibility of developing public-
private partnerships
Measuring the performance 2012 Public Performance 1 0 0.5 Koontz, TM,
of public-private partner- & Management Re- Thomas, CW
ships A Systematic Method view
for Distinguishing Outputs
from Outcomes
Cost performance compar- 2007 Journal of Manage- 1 0 0.5 Kuprenas, JA,
ison of two public sector ment in Engineer- Nasr, EB
project procurement tech- ing
niques
Continued on next page

clv
 Procurement strategy: PPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The Northern Line train 2000 Proceedings of 0 0 0 Harding, A,
service contract the Institution Watts, P
of Mechnical En-
gineers Part F:
Journal of Rail and
Rapid Transit
Comparison of Public- 2012 Transportation 0 0 0 Chasey, AD,
Private Partnerships and Research Record: Maddex, WE,
Traditional Procurement Journal of the Bansal, A
Methods in North American Transportation
Highway Construction Research Board
The researcher’s perspective 2010 Structural Survey 0 0 Cheung E.,
on procuring public works Chan A.P.C.,
projects Kajewski S.
The diffusion of risks in 2012 Accounting Audit- 0 0 0 Demirag, I,
public private partnership ing & Accountabil- Khadaroo, I,
contracts ity Journal Stapleton, P,
Stevenson, C
Purchasing public services: 2009 The China Non- 0 0 Le Y.
The contract-oriented profit Review
model for cooperation
between government and
civil organizations - The
case of shanghai dapuqiao
community culture services
center

clvi
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Public procurement and 2007 Research Policy 85 61 73 Edler J.,
innovation-Resurrecting the Georghiou
demand side L.
Innovation on demand-Can 2009 Research Policy 14 13 13.5 Aschhoff, B,
public procurement drive Sofka, W
market success of innova-
tions?
Understanding the Innova- 2010 European Planning 16 9 12.5 Uyarra, E,
tion Impacts of Public Pro- Studies Flanagan, K
curement
Public procurement as an 2009 Science and Public 8 8 Rolfstam M.
innovation policy tool: The Policy
role of institutions
Public procurement of in- 2011 International Jour- 6 6 Rolfstam M.,
novations, diffusion and en- nal of Public Sector Phillips W.,
dogenous institutions Management Bakker E.
Urban competitiveness and 2011 Urban Studies 6 2 4 Lember V., Kal-
public procurement for in- vet T., Kattel R.
novation
C.15.8 Procurement strategy: Innovation procurement

Demand-orientated policy 2010 Int. J. of Technol- 3 3 3 Myoken Y.

on leading-edge industry ogy Management
and technology: Public
procurement for innovation
Risk management in pub- 2010 Innovation: The 4 2 3 Kalvet, T, Lem-
lic procurement for innova- European Journal ber, V
tion: the case of Nordic- of Social Science
Baltic Sea cities Research

clvii
Continued on next page
 Procurement strategy: Innovation procurement – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
An institutional approach 2012 Innovation: The 2 3 2.5 Rolfstam, M
to research on public pro- European Journal
curement of innovation of Social Science
Research
Public Procurement for 2012 Research Policy 3 2 2.5 Edquist,
Innovation as mission- C; Zabala-
oriented innovation policy Iturriagagoitia,
JM
Innovation procurement as 2012 Journal of Public 0 0 Yeow J., Edler J.
projects Procurement
Good Rules or bad rules in 2012 Halduskultuur - 0 0 Rolfstam M.
public procurement of inno- Administrative
vation: But is it really the Culture
(right) question?

clviii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Privatization and its re- 2004 Journal of Public 117 99 108 Hefetz, A,
verse: Explaining the dy- Administration Re- Warner, M
namics of the government search and Theory
contracting process
The mythology of privatiza- 2003 Public Administra- 115 92 103.5 Van Slyke, DM
tion in contracting for social tion Review
services
Contracting out by the pub- 1997 Oxford Review of 111 94 102.5 Domberger S.,
lic sector: theory, evidence, Economic Policy Jensen P.
prospects
Agents or stewards: Using 2007 Journal of Public 100 90 95 Van Slyke, DM
theory to understand the Administration Re-
government-nonprofit social search and Theory
service contracting relation-
ship
C.15.9 Procurement strategy: Contracting-out

Managing public service 2006 Public Administra- 84 67 75.5 Brown T.L., Po-
contracts: Aligning values, tion Review toski M., Van
institutions, and markets Slyke D.M.
Contract-management ca- 2003 Public Administra- 68 61 64.5 Brown, TL, Po-
pacity in municipal and tion Review toski, M
county governments
Exploring and explaining 2005 Journal of Public 49 43 46 Brudney, JL,
contracting out: Patterns Administration Re- Fernandez,
among the American states search and Theory S, Ryu, JE,
Wright, DS
Continued on next page

clix
 Procurement strategy: Contracting-out – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Performance-based con- 2007 The American Re- 27 28 27.5 Heinrich, CJ,
tracting in social welfare view of Public Ad- Choi, Y
programs ministration
Partnering on defense con- 2002 Journal Of Con- 29 21 25 Glagola, CR,
tracts struction Engineer- Sheedy, WM
ing And Manage-
ment
Ensuring accountability in 2002 The American Re- 27 23 25 Dicke, LA
human services contracting view of Public Ad-
- Can stewardship theory fill ministration
the bill?
Contracting for manage- 2006 Journal of Policy 21 21 21 Brown, T, Poto-
ment: Assessing manage- Analysis and Man- ski, M
ment capacity under alter- agement
native service delivery ar-
rangements
Contracting out and ac- 1997 Australian Journal 21 19 20 Mulgan, R
countability of Public Adminis-
tration
Incentives and the efficiency 2005 Journal of Eco- 19 21 20 Jensen, PH,
of public sector-outsourcing nomic Surveys Stonecash, RE
contracts
Contracting for health ser- 2004 Health policy 19 16 17.5 Ashton, T,
vices in a public health sys- Cumming, J,
tem: the New Zealand ex- McLean, J
perience
Continued on next page

clx
 Procurement strategy: Contracting-out – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Purchase-of-service con- 1998 American Behav- 18 17 17.5 Nowland-
tracting, voluntary organi- ioral Scientist Foreman, G
zations, and civil society -
Dissecting the goose that
lays the golden eggs?
The role of contract design 2004 Children and 15 12 13.5 Unruh, JK,
in privatization of child wel- Youth Services Hodgkin, D
fare services: the Kansas ex- Review
perience
Contract service firms in lo- 1999 Regional Studies 15 10 12.5 Reimer, S
cal authorities: Evolving ge-
ographies of activity
Contracting-out health 1999 Health policy 15 9 12 Vining, AR,
care services: a conceptual Globerman, S
framework
Cost efficiency in primary 2004 Health Economics 11 10 10.5 Puig-Junoy, J,
care contracting: a stochas- Ortun, V
tic frontier cost function ap-
proach
Contract governance and 2003 Industrial Rela- 12 9 10.5 Ilcan, SM,
the Canadian public sector tions O’Connor, DM,
Oliver, ML
Rediscovering implementa- 2001 Australian Journal 9 11 10 Chalmers J.,
tion: Public sector contract- of Public Adminis- Davis G.
ing and human services tration
The role of nonprofit hu- 2004 Administration in 5 14 9.5 Schmid, H
man service organizations in Social Work
providing social services: A
prefatory essay
Continued on next page

clxi
 Procurement strategy: Contracting-out – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The ’externalisation’ of lo- 2010 International Jour- 9 9 Argento D.,
cal public service delivery: nal of Public Policy Grossi G.,
Experience in Italy and Tagesson T.,
Sweden Collin S.-O.
Problems with contracting 2004 Industrial and Cor- 10 7 8.5 Boardman, AE,
out government services: porate Change Hewitt, ES
lessons from orderly services
at SCGH
Contracting and negotia- 1998 Public Administra- 9 8 8.5 Gooden, V
tion: Effective practices tion Review
of successful human service
contract managers
Contracting-in manage- 2009 Health policy 8 8 8 Loevinsohn,
ment to strengthen publicly B, ul Haq, I,
financed primary health Couffinhal, A,
services-The experience of Pande, A
Punjab, Pakistan
Contracting-out in public 1998 International Jour- 8 8 Larbi G.A.
health and water services in nal of Public Sector
Ghana Management
Contracting capacity and 2009 Public Administra- 8 8 8 Yang, K., Hsieh,
perceived contracting per- tion Review J.Y., Li, T.S.
formance: Nonlinear effects
and the role of time
Privatization morphs into 2003 Public Administra- 7 8 7.5 Sellers, MP
’publicization’: Businesses tion
look a lot like government
Continued on next page

clxii
 Procurement strategy: Contracting-out – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The Effectiveness of Non- 2010 Nonprofit Manage- 7 7 , B, Graddy, EA
profit Lead-Organization ment and Leader-
Networks for Social Service ship
Delivery
The effects of administra- 2009 Governance 6 7 6.5 Bhatti Y., Olsen
tive professionals on con- A.L., Pedersen
tracting out L.H.
The challenges of con- 2004 The Journal of Fed- 8 5 6.5 Johnston, JM,
tracting and accountability eralism Romzek, BS,
across the federal system: Wood, CH
From ambulances to space
shuttles
Applying principles for 2004 Journal of public 7 6 6.5 Honore P.A.,
outcomes-based contracting health management Simoes E.J.,
in a public health program. and practice Moonesinghe R.,
Kirbey H.C.,
Renner M.
Outsourced services and 2006 European Manage- 6 6 Walker H.,
’imbalanced’ supply mar- ment Journal Knight L.,
kets Harland C.M.
Is there a future for con- 1998 Australian Journal 6 6 6 Davis G., Wood
tracting in the Australian of Public Adminis- T.
public sector? tration
The politics and admin- 2004 Policy Studies 9 3 6 Nicholson-
istration of privatization: Journal Crotty, S
Contracting out for correc-
tions management in the
United States
Continued on next page

clxiii
 Procurement strategy: Contracting-out – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Contracting in ten English 2000 International Jour- 6 6 Darwin J., Du-
local authorities: Prefer- nal of Public Sector berley J., John-
ences and practices Management son P.
Privatization, public goods, 2007 Administration & 5 6 5.5 Gerbasi, J,
and the ironic challenge of Society Warner, ME
free trade agreements
Private operation with pub- 2010 Public Choice 5 5 5 Cabral, S, Laz-
lic supervision: evidence of zarini, SG, de
hybrid modes of governance Azevedo, PF
in prisons
The impact of the Aus- 2007 Australian Journal 5 5 5 Rogers, C
tralian government job net- of Public Adminis-
work contracting on not-for- tration
profit service providers
Economic culture and 1997 Local Government 3 7 5 Mackintosh, M
quasi-markets in local Studies
government: The case of
contracting for social care
Complex management con- 1999 Public Administra- 5 5 5 Hubbard, M,
tracts: the case of customs tion and Develop- Delay, S, Devas,
administration in Mozam- ment N
bique
SHAPING THE PROVI- 2009 Public Performance 5 5 Marvel, MK,
SION OF OUTSOURCED & Management Re- Marvel, HP
PUBLIC SERVICES Incen- view
tive Efficacy and Service
Delivery
Continued on next page

clxiv
 Procurement strategy: Contracting-out – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Insourcing and outsourcing: 2012 Journal of the 6 3 4.5 Warner M.E.,
The dynamics of privatiza- American Planning Hefetz A.
tion among U.S. Municipal- Association
ities 2002-2007
Opening up Public Services 2003 Annals of Public 4 4 Bance P.
to Competition by Putting and Cooperative
Them Out to Tender: An Economics
Evaluation
Contracting-out in urban 2009 Urban Forestry & 4 4 4 Lindholst A.C.
green-space management: Urban Greening
Instruments, approaches
and arrangements
Motivations and impedi- 2001 Administration & 4 3 3.5 Ugboro I.O.,
ments to service contract- Society Obeng K.,
ing, consolidations, and Talley W.K.
strategic alliances in public
transit organizations
The provider/purchaser 1998 Governance 5 2 3.5 Ormsby, MJ
split: A report from New
Zealand
Government contracts and 2006 Journal of Business 4 3 3.5 Berrios, R
contractor behavior Ethics
Contracting private sector 2009 Human resources 3 4 3.5 Nigenda G.H.,
providers for public sector for health Gonzalez L.M.
health services in Jalisco,
Mexico: Perspectives of sys-
tem actors
Market-Based Government 2010 Administration & 2 4 3 Adams, GB,
and the Decline of Organi- Society Balfour, DL
zational Ethics

clxv
Continued on next page
 Procurement strategy: Contracting-out – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Contracting out public ser- 2010 Oxford Economic 3 3 3 Bennett J., Iossa
vice provision to not-for- Papers E.
profit firms
Contracting out and trust 2005 Public Organiza- 3 3 Huque A.S.
in the public sector: Cases tion Review
of management from Hong
Kong
Outsourcing Public Service 2012 Public Administra- 3 3 3 Girth, AM,
Delivery: Management Re- tion Review Hefetz, A,
sponses in Noncompetitive Johnston, JM,
Markets Warner, ME
Building public health goals 1998 American Jour- 3 3 3 Rosnick, M
into the purchasing process: nal of Preventive
Managed care perspective Medicine
The new public man- 2010 Public Money & 3 2 2.5 Ortiz, C.
agement of security: the Management
contracting and manage-
rial state and the private
military industry
Contracting out in Korean 2004 International 2 3 2.5 Park, SJ
local governments: cur- Review of Admin-
rent situation and chal- istrative Sciences
lenges ahead
Satisfaction of contract 2006 Children and 4 1 2.5 Barton, WH, Fo-
provider agencies with Youth Services laron, G, Busch,
a State’s Child Welfare Review M, Hostetter, C
Agency
Public functions and private 2008 International 2 2 Palmer, S.
services: A gap in human Journal of Consti-
rights protection tutional Law

clxvi
Continued on next page
 Procurement strategy: Contracting-out – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The role of the discount rate 2010 Transportation Re- 2 2 2 Vassallo, JM
in tendering highway con- search Part A
cessions under the LPVR
approach
Institutional sources of dis- 2009 Public Manage- 2 2 Saz-Carranza
trust in government con- ment Review A., Serra A.
tracting: A comparison be-
tween home-based and res-
idential social services in
Spain
Bureaucrats as purchasers 2011 Public Administra- 2 1 1.5 Zaidi S., May-
of health services: Limita- tion and Develop- hew S.H.,
tions of the public sector for ment Palmer N.
contracting
The Politics of Transaction 1999 Public Money & 1 0 0.5 Choi Y.-C.
Costs Management
Public finance expenditure 2011 Journal of Applied 0 0 Setnikar-Cankar
and awarding work to ex- Business Research S., Seljak J.,
ternal contractors - Case of Petkovsek V.
Slovenia
Purchase-of-service con- 2010 Halduskultuur - 0 0 Lember V., Kriz
tracting in Estonia Administrative K.A.
Culture
Contracting out at local 2007 Public Manage- 0 0 Nemec J.,
government level in Slovakia ment Review Merickova B.,
and the Czech Republic Sumpikova M.F.
Continued on next page

clxvii
 Procurement strategy: Contracting-out – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Adapting to liberalization: 2012 Journal of Trans- 0 0 0 Eriksson, M,
government procurement port Geography Pettersson, T
of interregional passenger
transports in Sweden,
1989-2008
Contract Management Ca- 2012 Public Administra- 0 0 0 Joaquin, ME,
pacity Breakdown? An tion Review Greitens, TJ
Analysis of U.S. Local Gov-
ernments
The Neoliberal Transforma- 2012 Mediterranean Pol- 0 0 0 Kadirbeyoglu,
tion of Local Government in itics Z, Sumer, B
Turkey and the Contracting
Out of Municipal Services:
Implications for Public Ac-
countability
Delivery of Public Services 2012 Australian Journal 0 0 0 Housego, A,
by Non-Government Organ- of Public Adminis- O’Brien, T
isations tration
To Trust or Not to Trust? 2012 Journal of Public 0 0 Lamothe, M,
What Matters in Local Administration Re- Lamothe, S
Government-Vendor Rela- search and Theory
tionships?
Reforming social services 2008 Australian Journal 0 0 0 Wong, H.K.
in Hong Kong: The role of Public Adminis-
of contracting and perfor- tration
mance management in the
non-profit sector
Continued on next page

clxviii
 Procurement strategy: Contracting-out – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
How Hollow Can We Go? A 2012 The American Re- 0 0 0 Yang, KF, Van
Case Study of the Florida’s view of Public Ad- Landingham, G
Efforts to Outsource Over- ministration
sight of Privatized Child
Welfare Services
Contracting: The Queens- 1997 Australian Eco- 0 0 Hollander, R
land Housing Commission nomic History
experience, 1945-1957 Review
Managerial challenges in 2011 Public Administra- 0 0 0 Lindholst A.C.,
public service contracting: tion Bogetoft P.
Lessons in green-space man-
agement

clxix
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Addressing sustainable de- 2009 Supply Chain Man- 28 18 23 Preuss L.
velopment through public agement: An Inter-
procurement: The case of national Journal
local government
The hurdle analysis. A self- 2006 Corporate Social 22 22 Gunther E.,
evaluation tool for munic- Responsibility and Scheibe L.
ipalities to identify, anal- Environmental
yse and overcome hurdles to Management
green procurement
Fostering sustainability 2008 Journal of Cleaner 25 18 21.5 Walker, H,
through sourcing from Production Preuss, L
small businesses: public
sector perspectives
Sustainable procurement in 2007 Journal Of En- 21 15 18 Thomson, J,
practice: Lessons from local vironmental Jackson, T
government Planning And
Management
Buying into our future: 2007 Business Strategy 16 16 Preuss L.
Sustainability initiatives in and the Environ-
local government procure- ment
C.15.10 Procurement strategy: Green Public Procurement

ment
Developing priorities for 2005 Journal Of Cleaner 19 13 16 Swanson, M,
greener state government Production Weissman,
purchasing: a California A, Davis, G,
case study Socolof, ML,
Davis, K
Continued on next page

clxx
 Procurement strategy: GPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Experiences with greening 2008 Journal of Cleaner 17 12 14.5 Bala A., Munoz
suppliers. The Universitat Production P., Rieradevall
Autonoma de Barcelona J., Ysern P.
Green procurement in Nor- 2009 Journal of Envi- 13 11 12 Michelsen, O, de
way; a survey of practices ronmental Manage- Boer, L
at the municipal and county ment
level
Making the market work for 2003 Journal of Environ- 11 11 Kunzlik, P
the environment: Accep- mental Law
tance of (some) ’green’ con-
tract award criteria in pub-
lic procurement
Greener public purchasing: 2006 Climate Policy 11 9 10 van Asselt, H,
opportunities for climate- van der Grijp, N,
friendly government pro- Oosterhuis, F
curement under WTO and
EU rules
Environmental criteria in 2009 Ecological Eco- 12 7 9.5 Nissinen A.,
the public purchases above nomics Parikka-Alhola
the EU threshold values K., Rita H.
by three Nordic countries:
2003 and 2005
Protecting the environment 2008 Natural Resources 11 7 9 Bolton P.
through public procure- Forum
ment: The case of South
Africa
Continued on next page

clxxi
 Procurement strategy: GPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
A life cycle approach to 2011 Energy 10 6 8 Tarantini, M,
Green Public Procurement Loprieno, AD,
of building materials and el- Porta, PL
ements: A case study on
windows
Life cycle approach in the 2006 The International 8 6 7 Hochschorner,
procurement process: The Journal of Life E, Finnveden, G
case of defence materiel Cycle Assessment
Release the power of the 2006 Energy Policy 5 4 4.5 Borg N., Blume
public purse Y., Thomas
S., Irrek W.,
Faninger-Lund
H., Lund P.,
Pindar A.
Sustainable partnerships for 2011 Natural Resources 3 3 3 Otsuki K.
a green economy: A case Forum
study of public procurement
for home-grown school feed-
ing
Green public procurement: 2010 Review of Euro- 3 3 Palmujoki, A,
Analysis on the use of en- pean Community & Parikka-Alhola,
vironmental criteria in con- International Envi- K, Ekroos, A
tracts ronmental Law
Psychological barriers in the 2011 Business Strategy 3 2 2.5 Preuss L.,
road to sustainable develop- and the Environ- Walker H.
ment: Evidence from public ment
sector procurement
Continued on next page

clxxii
 Procurement strategy: GPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The relationship between 2012 International Jour- 3 2 2.5 Walker H.,
sustainable procurement nal of Production Brammer S.
and e-procurement in the Economics
public sector
Barriers to addressing 2011 Proceedings of 3 1 2 Sourani, A, So-
sustainable construction the Institution hail, M
in public procurement of Civil Engi-
strategies neers: Engineering
Sustainability
Public procurement incen- 2009 Architectural engi- 2 2 Sporrong J.,
tives for sustainable design neering and design Brochner J.
services: Swedish experi- management
ences
What factors influence the 2012 Ecological Eco- 1 1 1 Testa F., Iraldo
uptake of GPP (green pub- nomics F., Frey M.,
lic procurement) practices? Daddi T.
New evidence from an Ital-
ian survey
Procurement for sustain- 2012 International Jour- 1 1 Nijaki L.K.,
able local economic develop- nal of Public Sector Worrel G.
ment Management
Sustainability and local 2012 British Food Jour- 2 0 1 Lehtinen, U
food procurement: a case nal
study of Finnish public
catering
Green public procurement 2011 Society and Econ- 1 1 Fet A.,
in practice - The case of omy Michelsen O.,
Norway Boer L.
Continued on next page

clxxiii
 Procurement strategy: GPP – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The impact of sustainable 2012 Industrial Market- 2 0 1 Oruezabala G.,
public procurement on sup- ing Management Rico J.-C.
plier management - The
case of French public hospi-
tals
Environmental impacts and 2012 Journal of Public 0 0 Parikka-Alhola
the most economically ad- Procurement K., Nissinen A.
vantageous tender in public
procurement
Sustainable procurement in 2012 Public Money & 0 0 0 Erridge A., Hen-
health and social care in Management nigan S.
Northern Ireland
A reflection on the Dutch 2012 Journal of Integra- 0 0 0 Melissen, F,
Sustainable Public Procure- tive Environmental Reinders, H
ment Programme Sciences

clxxiv
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
An e-procurement system 2004 International Jour- 56 36 46 Panayiotou,
for governmental purchas- nal of Production NA, Gayialis,
ing Economics SP, Tatsiopou-
los, IP
Exploring success factors 2004 Government Infor- 36 22 29 Chu, PY, Hsiao,
for Taiwan’s government mation Quarterly N, Lee, FW,
electronic tendering system: Chen, CW
behavioral perspectives
from end users
Profiling a methodology for 2005 Technovation 36 19 27.5 Carayannis
economic growth and con- E.G., Popescu
vergence: Learning from the D.
EU e-procurement experi-
ence for central and eastern
European countries
C.15.11 Procurement strategy: e-Procurement

E-government policy and 2008 Government Infor- 30 19 24.5 Hardy C.A.,

practice: A theoretical and mation Quarterly Williams S.P.
empirical exploration of
public e-procurement
Towards an e-Government 2007 European Journal 26 13 19.5 Hackney, R,
efficiency agenda: the Of Information Jones, S, Losch,
impact of information and Systems A
communication behaviour
on e-Reverse auctions in
public sector procurement
Continued on next page

clxxv
 Procurement strategy: e-Procurement – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
An empirical analysis 2010 International Jour- 7 7 Wirtz B., Lutje
of the acceptance of e- nal of Public Ad- S., Schierz P.G.
procurement in the German ministration
public sector
Empirical evaluation of 2008 International Jour- 6 6 Assar S.,
public e-procurement nal of Value Chain Boughzala
platforms in France Management I.
Public sector e- 2011 International Jour- 6 6 Johnson M.
procurement: A study nal of Services
of benefits from e-markets Technology and
in the local government Management
sector
Inter-organisational in- 2011 Int. J. of Busi- 5 5 Vaidya K., Hyde
formation systems as- ness Information M.
similation: An empirical Systems
evaluation in light of the
diffusion of innovation
theory
E-Government procure- 2012 Government Infor- 4 2 3 Concha, G,
ment observatory, maturity mation Quarterly Astudillo, H,
model and early measure- Porrua, M,
ments Pimenta, C
A study of e-market adop- 2012 Journal of Enter- 3 3 Johnson M.
tion barriers in the local prise Information
government sector Management
E-procurement: Myth or re- 2012 Journal of Public 2 2 McCue C., Ro-
ality? Procurement man A.V.
Continued on next page

clxxvi
 Procurement strategy: e-Procurement – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Towards a pan-european 2012 International Jour- 3 1 2 Alvarez J.M.,
e-procurement platform nal of Software Labra J.E.,
to aggregate, publish and Engineering and Cifuentes F.,
search public procurement Knowledge Engi- Alor-Hernandez
notices powered by linked neering G., Sanchez C.,
open data: The moldeas Luna J.A.G.
approach
Use of E-procurement in 2010 European Planning 2 2 2 Cabras I.
local authorities’ purchas- Studies
ing and its effects on local
economies: Evidence from
Cumbria, UK
An integrated approach in 2005 Lecture Notes 1 1 1 Federici, T
healthcare e-procurement: inArtificial Intelli-
The case-study of the ASL gence
of Viterbo
Evaluating the anti- 2012 The Electronic 0 0 Neupane A.,
corruption capabilities of Journal on Infor- Soar J., Vaidya
public eprocurement in a mation Systems K.
developing country in Developing
Countries

clxxvii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Early contractor involve- 2012 Journal of Public 3 3 Lenferink S.,
ment in dutch infrastruc- Procurement Arts J., Tillema
ture development: Initial T., van Valken-
experiences with parallel burg M., Nijsten
procedures for planning and R.
procurement
C.15.12 Procurement strategy: Early contractor involvement

clxxviii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Is local authority procure- 2010 Journal of Pur- 7 2 4.5 Loader, K
ment ’lean’ ? An explo- chasing and Supply
ration to determine if ’lean’ Management
can provide a useful expla-
nation of practice
Lean thinking within pub- 2012 Journal of Public 0 0 Waterman J.,
lic sector purchasing depart- Procurement McCue C.
ment: The case of the U.K
public service
C.15.13 Procurement strategy: Lean PP

clxxix
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Shared services: An outline 2010 Computer Law and 1 1 Turle M.
of key contractual issues Security Review:
The International
Journal of Technol-
ogy and Practice
C.15.14 Procurement strategy: Shared services

clxxx
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Procurement as a shared 2008 International Jour- 6 6 Murray J.G.,
service in English local gov- nal of Public Sector Rentell P.G.,
ernment Management Geere D.
Public libraries and the con- 2003 Electronic Library 5 1 3 Ball, D
sortium purchase of elec-
tronic resources
One-Year assessment of 2009 Clinical Therapeu- 2 1 1.5 Al-Abbadi I.,
joint procurement of phar- tics Qawwas A.,
maceuticals in the public Jaafreh M.,
health sector in Jordan Abosamen T.,
Saket M.
Let’s stick together: Collab- 2008 Health Information 0 0 0 Marriott R.
orative purchasing of elec- & Libraries Journal
tronic journals in the Na-
tional Health Service
Cost impact of purchasing 2011 Jordan Journal of 0 0 Alabbadi I.
pharmaceuticals jointly in Pharmaceutical
C.15.15 Procurement strategy: Joint procurement

the public health sector in Sciences

Jordan

clxxxi
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Legal issues associated with 2006 Journal of Pro- 9 4 6.5 Pryke S.D.
emergent actor roles in fessional Issues
innovative U.K. procure- in Engineering
ment: Prime contracting Education and
case study Practice
Initial success and sub- 1997 Military Medicine 0 0 0 Rembold, JM,
stantial government savings Berry, TR
may mandate prime vendor
contracts for table of organi-
zation and equipment units
and deployment support
C.15.16 Procurement strategy: Prime contracting

clxxxii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Developing new forms of 2006 Public Administra- 55 44 49.5 Bovaird T.
partnership with the ’Mar- tion
ket’ in the procurement of
public services
Government Contracts and 2012 Administration & 9 7 8 Johnston, JM,
“Managing the Market”: Society Girth, AM
Exploring the Costs of
Strategic Management
Responses to Weak Vendor
Competition
C.15.17 Procurement strategy: Market-based PP

clxxxiii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Emergency contracting 2008 Journal of Pro- 1 1 1 Jeffrey, JT,
strategies for federal fessional Issues Menches, CL
projects in Engineering
Education and
Practice
After Katrina: Compar- 2012 Journal of Public 0 0 Atkinson C.L.,
isons of post-disaster pub- Procurement Sapat A.K.
lic procurement approaches
and outcomes in the New
Orleans area
C.15.18 Procurement strategy: Emergency contracting

clxxxiv
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Centralized vs. decentral-
2000 International Jour- 12 9 10.5 Vagstad, S
ized procurement: Does nal of Industrial
dispersed information call Organization
for decentralized decision-
making?
Estimating the cost ef- 2011 Journal of Pur- 3 2 2.5 Karjalainen, K
fects of purchasing chasing and Supply
centralization-Empirical Management
evidence from framework
agreements in the public
sector
State and Local Govern- 2008 Public Administra- 2 0 1 Potoski, M
ment Procurement and the tion Review
Winter Commission
C.15.19 Procurement strategy: De- / centralization

clxxxv
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Innovative practices in pub- 2005 Journal of Pur- 9 9 Lawther W.C.,
lic procurement partner- chasing and Supply Martin L.L.
ships: The case of the Management
United States
C.15.20 Procurement strategy: PP Partnerships

clxxxvi
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Using public procurement 2004 Natural Resources 47 27 37 McCrudden C.
to achieve social outcomes Forum
C.15.21 Procurement strategy: Social procurement

clxxxvii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Eminent Domain versus 2010 The Journal of Law 3 3 3 Shavell, S
Government Purchase of and Economics
Land Given Imperfect
Information about Owners’
Valuations
C.15.22 Procurement strategy: Eminent domain versus purchase of land

clxxxviii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Managing markets for pub- 2008 Public Administra- 48 29 38.5 Warner M.E.,
lic service: The role of tion Review Hefetz A.
mixed public-private deliv-
ery of city services
Simultaneous public and 2003 International Tax 1 2 1.5 Boadway, R,
private provision of ser- and Public Finance Marchand, M,
vices, asymmetric informa- Tremblay, JF
tion and innovation
C.15.23 Procurement strategy: Mixed service delivery

clxxxix
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Modeling offset policy in 2003 Journal Of Policy 7 2 4.5 Taylor, TK
government procurement Modeling
C.15.24 Procurement strategy: Offsets

cxc
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Competing agendas in pub- 2011 Environment and 6 3 4.5 Pickernell, D,
lic procurement: an empir- Planning C: Gov- Kay, A, Pack-
ical analysis of opportuni- ernment and Policy ham, G, Miller,
ties and limits in the UK for C
SMEs
C.15.25 Procurement strategy: Promoting SMEs

cxci
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Does dual sourcing lower 2006 The Journal of In- 10 10 10 Lyon, TP
procurement costs? dustrial Economics
C.15.26 Procurement strategy: Dual sourcing

cxcii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Using bargaining-game the- 2007 Journal Of Con- 28 30 29 Shen, LY, Bao,
ory for negotiating conces- struction Engineer- HJ, Wu, YZ, Lu,
sion period for BOT-type ing And Manage- WS
contract ment
Developing priorities for 2005 Journal Of Cleaner 19 13 16 Swanson, M,
greener state government Production Weissman,
purchasing: a California A, Davis, G,
case study Socolof, ML,
Davis, K
C.15.27 Public procurement tool

Traffic revenue risk man- 2006 International Jour- 11 11 Boeing Singh L.,
agement through Annuity nal of Project Man- Kalidindi S.N.
Model of PPP road projects agement
in India
Conditions and benefits of 2005 Journal of Pur- 8 8 Csaki C., Gelleri
applying decision techno- chasing and Supply P.
logical solutions as a tool to Management
curb corruption within the
procurement process: The
case of Hungary
E-Government procure- 2012 Government Infor- 4 2 3 Concha, G,
ment observatory, maturity mation Quarterly Astudillo, H,
model and early measure- Porrua, M,
ments Pimenta, C
Data mining for government 2004 Building Research 2 0 1 Perng, Y.-H.,
construction procurement & Information Chang, C.-L.
Continued on next page

cxciii
 Public procurement tool – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
A model of trade restrictive- 2012 Journal of Public 0 0 Demessie D.
ness index: Its application Procurement
and implications in public
procurement

cxciv
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Public expenditure, inter- 2004 European Eco- 23 17 20 Brulhart M.,
national specialisation and nomic Review Trionfetti F.
agglomeration
Contracting out and ac- 1997 Australian Journal 21 19 20 Mulgan, R
countability of Public Adminis-
tration
Government procurement: 2005 European Journal 16 16 Evenett S.J.,
Market access, trans- of Political Econ- Hoekman B.M.
parency, and multilateral omy
trade rules
Public sector restructuring 2000 Regional Studies 15 13 14 Pinch, PL, Pat-
C.15.28 Effect of public procurement

and regional development: terson, A

The impact of compulsory
competitive tendering in the
UK
The challenge of competi- 2007 Public Money & 11 6 8.5 Loader K.
tive procurement: Value for Management
money versus small business
support
Privatization morphs into 2003 Public Administra- 7 8 7.5 Sellers, MP
’publicization’: Businesses tion
look a lot like government
Public procurement strat- 2009 Supply Chain Man- 7 3 5 Murray J.G.
egy for accelerating the eco- agement: An Inter-
nomic recovery national Journal
Continued on next page

cxcv
 Effect of public procurement – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The impact of the Aus- 2007 Australian Journal 5 5 5 Rogers,
tralian government job net- of Public Adminis-
work contracting on not-for- tration
profit service providers
Urban competitiveness and 2011 Urban Studies 6 2 4 Lember V., Kal-
public procurement for in- vet T., Kattel R.
novation
Contract compliance: sub- 2002 Journal of Euro- 3 3 3 Fee, R
national and European in- pean Social Policy
fluences in Northern Ireland
Law, economics, and the 1998 Administrative 1 5 3 Kovacic, WE
reinvention of public admin- Law Review
istration: Using relational
agreements to reduce the
cost of procurement regula-
tion and other forms of gov-
ernment intervention in the
economy
Eminent Domain versus 2010 The Journal of Law 3 3 3 Shavell, S
Government Purchase of and Economics
Land Given Imperfect
Information about Owners’
Valuations
Market-Based Government 2010 Administration & 2 4 3 Adams, GB,
and the Decline of Organi- Society Balfour, DL
zational Ethics
Continued on next page

cxcvi
 Effect of public procurement – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The new public man- 2010 Public Money & 3 2 2.5 Ortiz, C.
agement of security: the Management
contracting and manage-
rial state and the private
military industry
Whatever happened to 2008 Journal of Applied 2 2 2 Zervos, V
competition in space Economics
agency procurement? The
case of NASA
Mapping the spatial pat- 2011 International Jour- 2 2 Cabras I.
terns of public procurement: nal of Public Sector
A case study from a pe- Management
ripheral local authority in
Northern England
Public functions and private 2008 International 2 2 Palmer, S.
services: A gap in human Journal of Consti-
rights protection tutional Law
Use of E-procurement in 2010 European Planning 2 2 2 Cabras I.
local authorities’ purchas- Studies
ing and its effects on local
economies: Evidence from
Cumbria, UK
Public Procurement at the 2003 Expert Systems 1 1 Obermann G.,
Local Level in Austria: The with Applications Kostal T.
Economic Consequences
of Compulsory Competi-
tive Tendering for Public
Services
Continued on next page

cxcvii
 Effect of public procurement – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Are public sector procure- 2011 Public Money & 1 1 1 Loader K.
ment models and prac- Management
tices hindering small and
medium suppliers?
Tendering procedures and 1999 International Ad- 1 1 Mardas D.
buy-national policies vances in Economic
Research
Strategic procurement, 2008 International Jour- 1 0 0.5 Garcia-Alonso,
openness and market nal of Industrial MDC, Levine, P
structure Organization

cxcviii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Public expenditure, inter- 2004 European Eco- 23 17 20 Brulhart M.,
national specialisation and nomic Review Trionfetti F.
agglomeration
Government procurement: 2005 European Journal 16 16 Evenett S.J.,
Market access, trans- of Political Econ- Hoekman B.M.
parency, and multilateral omy
C.15.29 Effect: Economy

trade rules
Public sector restructuring 2000 Regional Studies 15 13 14 Pinch, PL, Pat-
and regional development: terson, A
The impact of compulsory
competitive tendering in the
UK
Public procurement strat- 2009 Supply Chain Man- 7 3 5 Murray J.G.
egy for accelerating the eco- agement: An Inter-
nomic recovery national Journal
Urban competitiveness and 2011 Urban Studies 6 2 4 Lember V., Kal-
public procurement for in- vet T., Kattel R.
novation
Use of E-procurement in 2010 European Planning 2 2 2 Cabras I.
local authorities’ purchas- Studies
ing and its effects on local
economies: Evidence from
Cumbria, UK
Continued on next page

cxcix
 Effect: Economy – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Mapping the spatial pat- 2011 International Jour- 2 2 Cabras I.
terns of public procurement: nal of Public Sector
A case study from a pe- Management
ripheral local authority in
Northern England
Public Procurement at the 2003 Expert Systems 1 1 Obermann G.,
Local Level in Austria: The with Applications Kostal T.
Economic Consequences
of Compulsory Competi-
tive Tendering for Public
Services
Tendering procedures and 1999 International Ad- 1 1 Mardas D.
buy-national policies vances in Economic
Research
Strategic procurement, 2008 International Jour- 1 0 0.5 Garcia-Alonso,
openness and market nal of Industrial MDC, Levine, P
structure Organization

cc
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Contract compliance: sub- 2002 Journal of Euro- 3 3 3 Fee, R
national and European in- pean Social Policy
fluences in Northern Ireland
Eminent Domain versus 2010 The Journal of Law 3 3 3 Shavell, S
Government Purchase of and Economics
Land Given Imperfect
Information about Owners’
Valuations
Public functions and private 2008 International 2 2 Palmer, S.
services: A gap in human Journal of Consti-
rights protection tutional Law
C.15.30 Effect: Human rights, society

cci
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The challenge of competi- 2007 Public Money & 11 6 8.5 Loader K.
tive procurement: Value for Management
money versus small business
support
C.15.31 Effect: SMEs

Are public sector procure- 2011 Public Money & 1 1 1 Loader K.

ment models and prac- Management
tices hindering small and
medium suppliers?

ccii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Market-Based Government 2010 Administration & 2 4 3 Adams, GB,
and the Decline of Organi- Society Balfour, DL
zational Ethics
C.15.32 Effect: Ethics

cciii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Law, economics, and the 1998 Administrative 1 5 3 Kovacic, WE
reinvention of public admin- Law Review
istration: Using relational
agreements to reduce the
cost of procurement regula-
tion and other forms of gov-
ernment intervention in the
economy
Whatever happened to 2008 Journal of Applied 2 2 2 Zervos, V
competition in space Economics
agency procurement? The
case of NASA
C.15.33 Effect: Public procurement efficiency

cciv
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Privatization morphs into 2003 Public Administra- 7 8 7.5 Sellers, MP
’publicization’: Businesses tion
look a lot like government
The impact of the aus- 2007 Australian Journal 5 5 5 Rogers, C
tralian government job net- of Public Adminis-
work contracting on not-for- tration
profit service providers
C.15.34 Effect: Private contractor

ccv
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
The new public man- 2010 Public Money & 3 2 2.5 Ortiz, C.
agement of security: the Management
contracting and manage-
rial state and the private
military industry
C.15.35 Effect: Quality

ccvi
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Contracting out and ac- 1997 Australian Journal 21 19 20 Mulgan, R
countability of Public Adminis-
tration
C.15.36 Effect: Government accountability

ccvii
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Corruption in public con- 2006 Annals of Public 10 10 Boehm F.,
tracting auctions: The role and Cooperative Olaya J.
of transparency in bidding Economics
processes
Conditions and benefits of 2005 Journal of Pur- 8 8 Csaki C., Gelleri
C.15.37 Anti-corruption

applying decision techno- chasing and Supply P.

logical solutions as a tool to Management
curb corruption within the
procurement process: The
case of Hungary
Bribery and public pro- 2008 Public Choice 5 4 4.5 Buchner, S,
curement: an experimental Freytag, A,
study Gonzalez, LG,
Guth, W
Analyses and evaluation of 2011 Construction Man- 3 3 Tabish S.Z.S.,
irregularities in public pro- agement and Eco- Jha K.N.
curement in India nomics
The transformation of 2007 Journal of Business 2 2 2 Lennerfors T.T.
transparency - On the act Ethics
on public procurement
and the right to appeal in
the context of the war on
corruption
Public procurement in the 2001 Regional Science 2 1 1.5 Weichenrieder
presence of capital taxation And Urban Eco- A.J.
nomics
Continued on next page

ccviii
 Anti-corruption – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Corruption and public pro- 2010 Journal of Balkan 3 0 1.5 Ateljevic J., Bu-
curement: Example from and Near Eastern dak J.
Croatia Studies
Corruption and accession: 2011 Public Manage- 1 1 Pashev, K:V.
Evidence from public pro- ment Review
curement in Bulgaria
Perceived benefits related 2012 Asian Journal of 1 1 Neupane A.,
to anti-corruption from e- Information Tech- Soar J., Vaidya
tendering system in Nepal nology K.
Evaluating the anti- 2012 The Electronic 0 0 Neupane A.,
corruption capabilities of Journal on Infor- Soar J., Vaidya
public e-procurement in a mation Systems K.
developing country in Developing
Countries

ccix
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Discriminatory public pro- 1998 Journal of Public 27 15 21 Naegelen F.,
curement policy and cost re- Economics Mougeot M.
duction incentives
Public expenditure, inter- 2004 European Eco- 23 17 20 Brulhart M.,
national specialisation and nomic Review Trionfetti F.
agglomeration
Government procurement: 2005 European Journal 16 16 Evenett S.J.,
Market access, trans- of Political Econ- Hoekman B.M.
C.15.38 Trade discrimination

parency, and multilateral omy

trade rules
Public procurement direc- 1999 Public Administra- 9 7 8 Martin S., Hart-
tives in the European union: tion ley K., Cox A.
A study of local authority
purchasing
How costly is affirmative ac- 2009 The Review of Eco- 7 6 6.5 Marion, J
tion? Government contract- nomics and Statis-
ing and California’s propo- tics
sition 209
Utilizing affirmative action 2009 Economic Develop- 3 4 3.5 Bates T.
in public sector procure- ment Quarterly
ment as a local economic de-
velopment strategy
Defence procurement of 1999 Defence and Peace 3 3 3 Martin S., Hart-
dual-use goods: Is there Economics ley K., Cox A.
a single market in the
European union?
Continued on next page

ccx
 Trade discrimination – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
A contest model of liber- 2009 European Journal 4 1 2.5 Van Long, N,
alizing government procure- Of Political Econ- Stahler, F
ments omy
International procurement 2001 The Economic 2 1 1.5 Collie, DR,
as a signal of export quality Journal Hviid, M
Discrimination in interna- 2009 Acta Politica 0 0 0 Rohlfing, I
tional trade: A different
perspective
Services procurement under 2011 World Trade Re- 0 0 Shingal, A
the WTO’s Agreement on view
Government Procurement:
whither market access?
Stabilization and Associa- 2010 Atlantic Economic 0 0 Mardas D.
tion Agreements (SAAs), Journal
Europe Agreements, and
public procurement
A model of trade restrictive- 2012 Journal of Public 0 0 Demessie D.
ness index: Its application Procurement
and implications in public
procurement
Welfare loss in linear price- 2007 International Game 0 0 Koh W.T.H.
preference procurement Theory Review
auctions

ccxi
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Contracting out by the pub- 1997 Oxford Review of 111 94 102.5 Domberger S.,
lic sector: theory, evidence, Economic Policy Jensen P.
prospects
Managing public service 2006 Public Administra- 84 67 75.5 Brown T.L., Po-
contracts: Aligning values, tion Review toski M., Van
institutions, and markets Slyke D.M.
Public-private partnerships: 2004 International 76 57 66.5 Bovaird, T
from contested concepts to Review of Admin-
prevalent practice istrative Sciences
Competitive tendering in lo- 1998 Public Administra- 56 46 51 Boyne, GA
cal government: A review of tion
theory and evidence
An e-procurement system 2004 International Jour- 56 36 46 Panayiotou,
for governmental purchas- nal of Production NA, Gayialis,
C.15.39 Public procurement status overview

ing Economics SP, Tatsiopou-

los, IP
Rural-urban differences in 2003 Environment and 40 37 38.5 Warner M.,
privatization: Limits to the Planning C: Gov- Hefetz A.
competitive state ernment and Policy
Managing markets for pub- 2008 Public Administra- 48 29 38.5 Warner M.E.,
lic service: The role of tion Review Hefetz A.
mixed public-private deliv-
ery of city services
PPPs: The passage of time 2009 Economic Affairs 23 23 Hodge G.A.,
permits a sober reflection Greve C.
Continued on next page

ccxii
 Public procurement status overview – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Public procurement of con- 2006 International Jour- 13 13 Roodhooft F.,
sulting services: Evidence nal of Public Sector Van den Abbeele
and comparison with pri- Management A.
vate companies
Professional service acquisi- 2006 International Jour- 16 8 12 Schiele, JJ, Mc-
tion in public sector pro- nal of Operations Cue, CP
curement - A conceptual and Production
model of meaningful in-
volvement
Procurement methods for 2002 Building Research 13 6 9.5 Pietroforte, R,
US infrastructure: Histori- & Information Miller, JB
cal perspectives and recent
trends
Outcome-orientation in per- 2007 International 9 9 9 Proeller, I
formance contracts: empiri- Review of Admin-
cal evidence from Swiss lo- istrative Sciences
cal governments
Enabling development of 2010 Journal Of Con- 9 5 7 Garvin M.J.
the transportation public- struction Engineer-
private partnership market ing And Manage-
in the United States ment
Is there a future for con- 1998 Australian Journal 6 6 6 Davis G., Wood
tracting in the Australian of Public Adminis- T.
public sector? tration
Insourcing and outsourcing: 2012 Journal of the 6 3 4.5 Warner M.E.,
The dynamics of privatiza- American Planning Hefetz A.
tion among U.S. Municipal- Association
ities 2002-2007
Continued on next page

ccxiii
 Public procurement status overview – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Is local authority procure- 2010 Journal of Pur- 7 2 4.5 Loader, K
ment ’lean’ ? An explo- chasing and Supply
ration to determine if ’lean’ Management
can provide a useful expla-
nation of practice
Reforming defense procure- 2009 Business & Politics 4 4 Kapstein E.B.,
ment: Lessons from France Oudot J.-M.
Infrastructure procure- 2011 Environment and 4 4 4 Regan M.,
ment: Learning from Planning C: Gov- Smith J., Love
private-public partnership ernment and Policy P.
experiences ’down under’
Procurement of construc- 2005 Municipal Engineer 2 2 2 Wamuziri, S,
tion projects in local gov- Seywright, A
ernment
Whatever happened to 2008 Journal of Applied 2 2 2 Zervos, V
competition in space Economics
agency procurement? The
case of NASA
Public Procurement at the 2003 Expert Systems 1 1 Obermann G.,
Local Level in Austria: The with Applications Kostal T.
Economic Consequences
of Compulsory Competi-
tive Tendering for Public
Services
New paradigms for pub- 2008 Canadian Journal 1 1 1 De La Cruz
lic procurement of construc- of Civil Engineer- M.P., Del Cano
tion projects in the United ing A., De La Cruz
Kingdom - Potential appli- E.
cability in Spain
Continued on next page

ccxiv
 Public procurement status overview – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
State and Local Govern- 2008 Public Administra- 2 0 1 Potoski, M
ment Procurement and the tion Review
Winter Commission
Public-private partnerships 2010 ERA Forum 1 1 Bovis C.
in the 21st century
Limits of public procure- 2006 Lecture Notes in 1 0 0.5 Moe, CE, Ris-
ment: Information systems Computer Science vand, A, Sein,
acquisition MK
Public finance expenditure 2011 Journal of Applied 0 0 Setnikar-Cankar
and awarding work to ex- Business Research S., Seljak J.,
ternal contractors - Case of Petkovsek V.
Slovenia
Delivery of Public Services 2012 Australian Journal 0 0 0 Housego, A,
by Non-Government Organ- of Public Adminis- O’Brien, T
isations tration

ccxv
 Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Active and Passive Waste in 2009 The American Eco- 11 13 12 Bandiera, O,
Government Spending: Ev- nomic Review Prat, A, Val-
idence from a Policy Exper- letti, T
iment
C.15.40 Other topics

Procurement routes in pub- 2006 Journal Of Con- 15 8 11.5 Laedre, O,

lic building and construc- struction Engineer- Austeng, K,
tion projects ing And Manage- Haugen, TI,
ment Klakegg, OJ
Improving the validity 2009 International Jour- 10 10 Murray J.G.
of public procurement nal of Public Sector
research Management
The involvement of small- 2008 Journal of Pur- 9 9 Karjalainen K.,
and medium-sized enter- chasing and Supply Kemppainen K.
prises in public procure- Management
ment: Impact of resource
perceptions, electronic sys-
tems and enterprise size
The Effects of Government 2011 The Economic 8 6 7 Beetsma, R,
Purchases Shocks: Review Journal Giuliodori, M
and Estimates for the EU
Organizational design in 2007 Journal of Pur- 6 6 Kamann D.-J.F.
public procurement: A chasing and Supply
stakeholder approach Management
Government Purchases and 2010 Open Economies 5 5 5 Kollmann, R
the Real Exchange Rate Review
Continued on next page

ccxvi
 Other topics – continued from previous page
Title Year Journal Citations Citations Mean Authors
Scopus WoS citations
Public Versus Private Sec-
2011 Journal of Business 2 3 2.5 Hawkins T.G.,
tor Procurement Ethics and Ethics Gravier M.J.,
Strategy: What Each Sec- Powley E.H.
tor can Learn from the
Other
Ethics in government: A 1997 Journal of Business 1 1 1 McCampbell,
survey of misuse of position Ethics AS, Rood, TL
for personal gain and its im-
plications for developing ac-
quisition strategy
Exponential and power laws 2012 Europhysics Let- 0 0 0 Kristoufek L.,
in public procurement mar- ters Skuhrovec J.
kets
Bypassing public procure- 2011 Regulation & Gov- 0 0 0 Hansson L.,
ment regulation: A study of ernance Holmgren J.
rationality in local decision-
making

ccxvii
References
[1] URL http://www.greynet.org/greynethome.html.

[2] URL http://help.scopus.com/Content/h_bscssrchFASTprox.htm.

[3] URL http://www.utwente.nl/mb/pa/staff/telgen/.

[4] February 2013. URL http://www.oecd.org/gov/ethics/

meetingofleadingpractitionersonpublicprocurement.htm.

[5] Lawrence K. Altman. The ingelfinger rule, embargoes, and journal peer
review-part 1. The La, 347(9012):1382–1386, May 1996.
doi:10.1016/S0140-6736(96)91016-8.

[6] Richard Arnold and Andrew B. Whitford. Making environmental

self-regulation mandatory. Global Environmental Politics, 6(4):1–12,
November 2006. doi:10.1162/glep.2006.6.4.v.

[7] Birgit Aschhoff and Wolfgang Sofka. Innovation on demandcan public

procurement drive market success of innovations? Research Policy, 38(8):
1235–1247, October 2009. doi:10.1016/j.respol.2009.06.011.

[8] Earl R. Babbie. The Practice Of Social Research. Thomson Wadsworth,

11th edition, January 2006.

[9] Josette Bettany-Saltikov. Learning how to undertake a systematic review:

part 2. Nursing Standard, 24(51):47–56, August 2010.
doi:10.7748/ns2010.08.24.51.47.c7943.

[10] Jeroen Bosman, Ineke van Mourik, Menno Rasch, Eric Sieverts, and Huib
Verhoeff. Scopus reviewed and compared. June 2006. URL
http://www.library.uu.nl/medew/it/eric/scopus-eng-2006.pdf.

[11] David Budgen and Pearl Brereton. Performing systematic literature reviews
in software engineering. In Proceedings of the 28th International Conference
on Software Engineering, ICSE ’06, pages 1051–1052, New York, NY, USA,
2006. ACM. ISBN 1-59593-375-1. doi:10.1145/1134285.1134500.

[12] Mario Candeias, Rainer Rilling, and Katharina Weise. Crisis of privatisation
return of the public sphere. Policy Report 1, Rosa Luxemburg Foundation,
2008. URL http://www.rosalux.de/fileadmin/rls_uploads/pdfs/
Policy_Paper/pp-Candeias01_2008.pdf.

[13] Craig R. Carter and Lisa M. Ellram. Thirty-five years of the journal of
supply chain management: Where have we been and where are we going?
Journal of Supply Chain Management, 39(1):27–39, March 2003.
doi:10.1111/j.1745-493X.2003.tb00152.x.

ccxviii
[14] Rosalyn Y. Carter and Rick Grimm. Journal of public procurement under
the fau-nigp partnership. Journal Of Public Procurement, 1(1):3–8, 2001.
URL http://ippa.org/jopp/download/vol1/Carter%20&%20Grimm.pdf.

[15] Myun J. Cheon, Varun Grover, and Rajiv Sabherwal. The evolution of
empirical research in is - a study in is maturity. Information &
Management, 24(3):107–119, 1993. doi:10.1016/0378-7206(93)90060-7.

[16] Jeong-Wook Choi. A study of the role of public procurement can public
procurement make society better? 2010. URL http://www.ippa.org/
IPPC4/Proceedings/13ProcurementPreferences/Paper13-4.pdf.

[17] Mary M. Crossan and Marina Apaydin. A multi-dimensional framework of

organizational innovation: A systematic review of the literature. Journal of
Management Studies, 47(6):1154–1191, September 2010.
doi:10.1111/j.1467-6486.2009.00880.x.

[18] Philip Davies. The relevance of systematic reviews to educational policy and
practice. Oxford Review of Education, 26(3 & 4):365–378, 2000.
doi:10.1080/713688543.

[19] Catherine Day. Buying green: the crucial role of public authorities. Local
Environment, 10(2):201–209, April 2005. doi:10.1080/1354983042000388214.

[20] David Denyer, David Tranfield, and Joan Ernst van Aken. Developing
design propositions through research synthesis. Organization Studies, 29(3):
393–413, March 2008. doi:10.1177/0170840607088020.

[21] Jakob Edler and Luke Georghiou. Public procurement and

innovationresurrecting the demand side. Research Policy, 36(7):949–963,
September 2007. doi:10.1016/j.respol.2007.03.003.

[22] Matthias Egger and George Davey Smith. Metaanalysis: Bias in location
and selection of studies. The BMJ, 316:61–66, January 1998.
doi:10.1136/bmj.316.7124.61.

[23] Matthias Egger, Tanja Zellweger-Zähner, Martin Schneider, Christoph

Junker, Christian Lengeler, and Gerd Antes. Language bias in randomised
controlled trials published in english and german. The Lancet, 350(9074):
326–329, August 1997. doi:10.1016/S0140-6736(97)02419-7.

[24] Kathleen M. Eisenhardt and Melissa E. Graebner. Theory building from

cases: Opportunities and challenges. Academy of Management Journal, 50
(1):25–32, February 2007. doi:10.5465/AMJ.2007.24160888.

ccxix
[25] Edeltraud Günther and Lilly Scheibe. The hurdle analysis. a self-evaluation
tool for municipalities to identify, analyse and overcome hurdles to green
procurement. Corporate Social Responsibility and Environmental
Management, 13(2):61–77, 2006. doi:10.1002/csr.92.

[26] David Hall, Emanuele Lobina, and Philipp Terhorst. Re-municipalisation in

the early twenty-first century: water in france and energy in germany.
International Review of Applied Economics, 27(2):193–214, 2013.
doi:10.1080/02692171.2012.754844.

[27] Sally Hopewell, Steve McDonald, Mike J. Clarke, and Matthias Egger. Grey
literature in meta-analyses of randomized trials of health care interventions
(review). The Cochrane Library, (2), 2007.
doi:10.1002/14651858.MR000010.pub3.

[28] Ashley K. Kable, Jacqueline Pich, and Sian E. Maslin-Prothero. A

structured approach to documenting a search strategy for publication: A 12
step guideline for authors. Nurse Education Today, 32(8):878–886,
November 2012. doi:10.1016/j.nedt.2012.02.022.

[29] Mary M. Kennedy. Generalizing from single case studies. Evaluation

Quarterly, 3(4):661–678, November 1979. doi:10.1177/0193841X7900300409.

[30] Laura McAuley, Ba’ Pham, Peter Tugwell, and David Moher. Does the
inclusion of grey literature influence estimates of intervention effectiveness
reported in meta-analyses? The Lancet, 356(9237):1228–1231, October 2000.
doi:10.1016/S0140-6736(00)02786-0.

[31] Christopher McCrudden. Using public procurement to achieve social

outcomes. Natural Resources Forum, 28(4):257–267, November 2004.
doi:10.1111/j.1477-8947.2004.00099.x.

[32] G. Melin and O. Persson. Studying research collaboration using

co-authorships. Scientometrics, 36(3):363–377, 1996.
doi:10.1007/BF02129600.

[33] David Moher, Alessandro Liberati, Jennifer Tetzlaff, and Douglas G.

Altman. Preferred reporting items for systematic reviews and
meta-analyses: The prisma statement. Annals of Internal Medicine, 151(4):
264–269, 2009. doi:10.7326/0003-4819-151-4-200908180-00135.

[34] Michael J. Mol and Finn Wynstra. Purchasing and supply management:
Defining, describing and assessing a multidisciplinary research field. Can be
obtained from the authors upon request, February 2008.

ccxx
[35] University of York. Centre for Reviews & Dissemination and Jo Akers.
Systematic reviews: CRD’s guidance for undertaking reviews in health care.
Centre for Reviews and Dissemination, 2009. URL
http://www.york.ac.uk/inst/crd/SysRev/!SSL!/WebHelp/SysRev3.htm.

[36] Philip M. Podsakoff and Dennis W. Organ. Self-reports in organizational

research: Problems and prospects. Journal of Management, 12(4):531–544,
1986. doi:10.1177/014920638601200408.

[37] Jennie Popay, Helen Roberts, Amanda Sowden, Mark Petticrew, Lisa Arai,
Mark Rodgers, and Nicky Britten. Guidance on the conduct of narrative
synthesis in sytematic reviews, 2006. URL http://citeseerx.ist.psu.
edu/viewdoc/download?doi=10.1.1.178.3100&rep=rep1&type=pdf.

[38] Arnold S. Relman. Peer review in scientific journals-what good is it? The
Western Journal Of Medicine, 153(5):520–522, November 1990. URL
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1002603/.

[39] Denise M. Rousseau, Joshua Manning, and David Denyer. Evidence in

management and organizational science: Assembling the field’s full weight of
scientific knowledge through syntheses. The Academy of Management
Annals, 2(1):475–515, 2008. doi:10.1080/19416520802211651.

[40] William R. Shadish, Thomas D. Cook, and Donald Thomas Campbell.

Experimental And Quasi-experimental Designs For Generalized Causal
Inference. Cengage Learning, 2 edition, 2001.

[41] Jung Cheol Shin, Soo Jeung Lee, and Yangson Kim. Research collaboration
across higher education systems: maturity, language use, and regional
differences. Studies in Higher Education, 38(3):425–440, 2013.
doi:10.1080/03075079.2013.774585.

[42] Khi V. Thai. Public procurement re-examined. Journal Of Public

Procurement, 1(1):9–50, 2001. URL
http://ippa.org/jopp/download/vol1/Thai.pdf.

[43] David Tranfield, David Denyer, and Palminder Smart. Towards a

methodology for developing evidence-informed management knowledge by
means of systematic review. British Journal of Management, 14(3):207–222,
September 2003. doi:10.1111/1467-8551.00375.

[44] Joan E. van Aken. Management research based on the paradigm of the
design sciences: The quest for field-tested and grounded technological rules.

ccxxi
 Journal of Management Studies, 41(2):219–246, March 2004.
doi:10.1111/j.1467-6486.2004.00430.x.

[45] Elizabeth S. Vieira and José A. N. F. Gomes. A comparison of scopus and

web of science for a typical university. Sciento, 81(2):587–600, November
2009. doi:10.1007/s11192-009-2178-0.

[46] Finn Wynstra. What did we do, who did it and did it matter? a review of
fifteen volumes of the (european) journal of purchasing and supply
management. Journal of Purchasing & Supply Management, 16(4):279–292,
December 2010. doi:10.1016/j.pursup.2010.09.003.

ccxxii