Laurence J O'Toole - Kenneth J Meier - Public Management - Organizations, Governance, and Performance-Cambridge University Press (2011)
Laurence J O'Toole - Kenneth J Meier - Public Management - Organizations, Governance, and Performance-Cambridge University Press (2011)
How effective are public managers as they seek to influence how public organizations
deliver policy results? How, and how much, is management related to the perform-
ance of public programs? What aspects of management can be distinguished? Can
their separable contributions to performance be estimated?
The fate of public policies in today’s world lies in the hands of public organizations,
which in turn are often intertwined with others in latticed patterns of governance.
Collectively, these organizations are expected to generate performance in terms of
policy outputs and outcomes. In this book, two award-winning researchers investigate
the effectiveness of management in the public sector. First, they develop a systematic
theory on how effective public managers are in shaping policy results. The remainder
of the book then tests this theory against a wide range of evidence, including a data set
of 1,000 public organizations.
Published in the United States of America by Cambridge University Press, New York
www.cambridge.org
Information on this title: www.cambridge.org/9781107004412
A catalogue record for this publication is available from the British Library
Glossary 287
References 291
Index 309
v
Figures
vi
Tables
How effective are public managers as they seek to influence the efforts of
public organizations to deliver policy outputs and outcomes? How, and how
much, is management related to public program performance? What aspects
of management can be distinguished, and can their separable contributions
to performance be estimated? How do managers deal with internal operations,
opportunities in the environment, and threats or shocks from outside the
organization? Can the networking behavior of managers and the networked
structures in which many public organizations sit shape policy results – for
good or ill?
In this book we address these salient questions – and more. Whereas in
an earlier volume (Meier and O’Toole 2006) we explored the relationship
between democratic governance systems and public bureaucracy via the
literatures of political science and public administration, and used empirical
analyses to sort through the issues, in this new book we put the politics-and-
administration theme to one side – mostly – to focus on management and
performance. This approach does not mean that we reconstruct some sort
of implicit politics/administration dichotomy. Indeed, the role that public
managers occupy includes some highly political elements, and some of our
work on management and performance demonstrates some explicitly polit-
ical patterns. It turns out, for instance, that managerial interactions with
external stakeholders shape the outcomes of their organizations in ways that
reflect the distribution of power in their settings. It is also the case, further-
more, that maintaining personnel stability within the organizations we have
been studying provides particularly strong benefits for the least advantaged
clientele of the agencies. Public management certainly involves political
themes and potentially controversial outcomes. What is distinctive about
this volume, instead, is that our focus is directly on managers and how they
shape results.
Examining the link between public management and performance might
seem to be covering rather well-trodden ground. Until fairly recently,
xi
xii Preface
public management can be divided into two broad parts: managing within
the organization and managing the organization’s relationships with the
environment. Both can be expected to have performance implications.
Third, external management can be divided, at least theoretically, into
efforts to exploit opportunities in the environment and efforts to buffer
the organization from threats that the environment might generate.
Fourth, managers use structures, systematic processes, and procedures
to regularize organizational actions. Put succinctly, organizations and their
managers organize. They set up stabilizing routines that embed knowledge
and experience so that cases can be handled quickly and consistently. Finally,
the relationships between variables – that is, management, stabilizing elem-
ents such as structure, and the environment – are nonlinear. In simple terms,
this point means that management is not just another input to program
performance but, rather, that it interacts with a variety of other factors
and can produce large gains in effectiveness relative to the resources that
management consumes.
Our approach is to formalize these principles via a mathematical model
and then to test aspects of it systematically through most of the chapters of
this volume. In particular, we focus on large panel data sets that permit the
inclusion of a wide variety of control variables. In this fashion we can isolate
the independent effects of public management as the key variable, instead of
mistaking as management effects those that are actually due to some other
factor that has been omitted from the analysis.
The most frequently used data set in the book, and perhaps in the field of
public management, is the Texas school district data set, which we have built
and refined for ten years. It has several significant advantages over other
public management data bases, as we explain in this volume. Although Texas
schools constitute the primary data set, we recognize that even a state as
diverse as Texas cannot contain all the relevant organizational and environ-
mental variables. In this book, therefore, we incorporate additional analyses
we have undertaken with data on local police departments, local govern-
ments in the United Kingdom, and state unemployment insurance agencies.
Further, we explain relevant findings garnered in others’ research, as appro-
priate, at several points in the coverage. We make no claim that we have
looked at the universe of organizations and organizational characteristics,
but we have assembled research results from several thousand public
organizations.
The work represented here stems from a decision made about a dozen
years ago to pool our interests in order to develop a long-term research
xiv Preface
Governments around the globe cope with critical issues and thorny policy
challenges: encouraging economic growth, combating climate change, edu-
cating young people, protecting against disease, building and maintaining
infrastructure, planning urban communities, providing social security, and a
great deal more. Talented policy designers, and the contributions of policy
analysts, can render many of these difficult tasks less daunting. Governments
can also learn from each other’s experiences, so that mistakes do not
necessarily have to be repeated in many places before policy learning can
occur (Rose 1993). To convert sensible policy ideas into reliable and effective
streams of programmatic action, however, much more is needed.
Few policies are self-executing.1 Typically, public programs require the
concerted effort of many people, often coordinated via formal organization,
to achieve their intended results. While some policy interventions can avoid
the need for substantial coordination – monetary policies and other govern-
mental efforts to shape market conditions, for instance, rely for much of
their effectiveness on individuals’2 uncoordinated responses to reconfigured
incentives – the great bulk of policies are delivered into the hands of
intended implementers, whose responsibility it is to make policy come alive
in patterns of goal-oriented behavior. Indeed, the promise of democracy in
advanced nations is fundamentally tied to the ability of representative insti-
tutions to deliver regularly on their policy commitments through such
processes of converting public intention into action.
Governments typically face these implementation challenges with regard
to numerous policy objectives and programmatic initiatives. In the United
States, for example, the national government is committed to thousands of
such policy efforts, and several hundred of these are intergovernmental: they
encourage or require subnational governments to be a part of the action
as well through grant-in-aid programs, intergovernmental mandates, and
other such approaches. Subnational governments also develop their own
policy initiatives. In addition to the fifty states, the United States is home to
1
2 Performance: an evidence-based perspective
The management task is even more challenging than would seem apparent
at first glance. Public organizations – agencies, departments, bureaus,
authorities, and the like – are at the core of the apparatus for policy
implementation. Indeed, the US federal government’s “bureaucracy”3 is
impressively large – hundreds of organizations, approximately 2.7 million
civilian employees. Even though the national civil service has actually
declined in size during the past half-century,4 its scope and reach have
not, because many policy initiatives involve contributions to policy action
from entities outside the national bureaucracy. Indeed, Paul Light (1999)
estimates that in 1996 a “shadow” federal workforce of approximately
12.7 million people beyond those in the civil service were involved in
carrying out national policy – including government contractors and state
and local employees.
Policy implementation is complicated by the fact that many important
public policies and public programs call for the joint efforts of actors in two
or more – sometimes many more – organizations, frequently in more
than one government, and often in the for-profit and nonprofit sectors.
The expression governance is now often used to denote these broadened
patterns of collective action. “Governance,” as the saying goes, often means
more than just governments (Rhodes 1997; Peters and Savoie 2000;
Kooiman 2003). The need for such multiorganizational action in networked
patterns means that the task of public management requires attention to
such interunit coordination along with a focus on internal organizational
responsibilities.
The fate of public policies in today’s world lies in the hands of public
organizations, which in turn are often intertwined with others in latticed
patterns of governance, which collectively are expected to generate perform-
ance: policy outputs and outcomes. Public management, therefore, means
dealing with organizations, governance, and performance. This book exam-
ines the intersection of these three themes and how managers address them.
Even though our focus includes the performance of public programs, this
volume is not another study of performance measurement or performance
management (for instance, Radin 2006 or Moynihan 2008). That is to say,
we do not explore in detail the issues and controversies involved in measur-
ing performance, nor do we systematically investigate how managers use
performance information to help influence what the people in their organ-
izations do. Instead, in our empirical analyses we rely mostly on perform-
ance information that is regularly collected and typically treated as relevant
and important by managers and others. Where appropriate, we also report
4 Performance: an evidence-based perspective
In the chapters that follow, we conclude with confidence that public man-
agement makes a difference to performance, and the impact is far from
trivial. At the same time, it is important to avoid the leap to what some have
called “managerialism”: the “seldom-tested assumption that better manage-
ment will prove an effective solvent for a wide range of economic and social
ills” (Pollitt 1990: 1). We steer an evidence-based middle course here (Meier
and O’Toole 2009b). Much like the similar movements in medicine (Guyatt,
Cairns, Churchill, et al. 1992) and in public policy (Heinrich 2007), our
research, grounded in evidence-based public management, has as its object-
ive to assess the conventional wisdoms – what earlier scholars might have
called proverbs (Simon 1946) – so as to separate the wheat from the chaff
and determine what actually works in practice. Specifically, we consider the
theory and literature of public management, look for ways of tapping the
relevant aspects of what managers do, and estimate the effects of public
management on public program performance, while controlling for other
relevant factors – in particular the difficulty of the policy-relevant tasks and
the resources available for their successful achievement.
Evidence-based public management can proceed in a variety of ways,
including the careful analysis of key case studies. We have opted, however,
to employ the approaches and quantitative techniques of the social sciences.
These include formal and precise theories that generate testable hypotheses
and the statistical analysis of organizations over a period of time.
In this fashion, our theoretical and empirical perspectives avoid two
approaches that are sometimes adopted. As mentioned in the preface, at
one extreme are the population ecologists. This approach, best represented
in the research literature on public management by Herbert Kaufman
(1991), holds that public organizations survive and flourish because they
are lucky, not because they or their managers make sound decisions.
Organizations, in this view, are simply at the mercy of their environments.5
5 Themes from the research literature
many other parts of the world. If anything, the array of issues addressed in
serious studies of public organizations and their management has expanded
in recent years, with notable investigations of such topics as public service
motivation; red tape, its causes and consequences; government contracting
and privatization; the use of discretion by supervisors and front-line
workers; the differences between public and private management; the chal-
lenges of involving stakeholders in public decision making; the adoption of
new public management and other managerial reforms; the development of
interorganizational collaboration and networks for the delivery of public
programs; innovations in public organizations; institutional isomorphism
(the consequence of mimesis, or organizations’ copying or deriving their
institutional forms from other such organizations) in the public sector;
emergency or crisis management; and diversity management. This list,
furthermore, is merely a partial one.
On the specific theme of public sector performance, moreover, consi-
derable important work has been accomplished by researchers. Even
leaving aside the frequently studied issue of whether so-called “pay for
performance” systems produce useful results (many studies raise serious
questions about the notion), public organizational performance has been
approached from a number of angles. Some, for instance, have explored the
meaning and determinants of the US national government’s recent efforts to
assess program performance by means of so-called “PART” (Program Assess-
ment Rating Tool) scores (see, for example, Dull 2006, Gilmour and Lewis
2006, Moynihan 2006, 2008; more about PART scores shortly). Researchers
have sought to understand whether setting performance targets helps to
improve performance (Boyne and Chen 2007). Others have sought to esti-
mate the influence of such diverse factors as organizational goal ambiguity,
institutional design and reputation, and individual characteristics on per-
formance (respectively, Chun and Rainey 2005, Krause and Douglas 2005,
and Kim 2005). Researchers have tried to determine how features of network
structure can shape performance (Provan and Milward 1995; Schalk,
Torenvlied, and Allen 2010).
Some broad meta-analyses of hundreds of studies related to governance
and performance have attempted to develop some generalizations and themes
from the work of many others (Forbes and Lynn 2005; Hill and Lynn 2005).
In addition, there have been efforts to compile the results of a number of
different studies of performance from different empirical contexts (for
example, see the full set of papers in the October 2005 issue of the Journal
of Public Administration Research and Theory, as well as Boyne et al. 2006).
7 Themes from the research literature
Milward 1995; Klijn 1996). More recently, several studies have sought to
cover numerous public organizations and/or governments in making and
seeking to validate this claim (examples include Donahue et al. 2004, Boyne
and Walker 2006, Brewer 2006, and Walker and Boyne 2006; see also some of
the literature referenced earlier in this chapter); and some of these assert, but
do not really test, the effects of management on results (for instance, the
products of the Government Performance Project (GPP): see Ingraham,
Joyce, and Donahue 2003, and Ingraham 2007). Given the broad agreement
that public management matters (a conclusion that this book also validates),
the important question guiding the analyses here is this: how effective is
public management at generating performance?
Third, the case study literature, as well as the literature based upon larger-N
studies of many organizations, is mostly in agreement that public man-
agement is not a simple function but, rather, encompasses multiple aspects.
Different scholars offer different lists of functions. Ingraham, Joyce, and
Donahue (2003) treat financial management, human resources management
(HRM), information technology management, and capital management as
the central elements of the managerial function,10 while, in their early work
together, Boyne and Walker (2006; Walker and Boyne 2006) concentrate on
both managerial strategy process and strategy content. A number of case
study authors and others focus in particular on “leadership” by managers
(for example, Doig and Hargrove 1987, Behn 1991, and Terry 2002). Studies
emphasizing the external/network-related aspects of public management
highlight in particular the brokering, framing, exchange-related functions –
above all, collaboration. For instance, Agranoff and McGuire (2003) identify
a number of vertical and horizontal aspects of collaborative activity in which
local government managers engage, including information seeking, adjust-
ment seeking, policy making and strategy making, resource exchange, and
project-based work. Rainey (2009) draws numerous structural and proced-
ural dimensions into public managers’ purview, while also noting the
assumed importance of variables such as organizational environment, tech-
nology and tasks, goals, and culture. So, although there is no clear consensus
on the preeminent or essential functions of public management – no agreed-
upon “POSDCORB”11 for the twenty-first century – a widespread consensus
holds that public management is not a simple, unidimensional activity. An
implication is that, given that management is multifunctional and involves
varied behaviors, determining systematically just what differences all these
functions make in the performance of public programs is an exceedingly
difficult task. In this book we identify a number of distinct aspects and
9 Themes from the research literature
Tapping performance
agencies. Other data sets also record similar perceptual data. Survey items
ask for responses on some performance-related matters. Drawbacks, how-
ever, include the points that (1) it is not clear to what extent federal
employees are knowledgeable and impartial with regard to their larger
organization’s overall performance, (2) several of the most relevant survey
items are focused on the individuals’ work units rather than their overall
organization’s outputs or outcomes,15 and (3) models of performance esti-
mated with independent as well as dependent variables drawn from the same
respondents may be prone to common-source bias (Brewer 2006; for a test
of common-source bias through a comparison of subjective and objective
measures of performance, see Meier and O’Toole 2010).
One locus of interesting and useful data on the performance of a substan-
tial number of general-purpose governments is the Comprehensive Perform-
ance Assessment (CPA) of the United Kingdom’s Audit Commission, and
especially the Core Service Performance (CSP) aspect.16 The CPA and CSP
have been applied to local authorities throughout the United Kingdom. The
CSP is determined for each of seven service specialties and is based largely on
archival performance indicators, supplemented by the results of the inspec-
tion and assessment of plans (Andrews et al. 2005). The archival perform-
ance indicators cover six aspects of organizational performance: quantity of
outputs, quality of outputs, efficiency, formal effectiveness, equity, and
consumer satisfaction. The inspection of services draws upon internal
improvement plans, field visits, and other documentation. Statutory plans
are assessed against the criteria of the service’s relevant central government
department. Evaluators external to the local authority conduct all assess-
ments. Each service area is given a performance score by the Audit Commis-
sion from 1 (lowest) to 4 (highest). After calculating the CSP score for each
service area, the Audit Commission derives a score for the whole organiza-
tion by weighting services to reflect their relative importance by budget, then
combining these weights with the performance score for each service area.
The CSP therefore offers a number of measurement advantages, but there
are disadvantages as well. One is that using an overall measure of the
performance of a local authority does not easily allow for exploration of
individual service areas, and thus analysis is largely limited to relatively
underspecified models. A second is that individual services are grouped into
four rough performance categories (omitting much valuable information),
and the adding of these weighted categories creates a false sense of precision
that may not exist in practice. Also, of course, additional data on manage-
ment must be gathered to try to model the management–performance link.
14 Performance: an evidence-based perspective
Some such studies have been completed (for instance, Andrews, Boyne, and
Walker 2006 and Walker and Boyne 2006).17 In any event, the British
government has now modified its approach to assessing the performance
of local authorities. The newer Comprehensive Area Assessment (CAA),
created in 2009, was not comparable to the CSP approach, and explicitly
placed significant discretion into the hands of the auditors. Furthermore, in
May 2010 the newly elected Conservative/Liberal Democrat coalition gov-
ernment scrapped the CAA as well.
Perhaps the best way of making progress is to draw from many public
organizations in one or other policy sector or service area, ideally in settings
in which there is substantial consensus that certain performance measures
are relevant, even highly salient. If such measures are collected systematic-
ally, in time series, and if additional data on control variables are likewise
available, it may be possible to supplement this information with data on
management to explore the difference that management makes. This is the
approach we have taken here (see Chapter 2). Most of our empirical work
draws from one field of public service: education. Results from education
can be supplemented by similar studies in other policy fields, and valid
general findings about public management and performance can be
developed. In fact, a number of such studies have been conducted in other
substantive fields of policy and management, both by us and by other
investigators. The results of many such studies are included in later chapters
of this book as appropriate, along with more detailed analyses of manage-
ment and performance in public education. Although the other study areas
have not produced a volume of research equal to that produced for public
education, they have generated sufficient work to indicate that the theory
and the approach can be generalized.
one not chosen here, operates or is driven primarily at and from the
individual level (for instance, Argyris 1957, and subsequent publications;
Golembiewski 1962, 1990, and subsequent publications; Katz and Kahn
1978). Both traditions have their strengths. We are interested in organiza-
tional and programmatic outputs and outcomes – and the effectiveness of
management in shaping these – and judge that the former tradition offers a
more direct and appropriate means for theory building and testing for this
purpose.
In building from the tradition we have chosen, it is not imperative that we
make a choice between socialized choice-based notions of individual deci-
sion making, on the one hand, and economic rationality, on the other (see
the discussion in Lynn, Heinrich, and Hill 2001: 60–71). In tying our
investigations of public management and performance to this earlier line
of work in organization theory, furthermore, we are doing what Steven
Kelman (2008) proposes for researchers in public management.
We also chose to generate such a model on the basis of our reading of the
literature – in other words, inductively. Our approach has been to specify
and formalize into mathematical expression what we understood to be some
of the key theoretical assertions in the extant set of studies. Sometimes these
earlier studies were not precise about the nature of the relationships in the
theoretical arguments, so where we thought it necessary we added specifi-
city. One reason why many apparent theoretical insights in the field remain
neither validated nor refuted, we believe, is that they are sometimes not
formulated with sufficient specificity to be tested and given a chance to be
found wanting. Our approach, therefore, is the opposite: a formal, reductive
model that is constructed inductively but that is in some respects more
precise than the literature from which it springs. As we indicated at the time
of the first publication of the model (O’Toole and Meier 1999), we would
not be surprised to learn that some aspects of the model might need to be
reconfigured on the basis of the evidence, but we would rather be precise so
as to learn of the need for such modifications than persist in imprecision
without progress.
We concluded that the model needed to offer a prominent role for what
might be called internal management – the hands-on activities that man-
agers undertake in seeking to organize and coordinate people and resources
to get things done, as well as to reinforce and possibly enhance the routines
and standard processes through which their organizations generate results.
Equally importantly, we also concluded that the model would need to reflect
the burgeoning emphasis on networks of organizational actors – the
17 Our perspective: a parsimonious and formal approach
detail, and we also demonstrate some of the major advantages of using such
data in a research program such as this one.
Chapters 3 through 7 provide coverage of the management–shapes–
performance evidence. Each chapter concentrates on an aspect of management,
with the major managerial functions carved from the general model for
focused attention. Systematic evidence is adduced in these chapters: detailed
findings, especially from our work in public education, plus summary
empirical evidence from other fields of policy and management and from
numerous other venues.
Chapter 3 addresses the important themes of networks and managerial
networking with other interdependent actors. Among the findings the
chapter reports are: both network structure and networking behavior are
appropriate foci of research for those interested in program performance;
networking patterns of managers exhibit some similarities even when one
compares data across national settings; networking by managers is not a
product of pressure from outside the organization but, rather, reflects
choices and actions by the managers themselves; the networking behavior
of managers contributes positively to performance; managers’ networking
behavior interacts with some resources and constraints in the environment
to boost the effects of networking in nonlinear ways; these positive outputs
and outcomes are not equally distributed among interested parties, a pattern
thus raising an issue of equity; and the direction(s) in which managers
interact outward, and the nature of the interaction partner(s), help to
explain who benefits from managerial networking.
Managers exhibit more than a mere degree of activity or “busyness” when
performing their responsibilities. Some managers are highly skilled at what
they do, while others frequently make mistakes. In Chapter 4 we develop a
measure of managerial quality and estimate the separate impact of quality
on public program outputs and outcomes. We also show that managerial
quality can limit the onset of diminishing returns in the case of networking.
The management of people and operations within the core public organ-
ization charged with delivering results is a huge topic. Indeed, it is the
primary focus of much of the literature on public management. Chapter 5
is devoted to analyses of some aspects of internal management. Among the
results developed there are: personnel and managerial stability contribute
positively to performance; and, more broadly, the management of an organ-
ization’s human capital has a substantial positive influence that can be seen
in organizations as diverse as those dealing with education and those
charged with law enforcement. Chapter 5 also shows that good internal
20 Performance: an evidence-based perspective
management can be used to deal with major events, such as budget cuts, that
can harm the organization and its outputs.
Chapter 6 turns to two often neglected aspects of public management: the
protective dimension and the nonlinearity of management’s impact. Not
only must managers be creative, help their organizations to exploit oppor-
tunities and resources in their setting, and jump-start new operations, they
also can serve a crucial performance function by buffering public programs
from perturbations and protecting them from negative shocks. Even when
shocks enter the organizational system, management capacity plays a key
role in allowing the organization to weather the disruption. In this chapter
we demonstrate how important such functions can be in dealing with such
sources of turbulence as budget cuts and natural disasters. We also explore
the form of the managerial buffering function, and we show how this general
process appears to benefit the organization’s most disadvantaged clientele.
Chapter 7 presents an initial foray into the distinction between behavior
and structural networks. This book focuses on behavioral networks, even
though much of the literature deals with the structural dimension. Our
measure of structural networks is the set of intergovernmental fiscal ties on
which local governments depend, and we explore how variation in such
funding sources between governments might shape results. We then show
how behavioral networking, as well as other managerial aspects, affect
performance within different types of structural networks.
In the final chapter we draw together the results of the research program
to date, examine how all these managerial influences aggregate, sketch
additional questions that remain to be explored, and summarize the differ-
ence that management makes.
NOTES
1. An exception is symbolic policies – those not intended to accomplish anything apart from
signaling approval or disapproval of some person, event, or institution. Symbolic policies
are obviously not intended to be implemented.
2. Here the individuals might be either people or organizations such as business firms. This
point should not imply that such policies can operate without the benefit of public
management to oversee the incentives and adjust them as priorities change or as the
incentives generate unintended consequences.
3. As is often observed, the term “bureaucracy” typically appears as one of opprobrium in
standard conversation – a shorthand for large, heavy-handed, intrusive, red-tape-encrusted,
21 Notes
inefficient government organization. Ever since Max Weber analyzed the concept
nearly a century ago (Gerth and Mills 1958), however, social science has used the
term to reference formal organization with certain distinctive features, including a
hierarchy of superior–subordinate relations, the appointment of experts on the basis
of merit criteria, fixed and limited jurisdictions, decision making on the basis of
rules, and reliance on written records. Note that, by such a designation, bureaucracy
as an organizational form applies to many for-profit and not-for-profit organizations
as well as governmental ones.
4. The budget, on the other hand, has grown considerably.
5. A much less extreme version of such an argument holds that management matters, but
what managers should do is largely driven by features of the organization’s environment
(see, for example, Woodward 1965). As becomes clear later in this book, we believe that
this approach underestimates too much the potential effect of public management.
6. As many commentators have noted, NPM is less a coherent approach than a loosely linked
cluster of ideas and reforms. Many of the specific NPM proposals have to do with bringing
business management practices into public organizations and/or tapping market forces –
for instance, by contracting functions out from public organizations. For varying versions
of and emphases within NPM, see Hood (1991), Ferlie et al. (1996), Pollitt and Bouckaert
(2000), and Barzelay (2001). NPM has shaped practices and ideas in many countries.
7. There is even a literature covering alternative ways that “publicness” might be defined
and measured. We ignore such details in the coverage here, but revisit the subject briefly
in the concluding chapter of the book.
8. It may be that private management has the same impact as public management; we do
not know, and the literature has not demonstrated findings on this point, one way or
another. We study public organizations because we are interested in public programs.
9. For an attempt to review the relevant literature and distill a set of testable propositions
regarding the determinants of effective public organizations, see Rainey and Steinbauer
1999.
10. Overlying these four, three additional aspects are interwoven: leadership influence and
emphasis, integration and alignment, and managing for results (see Ingraham, Joyce, and
Donahue 2003: 16).
11. POSDCORB was Luther Gulick’s (1937) way of summarizing the core managerial func-
tions in the relatively early days of public administration as a self-aware field. The acronym
stands for “planning, organizing, staffing, directing, co-ordinating, reporting, and
budgeting.”
12. On the one hand, many studies indicate that networks and collaboration are on the rise
in today’s world. The emerging theme of governance is reflective of this argument. On the
other hand, diachronic studies of US legislation find little evidence of change across a
nearly thirty-year period (Hall and O’Toole 2000, 2004). The actual trends over time, if
any, await further empirical research.
13. Another requirement, of course, is measures of management. We address the set of issues
related to this measurement challenge in various chapters of this book.
14. Many Cabinet departments have a wide variety of programs that are frequently not tied
closely together. These aggregations reflect a wide variety of historical and political
factors rather than any effort to group programs next to similar ones (see Seidman 1998).
22 Performance: an evidence-based perspective
15. Using work units might mean suboptimization at the work-unit level rather than optimal
performance by the entire organization.
16. The CPA includes a subjective assessment of management style, which can bias the results
if management is an independent variable in the analysis.
17. For management to play a major role, there must be discretion available to managers. In
many UK service areas, such as education, the national government restricts the range of
actions that local managers can take, thus limiting their impact.
18. More recently, one of us has suggested that the model might be used to explore
performance-related relationships across a wide range of political institutions, not merely
in bureaucratic organizations and networks of such implementing organizations (Meier
2007). This possibility is discussed in Chapter 8.
19. Lynn, Heinrich, and Hill do indicate that their reduced-form model implies an “essen-
tially hierarchically” framed perspective on governance (e.g. legislative preferences
driving the formal structures and process of public agencies, the latter then shaping the
de facto organization and management of agencies and programs, this last set of forces
influencing the “core technologies and primary work of public agencies,” etc.; 2001: 32),
although they also note that “there is likely to be endogeneity in these interactions, and
one should not assume that the causal arrow always points downward” (39, note 14). The
hierarchical formulation is based in part on the fact that many available empirical studies
test for hierarchical effects. This finding, while undoubtedly partially valid, unfortunately
does not take into account other under-researched causal paths – for instance, from
front-line bureaucrats to managers to political leaders. Where such reverse or reciprocal
causal paths have been hypothesized, evidence has validated such channels of influence;
see Meier, O’Toole, and Nicholson-Crotty (2004).
20. The exception is when the motivation of front-line workers is reflected in lower turnover –
a variable that we can measure directly.
21. Our approach is not divorced from the real work of practice. We have much experience
interacting with managers in these organizations, as will be evident from our qualitative
discussions in various places. All analysts of organizations and performance need to
understand how organizations operate and how they generate the results that they do.
2 A model of public management
and a source of evidence
Elements of a model
however, it is necessary to clarify some basic concepts that are both common
in the literature and also central to our approach.
Public organizations are almost always structured as hierarchies. Indeed,
bureaucracy as an organizational form is defined in part in terms of struc-
tures of superior–subordinate relations. In Chapter 1 we observed that
frequently public organizations are also linked to other organizations of
various sorts as they coproduce outputs and outcomes of public programs.
So networks, as defined in the last chapter, often contain hierarchies embed-
ded within them. At a more abstract level, we can think of hierarchy and
network as structural forms at two ends of a continuum. That continuum
would array structural forms – stable sets of relations – in terms of the
degree to which each such structural form is governed by superiors who hold
formal authority to compel action on the part of others.
Although we present hierarchies as a single type at one pole of the
continuum, in practice they vary considerably in structure. They can be
centralized or decentralized; they can vest extensive discretion in employees
or seek to limit discretion with extensive rules; they can permit the lateral
entry of employees or require that all promotions are from within the
organization. These formal arrangements themselves tell only part of the
story, since “informal organization,” which develops in every functioning
organization, is also important. For present purposes, however, we simplify
by treating hierarchy as a stabilizing arrangement. In other words, at the
extreme a “pure” hierarchy would be highly stable, even rigid, and would
resist forces that might otherwise perturb or modify it.
Formal hierarchy is not the only stabilizing force in bureaucratic
organizations. Among the other stabilizing aspects of formal organization,
aside from structural stability, are mission stability (constancy over time
in the stipulated goal(s) of the organization), procedural stability (con-
stancy in the routines, rules, and standard operating procedures of the
organization), production or technology stability (constancy in the tools
used by the organization to get things done), and personnel stability
(retention of the same individuals in the organization; see O’Toole and
Meier 2003b). Indeed, some of these stabilizing forces are likely to
reinforce each other; hierarchy, or structural stability, for example, can
contribute to procedural stability.1 These aspects of stability are discussed
further in Chapter 5.
In short, we expect hierarchies to be relatively stable systems, and we also
note that other forces also contribute to stable organizational systems. These
features of public organizations will prove to be useful in our efforts to
25 Elements of a model
model management and performance, and some of them are also examined
in the empirical parts of this book.
If “pure” hierarchy, or completely stable organization, is at one pole of the
continuum mentioned earlier, pure networks can be considered to sit at the
other end.2 There is considerable evidence demonstrating that many public
programs are not executed within or by a single hierarchical agency but are
spread across parts of two or more organizations. These can be different
organizations within a common government, but in many cases they are
parts of multiple governments, and sometimes they also include businesses
and/or nonprofit organizations. Such patterns are what we mean by net-
works. The nodes of networks can be occupied by individuals, organizations
(including hierarchies), or parts of organizations.
As with hierarchies, networked structures can vary greatly in structural
terms, from simple dyads to breathtakingly complex arrays of several dozen
organizations, and with great variation as well on a number of structural
dimensions that are typically used to characterize networked patterns: net-
work centrality, multiplexity, and so forth (O’Toole 1997). Networked action
is typical in the United States (see, for instance, Bardach 1998 and Bingham
and O’Leary 2008) as well as in other settings, from the United Kingdom
(Huxham 2000; Stoker 1999) to Sweden (Lundin 2007) and the Netherlands
(Schalk, Torenvlied, and Allen 2010), and even Thailand (Krueathep,
Riccucci, and Suwanmala 2010).
Despite the absence (or low level) of formal authority possessed by
“leaders” in a network, such patterns may over time acquire some consider-
able degree of stability. In fact, some types of networks have become known
for their relatively closed and impenetrable features – for example, the “iron
triangles” of administrative agency, legislative committee, and interest
groups sometimes seen operating for extended periods in certain US policy
fields (Freeman 1965). Our particular interest is in networks of actors
involved in implementing public programs and delivering public services.
Networks for implementation can also acquire stability over time, but those
that are not well established, but are in formation or flux due to the
establishment of a new program or significant modification in an existing
one, can be quite fluid. Indeed, in pluralist governance settings such as in the
United States, we expect networks to be structurally more open and shifting
than in implementation settings in more corporatist contexts where there is
broad agreement on processes and procedures.
Networks are particularly interesting to public management scholars
because public managers have the responsibility for trying to weave
26 A model of public management, and evidence
Organizations and programs, as has often been noted, are inertial systems.
What they do and what they produce today is typically very much like what
they did and produced yesterday. The pattern holds for both empirical and
normative reasons. Empirically, it is difficult to induce significant change
overnight when the routines and operations of hundreds or thousands of
individuals would need to be adjusted and coordinated anew, and perhaps in
a different direction. Normatively, one of the major advantages of bureau-
cracy as an organizational form is consistency and relative stability (Gerth
and Mills 1958); organizations, as a result, are designed to be inertial. An
29 Inertial systems and stability
Ot ¼ b0 Ot1 þ e ð2:1Þ
where current performance is the result of past performance at time t–1,
discounted by a rate of stability, b0, and a set of shocks to the system, ε. In
this general modeling effort, we ignore the nature of the relevant outputs,
how they would be measured, and whether multiple dimensions should be
considered.6 In mathematical terms, such an inertial system is called an
autoregressive system. An autoregressive system is not the equivalent of a
static system. A static system does not change from one time period to the
next; an autoregressive system can build in change over time either internally
or in response to environmental change.7 The rate of stability of this system
is constrained to a value between zero and one. As b approaches one, the
system becomes highly stable. As the value approaches zero, the system
moves toward entropy.8
Shocks to the system, ε, can originate from a variety of forces in the
environment. Some of them are intentionally generated by other actors –
for instance, decisions from the courts that alter or constrain program
activity, actions by legislatures or executives that change priorities or alter
program funding, or antagonistic moves by those who oppose the program
or the organization that operates it. Some shocks may emanate from other
influences, such as changes in the economic or social environment. The
examples mentioned thus far are exogenous, but some may have their
source from within the system itself, such as planned organizational change,
or organization development. As will become clear shortly, we distinguish
some of the exogenous parts of ε and incorporate them into the modeling
process.
In rigid hierarchies, as indicated earlier, we expect systems to be highly
autoregressive, whereas with fluid and emerging networks there is much less
inertia. If we consider both structure and other stabilizing features of such
systems (standard operating procedures, civil service rules, and the like), we
can introduce another term, S, as an expression for the set of stabilizing
features. If we had a good measure of the set of stabilizing features, and if we
normalize it to approach 1.0 at the highest level of stability and to approach
0 at the extremely fluid and flexible end of the continuum, we could say
b0 ¼ f ðSÞ ð2:2Þ
30 A model of public management, and evidence
or that the rate of stability, b0, can be partitioned into the structural and other
related stabilizing features, S, along with other inertial elements, now b1.
The general equation would be
Ot ¼ b1 SOt1 þ e ð2:3Þ
which indicates that an increase in organizational structure and/or other
stabilizing elements results in a more inertial system.
Shocks
A major difference between fluid networks and highly stable structures such
as bureaucratic hierarchies lies in how they are affected by external shocks
from the environment. Later in this book we consider in some detail how
shocks affect organizational performance and what can be done to mitigate
any potentially negative effects. For now, we consider the issue in general
and abstract terms. Stable hierarchies generally tend to buffer or protect the
organization fairly effectively. Shocks that do penetrate a system’s protec-
tions, nonetheless, have different impacts on stable organizations from the
impacts they have on fluid networks. Although shocks are less likely to pass
through a hierarchy’s buffering apparatus, when they do they can have a very
significant impact. To see why, we return to the initial autoregressive rela-
tionship in Equation (2.1) from above for an approximation to the pattern
in a highly stable hierarchical system (where b0 ! 1):
Ot ¼ b0 Ot1 þ e ð2:4Þ
If we partition the ε into some shock Xt that penetrates the system’s buffers
with an initial impact of b2 and a random component, εt, this yields
Ot ¼ b0 Ot1 þ b2 Xt þ et ð2:5Þ
Note that, in this case, a one-unit change in Xt produces a b2 change in
Ot, all other things being equal. This effect is the impact of Xt on O for time t
only, however. Because Xt has increased the value of Ot, then in time tþ1 this
larger value of Ot will also influence the size of Otþ1. Because Ot is b2 larger
as the result of Xt, Otþ1 will be b0b2 larger as the result of the impact of Xt in
the preceding year. Such impacts continue to reverberate through the system
in future years, gradually becoming smaller (forming what is known as a
geometrically distributed lag; see Hamilton 1994) but still cumulating into a
relatively large impact.
31 Buffering
Buffering
Given the different functional forms that buffers may take, for modeling
purposes we would need to take into account the form of the buffer to
represent it mathematically. We do so here for one of the types mentioned
above: that of buffer as dampener. We can conceive of the stabilizing features
of a system (here subscripted with an “e” to indicate that the feature is
designed to interface with the environment rather than generate internal
stability – for instance, a legislative affairs or public affairs office), including
the system (such as organizational) structure, as reducing the impact of
shocks via a discounting term in the model, thus:
Ot ¼ b1 SOt1 þ b2 Xt ð1=Se Þ þ et ð2:7Þ
In this way, an increase in stabilization, Se, acts directly on the exogenous
shock to limit its impact on the system. Any shock that penetrates the
buffers of the system can still have a substantial, long-run impact on the
organization, however, if the organization is highly inertial. For a fluid
network, in contrast, buffering is relatively weak, so shocks easily reach the
system. The impact of such shocks over time is far less, however – simply
because the networks are more loosely coupled.
Equation (2.7) indicates how one might model a buffer that operates as a
dampener, reducing all environmental impacts by a given amount. Other
types of buffers would take different mathematical forms. A buffer that
operated as a barricade or a levee, for example, would be operationalized
as a more additive (subtractive in practice) process, as follows:
Ot ¼ b1 SOt1 þ b2 ðXt Se Þ þ et ð2:8Þ
The important theoretical point about buffers is that they can be designed in
very different ways; models of organizations need to reflect the different
buffering processes with appropriate mathematical representations.
Hierarchies and networks are human systems for executing policy; as such,
they are not merely inertial structures and buffers but managed entities as well.
Obviously, therefore, we need to represent some of the core features of public
management in our mathematical representation – but how, exactly? We know
that all signs point to management often contributing positively to program
performance. If this contribution were to take the form of another standard
input in the production process, we could include management – “M” – as
33 Introducing management into the picture
S and M over extended periods. This line of research must be left to future
work, but it is a promising area in which to merge the study of public
management with the study of organization theory (Kelman 2008).
We have developed a model that includes a number of managerial func-
tions and a set of contingent relationships. Modeling management and
performance at this level has incorporated some assumptions and simplifi-
cations, but a big advantage is that we have specified precisely a set of
empirical relationships that might or might not hold in practice. Although
we begin to test many of them later in this volume, at this point the model
can be treated as a set of hypotheses. It is quite possible that this theoretical
effort will eventually be shown to be in error on certain points (one such
possibility is introduced later in the book; see Chapter 6), but we care less
about being correct in the details than about catalyzing work along these
lines. Progress can be expected only through precise and ultimately falsifi-
able predictions about managing public programs.
Our approach differs from others that have been taken in the research
literature on public management. First and most obviously, this approach
varies markedly from the most common approach in the field of public
management. Although the model has been built by relying on the extensive
case study literature, and although there is nothing about the model that
could not be explored via additional case studies, we have formalized several
of the assertions and intuitions of that earlier literature for the purposes of
more precise, large-N statistical tests. We think the advantages of this approach
in terms of reliability and external validity make the effort potentially valuable.
It should also be clear that, given the complexity of the model and the number
of hypothesized relationships, it is not a simple matter of generating one study
that can see if all the theoretical ideas set forth here are valid or invalid. The
model, in short, initiates and catalyzes a research program that needs to
encompass multiple kinds of empirical investigations. As we mentioned at
the conclusion of our initial articulation of the model, “[T]his perspective
suggests the initiation of a research agenda rather than the sketch of a one-shot
research design” (O’Toole and Meier 1999: 524, emphasis in original). Indeed,
this book synthesizes a number of the investigations that have been part of that
research agenda as it has developed over several years.
Second, the theoretical ideas sketched here are somewhat different from
those offered by certain other researchers. Even among those analysts who
frame public management in terms of multiple functions, there can be
different ways of slicing such functions aside from the way we have done
here. Mark Moore (1995), for example, carves managerial effort into three
37 Introducing management into the picture
2004a). Although the core concepts and the basic ideas remain the same, the
number of possible relationships and the demands that these place on data
and models increase significantly. This section merely indicates the direction
that such modeling and estimation may need to take; a full elaboration
would take substantial additional space, and the data requirements for
systematic testing of these ideas surpass significantly the kinds of data now
available. For that reason, we restrict this presentation to the outlines of how
such a modeling effort should develop.
We begin this sketch by reintroducing our basic model, but with a sub-
script, h, to indicate that the concepts are measured for a formal hierarchy –
that is, at the organizational level. This modification in symbolization, but not
conceptualization, yields the following:
Oth ¼ b1h ðSh þ M1h ÞOðt1Þh þ b2h ðXth =Seh ÞðM3h =M4h Þ þ eth ð2:15Þ
For the sake of simplicity, one can define the internal (that is, first-term)
nonoutput portion as Y and the external (environmental) term as Z, yielding
the following simple equation for a hierarchy:
Oth ¼ b1h ðYh ÞOðt1Þh þ b2h ðZh Þ þ eth ; ð2:16Þ
The two new symbols require explanation. The “” term is used to indicate
that the internal management terms of the individual organizations compris-
ing a network are aggregated in some manner, as yet undefined; the external
management terms of these units are also aggregated in some manner. The
form of aggregation, we theorize, depends on the type of interdependence
among the units comprising the network. Thompson (1967) has sketched a
simple typology of such patterns for organizations, and his notions can be
applied across units as well (see, for instance, O’Toole and Montjoy 1984).
Whether networks of organizations are pooled, sequential, or reciprocal
carries implications for how one models management.
Pooled environments around a core or focal organization and its man-
agement, whereby multiple external organizational actors contribute to
impacts on the targets of public policy but do not deal directly with each
other during their own efforts, are by definition less interdependent than
other patterns; thus resources (or constraints) from them can likely be
summed. Maintaining a supply of a particularly strategic resource from
one part of a pooled environment does not require managing relations with
the remainder of the organizational actors. Similarly, controlling the impact
of constraints imposed from a particular direction does not necessarily entail
orchestrating coalitions of actors across multiple units.
Sequentially structured environments – arrays in which an output of one unit
serves as an input for the next, and so on – suggest certain other critical
management issues: eliminating any blockages in the flows of production
between units in the environment, and taking advantage of how resources may
be aggregated. Sequential environments, or networks of organizations subject to
sequential interdependence, should be aggregated in a multiplicative manner; a
probability of failure (or success) in one relationship affects the probability of
failure (or success) of all the subsequent units in the sequential chain.
Reciprocal environments, in which the outputs of some units serve as
inputs for others, which in turn provide critical inputs for the first set,
cannot be modeled in such simple ways. These require mathematical tech-
niques that permit both positive and negative feedback in a pattern in which
the resources are not wholly exogenous to the focal organization.
41 Modeling management and performance in networks
of Texas (we say “started” because the process is ongoing). Rather than
beginning from scratch, we have opted to build on an existing data set that
had a wide range of performance indicators for more than 1,000 public
organizations over an established period of time – the Texas school district
data set. To that data set we have added managerial measures with a series of
surveys of top managers undertaken in 2000, 2002, 2005, 2007, and 2009,16
plus an additional survey of top managers concerning how they responded
to the devastating effects of Hurricanes Katrina and Rita, which unexpect-
edly ravaged that region in 2005.
Texas districts tend to be very similar on some structural dimensions but vary
dramatically on others. All districts but one are independent school districts,
which means that they are governed by a locally elected school board that has
the power to levy taxes in support of education. The school boards hire a
professional administrator, the superintendent, to be the chief operating
officer of the schools. The superintendent has a great deal of discretion; he
or she sets the agenda for school board meetings, proposes the district budget,
establishes the schools’ curriculum, and oversees all personnel processes.
The superintendent has the formal authority to hire and fire managers
(principals, assistant superintendents, etc.) and general authority to move
personnel to different locations or positions. Teachers’ unions are relatively
weak in the state; and, even in the large districts, managers have substantial
control over who teaches for them. These formal powers are limited some-
what by a significant teacher shortage in the state as well as informal norms
and traditions.
These structural commonalities contrast dramatically with the vast other
differences – differences that are to be expected in a highly diverse state that
contains 8 percent of all US school districts. The districts range from wealthy
to poor. Even with substantial state aid, per student instructional spending
ranged from a low of $3,069 in 2007 to a high of $21,206. Correspondingly,
the percentage of students who qualify for free or reduced school lunches
(a poverty measure) ranged from 0.0 percent to 99.9 percent. Racially, the
state is highly diverse; the student population is 14 percent African American,
47 percent Latino, 35 percent Anglo, 3.4 percent Asian, and 0.3 percent
Native American. Individual districts vary greatly on these dimensions.
To illustrate, the percentage of black students in a district ranges from
0.0 percent to 86.9 percent while the Latino percentage runs the full range
from zero to 100.
In sum, these units of analysis are all school districts and share some charac-
teristics, but they are exceptionally varied on many other dimensions and thus
constitute a valuable source of information about public management. It is worth
emphasizing that more public employees work in the field of education in the
United States than in any other policy sector, and this Texas sample represents
more than 1 percent of all governments of any type in the country.
We did not seek to become the foremost experts on the management of
Texas school districts and to purposely irritate readers, reviewers, and
45 The structure of Texas districts
editors with a narrowly focused set of studies. As the research has unfolded,
however, each survey, each development of a new measure, has made this
data set more and more valuable and more and more superior to alternative,
available data sets – in five ways. First, the data set contains multiple
measures of management and multiple measures of performance in addition
to a wide variety of control variables. The control variables are chosen to fit
with the rather well-developed production function research literature on
public education. In this book we explain the details of the management
measures and control measures, as well as the different ways of tapping
performance. The multiple measures of performance allow investigation of
the fact that public organizations have multiple goals and may need to
emphasize one goal at the expense of another. The multiple measures of
management and the extensive controls mean that we can rule out alterna-
tive explanations of our findings and thus provide evidence that the results
are not spurious due to underspecification. The multiple measures of man-
agement also reflect the inherent complexity of the process by which public
managers influence performance.
Second, by having data on the same organizations over time, we can
address questions of causality (see O’Toole and Meier 2004b) and can
replicate studies for different time periods to determine if findings remain
valid (O’Toole and Meier 2004a, 2006). Both processes augment the
existing general advantages of a large-N approach. Third, the large size of
the data set – as many as 1,000 cases over a ten-year period – means that
complex relationships that include multiple interactions can be tested
without being limited by collinearity. Too frequently complex theories of
management are based on only a small number of cases (for example, Miles
and Snow 1978). Fourth, school districts have some valuable characteris-
tics. They are the most common public organization in the United States,
and similar organizations exist in virtually all countries. They are highly
professionalized organizations that are generally decentralized and vest
substantial discretion in street-level bureaucrats. To be sure, many public
organizations have different characteristics and thus limit generalizations,
but a large number of public organizations share these characteristics.
Fifth, the data set is accessible; we provide the data to all scholars who
request it, and we have invited other scholars to suggest additional items to
include. These factors have made the returns to investment increasingly
positive.18
We should also note, however, that the evidence-based research agenda
has also used a wide variety of other data bases, including local law
46 A model of public management, and evidence
Measures of performance
Although virtually all programs have multiple goals and are therefore subject
to multiple performance indicators, some objectives are defined by the
political environment as being more important than others (O’Toole and
Meier 2004a). This study incorporates eleven different performance indica-
tors in an effort to determine how public management affects a variety of
organizational outcomes.
Although each performance indicator is salient to some portion of the
educational environment, the most noticeable by far is the overall student
pass rate on the statewide examination; called the Texas Assessment of
Academic Skills (TAAS) until 2002, it was then replaced by the Texas
Assessment of Knowledge and Skills (TAKS). The exams are standardized,
criterion-based tests that all students in various grades have to take. Initially
the exam was given in grades 3, 5, and 7, and as an exit exam. Currently
grades 3 to 8 must take the exam as well as the exit exam, which at different
times has been given in grades 10 or 11. The current system is also develop-
ing a series of end-of-course exams, such as 9th grade algebra, to assess the
learning of specific course material. The exit exam is a high-stakes test, and
students are required to pass it to receive a regular diploma from the state of
Texas. TAAS/TAKS scores are used to rank districts, and the examination
results are without question the most visible indicator of performance used
47 Measures of performance
Any assessment of public program performance must control for both task
difficulty and program resources. For school districts, neither of these types
of elements is under the substantial control of the districts themselves, and
50 A model of public management, and evidence
Conclusions
NOTES
1. Indeed, Max Weber defined bureaucracy in part in terms of stable decisions over
time based upon precedent, thus suggesting reinforcement across certain stabilizing forces.
See Gerth and Mills (1958).
2. Some observers might point to another sort of array: the market. The pure neoclassical
market setting is characterized by an absence of structural stability, however, aside from
some basic rules of the game – such as contract law, barriers to collusion, etc. Markets
in the classic sense, in other words, are defined largely in terms of an absence of
structure among the actors. In practice, of course, markets are often structured to
some extent. How structuring and rules affect markets is an important issue of policy
design, but we do not address it in this volume. Here we are interested in structured
relationships among relevant actors, as these vary between hierarchy and network as
the archetypical forms.
53 Notes
3. Beyond the structural variation between hierarchy and network, we also want to take
note of other stabilizing elements mentioned earlier as we consider the role of public
management. In the initial formulation of our model (O’Toole and Meier 1999), we took
structural variation between stable hierarchies and flexible networks into account; but we
omitted other stabilizing forces. The model was later expanded to include the latter as
well (O’Toole and Meier 2003b), and we work from the broader version of the model
throughout this book.
4. An interesting question in management is the degree to which treating it as a vector sum
provides a misleading picture by ignoring whether or not management is consistent
throughout the organization (Andrews et al. forthcoming (b)). The impact of managerial
consistency on performance in theory would be positive but one can envision an
organization with too much consistency – e.g. groupthink – that would lead to poor
performance. Consistency needs to be explicitly modeled; surveying multiple respond-
ents and then averaging the responses (Enticott, Boyne, and Walker 2009) provides no
more information than a single-manager survey.
5. The outputs of an organization or program are the immediate consequences of policy
and management efforts: bridges built, cases processed, environmental permits issued,
etc. Outcomes relate to the eventual impact of policy actions, along with the results of
other causal variables, on the ultimate issue or concern prompting the initial policy
intervention. An example of an outcome, for which environmental permits would be an
output, is cleaner rivers and streams.
6. All these issues can be handled through appropriate conceptualization and methods.
Indeed, we address them all in the empirical chapters of this book.
7. This interpretation affects how organizations deal with their environments. That is to say,
they can assume some degree of change and build that into the inertial aspects of the
organizations rather than treating any environmental change as something new and different.
8. If b were to exceed one, the system would generate positive feedback and eventually
explode.
9. Empirically, there is little research on what the stability coefficients are for organizations.
A value of 0.99 might well be far more rigid than anything that exists in the real world of
organizations.
10. Shocks themselves can have a variety of functional forms and both short- and long-run
impacts; with adequate data, all these impacts can be estimated.
11. We realize that sometimes internal management is aimed at changing things – for
example, due to slacking, underperformance, etc. Although this recognition suggests
that management sometimes has a destabilizing influence, that influence is only in the
short run. Once such efforts are successful at fixing organizational problems, manage-
ment will need to institutionalize the changes via stabilizing structures. We return to the
point in the concluding chapter.
12. For a somewhat different way of distinguishing and partitioning managerial functions,
see Moore’s treatment of managing upward, downward, and outward (1995).
13. It is possible for management to operate independently of the buffering structures.
Management can act in a boundary-spanning function to reach out to other organiza-
tions or monitor potential changes in the environment. Such functions might even be
institutionalized in strategic planning units or units for organizational intelligence.
54 A model of public management, and evidence
14. In this exposition, we simplify for the moment by assuming that management knows
what it is doing – that is, that management operates with considerable skill or quality, not
simply effort. As will become clear later in this book, we consider each managerial
function to contain both an effort and a quality component. We introduce and validate
a measure of managerial quality in Chapter 4, but the focus here is on effort. An
alternative way of thinking about the model at this point is that it contains an assump-
tion of some deliberativeness or choice on the part of management – as to the allocation
of managerial effort across the functions of management.
15. Networks can differ from each other in many other ways as well: the number of nodes,
the degree of centralization, and numerous other dimensions sketched by those who
employ the tools of social network analysis.
16. The 2009 survey was unique, in that the questionnaire included a variety of questions
submitted by other scholars.
17. Part of the reforms was a provision that students who did not pass their courses were not
allowed to participate in extracurricular activities such as football. The adoption of the
reforms and their extensive nature owe a great deal to the leadership of Governor White
and his designated reform advocate, Ross Perot. Although some people term these
reforms and their impact “the Texas miracle,” in reality this set of changes was a
twenty-plus-year process that involved significant effort on the part of politicians and
school officials. Overall, the state has made substantial progress in educational attain-
ment, but it still has a fair way to go.
18. It is also fair to point out that the Texas school district data set has contributed to several
literatures other than the public management research field. These include the study of
representative bureaucracy (Keiser et al. 2002), the impact of charter schools on public
school competition (Wrinkle, Stewart, and Polinard 1999; Bohte 2004), the patterns of
organizational cheating (Bohte and Meier 2000), punctuated equilibria in policy settings
(Robinson et al. 2007), and the investigation of statistical techniques (Bretschneider,
Marc-Aurele, and Wu 2005; Wagner and Gill 2005), among others.
19. The various pass rates do not correlate as highly as one might imagine. The intercorrel-
ations between the Anglo, black and Latino pass rates are all in the neighborhood of 0.67,
thus suggesting that the overlap is only about 45 percent. The individual scores
for race and class correlate more highly with the overall score, because they are sub-
components of it.
3 Public management in interdependent
settings: networks, managerial
networking, and performance
When people think of what public managers do, often the tasks and
responsibilities that come most readily to mind are those tied to the
internal functioning of a public organization: motivating staff, organizing
tasks, structuring work relationships, handling the budget and other
resources such as information technology, appraising individuals’ perform-
ance, and the like. We begin our empirical examination of public manage-
ment from another angle: the externally oriented actions of managers as
they seek to do their jobs and advance their organization’s causes. We do so
for two reasons. First, this aspect of public management is often given
short shrift in standard accounts, and yet – as explained earlier in this
volume – contemporary governance arrangements typically enmesh the
actions and objectives of specific public organizations in a web of relations
with other actors. Second, in the development of our own research pro-
gram, we began by studying the external efforts of managers and sought to
explore their performance-related implications.1 Accordingly, in this book
we proceed in like manner.
As noted earlier, public programs and public organizations are often situated
in networks – arrays through which many aspects of contemporary govern-
ance are handled. Networks are structures of interdependence involving
multiple organizations or parts thereof, in which one unit is not merely
the formal subordinate of the others in some larger hierarchical arrange-
ment. Networks exhibit some structural stability but extend beyond formally
established linkages and policy-legitimated ties. The institutional glue con-
gealing networked ties may include authority bonds, exchange relations, and
coalitions based on common interest, all within a multi-unit structure
(O’Toole 1997: 45).
55
56 Public management in interdependent settings
Table 3.1 Factor loadings for nodes involved in managerial networking, 2007
departments, and parent groups. As Table 3.2 shows, however, the relative
level of interaction changes little over time. Furthermore, past the first four
or five external nodes, the factor scores are relatively insensitive to the
number of nodes that are inquired about (see the discussion below). This
point is important, since some might argue that one needs to know the
full set of interactions before it is possible to understand how managers
operate in their networked environment – a hurdle that would make it
exceedingly difficult to explore such patterns in hundreds of organizations
and with hundreds of managers. The evidence shows, rather, that most of
what one needs to know about the general networking pattern exhibited by
61 Do public managers network with external parties?
Dependent variables
positively associated with support from the school board, support in the
general community, and the level of parental involvement. Each relationship
contributes additional evidence that we have created a reliable and valid
measure of managerial networking.
Fourth, by comparing survey results between two time points – for
instance, between 2000 and 2002 – we provide a systematic evaluation
of the concept’s reliability and validity (Meier and O’Toole 2005). The
2000/2002 assessment reveals that the exact number of nodes included in
the measure was not especially crucial; the five-node measure correlated
strongly with the eight-node measure (as did the four- and seven-node
measures). Similar patterns are found in comparing managers’ responses
between the more recent surveys. This finding does not mean that scholars
can select any set of nodes to create this measure but, rather, that they need
to select the most common nodes that occupy a manager’s time. Given
careful selection, the total number of nodes becomes less relevant; research-
ers should stress getting information on the most common nodes rather
than worrying about information on all nodes.
The 2000/2002 comparisons, along with comparisons between more
recent time periods, also reveals that M2 is very much a managerial choice.
At least in principle, measuring interactions does not reveal whether it is the
manager seeking to network with actors in the external environment, or
whether it is the other actors and/or pressure from external forces that
stimulates the networking behavior. Analysis of our data reveals that it is
63 Do public managers network with external parties?
clearly the former. Networking measures for a given organization at the two
time points were essentially uncorrelated if the organization had changed
top managers. When the same manager was in place in both years, there was
a strong positive correlation between the two measures of M2 (above 0.5 – a
notable correlation for a behavioral measure such as this one). It is clear,
therefore, that networking itself is driven largely by managers’ decisions. It is
not an epiphenomenon forced on managers by the external actors (Meier
and O’Toole 2005).
There is also evidence that managers’ networking style can help to
explain the emergence of interorganizational collaborative links, at least
during crisis periods. This evidence is also drawn from Texas school
districts and their top managers. In a natural-experiment design in the
context of Hurricanes Katrina and Rita, we sought to learn if pre-disaster
levels of managerial networking were related to the post-hurricane emer-
gence of interorganizational collaboration with particular institutions in
the settings of Texas school districts. With appropriate controls, we deter-
mined that generalized networking behavior prior to the crisis helps to
explain the development of collaborative relationships in response to the
disaster, and not simply or primarily contacts with the pre-crisis network-
ing partners (Hicklin et al. 2009).
Finally, it is noteworthy that the factor loadings in Table 3.1 and the
discussion of nodes in the current chapter include the school board as an
“external” node. One might argue that the school board is the primary
political principal of the school district and should not be treated as a
networked, or networking, partner of the top manager. (Networks, as defined
at the outset of the chapter, reference non-hierarchical linkages.) It turns
out that the factor scores themselves do not change much, whether or not
school board interactions are included in the factor analysis. Nonetheless,
our two-year comparison and subsequent work (see O’Toole, Meier and
Nicholson-Crotty 2005: 57–8) have found that direct hierarchical linkages
might be best treated as separate interactions. While interactions with the
school board do correlate with interactions with other nodes, the portion of
the school board variance that is uncorrelated with M2 shows a much different
relationship. Unlike top managerial networking with other external actors
(see below), superintendent–school board interactions generally demonstrate
a negative impact on performance, when one controls for M2 using inter-
actions with the other nodes. Whether this negative relationship is the result
of political meddling in the administrative process or merely reflects an
endogenous fire alarm about performance cannot be determined from the
64 Public management in interdependent settings
Table 3.4 Mean scores for interactions between different groups of officers in English local
authorities
broad policy for the district), the relevant state-level educational department
(a source of primarily formula-based funding that varies in importance from
state to state, as well as a unit that issues some regulations that apply to the
local districts), state-level legislators (who frame general educational policy),
local business leaders (who can play crucial roles in supporting the locally
enacted taxing decisions that drive much of school district revenue), and
other superintendents (professional colleagues and sources of experience
and innovation in the turbulent world of public education). Other parties
may also be tied to the operations of school districts, and, as explained
earlier, we have surveyed top managers about broader patterns of potential
interaction; but the interaction partners just mentioned can be expected to
be the most important, and most regularly contacted, in the typical case.
In contemporary American public education, in which funding issues are
critical and many ostensibly separate policy problems – e.g. drug abuse,
broken families – intrude in highly visible ways in the educational process,
schools have become battlegrounds for a range of policy disputes (Chubb
and Moe 1990; Meier and Stewart 1991). Efforts to reform schools and
influence educational policy are frequently debated and adopted in realms
where the school district is only one voice among many. Accordingly,
superintendents may have reason to devote managerial energy and effort
to understanding and leveraging their networked environment. This net-
work orientation is more extensive in the US context than in most other
countries. An Organisation for Economic Co-operation and Development
(OECD) (1995: 52) study of fourteen national education systems found
that more education decisions had to be made in consultation with others
(44 percent) in the United States than in any other Western democracy. US
systems were also rated the lowest in terms of local – that is, school district –
autonomy.
Superintendents manage their districts – a headquarters office along with
sets of schools, which in turn are managed by school “principals” – within
this broader constellation of other actors, who may be potentially important
as sources of funds, staff, ideas, guidance, other resources, and turbulence.
The extent and kind of network to build, maintain, and use is a matter
largely under the control of the superintendent.10
Managing in the network, then, is an opportunity available to those
superintendents who recognize their interdependence and opt to try to
manage it actively. To network, in this context, is therefore a key strategic
option. Our model suggests that such managerial networking can contribute
to performance. What does the evidence show? To answer this key question,
68 Public management in interdependent settings
Each, in other words, represents a more complex model than the linear,
additive versions more typical in multivariate analysis. A linear version of
the simplified model depicted in the last equation is
Ot ¼ b2 Xt þ b3 M2 þ et
Here managerial networking would make a difference, but not by interacting
with the set of environmental forces. Similarly, a linear version of the auto-
regressive simplification introduced above can be depicted in like fashion:
Ot ¼ b1 Ot1 þ b2 Xt þ b3 M2 þ et
Estimating these last two equations empirically would constitute a test,
generally speaking, of whether managerial networking matters; but the
simplified forms of our model – the two equations preceding these two –
must also be explored to check for the nonlinear relationships that, we have
argued, seem to be called for by the extant case study depictions.
The following hypotheses are the focus of the current investigation.
H1: managerial networking matters – in a positive direction – for program
performance. School system output/outcome is higher if superintendents
exert management effort in the networked environment surrounding them.
H2: managerial networking matters for how management relates to both
educational system inputs and environmental perturbations. In practical
terms, managers in networked settings deal with environmental shocks in
different ways from public managers who do not manage in networks. We
expect managerial networking to interact in a nonlinear fashion with the
vector of environmental forces to which school districts are exposed.
H3: the way that networking managers tap their surroundings is to exploit
opportunities and buffer impediments to program performance. That is, the
form of the nonlinear function can be expected to show managers
tapping resources in their networked environments to enhance program
performance. To the extent that environmental shocks challenge or
threaten program performance, managerial networking – by competent
managers – can be expected to protect the core performance bureaucracy
from these forces.
We conducted this empirical test of managerial networking and perform-
ance on a subset of Texas school districts. The 2000 superintendents man-
agement survey provided information about management styles, goals, and
time allocations (return rate of 55 percent). Of these, 507 responses were
usable in our analysis.13 We pooled five years of data (1995 to 1999) on
performance and control variables to produce a total of 2,535 cases for
71 Managerial networking and performance
Table 3.5 Factor loadings for managerial networking, 2000 survey data
Indicator Loading
analysis. All data other than the survey were taken from the data sets of the
Texas Education Agency.
Along with the set of production function controls that were outlined in
Chapter 2, we must also include a measure of managerial networking in the
empirical analyses. In this case, our measure of managerial networking is
developed as described above – and with the original five nodes included in
the interaction pattern. We asked each superintendent to note how often
they were in contact with each of these others, on a six-point scale ranging
from daily to never. Superintendents inclined toward networking with the
key actors in the district’s environment should interact more frequently with
all five other sets of actors than should superintendents with a traditional
hierarchical (internally focused) management style. A composite networking
scale was created via factor analysis (see Table 3.5). All five items positively
loaded on the first factor and produced an eigenvalue of 2.07; no other
factors were significant.14 Factor scores from this analysis were then used as
a measure of managerial networking or M2, with higher scores indicating a
greater networking orientation.
Clearly, this measure is simplified. It ignores all aspects of networking
aside from frequency and direction – for instance, skill, reputation, and a
number of strategic considerations.15 Further, it taps a particular kind
of networking activity: interactions of managers in clusters of dyadic inter-
actions. Networks can range considerably in the extent to which they are
integrated and the degree to which all actors are directly linked to the full
range of others. Even so, the measure taps the effort managers choose to put
into managing externally, in the networked environment.16 Furthermore,
the factor-analytic results suggest that the notion of managerial networking
as a strategic choice is a coherent concept that makes empirical sense.17
Our measure of program output18 or performance (O) in the present
analysis is the percentage of students in each school district who pass
72 Public management in interdependent settings
R2 0.58 0.59
Standard error 7.65 7.62
F 294.96 276.07
N 2,534 2,534
Notes: T-scores in parentheses. Dummy variables for individual years not reported.
ns ¼ not significant.
Ot ¼ b2 ðXt M2 Þ þ et
The classic way to test this relationship is to compare the interactive form to
the linear form in the following equation:
Ot ¼ b2 ðXt M2 Þ þ b3 ðXt Þ þ b4 M2 þ et
The key test is whether the vector of coefficients b2 is statistically significant –
that is, whether it adds additional explanatory power to a linear model.
The problem with this model is that the interaction terms frequently
generate so much collinearity20 that individual coefficients cannot be
precisely estimated. The actual coefficients are important, because we have
specific hypotheses about how managerial action affects the environmental
variables – that is, it should increase the impact of resources and reduce
the impact of constraints.
To test these specific estimates, an alternative approach is necessary. We
divide the sample into two parts: districts with high reported networking by
top managers (those with scores above 0) and districts with low managerial
networking (scores below 0):
74 Public management in interdependent settings
Resources
Teacher salaries (000s) 0.7727 (4.55) 0.2835 (1.98)
Class size 0.6620 (5.90) 0.1211ns (1.47)
Teacher experience 0.1256ns (0.85) 0.4556 (3.51)
Noncertified teachers 0.1100 (2.20) 0.2638 (5.30)
Percentage state aid 0.0189ns (1.39) 0.0073ns (0.69)
Constraints
Percentage of black students 0.1846 (7.20) 0.2291 (13.49)
Percentage of Latino students 0.1003 (6.18) 0.1147 (10.39)
Percentage of low-income students 0.1966 (8.53) 0.1537 (11.16)
R2 0.57 0.61
Standard error 7.60 7.61
F 124.23 176.83
N 1,154 1,380
Notes: T-scores in parentheses. Dummy variables for individual years not reported.
ns ¼ not significant.
Ot ¼ b2 ðXt Þ þ et M2 > 0
Ot ¼ b2 ðXt Þ þ et M2 < 0
The results of these models produced by splitting the sample are shown in
Table 3.7. The constraints can be examined first. Our theory suggests that, for
high levels of managerial networking, the size, or impact, of each of these
should drop in absolute value. Although the coefficients do not change
dramatically, in two cases (blacks and Latinos) the hypothesis is confirmed.
In one case (low income) it is not. In terms of the four cases of resources (state
aid is not significant and can be ignored), three are as predicted. Districts with
more networking on the part of superintendents get more out of teacher
salaries and reductions in class size and are less affected by noncertified
teachers. Teacher experience shows an interesting pattern of significance for
the low-networking districts and insignificance for the high-networking
districts. While this result ostensibly contradicts our hypothesis, it means that
high-networking districts are not affected by having less experienced teachers.
Five of the seven relationships found in Table 3.7 are consistent with our
nonlinear, interactive theory of management. Although this pattern might
75 Autoregressive models
not seem like strong support for the theory, examining the individual
coefficients provides additional corroboration. Most of the relationships
differ from each other in only marginal ways. The differences between four
sets of the relationships are substantial, however. Districts characterized by a
high managerial networking style get 2.7 times the impact from higher
teacher salaries, receive 5.5 times the impact from smaller classes, get only
42 percent of the negative impact of noncertified teachers, and are
not affected at all by inexperienced teachers.21 Even with the relatively
crude test presented here (a simple measure of managing in the networked
environment – a deliberately underspecified model), therefore, management
does matter; and it matters by interacting with program resources and
constraints in predicted directions. H2 (nonlinearity) and H3 (direction of
relationships) are supported by these tests.
The pattern of relationships merits some additional comment. Manage-
ment is about choice and decision making. Quite clearly, managers allocate
more time and effort to some constraints and resources than to others. As a
result, expecting all resources to become more valuable and all constraints to
become less negative may not only be expecting too much, it might also
conflict with what the manager is trying to do. In other words, the results
may be evidence that managers make strategic networking choices beyond
the fundamental ones of “How often?” and “With whom?” An effective
manager might well focus on a small number of strategic factors that can
be manipulated to get better results, while at the same time accepting some
modest negative tradeoffs on less important variables. The relationships in
Table 3.7 are consistent with such an interpretation. The negative findings
are relatively small, as are a few of the positive findings. Three of the impacts
are substantial – those regarding teacher salaries, class size, and noncertified
teachers. Getting large positive results on these three variables more than
compensates for the modest negative changes on other factors.
Autoregressive models
Table 3.8 Management and organizational performance: autoregressive and nonlinear models
Notes: T-scores in parentheses. ns ¼ not significant. Classical statistical significance does not apply to
SWAT models.
compared to weights of 1.0 for those above this threshold. This process
artificially creates a sample that has only one-tenth as many districts in the
low category and ten times as many (relatively) in the high managerial
networking category. The results of this weighted regression are shown in
column 3 of Table 3.8.
The coefficients in column 3 are not parameter estimates (since they deal
with a hypothetical universe), but they are informative when contrasted with
the ordinary least squares (OLS) regression coefficients because they show
how a set of units with a higher degree of networking by managers might use
resources differently. The previous results in Table 3.7 suggest that teacher
salaries, noncertified teachers, and class size are likely to be the key variables.
Most of the SWAT/OLS differences are relatively small, but in two cases –
teacher salaries and class size – the differences in coefficients are substantial.
In both cases the implication is that programs with more managerial
networking get more out of their resources. The SWAT equation stressing
high levels of management has a teacher salary coefficient approximately
24 percent larger, and the class size coefficient is 254 percent larger than that
for the same variable in the base OLS regression.
The consistency of these two relationships with the same relationships in
the nonautoregressive model in Table 3.7 is reasonable evidence that one
aspect of management is likely to interact with program inputs from the
environment to produce outputs above what would be expected in a strictly
linear relationship. Again, H2 and H3 are supported even in the estimations
of an autoregressive model.
Finally, for even more evidence on this question, we undertake another
analysis by splitting the sample in a couple of fashions. Table 3.9 divides the
school districts into five quintiles by level of performance on the TAAS. The
top quintile, for example, has a mean student pass rate of 79.2 compared to
73.9 for all districts and 64.8 in the lowest quintile. Care must be exercised in
partitioning a sample, particularly when partitioning on the dependent
variable, because each subset is designed to be unrepresentative of the entire
sample. The prediction levels in Table 3.9 increase dramatically compared to
the simple linear, autoregressive estimation in Table 3.8; in the middle three
quintiles less than 1 percent of the variance is left unexplained.23
Quite clearly, we might have some intuition as to why networking by
managers might matter more or less as organizations perform better. The
regressions in Table 3.9 show that networking’s impact on performance is
relatively stable in the middle three quintiles; these estimates are also statis-
tically more reliable than those in Table 3.8. For both the highest- and
79 Autoregressive models
Independent variable 5 4 3 2 1
Past performance 0.6645 (50.70) 0.7189 (187.09) 0.7150 (201.04) 0.7201 (174.85) 0.7330 (42.78)
Managerial networking 0.2792 (2.05) 0.1579 (4.70) 0.1626 (5.99) 0.1766 (5.26) 0.3727 (2.18)
Notes: T-scores in parentheses. All equations control for the eight control variables used in Table 3.7.
Independent
variable All 1.0 1.25 1.5 1.75 2.0
Notes: T-scores in parentheses. All equations control for the eight control variables used in Table 3.7.
(column 1). The first subset (column 2 in the table) includes only superin-
tendents with networking scores above 1 (or one standard deviation above
average) – about 18 percent of all managers. Subsequent regressions, listed in
successive columns of the table, raise this standard by 0.25 standard devi-
ations in a series of steps until only the top 4 percent remain (those scoring
above 2.0). This incremental process of examination illustrates how the
relationships evolve at different levels of networking activity. Because we
are selecting progressively less representative organizations, our interpret-
ation should be cautious and avoid assessing patterns where the relation-
ships are not strong. These findings contain all the previous controls, but we
show only the relevant coefficients.
As networking by top managers increases, the autoregressive term
declines slowly, until the management variable is 1.5 standard deviations
above the mean, and then precipitously. This pattern suggests that net-
working performs its desired function; rather than being trapped by past
routines and behaviors, well-networked managers generate more flexibil-
ity for their organizations to change. This link should be viewed as the
first step in a two-step process of managing the organization overall: first,
exploiting the environment to create change in the unit; and, second,
then structuring the changes to produce higher performance.26 Changing
the size of the autoregressive component in the model dramatically
changes the long-run impact of other variables, because the current
values of the independent variables will continue to affect performance
in the future by feeding back through the autoregressive term. The
finding suggests, therefore, that the influence of managerial networking
ramifies forward into the future and can enhance performance substan-
tially in the longer term.
Thus far this analysis has shown that managerial networking is related to
performance, but we have not fully demonstrated the process by which
managing in the networked environment generates better results. We have
several hypotheses. First, management’s greater attention to the environment
might create buffers from external shocks and thus permit lower-level per-
sonnel (teachers, principals) to be more effective. Second, a networking style
might encourage a more decentralized internal management approach – an
approach advocated by much current education reform literature. Third, the
82 Public management in interdependent settings
Distributional consequences
aside from the obvious point that the performance of networks might itself
be of interest to a broader public.
The inadvertently depoliticized analysis of networks in recent research has
neglected issues that should be part of the research agenda, however. In this
section we outline ways that networks and network management point
toward significant political issues.28 We then focus on one political dimen-
sion of networks and their performance: the likelihood that, rather than
being neutral producers of collective goods while enmeshed in a broader
environment, networking managers respond to the stronger and more
politically powerful elements of their surroundings, thus magnifying the
tendency toward inequality already present in the social setting. This
dynamic – what we call the “dark side” of managing networks – has been
largely unexplored by network researchers. Such patterns should not be
unexpected, however. The reasons are explicit in longstanding streams of
research that have been ignored in the work done thus far on networks. We
report some empirical results that give considerable credence to the dark
side hypothesis. In so doing, we argue that there is a need for systematic
study of the political aspects of networks and their management.
moreover, networks are leaner and weaker in the face of larger institutions
and significant individual actors in a policy system.
One way of explicating the point has to do with networks, network nodes,
and the pattern of exchanges that can be so important in facilitating network
action. Virtually all assessments of public management patterns recognize
that networks are built around exchanges between the nodes in the network,
often with managers framing and brokering the exchanges. An exchange
implies that node A provides something to node B, and vice versa, in such a
way that the overall aggregation is better off. This positive-sum view of
networks and networking overlooks the fact that each node enters the
network with a distinct set of goals. Only a portion of these goal sets overlap.
Despite the extensive literature on cooptation, the ability of network nodes
to shape the direction of public programs has not been carefully investi-
gated. For public organizations that seek multiple goals – that is, all public
organizations – the risk is that network interactions will emphasize some
goals to the detriment of others. The literatures on interest groups and on
citizen participation indicate that network nodes seek greater benefits for
goals that are favored by more entrenched interests and downplay efforts
that favor disadvantaged clientele.
An empirical test
total possible number of cases for this analysis is 2,535. To perform the
analyses, we used a simplified version of our model, which asserts a positive
relationship between managerial networking and performance, controlling
for a set of resources and constraints operating on the organizations. We
already knew that managerial networking improves performance; but we
also wanted to explore how such positive impacts vary across performance
measures that refer to, or are salient for, different school system constituencies
that provide part of the networked environment for the core educational
organizations. To investigate these questions, then, we used our measure of
managerial networking (we used the original five-node factor score for this
purpose), as well as the sets of suitable performance measures and appropriate
control variables introduced earlier.
The basic hypothesis is that networking contact will contain biases that
have distributional consequences for the performance of public organiza-
tions. In this case, because we know that participation and interest group
action is positively correlated with socioeconomic status, superintendents
who network are more likely to be exposed to portions of their networked
setting that will seek benefits for the better off or higher-status students
rather than for disadvantaged students. We would expect the networking
measure, therefore, to be positively correlated with test scores for Anglo
students, with ACT test scores, SAT test scores, and the percentage of
students who exceed the college criterion on these tests (1,110 on the SAT
or its ACT equivalent). We would not expect significant positive relation-
ships for those indicators that reference the performance of disadvantaged
students: TAAS pass rates for black, Latino, and low-income students,
attendance rates, and dropout rates. These hypotheses are supported by
the interest group/participation literature (Zeigler and Peak 1972; Verba
and Nie 1972; Salisbury 1984; Scholzman 1984), the urban services literature
(Lineberry 1977; Mladenka 1980; Jones 1985), and a substantial literature in
education policy (see Tyack 1974, Bowles and Gintis 1976, Kozol 1991, and
Meier and Stewart 1991).
Regression estimations were developed for each of the ten performance
indicators outlined above. The specification includes all control variables
plus the measure of managerial networking. Dummy variables for each year
were also included. These were usually jointly significant, reflecting an
upward trend in the performance data during this period.29
The last column of Table 3.6 displays the results for the overall TAAS pass
rate performance. As explained earlier, the adjusted R-squared is approxi-
mately 0.59, indicating a reasonable amount of explained variance.
88 Public management in interdependent settings
Notes: All equations control for teacher salaries, percentage of state aid, class size, teacher
experience, percentage of teachers not certified, percentage of black, Latino, and low-income
students, and yearly dummy variables. * ¼ significant at p < 0.05, two-tailed test.
Notes: All equations control for teacher salaries, percentage of state aid, class size, teacher
experience, percentage of teachers not certified, percentage of black, Latino, and low-income
students, and yearly dummy variables. * ¼ significant at p < 0.05, two-tailed test.
the results for managerial networking but omit the portions of the estima-
tions pertaining to the controls.
Table 3.11 summarizes five direct tests of the hypothesis by showing
managerial networking’s impact on five performance indicia that matter
most to minority constituents, the poor, and/or low performers. The pattern
is striking. For each of Latino students, black students, and low-income
students,30 managerial networking does not add to performance with any
statistically significant impacts. The same can be said for attendance. All
these performance measures are of more interest to marginalized constitu-
encies of the school system network. Only for dropout rates does managerial
networking seem to matter. This anomaly may result from the poor quality
of the dropout data, however. Data on dropout performance are the least
reliable of those analyzed in this study.
Table 3.12 shows the contribution of managerial networking to perform-
ance for four indicators relevant to advantaged (that is, top-end and/or
Anglo) students. For all, the impact of managerial networking is clearly
positive and significant. This is what one would expect if managers engaged
in the network are influenced by and attentive to what those with power
would prefer. For the Anglo pass rate, average SAT, average ACT, and
percentage of SAT above 1,110 (or its ACT equivalent), managerial network-
ing adds to performance. These are all indicators that are of considerable
interest to relatively influential or privileged constituencies.
The results overall are clear: the estimations retrieve Selznick’s insight
with detailed findings. Those parts of a networked constituency that are
influential and care about the performance results have managerial network-
ing assisting what they do; those parts dealing with more marginal or less
salient issues are less – or not – influenced by managerial networking.
Selznick’s argument is strongly supported by the findings. It is worth noting
that here, as well as for the results to be discussed next, the findings represent
distinct impacts from networking, not simply distributional inequities gen-
erated in school districts. In other words, the results indicate a set of
systematic relationships between networking and distributional impacts.
Networking actions generate greater inequalities than the school system
would have without network activity.
Further insight as to what is likely occurring in these settings can be gained
by taking a more thorough glimpse inside the managerial networking activity
reported by the district superintendents. To do so, we replace the overall
networking factor scores with the reported degree of networking, respectively,
with each node. We enter each node or networking partner into separate
90 Public management in interdependent settings
School board members 0.589 (3.39)* 0.572 (3.33)* 0.011 (0.37) 0.87 (0.52) 0.200 (0.89)
Local business leaders 0.268 (1.72)# 0.450 (2.92)* 0.104 (3.71)* 8.18 (5.48)* 1.093 (5.49)*
Other superintendents 1.011 (5.77)* 0.974 (5.62)* 0.013 (0.42) 1.20 (0.71) 0.037 (0.16)
State legislators 1.504 (4.21)* 1.170 (4.73)* 0.056 (1.29) 6.33 (2.70)* 0.398 (1.24)
Texas Education Agency 0.631 (3.15)* 0.569 (2.88)* 0.061 (1.72)# 1.97 (1.05) 0.256 (0.98)
Notes: T-scores in parentheses. All equations control for teacher salaries, percentage of state aid, class size,
teacher experience, percentage of teachers not certified, percentage of black, Latino, and low-income
students, and yearly dummy variables. * ¼ significant at p < 0.05. # ¼ significant at p < 0.10. N ¼ 1,110.
Table 3.14 The impact of individual network nodes on disadvantaged student indicators
Performance measure
School board members 0.184 (0.44) 0.059 (0.20) 0.746 (3.43)* 0.117 (6.97)* 0.049 (2.15)*
Local business leaders 0.768 (1.95)# 0.500 (1.91)# 0.535 (2.75)* 0.025 (1.66)# 0.016 (0.80)
Other superintendents 1.180 (2.82)* 0.850 (2.91)* 0.837 (3.80)* 0.078 (4.51)* 0.057 (2.49)*
State legislators 0.975 (1.59) 0.419 (1.01) 0.307 (0.98) 0.009 (0.38) 0.060 (1.81)#
Texas Education 0.556 (1.14) 1.040 (3.11)* 0.733 (2.94)* 0.038 (1.93)# 0.027 (1.03)
Agency
Notes: T-scores in parentheses. All equations control for teacher salaries, percentage of state aid, class size,
teacher experience, percentage of teachers not certified, percentage of black, Latino, and low-income
students, and yearly dummy variables. * ¼ significant at p < 0.05, two-tailed test. # ¼ significant at
p < 0.10, two-tailed test.
to push for improvements at the elite end of the educational spectrum since
their own children are likely to be relatively advantaged in the education
system. The Texas Education Agency is most associated with its exam, the
TAAS, and it sets standards for students by race and ethnicity. Other
superintendents are likely to reflect professional interests, and professional
educators in the United States are likely to push education benefits or have
ideas for new programs that affect both haves and have-nots. The exact
preferences of the political actors – that is, school boards and state legislators –
will depend on the composition of their constituencies, and systematic data
on the “electoral” constituencies – that is, who voted for the office holder – are
not available.
The analyses provide some hints as to what may be going on as top
managers of the school districts interact with their environment. While
not definitive, the results suggest possible causal links and, thereby, plausible
production processes. For business leaders the pattern is especially clear:
such contacts help on every measure of advantaged student performance
tested and hurt on four out of five measures of disadvantaged student
performance.31 In this case, cooptation is a likely explanation. More contact
with business leaders probably exposes top school-district managers to the
complaints, concerns, and preoccupations of the local business elite, from
whom some support (for instance, for the district’s revenue-raising agenda)
may be crucial. To the extent that superintendents use their discretion to
direct or redirect attention to these matters, some sacrifice to the more
marginalized clientele may follow.
Superintendents’ interactions with their counterparts in other districts
contribute to performance on seven of the ten measures, including on all five
measures tapping disadvantaged students’ results. What is likely happening
here is information sharing and professional assistance to colleagues, thus
suggesting that collegial professional interaction can be a route for diffusion
of innovations and relatively equitable performance boosts across organiza-
tions and governments. Interaction with the Texas Education Agency is also
helpful to several measures of performance: three each for the advantaged
and disadvantaged groups. Most of these have to do with performance on
the TAAS, a subject of obvious concern at the state level. This pattern is
consistent with what one might expect from interaction with a regulatory
agency – which is, in effect, how the TEA operates.
The more intriguing results are those for the other two external links for
the superintendents. Contacts with school board members do not help
performance, and for half the measures more networking with school board
members impedes performance. The negative impacts are spread across both
92 Public management in interdependent settings
Implications
chapter, this study also finds a single, general factor that could be termed
managerial networking. Andrews et al. find a different and differential
impact of networking on overall local government performance (the
outcome measure is established by the national government to explicitly
assess the performance of local governments across a variety of policy
areas), however. They find that poor performance brings contacts from
elected officials, and that such contacts serve as wakeup calls to adminis-
trators in regard to their level of performance. Local administrators then
increase their networking with user groups – an activity that, in turn, has
a positive impact on future performance. This cycle of poor performance,
wakeup calls from elected officials, networking with user groups and
subsequent increases in performance is very similar to that found by
Hawes (2006) with Texas education data.
Cohen, Vaughn, and Villalobos (2010) provide additional support for the
generality of the networking to performance relationship in their study of
the management of the US Office of the President. Explicitly using the
management theory in Chapter 2, they analyze more than 300 surveys from
individuals who interacted with the president’s chief of staff. The dependent
variable is the respondents’ rating of the effectiveness of the chief of staff.
They have an excellent measure of buffering (M4), with the chief of staff
taking the role of guardian of the president’s time; they have a separate
measure of being accessible that can be an M2 measure. Both external
management variables had a positive impact on how effective the chiefs of
staff were rated.
Conclusions
NOTES
1. The field of public management initially attempted to distinguish itself from the field of
public administration by arguing that it focused on actions at the very top of the
organization and, by definition, paid greater attention to the organization’s environment.
Although we do not see these two fields as separate, this study is central to the concerns
of scholars who identify with either of the fields.
2. Needless to say, in reality school districts are anything but insulated from politics.
3. This measure taps managers’ efforts to interact with their interdependent environment. It
does not reach to, or at least distinguish, efforts to manage at the network level – that is,
to manage or orchestrate the full set of interdependent actors en masse. Estimating this
aspect of public management is complicated (O’Toole 2000b). As indicated earlier in
this volume, we have made efforts to model management at the network level as a part of
this research program but do not delve deeply into this set of issues in the current book.
4. Findings in a study of English local government managers, designed around a similarly
constructed measure, mirror those obtained from the Texas data set; see Walker, O’Toole,
and Meier (2007).
5. The findings presented on this point rely on data from the 2000 survey responses. A more
complete exposition is presented by Meier and O’Toole (2003).
6. Work by Hawes (2006) indicates that the fire alarm pattern holds. Low performance at
time 1 is associated with greater school board contact at time 2, which is in turn associated
with higher performance at time 3. Hawes describes a cycle of political intervention
designed to improve performance. We have analyzed a somewhat similar pattern in data
on the performance of English local authorities (see Andrews et al. 2010c).
7. A similar survey was conducted several years later, in 2008, and the results were generally
quite similar.
8. The findings and discussion in this part of the chapter rely on Meier and O’Toole (2001).
9. For reasons explained earlier, for certain purposes the school board can be considered a
political principal rather than an external node.
10. Some of the networked relationships are mandatory and imposed from the environment.
An instance is the authority given to state auditors to check on fiscal matters. In most
cases, however, the superintendent can develop new relationships or seek to alter
mandated relationships in such a way as to benefit the district.
11. The actual correlation between managerial networking and interaction with one’s
school principals (a hierarchical form of management, thus part of M1), in the data
analyzed below, is 0.18, suggesting that, while the two are distinct, they are not
contradictory.
12. Underspecification is clearly less of a problem in the autoregressive form of the model,
since any omitted variables are likely to affect current outputs via past outputs. Only
those variables that affect current outputs but not last year’s outputs, therefore, are likely
to be a problem. The greatest concern should be whether there are omitted factors that
covary with elements included in the model.
13. Districts that responded to the survey were no different from nonrespondents in terms of
enrollment, enrollment growth, students’ race, ethnicity and poverty, or test scores. There
98 Public management in interdependent settings
were slight differences in a few other factors. Respondents had 0.48 more students per
class, paid their teachers $200 more per year, but had annual operating budgets of about
$100 per student less.
14. In this measure of M2, we include school boards as an element of the networked
environment of the superintendent. We treat school boards as part of the environ-
ment in this part of the analysis, since we think that on balance this notion is more
appropriate, but we have also performed the entire set of analyses again with M2
measured only on the other four types of interactions. The results are very similar to
those reported here. Omitting boards from the study strengthens the impact of M2 on
performance modestly in the linear versions of the simplified model and weakens
slightly the evidence on nonlinearity. The correlation between the two measures of
managerial networking is 0.96. The networking factor correlates at –0.27 with time
spent managing the district (in contrast to time spent in contacts outside the
organization).
15. Later in this book we introduce other measures of management, including managerial
quality.
16. Clearly, both “sides” can initiate interactions. Anecdotal evidence suggests that skillful
superintendents generally do not wait passively to be contacted, and our later surveys
have been designed to distinguish how much of the networking behavior reported by
managers was initiated by them. We do so by asking who initiated the last interaction
with each of the several nodes. Two findings of note can be summarized here. First,
managers do indeed report that they usually initiated the last interactions. Second, as
Goerdel (2006) has shown, a measure of managerial networking focused on the man-
agerially initiated interactions shows an even stronger relationship with performance
than does the measure used here. We treat this point later.
17. Of course, networking can occur at other levels of the organization, and this
measure will underestimate total networking by the organization. Some of the net-
work links are also clearly more important than others, and equal weighting might
obscure this. These and other measurement problems are likely to attenuate any
relationships found.
18. In policy analysis terms, test scores are an outcome rather than an output.
19. Exactly how managerial networking can influence performance is discussed below.
20. Collinearity refers to a situation in which two or more predictor variables in a multiple
regression analysis are highly correlated with each other. In such a situation, the coeffi-
cients generated for those variables are typically unstable. When collinearity is high,
standard errors are inflated but the estimation is unbiased. Collinearity impedes our
ability to develop precise estimates of the coefficients involved.
21. The resource measures should be thought of as general measures of resources from the
environment rather than specifically teacher salaries and class size. Access to resources
correlates with both teacher salaries and class size, as well as a variety of other factors.
22. The long-run performance of the management variable has a value of approximately 0.6,
which means the maximum total impact is approximately 3.6 percentage points – an
estimate very similar to the estimate for nonautoregressive models.
23. Only the within-quintile variance is being explained in these analyses. The middle
quintiles eliminate a great deal of the between-district variance.
99 Notes
24. As one would expect, the standard errors increase at the extremes, thus suggesting some
caution in interpreting the results. We view these findings as suggestive until confirmed
by other empirical studies.
25. This finding has implications for management theory and how to manage organizations –
that is, in the degree of hierarchical structure that managers should create (Drucker 1967).
26. Management in this situation is both a decision to act and then a match of the strategy
with the situation (see Lynn 1984). The decision to act in no way guarantees that the
strategy then selected will pay off.
27. Visits to various schools indicate that the process might be that networking behavior is
also associated with other behaviors that improve the levels of organizational cohesion.
Good and bad schools both frequently have the same programs; the difference is often in
the commitment of teachers and administrators to making programs work. Later in this
volume, we explore how managerial quality and also the quality of human capital in the
system help shape outputs and outcomes.
28. For a complete treatment of this topic, see O’Toole and Meier (2004b). Additional
analyses along the same lines have been carried out by Meier, O’Toole, and Lu (2006);
and O’Toole and Meier (2006).
29. A few exceptions can be noted. None of the year dummies was significant for attendance.
In three other cases – average SAT score, average ACT score, and percentage scoring above
1,110 in the SAT – the dummy for 1996 was not significant, but the succeeding years were
consistent with the upward trend.
30. The performance measure is the TAAS pass rate for these subgroups.
31. This summary includes relationships significant at p < 0.10.
32. The fourth impact is on dropouts.
4 Managerial quality and performance
success and failure in the delivery of public policy results (Lynn 1984).
Despite this widespread belief, the notion has rarely been carefully tested.
In this part of the book, we develop a measure of managerial quality suitable
for certain kinds of empirical settings and then test whether high-quality
management contributes positively to public program performance.1 Public
education, an important policy field, once again provides the context for the
investigation (Raffel 2007).
This relatively straightforward test of the management quality hypothesis
confronts a number of challenges. The notion of managerial quality itself,
although often used in teaching, research, and practice, is seldom clarified in
a way that facilitates systematic investigation. Difficulties of measurement on
this score have also impeded research. In addition, many other influences
shape what happens via public programs, so the research needs to take into
account these realities. The next sections of this chapter treat these chal-
lenges systematically; then our research on the management quality hypoth-
esis is presented and discussed.
could be gathered to build another great pyramid. They vary widely, and
none of them can claim conclusive validation.”
The growing emphasis on quality – and quality management – in recent
years (see Beam 2001) overlaps the attention to leadership in public pro-
grams. Interestingly, an examination of this theme also reveals an unresolved
tension as to what kinds of broad managerial efforts are likely to be most
critical for delivering performance. Much of the attention to quality or
excellence in recent years, in the United States and elsewhere, has focused
on the value of “entrepreneurial” management for achieving results. The
popularity of Osborne and Gaebler’s (1992) volume illustrates this point,
and the National Performance Review of the Clinton years – a reform effort
with direct intellectual ties to the same perspective – reflected a similar
emphasis (Gore 1993; see Rainey 2003: 408–11). The new public manage-
ment, more broadly, emphasizes these themes. Some analysts have seen in
these approaches a diminished view of management, however (Lynn 2001),
or one, they argue, likely to limit what public agencies can deliver (see
Goodsell 1993 and Moe 1994). Terry (2002) in particular contends that
administrators perform a key function by executing “conservatorship”:
preserving established institutional forms and activities that have developed
over time and would be difficult to reestablish (for a more elaborate discus-
sion of this point, see O’Toole and Meier 2007).
Indeed, while risk-taking, entrepreneurial activities can sometimes bring
benefits, protective, conserving efforts can be especially valuable under other
circumstances (see Meier et al. 2007). As we have argued earlier, the multiple
managerial functions, which likely work through different causal pathways,
should all be considered by those who desire to probe the connection
between management and performance. Although this general point may
be valid, any systematic effort to explore the link between management
quality and performance across a large number of cases must confront a
nearly intractable measurement challenge. If high-quality public manage-
ment embraces a multitude of difficult-to-define dimensions and if different
strategic approaches and managerial orientations might be appropriate
under different difficult-to-specify conditions, how can one test the propos-
ition that good management contributes to good performance across the
spectra of cases and circumstances?
The conceptual complexity thus fuels a serious measurement challenge. In the
broader literature beyond the public sector, efforts have been made to measure
the quality of management (Bloom and van Reenen 2007), but so far the criteria
used have not been applied in empirical studies of public management.
103 The Gordian concept of public management quality
With respect to the public sector, for some years now the Government
Performance Project has developed comprehensive measures of government
management systems via a criterion-based approach. Most of this research
effort has been devoted to measures of management itself, and management
capacity, rather than managerial impacts, although some relationships
between these measures and managerial (intermediate) outcomes have been
demonstrated (Donahue, Selden, and Ingraham 2000).
A few additional notes of progress have been sounded in the effort to
probe with systematic work the link between elements of public manage-
ment and ultimate program performance. Wolf (1993) examines subjective
assessments of agency leadership, and finds that these are correlated with
agency effectiveness. Hennessey (1998) suggests a relationship between
public organizational performance and leadership, defined in terms of
Bennis’s (1993) four competences, on the basis of data from nine offices
in two federal agencies. His core argument is that leaders shape organiza-
tional culture and, thereby, performance. Attention is directed primarily
to reinvention efforts, however, and only secondarily to performance
itself. Further, the small number of cases, subjective measurement of
leadership features, and lack of controls attenuate the conclusiveness of
the work.
Rainey and Steinbauer (1999) have proposed a “theory of effective gov-
ernment organizations” incorporating a number of features that might
explain effectiveness. Several characteristics they analyze are part of, or, at
minimum, closely related to, public management – including the develop-
ment of human resources (see Chapter 5), various elements of task design,
and, in particular, leadership characterized by certain attributes. Rainey and
Steinbauer craft their argument on the basis of a review of existing literature
on the likely determinants of effectiveness. While they do no testing, they do
“posit” that leadership is likely to “emerge as” among the most important
drivers of effectiveness in governmental organizations (28).
Brewer and Selden (2000) report a systematic empirical project based on
Rainey and Steinbauer’s theoretical argument. They explain a large portion
of the variance in federal employee perceptions of organizational perform-
ance, as interpreted in rather broad terms, across twenty-three agencies. The
model they develop and test includes a leadership and supervision measure,
which is positively related to perceptions of performance, although its
predictive power is relatively slight. The measure is limited to employee
perceptions of how their immediate supervisors rate; and, as Brewer and
Selden note, “leadership and supervision may contribute to organizational
104 Managerial quality and performance
superintendent and can access an extensive state database on the district and
its characteristics. Similarly, the hiring district will have extensive infor-
mation about how the candidate’s current district (or school, if it decides
to hire a principal) has performed, and assessments of an individual super-
intendent candidate’s management ability are relatively easy to obtain via the
established network of school board members. In short, a manager with a
good track record is likely to have several options, so that a school district
seeking to hire such a manager will need to offer a premium, all other things
being equal. There are no regulatory floors or ceilings regarding compen-
sation. The sheer range of salaries in the study ($35,000 to $205,228 in 1999
[mean ¼ $74,400; standard deviation ¼ $24,087]) supports the notion that
market dynamics are at work.3
Salary premiums operate within a salary structure that recognizes basic
understandings about the job, however (see Ehrenberg, Chaykowski, and Ehren-
berg 1988a, 1988b). First, the most significant determinant of salaries, both
normatively and empirically, is the size of the district; as the size of the job
expands, salaries increase proportionately. Second, human capital factors such
as education, experience, and training will result in additional adjustments to
salaries. Third, personal characteristics of the individual are likely to affect
salaries. Particularly relevant are such factors as race, ethnicity, and gender.
Although discrimination might play a role here, some districts, such as large
inner city districts, will prefer a minority superintendent for political reasons.
Fourth, because the relationship between salaries and performance can be
expected to be reciprocal – that is, superintendents could also be rewarded for
performance in the past – a control for prior school district outputs is needed.
Our strategy of analysis is to take variables measuring each factor that
should influence the manager’s salary and use them to predict the manager’s
actual salary. The residual from this equation – that is, the variance in salary
not accounted for by job size, human capital, personal characteristics, and
past performance – will contain the assessment of managerial quality (for a
similar residuals-based measure in a different context, see Palmer and
Whitten 1999: 629). This measure is quite clearly a messy one, since the
residual contains all those factors not included in the model – such as the
ability to sell oneself, experience and renown as a football coach, physical
characteristics and other irrelevant factors, as well as the assessment of
quality. The impact of this measurement error will attenuate any relation-
ships between the quality measure and organizational outputs, however
(Carmines and Zeller 1979; Bollen 1989: 159–67). The measurement error,
as a result, creates a bias in favor of null findings.
107 Measuring managerial quality
base salary; it omits the perks some districts offer, such as club memberships,
cellphones, and transportation benefits that are not reported to the state
of Texas.
Three district characteristics are included as independent variables: the
district’s total budget, tax rate, and average revenue per student; all three
variables are logged. Total district budget is our measure of district size,
which should be the strongest predictor in the model. The tax rate is
included because some earlier work contends that superintendents are
rewarded for keeping taxes low (Ehrenberg, Chaykowski, and Ehrenberg
1988b). Revenue per pupil is a measure of wealth; certain districts will pay
higher salaries simply because they can afford to do so. For some districts
this decision is a matter of civic pride.
Four human capital characteristics are included: experience as a superin-
tendent, tenure in the current job, age, and the possession of a doctorate.
The first three variables are measured in years; salaries should increase both
with total experience as a superintendent (most of this experience will have
been in other districts) and time in the current job. Age is commonly
included in models such as these, even though it is considered a surrogate
for experience, which is already in the model.5 In terms of education,
virtually all superintendents have a master’s degree (98 percent), so the most
salient distinction is the possession of a doctorate, which should be posi-
tively related to salary.
Three personal characteristics are included: whether the superintendent is
female, black, or Latino. The predicted signs for these variables are ambigu-
ous, depending on whether a district might see it as an advantage to hire a
superintendent with a given demographic. Data on salaries, district charac-
teristics, human capital, and personal characteristics were provided by the
Texas Education Agency from their administrative database.
Finally, we include the previous year’s test scores in the model. Because we
think perceived managerial quality is affected by prior performance, and
because quality then affects future performance, over time there is reciprocal
correlation. We cannot control for prior test scores without adjusting for this
endogeneity, or the quality measure’s impact will be biased downward. The
appropriate method is to purge the reciprocal causation via an instrumental
variables technique. We do this using six student characteristics and district
resources (percentage of black, Latino, and low-income students, teacher
salaries, class size, and instructional funding) as instruments; the purged
measure of prior performance is then included in the model. Five years
(1995 to 1999) of data are used in the model, and dummy variables for
109 Measuring managerial quality
District characteristics
Logged budget 0.1641 0.0017 95.07
Logged tax rate 0.0272 0.0161 1.69
Logged revenue/pupil 0.0683 0.0092 7.45
Human capital
Past experience 0.0022 0.0003 7.94
Current job tenure 0.0009 0.0002 3.63
Doctorate 0.0532 0.0045 11.79
Age 0.0004 0.0002 1.95
Personal characteristics
Female 0.0025 0.0009 2.85
Black 0.0941 0.0183 5.16
Latino 0.0165 0.0081 2.03
Past performance 0.0009 0.0003 3.16
R2 0.78
Standard error 0.1251
F 1193.92
N 5,127
Modeling performance
Control variables
As discussed in earlier chapters, any assessment of organizational perform-
ance must control for both the difficulty of the job faced by the organization
and the resources in its possession. We use the well-developed literature on
educational production functions for guidance and include the same set of
control variables used in Chapter 3. These eight variables are three measures
of task difficulty and five measures of resources.7 These are used strictly as
controls, to make sure that any findings we have relative to management
quality are robust to the inclusion of factors normally linked to educational
performance.
Performance measures
This chapter incorporates eleven different performance indicators in an
effort to determine if management quality affects a variety of organizational
outputs. The most salient is the student pass rate on the Texas Assessment of
Academic Skills.8 Our measure is the percentage of students who pass all
(reading, writing, and mathematics) sections of the TAAS.
Four other TAAS measures are also useful as performance indicators.
TAAS scores for Anglo, black, Latino, and low-income students are included
as measures of performance indicators. TAAS scores are linked most directly
to basic skills and performance levels for all students. Many parents and
policy makers are also concerned with the performance of school districts
111 Modeling performance
Findings
The first school district performance measure assessed is the overall TAAS
score; these results are presented in the first two columns of Table 4.2. The
proposed measure of managerial quality is positively and significantly
related to school district performance. Since the measure is standardized,
and thus ranges between approximately 3 and þ3, these equations suggest
that the maximum impact of quality management is approximately 5.3
points on the TAAS. Although management quality is clearly not the most
important factor in determining test scores, in substantive terms 5.3 points
is a meaningful amount of change (the standard deviation of TAAS scores is
approximately 12.5). To check for omitted variables bias, we ran regressions
with forty-one additional variables, without affecting the findings here.
These variables included additional student characteristics, budget expend-
itures in various categories, teacher assignments, and additional measures of
district wealth.
To explore a bit more how management quality might work through
other factors known to influence performance, a second regression in
Table 4.2 adds three variables: parental involvement, community support,
and student attendance. Parental involvement and community support were
assessed via a superintendents’ survey; because they reflect the impressions
of the superintendents, these measures might contain some bias.9 All three
new measures are positively associated with organizational performance; in
the case of student attendance, the relationship is a strong one. Including
these factors in the model reduces the size of the management coefficient.
112 Managerial quality and performance
Notes: Coefficients for annual dummy variables are omitted. Equations also control for
teacher salaries, state aid, class size, teacher experience, noncertified teachers, and the
percentages of black, Latino, and low-income students. ¼ significant at p < 0.05.
Notes: All equations control for teacher salaries, instructional expenditures per student,
class size, teacher experience, percentage of teachers not certified, percentage of black,
Latino, and low-income students, and yearly dummy variables. ¼ significant at p < 0.05.
management would matter less, simply because what the organization could
do to solve such problems is more limited.
Table 4.3 presents the regression coefficients for management quality and
the ten additional performance indicators. Each equation also controls for
all the variables included in the first regression in the table.12 The perform-
ance of the managerial quality variable can be appropriately characterized as
stunning. For nine of the ten additional performance indicators, manage-
ment quality is significantly related to performance in the predicted direc-
tion (the exception is the percentage of students who take college boards).
This pattern of relationships, along with those in Table 4.2, amounts to
strong evidence that the residual-based measure of managerial quality is
tapping at least in part some aspects of how well superintendents manage
their districts.13
We also replicated the results of Table 4.3 and included the managerial
networking variable. For all the dependent variables but black pass rates and
the percentage of student who took either the SATor the ACT, the relationships
were statistically significant and in the correct direction. As one final robust-
ness check, we reestimated the equations with a lagged dependent variable.
Such a test is stringent, since it requires managerial quality to have an impact
over and above last year’s scores – in short, to continue the improvement
that generated the higher salary in the first place. Table 4.4 reports an
abridged set of results, which show that managerial quality maintains a
statistically significant impact for five of the outcome indicators – Anglo
114 Managerial quality and performance
Notes: All equations control for teacher salaries, state aid, class size, teacher experience,
percentage of teachers not certified, percentage of black, Latino, and low-income students,
and yearly dummy variables. ¼ significant at p < 0.05.
pass rates, ACT scores, college boards above 1,110, dropouts, and attendance.
If the criterion is relaxed to a 0.10 with a one-tailed test, given the direction
specified, the results for the overall TAAS rate, the black pass rate, and SAT
scores are also significant in the correct direction.
There are reasons to expect that very high levels of networking may have
diminishing, or perhaps even negative, effects on organizational perform-
ance. Most of the literature on the benefits of networking focuses on how
managers form relationships with other organizations and stakeholders to
secure benefits, fend off disruptions, and identify opportunities. Managers
often network with others in an effort to attract and acquire more resources
for the organization. The environment and the relevant network actors do
not have infinite resources, however. While managerial networking should
result in considerable payoffs much of the time, there could be a limit to
these payoffs – meaning that at some point there is nothing, or, at least, less,
to gain from more external interactions.
A related point has to do with opportunity costs. Managers must perform
functions internally within their institution, not just outside. At some point,
the time spent on trying to extract the last bit from resources or buffer the
agency from all potential disturbances could have been better spent else-
where. The formal model sketched in Chapter 2 implies some sort of
balancing between managerial responsibilities without specifying how and
when the tradeoffs actually appear. More precisely, the model does not
specify the relationship between M1 (core internal functions) and M2 (exter-
nal, or networking, management). Although there is no reason to believe
that these two functions are necessarily a zero-sum effort – with a full
tradeoff at the margin between the two – managers who spend most of their
time on one component to some neglect of the other may generate perform-
ance setbacks, or, at least, suboptimal results.
Regardless of whether the limits on the benefits of networking come from
increasing difficulty in tapping opportunities/fending off perturbations
from the environment, or from tradeoffs among the multiple functions of
management,14 the consequence should be the same: at higher levels of
managerial networking, still more networking could be expected to produce
little in the way of positive performance payoffs for the organization. This
relationship can be tested with an hypothesis: the relationship between
networking and performance is nonlinear, with diminishing returns at the
higher levels.
We might also consider contingencies. Although we expect that, in the
aggregate, higher levels of networking will have diminishing effects, some
managers and certain public organizations may be able to ensure that time
117 Resources, time, and the managerial balancing act
Linear Nonlinear
R2 0.611 0.612
F 271.93 245.59
N 4,182 4,182
Notes: All equations control for teacher salaries, state aid, class size, teacher experience,
percentage of teachers not certified, percentage of black, Latino, and low-income students,
and yearly dummy variables. F-test for added variable yields F-statistic of 5.176 and
probability of < 0.0165.
level (principals, counselors, etc.). Our eight usual controls, resources and
constraints from the environment, are also included in all analyses.
Table 4.5 provides the abridged regression results for the linear and non-
linear estimation of managerial networking’s impact on performance (con-
trol variables not shown). Because managerial networking is a factor score, it
has a standard deviation of one; therefore, a one standard deviation change
in managerial networking is associated with a 0.883 percentage point
increase in TAAS exam pass rates. Over the full range of this variable, this
effect size translates into a maximum possible impact of approximately 4.7
percentage points on a district’s pass rate for this time period. The impact is
both statistically and substantively significant. This result is similar to
analyses presented earlier for different time periods.
Table 4.5 displays the results for the nonlinear estimation of managerial
networking – that is, it includes a value for networking squared. As pre-
dicted, the linear term is positive and significant and the squared term is
negative and significant. This pattern represents a classic case of diminishing
returns. The slope for managerial networking can be calculated for any value
by simply taking the first derivative of the equation and substituting in
values. Since the variable’s range was rescaled to be positive and runs from
0 to þ5.3, the slope is steepest at low levels of networking. At a networking
value of 0 (the least amount of contact with other nodes), a one-unit change
in networking is associated with a 1.97 point increase in the TAAS pass rate.
The impact gradually declines until a networking value of 4.25, where the
slope is zero – that is, additional networking above this value does not
120 Managerial quality and performance
80
Performance 79
78
Linear estimation
77
Nonlinear estimation
76
75
0 2 4 6
Networking
R2 0.624
F 235.58
N 4,114
Notes: All equations control for teacher salaries, state aid, class size, teacher
experience, percentage of teachers not certified, percentage of black, Latino, and
low-income students, and yearly dummy variables. F-test for added variable
yields F-statistic of 31.35 and probability of F < 0.001.
84
80
78
76
0 2 4 6
Networking
better managers are more efficient, or at least more perceptive, with the
ability to gauge when additional time spent in the networked environment
may not garner substantial payoffs.
Organizational differences
To evaluate the third and fourth hypotheses, on the impact of central office
staff size on the management–performance relationship, we split the sample
into two groups to test for how the presence of administrative human
122 Managerial quality and performance
Table 4.7 Nonlinear effects of networking on performance: impacts of the relative size of central
administrative staff
R2 0.69 0.43
F 203.27 18.12
N 2,256 829
Notes: All equations control for teacher salaries, state aid, class size, teacher experience,
percentage of teachers not certified, percentage of black, Latino, and low-income students,
and yearly dummy variables. T-scores are reported in parentheses.
84
Performance 82
78
76
0 2 4 6
Networking
agencies, the executive office of the US president, and even major league
baseball teams (although this last-mentioned group is obviously not a set of
public organizations). Given this wide range of cases, what “quality” means
will vary a great deal. In a developing country, for example, one would not
expect the market to generate an intrinsic measure of managerial quality;
more rudimentary measures of quality will be used.
Avellañeda (2009a, 2009b) uses the basic theoretical model and applies it
to municipal governments in Columbia. Given the location in a developing
country and given that local government in Columbia is not highly profes-
sionalized, her works suggests that the concept of quality is highly portable
to different public sector contexts. Her studies cover forty cities over a
several-year period of time. The measure of mayoral quality – the top
manager is the elected mayor of the city – includes both level of education
and prior service at the local government level. While these would not be
impressive indicators of quality in a developed country, there is substantial
variation on these features in Columbian municipalities. Avellañeda (2009b)
has as her dependent variable the percentage of eligible children who actually
attend school; education is a municipal function in Columbia. Despite an
extensive set of control variables to deal with structure, politics and elec-
tions, socio-demographics, and even citizen displacement by armed groups,
she finds that mayoral education and experience are both positively correl-
ated with educational outputs – although the impact is significantly
dampened in areas with the presence of armed guerrilla groups. Avellañeda
(2009a) relates mayoral quality to the ability to collect greater levels of local
property taxes and per capital social spending. Again, the presence of local
armed groups has a dramatic negative effect on the positive relationships she
finds between managerial quality and program outcomes.
Jacobson, Palus, and Bowling (2010) examine state-level administrators
and the adoption of new public management reforms (essentially the use of
incentives and the limitation of restrictions on managers). Their purpose is
to estimate a model that incorporates both internal management and man-
agerial networking rather than to create a measure of managerial quality;
they also find that the manager’s level of education is positively related to the
adoption of these reforms, however.
Petrovsky (2006) examines federal agencies using the Program Assessment
Rating Tool. PART scores, which were discussed briefly in Chapter 1, are an
effort initiated by the George W. Bush administration to evaluate federal
agencies and programs by using employees of the Office of Management and
Budget (OMB) to do the evaluations. Petrovsky’s strategy is to pull out the
125 Conclusions
Conclusions
NOTES
1. Much of the material covered in this chapter has been presented by Meier and O’Toole
(2002). We have redone the analysis to include managerial networking in the equations
and have also included analysis by Hicklin, O’Toole, and Meier (2008).
2. Alternatively, it might be tautological: good management is whatever seems retrospectively
to have produced good results – a special problem when perceptual measures of both
management and performance are used (see Wolf 1993).
129 Notes
3. Since 1999 superintendent salaries in the large districts have approached $400,000.
4. In the next chapter we analyze another stability-relevant theme: personnel and manager-
ial stability, and how these influence performance.
5. The two are moderately correlated, but the relationship is not strong enough to pose a
collinearity problem.
6. In analyses in subsequent chapters in which managerial quality is included as an
hypothesized influence on performance, we use a measure calculated in the same way.
Recalculating the residuals-based measure with other, more recent, time series data
produces an even higher predictive ability in the salaries’ equation.
7. The number of candidates for inclusion in education production functions is virtually
limitless. Because many of the variables measure the same thing or relatively similar
things, collinearity in these models is a problem. As a result, some variables may have an
inappropriate sign. Because our concern is with having sufficient controls in the model
rather than estimating the precise impact of each control variable, we are less concerned
with collinearity.
8. In a 2000 survey of superintendents by the authors, 45.5 percent of superintendents rated
TAAS scores as their top priority; no other goal was endorsed by more than 13 percent of
superintendents. An additional 46.8 percent of superintendents rated TAAS scores as
“very important.” Surveys in later years show an even higher priority for TAAS or its
replacement.
9. The specific question asked the superintendent to rate parental involvement and com-
munity support on five-point scales that ranged from excellent to inadequate. This 2000
survey had a 57 percent response rate, thus reducing the total number of cases for
analysis.
10. A path analysis of the results of this second analysis shows that 72 percent of the impact
of management quality is direct, with the other 28 percent indirect through community
and school board support.
11. Note that we are limiting our analyses to linear specifications in this portion of the
chapter. We recognize that our measure of managerial quality is likely to be controversial.
To provide focus on the management quality measure, therefore, we have opted for
relatively simple models of management. As explained early in this book, we believe that
management operates in a contingent and nonlinear manner conditioned by structural
context. Some of the chapters include analyses involving more complex models of
management.
12. When community and school board support are included in the equations, the results are
similar, except that the impact of management on black TAAS scores is no longer
significant.
13. The n-size varies for these equations because the state reports results only when five or
more students per district meet the category. Some districts, for example, do not have
sufficient minority students to generate results.
14. The most likely answer of all is: from both.
15. The relationship between managerial quality and performance is not subject to these
diminishing marginal returns and has a strictly linear relationship.
16. The difference in years reflects when the original analysis was done. Replicating all the
analysis with 1995–2002 data produced similar results.
130 Managerial quality and performance
Ideas swing wildly in and out of fashion; take, for instance, the notion of
stability in administrative organizations. For decades conventional wisdom
simply assumed that stability contributes to public management perform-
ance. Such core bureaucratic features as standard operating procedures,
regular structure, incremental decision making, and fixed rules are emblem-
atic of the persisting features of such organizations. At least since the early
years of the last century, scholars linked stable patterns to efficient
133 Stability and public management: out of fashion
and renewal, planned change, and, of course, the range of efforts to spark a
new public management in many countries have been of intense interest to
researchers, particularly those desirous of “breaking through bureaucracy”
(Barzelay and Armajani 1992). Research has followed the manifold govern-
mental efforts to innovate and reform, with particular attention to deter-
minants of innovation and how to develop and institutionalize change (for a
review of these themes and some of this literature, see Rainey 2003, espe-
cially 355–89; for a comparative cross-national consideration of NPM, see
Barzelay 2001). While innovation has produced considerably less than its
strongest proponents claim (Light 1998), the emphasis remains clearly
positive (see Altshuler and Behn 1997). Some work has been influential
among practitioner and research audiences alike (Osborne and Gaebler
1992), and additional dimensions of the innovations theme continue to be
advocated (Behn 2001). Stability, in contrast, rusts at the bottom of the
public manager’s toolbox.
Despite the attention given to change, reform, and entrepreneurship,
some dissents can be heard. Terry (2002) has critiqued the perspectives
sketched above and argues strongly, instead, for the importance of “adminis-
trative conservatorship,” whereby administrative leadership cultivates and
protects the core competences, values, and institutional elements of agency
life that are accumulated over extended periods. Administrative executives,
Terry indicates, are “conservators because they are entrusted with the respon-
sibility of preserving the integrity of public bureaucracies and, in turn,
the values and traditions of the American constitutional regime” (Terry
2002: xv, emphasis in original; see also Spicer and Terry 1993).
Distinct but similar arguments have been offered by a disparate set of
scholars. The Blacksburg group has emphasized the importance of a long-
term “agency perspective” that may serve as a guarantor of the public interest
(Wamsley et al. 1990). Kaufman, particularly in his classic The Forest Ranger
(1960), shows administrative routines and ingrained patterns of oversight to
be important “centripetal forces” that lend coherence to an otherwise chaotic
policy setting rife with opportunities for atomistic decision making.
Indeed, motivating the study reported here is the notion that stability is
not necessarily the bane of those committed to high performance, but can
offer opportunities for enhanced program achievement. Although this prop-
osition had been a truism of standard organization theory (see Perrow
1986), it seems to have become lost in the rush to embrace entrepreneurial
notions of public management, the enactment of innovations of all sorts,
and various forms of reinvention and change.3
135 Stability in administrative systems
Personnel stability
public management and public education press for change, concerns have been
raised about the performance consequences of personnel instability.
In this section we explore this issue by estimating models of how personnel
stability influences school district performance in Texas. We are interested
especially in two forms of personnel stability: the durability of top-level
public managers and the retention of front-line teaching professionals.
Why should either type of stability matter? Top managers navigate in a
complex environment; they need time to learn the basic demands of the job.
Assessing the surroundings, both inside and outside the administrative
system, can take time. Even the most skillful managers can be expected to
improve efficacy by learning their institutional, political, resource, personal,
and administrative contexts. Time also permits other stakeholders to ascer-
tain top management’s intent and style. Over an extended period, and
particularly among managers who do high-quality work, this familiarity
can breed trust. Top managers who have developed reputations can use
longevity to exercise power.7
Stability alone, of course, is not management’s sole contribution to
program performance. The quality of management exhibited by a given
manager can be expected to have an impact. Moreover, the sheer degree of
managerial activity devoted to monitoring and negotiating the external
environment can also pay off, as we have seen earlier. Accordingly, the
analysis reported below considers these additional dimensions of manage-
ment as well as the issue of stability.
Front-line professional workers, particularly in so-called “street-level bur-
eaucracies” (Lipsky 1980) that deal with unpredictable needs and demands
from clients, can also benefit from longer periods on the job. Extended time
in high-stress front-line positions can lead to burnout and departure, of
course; but, for those who endure, the multifaceted skills acquired in the
“trenches” can make a significant difference in performance. Classroom
teaching surely fits this pattern. Veteran teachers learn how to juggle the
many tasks involved in delivering high-quality instruction. They gradually
see how to translate pedagogical theories into workable practices in their
own particular setting. They also can learn over time how to sort through
the distractions that can absorb energy and attention during a school
day. They will have developed experience with difficult cases and multicul-
tural nuances. Many of these craft-like skills, developed through years of
experience, are only partially transferable to other districts with different
mixes of students and different curricula. Sheer time in position in a local
setting can help.
138 Internal management and performance
present purposes by retaining stability only in the first term of the model.
The upshot is a deliberately underspecified model designed to explore some
of the issues raised in the general formulation. With these adjustments, the
model reduces to
Ot ¼ b1 ðSP þ MQ ÞOt1 þ b2 ðM2 Xt Þ þ et
The particular interest in this investigation is personnel stability – both of
top managers and of front-line workers. Since the autoregressive form
means that a large part of any variance is likely to be explained by the lagged
dependent variable Ot1, it can be difficult to pick up the influence of other
variables. Accordingly, we test both this model and a further simplified form
that excludes the lagged dependent variable:
Ot ¼ b1 SP þ b2 MQ þ b3 ðM2 Xt Þ þ et
Both equations are used in the analysis here. Our usual set of eight appro-
priate controls, represented by Xt, a vector of environmental forces, is
included in the analysis.
Once again we use data drawn from a set of Texas school districts. We
incorporate superintendent responses from our initial survey and pooled
five years (1995 to 1999) of data on performance and control variables to
produce a total of 2,535 cases for analysis.
Personnel stability can be a recurring issue in such districts. School
district managerial talent is mobile within the state (and somewhat mobile
across states). While some superintendents remain for extended periods in
one locale, most individuals move among several districts as they pursue
their careers. Further, districts themselves seek to replace their superintend-
ents for various reasons. This movement inevitably means instability at top
managerial levels; those in the system must adjust to a new top manager and
that person’s influence on a range of district decisions. Indeed, shifts in the
top managers often trigger other personnel changes near the top, among
deputies, assistant superintendents, principals, and so forth. The average
tenure of superintendents in Texas is 5.3 years in their positions; their mean
tenure within the district in any capacity is 8.7 years.
Stability in the teacher corps should matter as well. Inexperienced teachers
are likely to be less effective as they engage in trial-and-error searches to
determine which of their academic skills actually matter in the classroom.
The teacher shortage in particular specialties compounds the difficulty. To
recruit new teachers on a regular basis, at the very least, school systems must
devote significant budgetary resources to human resources management.
140 Internal management and performance
Some systems find it necessary to take particularly sizable and costly efforts;
the Houston Independent School District, for instance, employs a recruiter
in Moscow, Russia. The average period of teacher experience in Texas school
districts is 11.6 years.
Other measures
Two measures of public management are included as potential explanatory
variables in this analysis: managerial quality and managerial networking.
Both measures have been introduced in earlier chapters. Eight control
variables, all introduced earlier, are included; three are measures of task
difficulty and five measures of resources.
We use ten performance measures in this portion of our analysis: the
overall student pass rate on the Texas Assessment of Academic Skills, TAAS
scores for Anglo, black, Latino and low-income students, three measures of
college-bound student performance (average ACT score, average SAT score,
and the percentage of students who score above 1,110 on the SAT (or its
ACT equivalent)), along with attendance rates and dropout rates.
Findings
The first line of analysis here focuses on explaining the overall TAAS pass
rate. Table 5.1 displays abridged results of regression analyses for two
141 Findings
R2 0.61 0.82
Standard error 7.43 4.99
F 239.58 678.43
N 2,503 2,503
Notes: Coefficients for annual dummy variables and control variables (teacher salaries,
state aid, class size, teacher experience, noncertified teachers, and the percentages of black,
Latino, and low-income students) are not shown. ¼ significant at p < 0.05, one tailed test.
Time period ¼ 1995–9.
models, the first omitting the autoregressive term and the second including
it.11 The tables omit the coefficients for the control variables.
In each equation, both measures of personnel stability are positively and
significantly related to school district performance. The impact of teacher
stability is slightly more than that for managerial stability in both cases.
While clearly not the most important determinant of districts’ standardized
test performance, both kinds of stability contribute to the explanation.
Since the measure of teacher stability in the sample ranges between 44.4
(55.6 percent of a district’s corps of teachers departed in one year)12 and 100
(zero turnover), the maximum impact of teacher stability is considerable:
more than 7.6 percentage points on a district’s pass rate, if the equation
without the lagged dependent variable is used, and almost three percentage
points even in the much more stringent autoregressive specification.13
Managerial stability also contributes to district performance. Here the
measure is in years of experience in the district; since the range in the data
set is forty-one years, the maximum impact of this feature is less but still
worth noting: approximately three percentage points or one percentage
point on the pass rate, respectively, depending on whether the equation
excludes or includes the lagged pass rate. Since the two elements of stability
are uncorrelated, the combined maximum impact of stability could amount
to almost eleven percentage points.14 Considering the short shrift given such
142 Internal management and performance
Management Stability
Latino pass percentage 0.5394 (2.07) 0.7722 (2.74) 0.0634 (1.37) 0.0659 (2.36) 0.36 2,283
Black pass percentage 0.4920 (1.29) 0.5691 (1.47) 0.3417 (4.54) 0.1093 (2.93) 0.37 1,548
Anglo pass percentage 0.7728 (5.20) 0.7986 (4.88) 0.1347 (5.44) 0.0781 (4.79) 0.45 2,475
Low-income pass 0.2693 (1.42) 0.9401 (4.48) 0.1345 (4.20) 0.1265 (6.07) 0.52 2,492
percentage
Average ACT score 0.0445 (1.64) 0.0932 (3.14) 0.0072 (1.41) 0.0018 (0.64) 0.36 2,196
Average SAT score 3.7900 (2.59) 3.6348 (2.28) 0.8699 (2.96) 0.1592 (1.05) 0.50 1,814
Percentage above 1,110 0.3743 (1.89) 0.7481 (3.40) 0.0636 (1.81) 0.0185 (0.86) 0.30 2,387
Dropout percentage 0.0368 (1.76) 0.1014 (4.40) 0.0006 (0.17) 0.0016 (0.71) 0.16 2,483
Class attendance 0.0015 (0.10) 0.0655 (3.89) 0.0120 (4.71) 0.0000 (0.02) 0.24 2,503
Notes: T-scores in parentheses. All equations control for teacher salaries, instructional expenditures per
student, class size, teacher experience, percentage of teachers not certified, percentage of black, Latino, and
low-income students, and yearly dummy variables. ¼ significant at p < 0.05, one tailed test.
Management Stability
Latino pass percentage 0.2787 (1.32) 0.3523 (1.56) 0.0148 (0.39) 0.0377 (1.68) 0.58 2,216
Black pass percentage 0.2640 (0.87) 0.3989 (1.29) 0.1254 (2.02) 0.0519 (1.73) 0.59 1,490
Anglo pass percentage 0.3110 (2.85) 0.1909 (1.59) 0.0576 (3.16) 0.0336 (2.82) 0.71 2,467
Low-income pass 0.2028 (1.47) 0.1580 (1.03) 0.0700 (2.99) 0.0543 (3.56) 0.75 2,491
percentage
Average ACT score 0.0346 (1.35) 0.0631 (2.27) 0.0055 (1.11) 0.0001 (0.05) 0.45 2,091
Average SAT score 1.0705 (0.87) 1.3360 (1.01) 0.4979 (1.94) 0.0893 (0.72) 0.67 1,655
Percentage above 1,110 0.2458 (1.33) 0.4301 (2.09) 0.0498 (1.51) 0.0134 (0.67) 0.39 2,366
Dropout percentage 0.0134 (0.72) 0.0669 (3.27) 0.0014 (0.45) 0.0006 (0.31) 0.34 2,483
Class attendance 0.0013 (0.14) 0.0126 (1.25) 0.0066 (4.36) 0.0004 (0.44) 0.71 2,503
Notes: T-scores in parentheses. All equations control for teacher salaries, instructional expenditures per
student, class size, teacher experience, percentage of teachers not certified, percentage of black, Latino, and
low-income students, a lagged dependent variable, and yearly dummy variables. ¼ significant at p < 0.05,
one tailed test.
and also clearly supports the notion that management itself matters, aside
from the personnel impacts captured by stability.
Table 5.3 shows the coefficients for the nine autoregressive analyses.
Picking up the impacts of independent variables is quite difficult in such
144 Internal management and performance
Nonlinear relationships
All findings reported thus far involve linear estimations for the full set of
school districts. We are interested in exploring nonlinear elements as well,
however, since both the theory and some earlier analyses indicate that these
can be expected when dealing with public managerial and related relation-
ships. Nonlinear impacts can be assessed either via interaction terms or by
examining relationships with different subsets of the sample. Here we
explore nonlinear relationships among the independent variables via phys-
ical controls – that is, by partitioning the data set.
We divide the school districts into quartiles four different times – by
values of each of the key independent variables successively (that is, man-
agement quality, managerial networking, teacher stability, and managerial
stability) – and examine changes in the impacts of the other independent
variables on performance.18 For each quartile of partitioning and each of the
independent variables, we calculate the regression coefficients for the other
variables. The coefficients can then be graphed, as in Figures 5.1 to 5.4. Each
figure shows the full set of coefficients for each quartile of the partitioned
146 Internal management and performance
1.400
1.200
1.000
0.800
0.600
0.400
0.200
0.000
Q1 Q2 Q3 Q4
Regression slopes for
Superintendent stability Teacher stability Networking
Figure 5.1 The interaction of management quality with networking and stability: quartile regression
coefficients
0.160
0.140
0.120
0.100
0.080
0.060
0.040
0.020
0.000
Q1 Q2 Q3 Q4
Regression slopes for
Teacher stability Networking Management quality
Figure 5.2 The interaction of superintendent stability with teacher stability, management quality, and
networking
147 Nonlinear relationships
2.000
1.500
1.000
0.500
0.000
Q1 Q2 Q3 Q4
–0.500
–0.100
Figure 5.3 The interaction of networking with management quality and stability
0.300
0.250
0.200
0.150
0.100
0.050
0.000
Q1 Q2 Q3 Q4
Figure 5.4 The interaction of teacher stability with superintendent stability, management quality,
and networking
148 Internal management and performance
Stability has received little attention in recent times from management gurus.
The vaunted virtues of entrepreneurship and reengineering, change and
reinvention, are the coins of today’s reformist realm. The best thinking about
public management over the decades offers justification for considering this
issue afresh, however. Administrative arrangements are autoregressive systems,
and change certainly entails costs as well as possible benefits. The model we have
developed suggests that stability in public programs is a dimension worthy of
systematic investigation and that it could shape performance for the better.
Stability takes on many forms in administrative systems. We have
explored just one of these, personnel stability, and its impact on educational
performance. We have also incorporated an explicit consideration of other
aspects of public management. Our analyses reconfirm the importance of
the other aspects of management while offering substantial support for the
notion that personnel stability at both managerial and front-line levels
contributes positively to performance. The findings regarding stability are
persuasive in a number of respects. They are unambiguous on the most
important and salient performance indicator, persist in analyses of many
other measures of performance, and can even be documented in most
autoregressive estimations. Further, the examination of interactions among
the independent variables of management and stability indicates that not
only do the variables matter, the relationships between them are nonlinear
and complex. The model contends that management actions are likely to be
contingent on stability. This empirical evidence suggests that the impact of
management actions on performance is likely to be contingent on the full
range of management decisions and how the various features interact.
Although we have referred to “management” and “stability” variables, in
an important sense all four have to do with public management. The latter
two reference an aspect of what is usually referred to as personnel manage-
ment. Unlike items such as jurisdictional wealth or student characteristics,
personnel stability derives from the administrative system itself and those
who comprise it. While not totally in the control of school district leaders,
these variables are susceptible to influence by the individuals who make
decisions about how such organizations are run. In a real sense, therefore, all
four variables tap aspects of public management.
This point is worth an explicit mention because, taken as a whole, the set
of four independent variables accounts for an impressively large slice of
150 Internal management and performance
educational performance in Texas school districts. For those who would say
that public management constitutes, at best, a tiny part of the explanation as
to why programs work as they do, we would say: look to education in Texas
for a rather dramatic rebuttal. We expect that, as additional scholars develop
similar, theoretically informed indicators of management in other public
organizations, the results will be similar.
This investigation might seem to amount to a fairly comprehensive
exploration of the issues in question. This section of the chapter reports
on the role of four public management variables in shaping educational
performance, uses ten performance measures, includes numerous controls,
tests for relationships with and without the autoregressive form, and
unpacks interactive effects. In these respects, the study offers convincing
evidence. It is nonetheless important to emphasize that the results are but
partial findings regarding a broader and more complex set of issues.
Indeed, as emphasized at the outset of the chapter, personnel stability is
merely one theme even within the realm of internal management. We next
turn to a second set of HR issues: the quality of human capital in an
organization and its effective management.
Attracting and developing skilled and motivated people at all levels is a core
function in the management of public organizations’ human resources.
McGregor admonished students of management to take note of the “human
side of enterprise” (1960; see also 2006).19
Of all the internal managerial functions, the management of public
organizations’ human capital is surely one of the most important and often
discussed (see Light 2008). Indeed, today’s frequent references to the federal
government’s “human capital crisis,” the attention devoted to HR strategy by
the US Comptroller General (see, for instance, Walker 2001), and the
arguments of a number of scholars that human resources management is
critical all amplify the theme (Ingraham, Selden, and Moynihan 2000;
Bilmes and Neal 2003; Breul and Gardner 2004; Kellough and Nigro 2006).
Within the United States, the great majority of public employees pursue their
careers at the local level, and far and away the vast majority of these – more than
6.7 million – work in the field of public education, especially elementary and
secondary education (Nigro, Nigro, and Kellough 2007: 4–5, 8). Here we
examine the impact over a several-year period of human capital and its
151 Human capital management and the model
Once again we use the Texas school district data set and our 2004/5 survey of
school district superintendents. For this version of the survey, the return rate
was 61 percent.20 Pooling four years (2004 to 2007) of data on performance
and control variables produces a total of 2,400 usable cases for analysis.
Missing data on individual items reduces this number somewhat in individ-
ual equations.21
We use our measure of managerial networking as developed earlier in this
book and used frequently throughout. One adjustment made in the analysis
in this section is that we use the factor score of interactions for the four
possible interaction nodes aside from interaction upward with the school
board. The school board interaction can be considered a principal–agent
link and is included in the equations reported here as a separate measure. We
also employ our validated measure of managerial quality, and we use both
measures of personnel stability developed in the present chapter.
We also employ the usual eight control variables, and we focus in this
section on the same ten performance measures already introduced in the
first part of the chapter.22 What remains to be explained is the measure of
human capital management.
Our measure of human capital management taps what should be present
as a part of successful human resources management: the attraction and
development of the organization’s human capital. Success in this aspect of
management should produce high-quality managers and front-line workers –
teachers in these highly professionalized organizations – and should also
154 Internal management and performance
Indicator Loading
the indicators and the overall factor, except for the willingness to recom-
mend an employee as a superintendent elsewhere.
The measure has some limitations, as it emphasizes the quality of human
capital and only somewhat its management. We do not have many details
regarding just how top management applied HR strategies and tactics to
build its stock of human capital. The question on professional development
does tap explicitly an aspect of management’s responsibility, and the fact
that it loads reasonably well on the factor suggests that the measure reflects
aspects of human capital and also its management.
While the individual items and the factor scores show some face validity,
before using the variable in any statistical analysis we should demonstrate
whether or not the concept is reliable. We can make some assessments of this
because the 2004/5 survey questions that were used to construct the index
were repeated in a 2006/7 survey of superintendents. This second source of
data means that we can gain some leverage on the reliability of the measure
over time. To the extent that management develops human resources, we
would expect these human resources to have some relatively lasting impact
on the organization. In short, we would expect a positive correlation
between the two measures. Further, we would expect this correlation to be
even higher if the same superintendent headed the system in both years,
simply because management practices are less likely to change if the same
person remains as superintendent.
Table 5.5 presents these findings. For the 467 districts that responded to
both surveys, the correlation of the human resources measure across time
was a robust 0.51 – fairly strong for perceptual measures over a two-year
period. When the analysis is restricted to those superintendents who held the
same position in 2004/5 and 2006/7, the correlation jumps to 0.60. For those
districts that changed superintendents between these two years, the correl-
ation drops to 0.33. The pattern is consistent with the notion that the store
of human capital both reflects the efforts of the top manager (the superin-
tendent) and is also embedded in the processes and structures of the
organization, so that the gains from good management are not lost imme-
diately when the top manager leaves.
156 Internal management and performance
R2 0.72 0.85
Standard error 7.30 5.27
F 354.98 761.51
N 2,380 2,379
Notes: Coefficients for annual dummy variables and control variables (teacher salaries,
state aid, class size, teacher experience, noncertified teachers, and the percentages of black,
Latino, and low-income students) are not shown. ¼ significant at p < 0.05, one tailed
test. Time period ¼ 2004–7.
Findings
We first report the impact of human capital on the most salient performance
measure: the all-pass rate on the standardized, statewide examination (the
TAKS). The first two columns of Table 5.6 display the full estimation for
the model developed above, without the lagged dependent variable and with
the pass rate as the dependent variable. The other two columns show the
results when the autoregressive term is added to the first model. In the former
case, and leaving aside the key variable of interest for the moment, all the
other management measures aside from management experience are related
to performance, and in the direction expected theoretically and on the basis of
earlier work. In addition to these relationships, human capital contributes
positively to the test results, and the relationship is highly significant – with a
T score above nine. Interestingly, as well, the effect size for this variable is
substantial. Since the measure is a factor score with an effective range of 3
to þ3, the maximum effect size is more than ten percentage points on the pass
rate. This result suggests a substantively important impact.
The estimation including the lagged dependent variable has some of
the variables dropping out of statistical significance, as would be expected
157 Findings
given the high hurdle that would have to be surmounted to show per-
formance impacts controlling for the preceding year’s pass rate. Manage-
ment quality, which can be considered a measure tapping top-level
human capital, and front-line workforce stability continue to have
impacts on performance, however. Our human capital factor score
remains significant and contributes positively to districts’ pass rates.
Although the effect size is smaller in this estimation than the previous
one, it is worth bearing in mind that in the autoregressive equation the
estimated impact of the variable should be considered as building into the
base from one year to the next, and thus reverberating forward over time.
In a several-year period, this model shows, this aspect of human resources
management has a substantial effect on the statewide standardized exam
performance. This finding is striking, particularly since a considerable
portion of the human capital was already in place during the preceding
period. The fact that this variable is shown to be substantively as well as
statistically significant in an autoregressive equation and with numerous
management and other controls included speaks to the importance of
human capital and its management for delivering public policy outcomes.
The strong finding in the equation with the lagged dependent variable
suggests that it is likely that causality works in the direction we have
hypothesized, rather than the reverse.24
The overall pass rate on the statewide exam is an important perform-
ance result, but the organizations in question are expected to achieve
other educational results as well. Tables 5.7 and 5.8 show summary
results for the nine other performance measures sketched earlier in this
chapter. The tables include only coefficients and T-scores for the esti-
mated impacts of HRM, but the full model was used to develop the
results. Table 5.7 displays the results for the model without the lagged
dependent variable, while Table 5.8 shows the findings for the autore-
gressive estimations.
As the results in Table 5.7 demonstrate, human capital has a performance-
improving impact in all nine instances (a negative influence on the dropout
rate counts as an improvement). Results for subgroups of students taking
the TAKS – black, Latino, Anglo, and low-income students – all benefit from
better human resources management. Latino students benefit even more
than the others. Similar results can be seen for the other dependent variables.
For example, the maximum effect size for SAT scores is more than thirty
points. High-end performance also improves with better human resources
and their management; the percentage of students achieving college-ready
158 Internal management and performance
Notes: All equations control for the five management variables, teacher salaries, per student
instructional funds, class size, teacher experience, percentage of teachers not certified,
percentage of black, Latino, and low-income students and yearly dummy variables.
¼ significant at p < 0.05, one tailed test.
Table 5.8 The autoregressive impact of human capital on alternative indicators of performance
Notes: All equations control for past performance, the five management variables, teacher
salaries, per student instructional funds, class size, teacher experience, percentage of teachers
not certified, percentage of black, Latino, and low-income students, and yearly dummy
variables. ¼ probability p < 0.05, one tailed test.
human capital boosts results. Positive results are also estimated for
attendance as well as high-end performance. In none of the cases are
there negative performance impacts; the result for dropouts is not signifi-
cant. Given the difficulty of attaining significant results in autoregressive
estimations, and particularly since the districts’ human resources at
any time are likely to be partially tapped in the preceding period
(see Table 5.5), these results again provide support for the proposition
that good human resources and the skillful development of them can pay
important performance dividends.
Implications
Gregory (a Scotland Yard detective): “Is there any point to which you would wish to
draw my attention?”
Holmes: “To the curious incident of the dog in the night-time.”
Gregory: “The dog did nothing in the night-time.”
Holmes: “That was the curious incident.”
Measuring shocks
To estimate budget shocks, we follow Ratts (1999), who examines shocks to
national economies. We regress total school district revenues (logged) on
their logged values for the prior year.26 This regression essentially estimates
what school district revenues would be if past trends continued. We then
164 Internal management and performance
Findings
Our first question is to ask what the impact of a budget shock of 10 percent
or more is on the performance of the organization. Table 5.9 provides a
regression of overall TAAS rates on a budget shock while controlling for the
other resources and constraints of the organization. The results in the first
two columns are surprising. A budget shock has only a modest impact on
the organization’s performance; it results in only a drop of one half-point
in TAAS performance, all other things being equal, and this relationship is
statistically significant only if we use our directional hypothesis and then use
a one-tailed test of significance at the 0.10 level. The remaining control
165 Findings
Table 5.9 The impact of a 10 percent or greater budget shock on organizational performance
R2 0.61 0.61
Standard error 7.66 7.66
F 820.09 773.71
N 8,321 8,321
Notes: Dummy variables for individual years not reported. ns ¼ not significant at p < 0.05.
Time period ¼ 1995–2002.
variables in the model show the predicted relationships. (The findings are
also robust to the inclusion of a set of management variables.)
Because student performance is highly autoregressive (the same students
are tested every year), it might take more than one year for a negative impact
to show up. The third and fourth columns of Table 5.9 include a one-year lag
for the budget shock. The results show a small but statistically significant
negative impact of the budget cut in the second year, approximately one
percentage point on the TAAS. Additional estimations with longer time lags
show no further impacts.
The ability of school districts to take a 10 percent or better budget cut and
produce performance results that drop only a small amount is an interesting
finding. This is clearly a case of a sizable cut, and the interesting story is the
dog that did not bark, let alone bite. The most plausible explanation has to
do with management. Public organizations are open systems, but they are
also actively managed – that is, they are not blown along at the whim of
environmental winds. They adopt procedures to dampen environmental
threats, and they can also take actions internally to ameliorate the effects
of unpleasant shocks from the environment. Budget shocks should be no
166 Internal management and performance
Notes: All equations control for teacher salaries, per student instructional funds, class size,
teacher experience, percentage of teachers not certified, percentage of black, Latino, and
low-income students, and yearly dummy variables. ¼ significant at p < 0.05, two-tailed test.
# ¼ significant at p < 0.10, two-tailed test. Significant second-year effects were found for
Anglo students and for the percentage above 1,110.
exception to this rule, as the budget process is often fraught with crises of
either economic or political origin (Rubin 2005).
Table 5.9 shows the impact of the budget shock only on the primary
performance indicator for Texas school districts. Nine additional regressions
were run on the other performance indicators to determine if budget shocks
had any other impacts, or if perhaps the shocks affected some portions of the
organization rather than others. Table 5.10 shows the abbreviated results of
these regressions. In three cases, we find statistically significant negative
impacts of a 10 percent or greater budget shock on the organization: Anglo
test score results, the percentage of students who take one or both of the SAT
and ACT exams, and the percentage of students who score above 1,110 on
the SAT or its ACT equivalent. TAAS pass rates for blacks, Latinos, and low-
income students, as well as attendance rates and ACT and SAT mean scores,
show no discernible impact (similar null results occur with a lagged shock
variable). The budget-shock impact on Anglo TAAS rates remains at the
marginal level of about one-half point and now just crosses the threshold of
significance at the 0.10 level (or the 0.05 level with a one-tailed test, not an
especially stringent test with 8,000 plus cases). A one-year lag of the shock on
this variable shows a slightly larger negative impact of 0.9 points (results not
shown). The impact on college-bound students appears greater. Approxi-
mately 1.4 percentage point fewer students take either the ACT or the SAT
(in the first year), and those students who score above 1,110 drop by about
167 Findings
Table 5.11 Superintendent priorities: what is your primary goal for improving
your district?
Goal Percentage
N ¼ 650
1.3 percentage points (in the first year, and a significant second-year drop of
0.8 points [equation not shown]). These two impacts are likely cumulative;
fewer students take the exam and those who do score lower. Although a 1.4
percentage point drop from the average of 62.8 percent taking the exams is
not large, a 1.3 percentage point drop and a 0.8 percentage point drop from
the 19.0 percent who score above 1,110 is a sizable reduction.
Why might such a pattern occur whereby one set of performance
indicators is generally unaffected by a major budget reduction while others
are? One explanation might be that management seeks to protect those
organizational outputs that are more highly valued – that is, part of their
core mission (Thompson 1967). Although it might be argued a priori that
the emphasis on standardized tests in Texas will be valued more highly
than other outputs, the results from a 2002 survey of Texas school super-
intendents (see Table 5.11) provides unequivocal evidence. Superintendents
were asked to rank-order their goals among six different areas: TAAS,
college-bound students, vocational education, bilingual education, extra-
curricular activities, and athletics. Fully 70 percent of superintendents listed
TAAS as the top goal for their district. The results of Tables 5.9 and 5.10,
therefore, are consistent with the view that superintendents protected their
primary goal at the expense of some degradation in the achievement of
secondary goals.
Goals convey intentions; they do not tell us how superintendents are
actually able to keep a large budget cut from affecting their primary
performance goal. Indeed, prior research on the public management of
cutbacks offers at least three broad possibilities. One, developed by
researchers focusing on local government management, indicates that
managerial choices under fiscal stress can be fairly unpatterned and unsys-
tematic (Pammer 1990; Bartle 1996). Another is that cuts might be
168 Internal management and performance
Table 5.12 The nonbarking dog: the relationship between a budget shock and
instructional expenditures
R2 0.75
Standard error 0.12
F 12,707.20
N 8,328
Table 5.14 Reducing core costs: teachers’ salaries and class size
Dependent variable
R2 0.88 0.88
Standard error 1.39 0.87
F 29,908.92 30,203.83
N 8,323 8,329
Table 5.15 Reducing core support tasks: instruction, aides, and support staff
Implications
The analyses show that managers are able to cope rather well, but what
happens beyond short-term coping is an important and so far unanswered
question. Clearly, repeated budgetary shocks are likely to show substantially
greater negative impacts on performance. Even isolated shocks may carry
larger long-term consequences, particularly on some aspects of educational
performance – bilingual or special education, perhaps, or advanced work by
high-performing students. The protective moves visible in the school dis-
tricts studied here provide some clear benefits, but they may also function,
in effect, as initiating a process of eating the seedcorn: weakening the
educational system’s infrastructure so that it becomes progressively more
difficult over time to maintain effective performance. These matters too
deserve careful investigation.
proposals; both measures should be associated with lower interest rates for
debt. Although the M1 measures do not have much impact on competitive
sales, they do have a strong positive impact on the percentage of bonds
covered by requests for proposals (142).
Meier, O’Toole, and Hicklin (2009) examine the managerial practices of
266 public and private universities in the United States. They create an
internal management measure that is a factor analysis of how the university
president allocates his or her time. Using scales similar to the managerial
networking scales in terms of frequency, the president’s interactions with
thirteen different individuals or groups within the university are assessed.
A two-factor solution is found. One factor indicates a very hierarchical
managerial style, whereby actions are taken almost exclusively through direct
subordinates – that is provosts, deans, and department chairs. The other
factor is a more fluid internal management style that includes interactions
with a far larger variety of individuals and resembles more a network-like
approach than a strict hierarchical orientation to management. The study
includes two performance measures: the six-year graduation rate (the
percentage of new first-year students who graduate within six years) and
the percentage of new faculty hires who are African American. A hierarchical
management style is positively associated with six-year graduation rates but
had no impact on the effort to hire more African American faculty
members. In contrast, a more networked internal management style is
positively associated with increases in faculty diversity but is unrelated to
the six-year graduation rate. In short, one approach to internal management
appears to generate efficiency benefits while a different management style is
associated with greater equity.
Roch, Pitts, and Narvarro (2010) study a specialized aspect of internal
management in their analysis of public schools in the US state of Georgia
from 2002 to 2005. The outcome they explore is whether the individual
schools pursue school disciplinary policies that are punitive (out-of-school
suspensions, expulsions, etc.) or ameliorative (in-school suspensions,
assignments to alternative schools, etc.). Their internal management meas-
ure is based on human resources and, essentially, is a measure of how well
the demographic composition of the teaching force and the administrators
reflect the demographics of the student body, using a Euclidian distance
measure. In essence, this measure taps how successful the HR managers
have been in recruiting a diverse workforce. Roch, Pitts and Narvarro find
that this measure of internal management is associated with more ameliora-
tive disciplinary actions, especially in the case of teachers.
176 Internal management and performance
Roch and Pitts (2010) extend this work on Georgia schools by examining
the differences between public schools and charter schools. Charter schools
are schools funded by the state of Georgia but not subject to the extensive
rules and regulations that affect public schools. The idea is to free up these
schools to be innovative and let them compete for students with each other
and public schools. Roch and Pitts argue that charter schools are managed in
a distinctly different way from public schools. They are generally headed by
entrepreneurs who have a strong commitment to a specific education
philosophy and who recruit teachers and administrators who share this
philosophy. In short, such organizations rely on value congruence rather
than hierarchy to manage the organization. This strong emphasis on value
congruence in terms of educational philosophy, the authors argue, means
that some key HR variables for public schools will no longer matter in
charter schools. Again, the authors focus on race, but in this case they have
two dependent variables: ameliorative disciplinary policies and the perform-
ance of minority students on the Georgia state standardized tests. For public
schools, the authors find, as in the previous study, that the diversity of the
faculty is positively associated with ameliorative disciplinary policies and
also that it is positively associated with minority student test scores. For
charter schools, however, these relationships are insignificant – a finding
that allows the authors to conclude that the strong goal orientation of
charter schools, an internal management factor, squeezes out other values
in the implementation of educational policy.
Pitts (2009) also pursues this line of management research but focuses on
federal government agencies, using the 2006 Federal Human Capital Survey
(a large survey of federal employees with over 200,000 respondents). Pitts
creates an internal management index (M1) designed to tap the organiza-
tion’s commitment to diversity management in terms of goals and actual
implementation. He then relates this measure of internal management to a
dependent variable that asks respondents to rate how well their work group
performs, and a second dependent variable that measures job satisfaction.
Pitts finds a strong positive association between internal management (M1)
and perceived job performance. He also finds this aspect of management is
positively correlated with job satisfaction, so it might indirectly affect other
organizational processes and outcomes though increases in job satisfaction.
The studies by Pitts and colleagues fall into a research genre termed
“representative bureaucracy.” This literature documents when and under
what conditions attempts to create a workforce representative of the popu-
lation results in changes in program outcomes. The literature is not
177 Generalizing the impact of internal management
considered part of the public management field, but the basic premise – that
managerial efforts to build human resources of a specific type will generate a
predictable set of program outcomes – is a premise that is part of the public
management agenda. We do not review this extensive literature here; we
should note, however, that the basic relationship (that internal management
affects performance) has been found for child support enforcement agencies
in Missouri (Wilkins and Keiser 2006), local police forces in urban counties
(Meier and Nicholson-Crotty 2006), the federal Equal Employment Oppor-
tunity Commission (Meier, Eller, and Pennington 2005), and the Federal
Housing Administration (Selden 1997), as well as in public schools data,
both nationally in the United States and in the state of Florida (Meier and
Stewart 1991).
Nicholson-Crotty and O’Toole (2004) use the basic management model
in Chapter 2 to study 570 municipal police departments in the United States.
They create an internal management variable by using survey measures that
include both structure and the development of human resources. The
fourteen items produce a single internal management factor that they
designate as M1. As a dependent variable, the authors use the clearance rate
for indexed crimes; these are the serious crimes that the FBI uses to calculate
crime rates in the United States. The internal management measure has a
positive impact on crime clearance rates; it also interacts with past perform-
ance and generates additional impacts via this autoregressive interaction.
Jacobson, Palus, and Bowling (2010) use data from the 1994 and 1998
American State Administrators Project; this is a large survey of state admin-
istrators that asks a range of questions about these managers and how they
perform their jobs. Although their objective is to examine management
behaviors and how they vary by gender, their findings are relevant for this
study. As a dependent variable they measure how extensively “reinventing
government” initiatives were implemented. Reinventing government is a
general reform of the new public management that seeks to bring more
business management techniques and more incentives into public manage-
ment. The authors find a negative relationship between the extent of time
spent on internal management (regular day-to-day operations) and the
adoption of these reforms. The negative relationship is expected, because
these reinventing reforms are being pushed by outside political actors, and
the management measure taps into an internal rather than an external focus
for management.
Andersen and Mortensen (2010) take the O’Toole and Meier notions on
the stability aspects of internal management as the starting point and ask
178 Internal management and performance
Conclusions
NOTES
1. Sargent (2009) examines other internal management issues, such as goal setting, budget
efficiency, employee training, and technology adoption.
2. This portion of the chapter is adapted from the analysis presented by O’Toole and Meier
(2003b).
3. Overgeneralization should be avoided with regard to the impact of stability on performance.
In this chapter we argue that stability can be helpful, and test one aspect of this idea against
evidence; but we expect the overall impact of stability, as well as of certain types of stability,
to be contingent. We are exploring some of the contingencies in additional research.
4. Recently Andersen and Mortensen (2010) have considered an additional aspect of
stability beyond what is included here: the stability of resource allocation. Based on
Danish public educational data, and consistent with the argument of the present chapter,
they find that budgetary stability helps organizational performance.
5. Their primary term for this set of features is “treatments,” by which they mean “primary
work or core processes or technology” (Lynn, Heinrich, and Hill 2000: 15).
6. Despite the stereotype of bureaucracy as unchanging, substantial personnel turnover
exists, and it varies greatly across public organizations (Kellough and Osuna 1995).
7. Such stability can also reduce policy churn – the adoption of frequently changing reforms
without leaving sufficient time for implementation. Policy churn is identified by Hess
(1999) as a major problem affecting urban school system performance.
8. Structural stability is largely constant across the entire sample examined in this study. We
are pursuing some additional aspects of stability in work not reported here.
9. As a result, the measure taps both stability and an aspect of capacity – the latter in the
sense of knowledge about the organization.
10. Turnover in organizations varies widely. School districts are similar to other public
organizations in the level of turnover (see Meier and Hicklin 2008).
11. We assessed the normal problems of serial correlation and heteroskedasticity in pooled
models. We include individual dummy years to control for the changes in variables from
year to year. Diagnostics showed only marginal levels of heteroskedasticity that should
not affect the results.
12. This level of exceedingly high turnover could be a behavioral symptom that, in turn,
is driven by other causes. Several of the most plausible sources of turbulence are
included in the model via the set of controls; obviously, idiosyncratic factors are not.
Since the focus of this research is to explore the influence of the impact of
180 Internal management and performance
management and stability on performance, not to explain turnover per se, the issue is
not pursued further here.
13. We also reran the analysis for a much larger sample: all 1,000þ districts in Texas. Given
the five-year time series, this exploration amounts to a 5,000-case data set. Doing so
requires dropping two independent variables derived from the survey: managerial net-
working and managerial stability. In this estimation, teacher stability maintained its
impact and is statistically significant. The impact of management quality also continues
to appear.
14. For the autoregressive form, the comparable figure is approximately 4 percent. Although
this result may not seem overwhelming, the autoregressive term means that an increase in
performance today grows the base for future increases as well, via the lagged dependent
variable, and therefore improvements reverberate forward into the future. If the improve-
ments continued indefinitely, the total impact would be 13.3 percentage points, relatively
close to the 11 percentage points without the lag.
15. Including the analysis for overall TAAS pass rate results in totals of thirty-seven properly
signed coefficients out of forty, with more than two-thirds statistically significant.
16. The sensitivity of black student TAAS performance to personnel stability at school seems
more general. Note the enhanced impact of managerial stability as well, surely an influ-
ence at some remove from most students’ day-to-day educational experience (Tables 5.2
and 5.3).
17. Note in this regard, for example, the function of M3 in our theoretical model.
18. For these analyses, the performance indicator used is the overall TAAS pass rate. The
estimations omit the lagged dependent variable but include all other controls.
19. This section treats human resources and their management seriously but is not designed
to explore McGregor’s advocacy for so-called “theory Y” over “theory X” (or vice versa).
The analysis in this section draws on that presented by O’Toole and Meier (2009).
20. We also use the 2006/7 survey in Table 5.5; that survey had a response rate of 67 percent.
Districts responding to the surveys were no different from nonrespondents on key
variables such as enrollment, enrollment growth, students’ race, ethnicity and poverty,
or test scores.
21. In addition, performance measures (the dependent variables) are reported for school
districts only if the district had performance data on five or more students. For certain
measures, such as the black pass rate on the statewide standardized exam (white subur-
ban districts) and SAT scores (more Texas college-bound students sit for the ACT
instead), some districts have no performance data reported.
22. As of 2003 the TAAS had been replaced by the Texas Assessment of Knowledge and Skills.
The results of the two examinations correlate very highly, nonetheless.
23. These items were asked on the 2004/5 survey. They were also repeated on the 2006/7
survey. The results are presented in Table 5.4 and the actual values used are from the
2004/5 survey.
24. To investigate further the causal direction, we conducted a panel version of Granger
causality analysis. The results were ambiguous, and we could not rule out reciprocal
causation for this and the other nine indicators. Measures at two time periods, particu-
larly with different respondents for some of the time periods, did not provide enough
leverage to sort this out statistically.
181 Notes
25. The analysis here draws from that presented by Meier and O’Toole (2009a).
26. This estimate is carried out on the panel so that the individual estimate for a district is
based on its entire history in the data set. The key estimation question is whether to
estimate one set of parameters for the entire data set or use individual parameters for
each district. While in theory this distinction is important, in practice the results are
correlated at 0.96. For efficiency purposes, therefore, we used the estimates based on a
single set of parameters rather than more than 1,000 sets.
27. It might be supposed that managerial quality should have something to do with organ-
izational responses to negative budgetary shocks. Analysis of the data shows no signifi-
cant effect of quality. This finding is not especially surprising, given the salary-based
quality measure used in this data set. The top managers are likely to be rewarded for what
they do on a day-to-day basis, and budgetary crises do not occur with great frequency.
6 Nonlinearities in public management:
the roles of managerial capacity and
organizational buffering
Chapter 5 mentioned that, in the classic Sherlock Holmes tale “Silver Blaze,”
Arthur Conan Doyle’s famous detective infers an important finding lurking
behind an apparent non-event.1 Similarly, in the last section of the previous
chapter we built from something that did not happen – in this case, a very
limited negative impact on public program performance even in the face of
sizable and negative budget shocks from the environment – to highlight
ways that public managers are able to protect their organizational systems
from unanticipated and unpleasant disruptions to maintain performance
in the face of adversity. Because managers made a series of decisions that
reflected key priorities and long-term goals, the “dog that didn’t bark” in this
latter instance was a set of school systems that did not appreciably suffer – at
least in the short run.
This chapter follows the earlier analysis, at the intersection of public
management and organization theory, to explore a more general process
that bureaucracies use in the face of potentially disruptive circumstances. We
first examine the question of whether and how the presence of managerial
capacity in public organizations might provide protection or support for
public agencies facing environmental battering. Apart from the day-to-day
efforts on the part of managers to encourage efficient and effective produc-
tion, in other words, we ask if reserve capacity has positive impacts on
performance. Can capacity be activated in times of crisis to protect the
organization? This is the first core research question explored here. Chapter 5
offered a crisis response that entailed a series of decisions that are highly
specific to school districts. Our purpose is to determine if more general
principles hold that could be applied to other organizations.
The role of managerial capacity is examined as one of the nonlinear relation-
ships in our theory. Essentially, we expect managerial capacity to interact with
environmental shocks to lessen their impact. After examining two kinds of
environmental shocks – budget cuts and a natural disaster – we proceed to
probe additional nonlinear aspects of our managerial theory: the relationship
182
183 Managerial capacity and budget cuts
Several recent research efforts have moved public management to the central
concern of organization theory – performance (Kelman 2008) – by offering
evidence that public management and public managers make a difference in
delivering the outputs and outcomes of public organizations (see, for instance,
Lynn, Heinrich, and Hill 2001, Meier and O’Toole 2001, 2003, O’Toole and
Meier 2003b, 2004a, 2004b, Donahue et al. 2004, Ingraham and Lynn 2004,
Andrews, Boyne, Law, and Walker 2005, Brewer 2005, Chun and Rainey 2005,
Martin and Smith 2005, Boyne et al. 2006, and Hicklin, O’Toole, and Meier
2008). Such varied managerial features as networking behavior, strategic stance,
and the stability of managerial and front-line personnel are linked to stronger
performance. What of the relative size, or capacity, of the managerial cadre,
though? The relative size of the management cadre is important theoretically
because it is a fashionable target for journalists and management consultants
who condemn bureaucracy. This chapter seeks to bring some empirical
evidence to bear on this popular nostrum.
Management capacity has attracted interest from public management
researchers and practitioners, and efforts have been made to develop data
on the relative capacity of different governmental agencies and different
units of government (Ingraham, Joyce, and Donahue 2003). These data have
not thus far been tied clearly to information about program outcomes,
however. The present chapter taps an important aspect of managerial
capacity across a large number of public organizations, and estimates the
impact of capacity in mitigating the negative performance repercussions of
downward exogenous shocks.
for near-term production, and thus as a potential for action that may not be
fully realized except under relatively unusual circumstances – when tasks can
be reassigned and central staff can directly address immediate performance-
related needs. Indeed, the central office (headquarters) is also the location
where one might expect some slack in human resources, such as it is, to be
stockpiled – if there is any conscious effort to build such slack into the system.
The logic of storing slack in administrative capacity is based on the notion of
flexibility, innovation, and relative payoffs. Adding a single person to a line
production position is likely to increase production by a marginal amount,
but that person is unlikely to be usable for other functions should the need
arise. Similarly adding a person as a line administrator could well improve
day-to-day responsiveness, but these skills would not necessarily be transfer-
able in times of emergency. Storing slack within the central office provides the
greatest flexibility, however, because a central manager can be moved from
seeking grants one week to assessing the profitability of food services the next
week to an emergency fill-in for a line manager the next. Theoretically,
organizational slack of this sort is best stored at the managerial levels, where
it translates into increased management capacity.
Earlier research and theorizing on slack can help to clarify this notion.
Thompson (1967) and Galbraith (1973; see also Pfeffer and Salancik 1978)
argue that slack can serve as a buffer to help organizations absorb and survive
the effects of shocks. Slack is therefore conceptualized as resources that can, if
needed, be mobilized as inputs for the technical core during turbulent times.
Cyert and March (1963) point out that slack can also be seen as resources
available on behalf of innovation (see also Doig and Hargrove 1990: 3).
Organizations with slack are likely to be more innovative – particularly
so when the slack is managerial. Innovative organizations are more likely
to sustain their level of performance when shocks occur given their orienta-
tion of seeking new ways of dealing with problems. Organizational slack,
therefore, including managerial slack, should be positively associated with
performance in organizations experiencing shocks.
might carry implications for performance, we model the situation even more
straightforwardly than is the case in our model introduced in Chapter 2. Here we
start with a measure of managerial capacity (Mc) and a set of environmental
forces (X) that are related to organizational performance (O):
Ot ¼ b1 Mc þ b2 Xt þ et ð6:1Þ
We want to separate out from this environmental term (X) some shock to
the system; we call it X’:
0
Ot ¼ b1 Mc þ b2 Xt þ b3 Xt þ et ð6:2Þ
From this general linear model, we add a bit of complexity based on what is
suggested in some of the qualitative literature. Specifically, we would expect
management, or some forms of management such as managerial capacity, to
interact with the environmental shock and reduce the impact of the shock
on the organization. Specifically, we operationalize the following model,
which includes such an interaction:
Ot ¼ b1 Mc þ b2 Xt þ b3 X0t þ b4 Mc X0t þ et ð6:3Þ
Essentially, the argument that managerial capacity, once mobilized, can
mitigate environmental shocks suggests that b3, the coefficient for the shock,
should be negative but that b4, the coefficient for the interaction term,
should be positive and of such a magnitude as to cancel out the negative
impact of the shock.
The present analysis uses data drawn entirely from the Texas Education
Agency for eight years (1995 to 2002) for a total of 8,329 cases for analysis.
Missing data on individual items reduces this number somewhat in individ-
ual equations. We are interested, then, in budgetary shocks, managerial
capacity, and their performance consequences, while we control for a set
of other influences. Each of these variables is introduced in turn.
Measuring shocks
Our budget shock measure, introduced in Chapter 5, follows Ratts (1999),
who examines economic shocks to national economies. We regress total
school district revenues (logged) on its logged values for the prior year. As
188 Nonlinearities in public management
Managerial capacity
To deal with a shock to the organization, one would expect managers to
mobilize the available managerial capacity to analyze the nature and extent
of the shock and design strategies for mitigating the impact on the organiza-
tion. Without some surplus capacity, one would expect that the reallocating
of managerial time to deal with the shock would result in lower performance
in the short term, as managers – particularly line managers – neglect their
day-to-day duties in order to deal with the shock. Our measure of manager-
ial capacity is the percentage of school district employees engaged in central
office administration. This includes the superintendent, assistant superin-
tendents, the basic administrative support staff (budgeting, personnel, etc.),
and any centralized analytical capability. Capacity measured this way is
relatively common in the empirical studies of organizations (Dalton et al.
1980). Texas school districts are exceptionally lean in terms of administra-
tion. The average district during this time period had only 1.89 percent of
total employees allocated to central office administration, with a standard
deviation of 1.42. Nine out of ten school districts had between 0.71 percent
and 3.54 percent central administrators.
Performance indicators
A preliminary analysis incorporated ten different performance indicators
in an effort to determine how budget shocks affect a variety of organiza-
tional outcomes. The results in the analysis indicated that, for most of the
performance measures, managers were able to reallocate funding and staff
in ways that resulted in no statistically significant reductions in perform-
ance. For three of the ten measures there were negative performance
impacts in the year in question and/or in the following year (see Chapter 5).4
We focus in this section entirely on these three indicators – the Texas
Assessment of Academic Skills, the percentage of students who took either
189 Findings
the SAT or the ACT, and the percentage of students who score above 1,110 on
the SAT (or its ACT equivalent). Since these measures cover both the core task
of the organization and the more difficult high-end objectives, they should
provide a good overall view of how the organization deals with shocks.
Findings
Our first question is to ask what the impact of a budget shock of 10 percent
or more is on the performance of the organization. Because organizations
are highly autoregressive systems, they might be able to shrug off the impact
of a shock immediately by short-term adaptations but absorb greater losses
as a result in future years. The analysis in Chapter 5 revealed that budget
shocks affected the organization in the first and second years but had
no impacts in the third and fourth years. Accordingly, we include both
the initial shock to the organization and a shock that is lagged by one year.
Table 6.1 provides a regression of overall TAAS rates on a budget shock while
controlling for the other resources and constraints of the organization.
A budget shock has only a modest impact on the organization’s performance
in the first year; it results in only a drop of one-half of a point in TAAS
performance, all other things being equal, and this relationship is statistically
significant only if we use our directional hypothesis and a 0.1 one-tailed test
of significance. The impact of the shock in the second year is much stronger,
however, and clearly significant (a drop of about one percentage point in the
TAAS pass rate).
The impact on examination pass rates, particularly the delayed impact, is
clearly an important finding. Given how important school districts’ performance
on this metric is considered, it seems clear that, despite short-term efforts to
190 Nonlinearities in public management
Table 6.1 The impact of a 10 percent or greater budget shock on students’ state
examination performance
R2 0.61
Standard error 7.66
F 773.71
N 8,321
Notes: Dummy variables for individual years not reported. * ¼ significant at p < 0.05,
one-tailed test. Time period ¼ 1995–2002.
protect the educational system from disruption, they are not completely success-
ful. School system superintendents overwhelmingly identify TAAS performance
as their highest priority (see Chapter 5), and budget shocks certainly impede that
objective.
Table 6.2 shows the impact of a 10 percent or greater budget cut on
the other two performance indicators – the percentage of students who take
either of the two standard national college entrance examinations and the
percentage of students who score above 1,110 on the SAT or its ACT
equivalent. For the former, the estimation shows that a budget shock reduces
the test taking rate by approximately 1.39 percentage points in the first
year – a sizable drop. This reduction in the performance criterion may be
due in part to efforts to maintain and protect other key educational activ-
ities. There is no statistically significant impact of the budget shock in the
following year, however. The second set of regression results reported in
the table show that the percentage of students who score 1,110 or above on
the SAT – a level designated by the state of Texas as “college-ready” – drops
by approximately 1.28 percentage points in the first year of the budget hit
191 Findings
Table 6.2 The impact of a 10 percent or greater budget shock on the performance of college-bound
students
R2 0.14 0.30
Standard error 15.18 10.07
F 71.00 189.56
N 7,449 7,526
Notes: Dummy variables for individual years not reported. * ¼ significant at p < 0.05,
one-tailed test.
and then another 0.8 percentage points in the next. The total impact on
the college-ready student cohort is a matter of real concern. On average, only
19 percent of students meet this criterion; a drop of 2.08 percentage points
over two years, therefore, translates into an 11 percent drop in students
meeting this criterion.
Table 6.3 examines whether managerial capacity can mitigate the impact
on the TAAS pass rate of a 10 percent or greater budget cut. Because we are
estimating the shock in both the first year and the second year, we add the
interaction of managerial capacity with both these shocks. The estimations
control for all variables included in Table 6.1, but only the relevant coeffi-
cients are presented. The intuition about an interaction term is that the
slope of a relationship (between shocks and performance) changes contin-
gent on the value of some other variable (management capacity). To see how
this occurs, we illustrate using the impact of the shock in the first year. To do
this we need both the shock coefficient and the interaction coefficient:
O ¼ 1:24 shock þ 0:28 ðshock capacity Þ
192 Nonlinearities in public management
R2 0.61
Standard error 7.64
F 661.02
N 8,319
Notes: Equations also control for teacher salaries, class size, teacher
experience, noncertified teachers, percentage state aid, percentage of
Latino students, percentage of black students, percentage of low-income
students as well as dummy variables for individual years. * ¼ significant at
p < 0.05, one-tailed test.
If we rearrange the terms, we get an equation that tells of the impact of the
budget shock – that is, the slope – at any level of managerial capacity:
O ¼ ð1:24 þ 0:28 capacityÞ shock
Various values can be substituted into this equation to calculate the effect of
a shock at a stipulated amount of managerial capacity. For example, an
organization with only 0.71 percent central office staff (the tenth percentile)
would suffer a reduction of about 1.04 in the TAAS pass rate that first year.
In contrast, a well-staffed central administration of 3.54 percent (the nineti-
eth percentile) would suffer a negative impact of only 0.26 points – a result
that is itself not statistically significant.
For the second year of the shock, a similar set of calculations can be made.
The equation for the slope is
O ¼ 2:25 lagged shock þ 0:50 ðlagged shock capacityÞ;
or
O ¼ ð2:25 þ 0:50 capacity Þ shock
193 Findings
To illustrate, then at the tenth percentile we would see a drop of about 1.89
percentage points, and at the ninetieth percentile the result would be –0.48
percentage points.
Two important calculations can be made with these relationships. The
first is to estimate where the slope of the line becomes zero and thus the
shock has no impact on the organization at all. This can be done by
taking the first derivative of the expression with respect to shocks and
setting the result equal to zero. For the first year of the shock, this occurs
when central office staff exceed 4.41 percent of total employment (about 5
percent of the cases); for the second year of the shock, the respective value
is 4.48 percent, or essentially the same level. One can also take the
formula for the confidence limits and calculate when the slope ceases to
be statistically distinguishable from zero (or statistically significant, in
layperson’s terms). For the first year of the shock, that occurs when
management capacity exceeds 0.764 percent (well below the mean); for
the second year of the shock, this occurs at 2.38 percent central adminis-
tration – a level exceeded by 24 percent of all school districts. In short,
greater management capacity appears to mitigate the negative impact of
budget shocks on the TAAS, and the level of capacity is well within the
range of existing organizations.
What about management capacity’s impact on what budget shocks do to
the number of students undergoing college testing? The first two columns of
Table 6.4 show the results of a regression constructed in a fashion parallel to
that for the TAAS pass rate. For this performance measure, the shock has
no impact in the first year if the management capacity measure reaches
4.01 percent of total staff – a value exceeded in 7 percent of the districts. In
the second year, districts with a central staff larger than a mere 0.34 percent
experience no negative, lagged impacts from the budget cut. Almost all the
districts – 97.9 percent – have this minimum level of managerial capacity.
The slope ceases to be statistically different from zero in the first year at a
managerial capacity value of 2.49 percent (23 percent of the districts), and
in the subsequent year at central staff size of 0.33 percent and above
(98.1 percent of the districts).
Finally, the last two columns of Table 6.4 report the results for the
percentage of students scoring above 1,110 on the SAT or its ACT equiva-
lent. The budget shock has no effect in the first year when central staff are
3.70 percent or more of the total district employment (9 percent of all
districts) and no effect in the second year when managerial capacity equals
or exceeds 1.21 percent (64.2 percent of all districts). The slope ceases to
194 Nonlinearities in public management
Table 6.4 The impact of a 10 percent or greater budget shock on the performance of
college-bound students
R2 0.14 0.30
Standard error 15.17 10.05
F 61.14 163.66
N 7,449 7,526
Notes: Equations also control for teacher salaries, class size, teacher experience, noncertified
teachers, percentage state aid, percentage of Latino students, percentage of black
students, percentage of low-income students as well as dummy variables for individual
years. * ¼ significant at p < 0.05, one-tailed test.
Implications
The units of analysis are all Texas school districts with 500 or more stu-
dents.8 The smaller districts are excluded from study here because these
units often have highly fluctuating test data (our dependent variable meas-
uring performance) that are overly sensitive to the handful of students who
are examined. In such cases, the ability to control for past performance is
limited, and so the estimation of how much an intervention event affected
performance may be biased or inefficient. The 703 school districts included
in the study range widely on a variety of dimensions, including student
composition (race, ethnicity, etc.), resources, setting (urban, rural, subur-
ban), and performance.
Control variables
Our theory specifies an autoregressive model, and that fits well the logic
undergirding the notion of environmental shocks. Our analysis, therefore,
includes the 2005 TAKS pass rate in all models that estimate 2006 perform-
ance impacts.12 The post-hurricane TAKS results are thus assessed relative to
the pre-hurricane TAKS results (a before–after research design). Although
such an estimation controls for the history of the school district by incorpor-
ating it in this lagged dependent variable, other changes in school district
resources or constraints could also affect performance for 2006. To control
for these factors, we include our five measures of resources and three
measures of constraints. All eight of these measures are change, or
202 Nonlinearities in public management
Table 6.6 Environmental shocks and student performance: the impact of students and missed
class days
Notes: T-scores in parentheses. * ¼ significant at p < 0.05, one-tailed test. Time period ¼ 2005/6.
differenced, measures – that is, they measure the change in the variable from
2005 to 2006. All the impact of the variables’ levels – e.g. if resources act as a
stock of capital rather than a flow – should be reflected in the lagged
dependent variable.13
Findings
Table 6.6 presents our findings for the impact of the two environmental
shocks on the Texas school districts. These shocks are estimated separately
(columns 1 and 2) as well as simultaneously in the same equation (column 3).
The third column with both shock measures included in the model shows
that a one percentage point increase in Katrina students (as a percentage of
the student body) is associated with a drop in the TAKS all-pass rate scores
of 0.437 percent (p < 0.05, one-tailed test). Although some of this drop
might have been the result of the originally enrolled students not doing well
as the result of more crowded classes and other factors, this effect size is the
203 Findings
equivalent of 43.7 percent of Katrina evacuees failing the TAKS (in contrast
to the statewide average of 33.6 percent). The maximum total impact
of Katrina students on district performance, based on the maximum of
5.42 percent evacuee students, is approximately 2.4 points on the TAKS
pass rate.14
The missed class days variable has a similar negative and statistically
significant impact on TAKS scores. Each additional day (above five total
days) that schools were closed is associated with a decline in TAKS scores of
0.131 percentage points on the pass rate. Based on the largest value of days
closed (twenty-nine), the maximum impact on performance in districts
suffering from closed schools is estimated to be approximately 3.1 points.15
The remaining factors in the equation are generally consistent with past
research. Clearly, the autoregressive term dominates the equation; it espe-
cially does so given the limitation to districts with 500 plus students. This
point is reflected in the extremely high coefficient of determination account-
ing for 91 percent of the variance in 2006 TAKS scores. Of the differenced
measures, only class size reaches the 0.05 level of statistical significance; an
increase in class size from 2005 to 2006 was associated with a (predictable)
drop in TAKS scores.
Estimating the performance results of the hurricane shocks raises the
important theoretical question of how the districts responded to the
shocks and whether there were factors that could have (or in some
districts did) mitigate(d) these negative results. An analysis of the
residuals from the equations in Table 6.6 confirms that the hurricane-
impacted districts include both positive and negative residuals; some
districts were able to take one or both shocks and still outperform
expectations. East Chambers Independent School District, for example,
was closed for twelve days and had slightly more than 1 percent of its
study body as Katrina students, yet the district scored 6.9 percentage
points above the regression line.
The parsimonious theory of public management that we use implies
that districts might mitigate shocks in one or more of three fashions:
through the stabilizing effects of structural (and other) elements, the
operations of management in supporting and reinforcing performance-
related operations, and/or the inertia that carries established practices
forward into the future (past performance). The easiest explanation to
consider is that for past performance. Prior performance is already in the
model as part of the autoregressive estimation; for past performance to
matter more than it does in Table 6.6, it would have to interact with either
204 Nonlinearities in public management
Table 6.7 Administrative capacity can overcome the impact of environmental shocks
Notes: T-scores in parentheses. * ¼ significant at p < 0.05, one-tailed test. Equations also
control for change in teacher salaries, per student instructional funds, class size, teacher
experience, noncertified teachers, black students, Latino students, and low-income students.
We can then use this equation to draw a line that will show the impact
of a day of school lost at various levels of administrative capacity (see
Figure 6.1). This figure, which also displays the 95 percent confidence
limits, indicates that, at low levels of administrative capacity, the impact
of missing a day of class is negative and statistically significant. As the
level of central administration increases, however, this negative impact
becomes less, and it becomes statistically indistinguishable from zero at
approximately 1.0 percent of central administrators. The slope equation
can be set equal to zero to get a point estimate of when the negative
impact ceases – that is, has a slope of zero; this occurs when central office
administration is equal to 2.33 percent of total employment. The equation
actually shows a positive slope at very high levels of central adminis-
tration, but this can be ignored for two reasons: these values are not
statistically different from zero, and only a small percentage of districts
have central administration percentages that are high (forty-eight of the
703). The logical conclusion is that, as central administrative capacity
grows, it gradually eliminates the negative impact of the environmental
shock on performance.17
Table 6.7 also shows that central management capacity has a similar
impact on the shock of Katrina evacuee students (see also Figure 6.2). The
impact of evacuee students is strongly negative and statistically significant at
206 Nonlinearities in public management
0.5
–0.5
0 1 2 3 4
Percentage central administration
Figure 6.1 The marginal impact of missed school days contingent on managerial capacity
Effect on performance (change in pass rate)
4
Marginal effect of percentage of displaced students
95% confidence interval
–2
0 1 2 3 4
Percentage central administration
Figure 6.2 The marginal impact of Katrina students contingent on managerial capacity
Implications
Natural disasters are a different type of shock from budget cuts because there
is no advance warning. As such, a natural disaster is a rigorous test of
the management capacity hypothesis. Indeed, the two hurricanes did reduce
the overall level of TAKS scores in the district (either by the influx of
students or the school closures). Management capacity interacted with these
shocks, however, and was able to reduce their impact on performance. In
short, management capacity operated as organizational slack and had an
important nonlinear impact in crisis situations.
The previous two sections have demonstrated the crucial role of managerial
capacity in dealing with budget cuts and major shocks to the organization
such as a natural disaster. In both cases, managerial capacity had nonlinear
impacts to mitigate the negative consequences of the shock. These findings
raise the question of whether or not managerial capacity is also useful in
other management efforts and if the impact continues to be in nonlinear
interactions with other factors. One potential candidate for such a set of
relationships is managerial networking, a management activity that has
demonstrated substantial impact on performance. This section investigates
whether managerial capacity can enhance the impact of networking.19
The literature often emphasizes the necessity for – and benefits of – networking
efforts, but effective managerial action entails costs as well. Various reasons thus
suggest the plausibility of the idea that the performance-related effects of man-
agerial networking are likely to be contingent on the capacity of the managerial
cadre to perform or assist with such functions.
This point can best be seen by considering what managers typically do
when they interact with others in their networked environment. Most public
managers face an environment with myriad potential actors who might be
useful to the “core” organization and/or might seek to impede the organiza-
tion in its effort to attain its goals. These actors, in turn, are frequently
linked with yet others (Scharpf 1993, 1997).
Public managers face the prospect of sorting through a potentially large
series of interactions with other actors, individual and corporate. Some
interactions are sure to be mandatory; some are voluntary; and some
contain elements of both. Certain interactions may be one-shot, but, in
208 Nonlinearities in public management
the longer term implementation of policy, managers would need to take into
account repeat pattern formulations (see Stoker 1992). The manager must
decide which external actors to engage; how to indicate this intention and
initiate contact; and, if engagement takes place, what strategy to take. Any
such externally oriented action entails some opportunity costs; managers
cannot do everything at once. There may also be some networking inter-
actions in which both (all) actors will, on average, be better off; some zero-
sum patterns; and some negative-sum interactions in which the strategy will
be to limit losses.
In any of these, the manager has to convince the other actor(s) to engage
and to cooperate – that is, to contribute positively to the manager’s organ-
ization or program. While success might occasionally be achieved through
sheer persuasion, the manager typically must bring something to the inter-
action. Such inducements might be in the form of monetary resources,
superior information, or the capacity to take action if some consensus is
reached. By “bearing gifts” in these exchanges, the manager can offer
something of value to induce the other actor(s) to participate. In principle,
therefore, the payoff from managerial networking will be contingent in part
on the creativity a manager displays in identifying attractive options (a form
of capacity), the inducements that the manager brings to the interaction
(resources), and the ability to convert the results into concrete gains
(another aspect of capacity).
This formulation implies that managerial networking – that is, making
contacts with key actors in the environment for the purposes of identifying
and implementing mutually acceptable, even attractive, jointly determined
decisions – will depend on the resources, broadly construed, that the man-
ager possesses. Managerial capacity can be expected to be one crucial
resource needed to operate effectively in an interdependent environment.
Sorting through such complicated institutional terrain and making the
most appropriate strategic moves, therefore, calls for a considerable amount
of informational and cognitive capacity (Simon 1997). In complex public
management settings, this requirement can perhaps be met via managerial
capacity. Greater managerial capacity can contribute to the choice among
interactions in which to engage, and how. Nor is this all; engaging the right
partners in an appropriate way does not ensure successful completion.
Greater managerial capacity can be used to implement whatever agreement
occurs in the networking process. An environmental actor might even be
more willing to participate if he or she perceives that the manager has the
ability to transform the network discussions into reality.
209 Modeling the impact of managerial capacity
For the empirical portion of this study, the units of analysis are all Texas
school districts. In this analysis we include eight years of performance data
(1995 to 2002) and supplement these with data from an original manage-
ment survey. The survey had a 55 percent response rate, and when combined
with the archival data produces 4,114 total cases for analysis. Missing data
on one of the performance indicators reduces the total number of cases to
3,798 in that case.20
A pooled time-series analysis such as this one needs to be concerned with
violations in the assumptions of multiple regression, particularly serial cor-
relation and heteroskedasticity. Assessments of the equations showed serial
correlation, so a set of dummy variables for individual years was included in
the analysis as an adjustment. Pooled diagnostics for heteroskedasticity
211 Data and measurement
Table 6.8 How the interaction of managerial networking and managerial capacity affects
organizational performance
R2 0.64 0.64
Standard error 7.13 7.12
F 341.43 326.14
N 4,114 4,114
Notes: Equations also control for teacher salaries, class size, teacher experience, noncertified
teachers, percentage state aid, percentage of Latino students, percentage of black students,
percentage of low-income students as well as dummy variables for individual years. Time
frame 1995–2002.
Findings
First we can illustrate the problem with direct interpretation of the unin-
teracted slopes in an equation such as this. The formula above says that,
when capacity is zero, the slope of networking’s impact on TAAS perform-
ance is 0.905, or a one standard deviation change (M2 is a factor score) in
networking is associated with an increase of 0.905 percentage points on the
TAAS, all other things being equal. This is the equivalent of the zero-order
slope listed in the table; but, since there are no school districts with no
central office administrators, this part of the relationship is well beyond the
range of the data. The best way to interpret the interactive slope is to include
representative values of capacity and then calculate the slope of networking
at those levels of capacity. We do such a calculation using the mean value
of capacity, as well as values one standard deviation above the mean and
one standard deviation below the mean. These calculations produce the
following results.
0.46 0.964*
1.89 1.149*
3.32 1.333*
1.0 0.109
0.0 0.149
þ1.0 0.278*
Table 6.9 How the interaction of managerial networking and managerial capacity affects
organizational performance: attendance
R2 0.26 0.26
Standard error 0.74 0.74
F 69.58 66.70
N 4,114 4,114
Notes: Equations also control for teacher salaries, class size, teacher experience, noncertified
teachers, percentage state aid, percentage of Latino students, percentage of black students,
percentage of low-income students as well as dummy variables for individual years.
0.46 0.047*
1.89 0.074*
3.32 0.101*
1.0 0.080*
0.0 0.099*
þ1.0 0.108*
Table 6.10 How the interaction of managerial networking and managerial capacity affects
organizational performance: college readiness
R2 0.32 0.32
Standard error 9.60 9.60
F 84.36 80.81
N 3,798 3,798
Notes: Equations also control for teacher salaries, class size, teacher experience, noncertified
teachers, percentage state aid, percentage of Latino students, percentage of black students,
percentage of low-income students as well as dummy variables for individual years.
Again, the interaction shows that the impact of managerial capacity on absentee-
ism increases when the superintendent engages in more effort to manage exter-
nally in the network. The relative increase from low to high (35 percent) is not as
large as it is for the networking increase contingent on capacity (118 percent), but
the impacts are strong and statistically significant at all levels.
The college board scores variable (see Table 6.10) has a different relationship
for managerial networking and performance in the noninteracted equation.
While managerial networking is strongly related to performance in a positive
direction, the relationship for managerial capacity is negative and significant.
Our experience in interviewing superintendents suggests that the negative
relationship for capacity, in part, reflects tradeoffs that superintendents have
to make. Resources committed to central office administration are resources
that cannot be committed to other programs, particularly to programs that
217 Implications
enhance the performance of the best students. Although the choice might not
always be so stark as whether to hire an advanced placement calculus teacher or
an attendance officer instead, once such hires are made they create a path
dependence in the short term, since the individuals are not fungible.
The interactive relationship shows that increases in managerial capacity
have a dramatic impact on the influence that networking has on the college
boards indicator, specifically the following.
0.46 0.366*
1.89 0.819*
3.32 1.272*
1.0 1.128*
0.0 0.811*
þ1.0 0.494*
Implications
Measuring buffering
emergency response unit such as a SWAT (special weapons and tactics) team
or Delta Force. For school districts, the organizations examined here, the
response to the children of migrant workers provides an excellent illustra-
tion of buffering. The Houston Independent School District begins the
school year with about 176,000 students, with enrollment then peaking at
210,000 in November. To buffer its schools from this turbulence, HISD has
created student intake units to conduct immediate assessments of the
students (language, grade level, special needs) and assign them to appropri-
ate classes. These bilingual assessment units operate as what Lynn (2005: 41)
terms “absorbed slack,” and thus process the environmental influx and allow
schools to continue to function in regular ways.30
Second, management itself could engage in a set of buffering activities.
Management might decide that certain environmental events or influ-
ences will be ignored, while others will require the intervention of top
management, and still others should be programmed for response by
specific units – say, an accounting office primed to handle external audits
or other challenges regarding expenditures. School systems sometimes
establish their own police forces to deal with security and crime problems
rather than rely on the double environmental shock of a crime and the
arrival of an outside police force. Such a unit allows management to set
procedures for dealing with minor crimes without involving local law
enforcement. This buffering component of management (which is termed
M4) might be an ancillary function of management’s effort to interact
with the environment (M2) – that is, while seeking external opportunities,
managers can also identify negative or threatening forces. We can consider
including both aspects of management, therefore, in the model eventually
specified here.
Because the buffering function itself is a combination of both structure
and management, we opt for a unified measure of overall buffering (in lieu
of trying to separate out the two processes), stipulate operational definitions
of each, and then simultaneously test these concepts and the various ways
they could combine. This simplification then allows as a first step a valid-
ation of the measure of buffering as dampening, and an effort to probe how
it affects performance. If this effort is successful, future research will permit
an examination of exactly how the buffering process is developed and
operated.
How might we get an organizational measure of buffering? If we start with
the basic principle that organizations are autoregressive systems – that what
they do today reflects what they did yesterday – then an examination of how
223 Measuring buffering
Even five years later, all other thing being equal, the environmental disturb-
ance retains nearly 60 percent of its impact for the first organization but has
fallen all the way to a 17 percent impact in the second.32 In organization-
theoretical terms, we think of the first unit as tightly coupled internally; any
disturbance, however slight, will reverberate through the organization for a
substantial period of time (see Meyer and Rowan 1977 and Powell and
DiMaggio 1991).33 The second organization is more loosely coupled internally
(probably decentralized but with absorbed slack; see Lynn 2005: 41); events
dissipate more quickly over time. This is the pattern that one would expect to
see if the organization had established structures and used managerial pro-
cesses to buffer or reduce the impact of environmental events or forces over
time.34 Loose coupling permits an organization to make a mistake and correct
that mistake without endangering the organization (Lynn 2005: 49). In this
224 Nonlinearities in public management
does not attempt to separate out the individual influences of structure and
management. We use this strategy because we are interested in probing the
complex functional forms in our model of management.
Our strategy of analysis is to make some simplifying assumptions in the
model and proceed to test this notion of buffering as dampening, and its
various functional forms, in a step-by-step process. We start with the base
model in Equation (6.7) and regroup the elements in the second term of the
model to cluster stability and M4 together as follows:
Ot ¼ b1 ðS þ M1 ÞOt1 þ b2 ðXt M3 Þ=ðSe M4 Þ þ et ð6:12Þ
In this model, buffering generates a highly complex reciprocal relationship
that interacts with M3 and Xt (that is, Se M4 is divided into XtM3). We then
simplify this model by focusing solely on the second term of the model, thus
eliminating the autoregressive term as in Equation (6.13).36 The rationale is
that the current investigation focuses entirely on how environmental influ-
ences (the X vector) shape performance and may be mitigated by buffering.
These elements of the model all appear in the second term.
Ot ¼ b2 ðXt M3 Þ=ðSe M4 Þ þ et ð6:13Þ
Because (6.13) is a highly nonlinear form, we investigate whether the
relationships are actually this complex. To do so, we move to the simplest
possible option: a linear additive model for all variables. Equation (6.14)
displays this linear model, and also includes another term (M, operational-
ized below) to represent any other relevant management influences:
Ot ¼ b1 M þ b2 Xt þ b3 M3 þ b4 ðSe M4 Þ þ et ð6:14Þ
(6.14) becomes the basis for the first model that we test. The exact model to
be tested is based on measures developed earlier, particularly a measure of
M2 used in place of M3:
Ot ¼ b1 M þ b2 Xt þ b3 M2 þ b4 ðSe M4 Þ þ et ð6:15Þ
This model now contains a direct test of whether buffering, the last-listed
term in (6.15), contributes to performance. Then we add to this model in a
series of incremental steps to determine if more complex forms of the
relationships are warranted. First, we determine if including a reciprocal
relationship for buffering adds any additional information to the analysis, by
estimating Equation (6.16):
Ot ¼ b1 M þ b2 Xt þ b3 M2 þ b4 ðSe M4 Þ þ b5 ð1=Se M4 Þ þ et ð6:16Þ
226 Nonlinearities in public management
We use eight years of data (1995 to 2002) from the Texas Education Agency
on organizational performance, resources, student composition, and other
relevant factors and results from our 2000 survey. Because this is a pooled
time-series analysis, we included dummy variables for the individual years to
deal with serial correlation. We then assessed the degree of heteroskedasticity
with pooled diagnostics and found the levels well within acceptable limits.
Our measure of buffering, as explicated in the preceding section, is unity
minus the correlation of school district outcomes for the period 1986 to
1994. Given that the primary statewide standardized test (the TAAS) is the
central outcome in the state’s performance appraisal system, we calculated
the buffering measure for that outcome and used it as a measure of buffering
in equations using TAAS or other outcomes as the dependent variable. The
final measure has a mean of 0.49 with a standard deviation of 0.20; it ranges
from 0.03 (a very tightly coupled system, with reverberations important over
time) to 0.999 (a school district well protected from the impacts over time of
environmental disturbances).
outcomes: the overall student pass rate on the Texas Assessment of Academic
Skills, TAAS scores for Anglo, black, Latino and low-income students, the
percentage of students who took either of the college board exams, the average
ACTscore, the average SATscore, the percentage of students who scored above
1,110 on the SAT (or its ACT equivalent), and attendance rates.37
Findings
The linear model estimates for the specification in (6.15) with the dependent
variable as the most prominent outcome measure – the overall TAAS pass
rate – are found in Table 6.11. The buffering variable is positively related to
overall performance, even controlling for a series of management variables
(M) as well as a set of variables covering a series of resources and constraints
(X). The inclusion of these controls supports the conclusion that buffering
itself matters rather than some combination of positive environmental
factors. Although the unstandardized coefficient looks large, the range of
the buffering variable is between zero and one, so this slope indicates a
maximum impact of 3.2 percentage points on the TAAS. In comparison, this
size represents approximately half the possible impact of that attributable to
the managerial networking variable. Although our concern is with the
buffering measure, the other relationships for the management variables
are consistent with earlier research: each variable is statistically significant,
and all of them except contact with the school board are positively associated
with performance.
Table 6.12 presents abbreviated information from nine additional regres-
sions, each representing the model specified in Equation (6.15) and one for
228 Nonlinearities in public management
R2 0.64
Standard error 7.10
F 345.04
N 4,114
Notes: Equations also control for teacher salaries, class size, teacher experience, noncertified
teachers, percentage state aid, percentage of Latino students, percentage of black students,
percentage of low-income students as well as dummy variables for individual years.
Notes: All equations control for the five management variables, teacher salaries, per student
instructional funds, class size, teacher experience, percentage of teachers not certified,
percentage of black, Latino and low-income students and yearly dummy variables.
* ¼ significant at p < 0.05, two-tailed test.
each of the other dependent variables. The top four lines deal with the
impact on TAAS scores for various subsets of students. In each case, greater
buffering is associated with higher student scores. The pattern of these
coefficients is interesting. Without question, the greatest impact of buffering
is for African American students – an impact five times larger than the
229 Findings
relationship for Anglo students. Similarly, the impact for low-income stu-
dents is substantially larger than that for all students; the Latino impact,
while only marginally larger, is still greater than that for Anglos. This pattern
of results suggests that buffering is particularly valuable for the least advan-
taged of the organizations’ clientele – a finding that is especially interesting
given that managerial networking tends to be associated with gains for more
advantaged groups (see the analysis in Chapter 3).
Buffering also has additional impacts, as a glance at the other relation-
ships in Table 6.12 attests. Attendance is a basic minimum performance
indicator that is focused on disadvantaged rather than well-off students.
Although attendance does not vary a great deal and is difficult to affect,
buffering is positively related to attendance. We suspect that, if attendance
rates were analyzed by race, some larger relationships would appear for non-
Anglo groups. For the more elite measures, on the other hand, buffering
does not do as well. It is associated with more students taking college boards,
but it is also associated with lower scores on the ACT. Neither SAT scores nor
the college-ready percentage is significantly related to buffering. Again, these
relationships could be interpreted as consistent with the notion that buffer-
ing benefits the more disadvantaged clientele. Expanding the number of
students who take the college boards is a policy that benefits students who
would not otherwise go on to college.
Having established that buffering is associated with organizational perform-
ance, we turn to determining if the functional form specified by the theory is
correct. Table 6.13 adds the reciprocal of the buffering variable to the ten
equations represented in Tables 6.11 and 6.12, thus summarizing ten estima-
tions for Equation (6.16), one for each performance measure. If the reciprocal
functional form were to add explanatory power, over and above a linear
specification, we should find that the coefficients for this reciprocal variable
are statistically significant. In seven of the ten cases, the reciprocal relationship
fails to attain the 0.05 level of statistical significance. If the case of SAT scores
with the negative relationship is dismissed, there are only two cases for which
the nonlinear form appears to contribute: low-income pass rates and attend-
ance. In both cases the relationship is not strictly linear, but the increase in the
overall level of explained variation is minimal. The linear coefficient holds up
better than the nonlinear version. An overall conclusion, then, should be that –
in trimming with Occam’s razor – the relationship between buffering and
organizational performance is linear rather than nonlinear.38
Table 6.13 tests a simple reciprocal relationship, while the full theory
specifies that buffering as a reciprocal relationship interacts with managerial
230 Nonlinearities in public management
Linear Reciprocal
Notes: All equations control for the five management variables, teacher salaries, per student
instructional funds, class size, teacher experience, percentage of teachers not certified,
percentage of black, Latino and low-income students and yearly dummy variables.
* ¼ significant at p < 0.05, two-tailed test.
Table 6.14 Does the interaction with M2 add explanation to a linear model?
Notes: All equations control for the five management variables, teacher salaries, per
student instructional funds, class size, teacher experience, percentage of teachers not
certified, percentage of black, Latino and low-income students and yearly dummy variables.
* ¼ significant at p < 0.05, two-tailed test.
Notes: All equations control for the five management variables, teacher salaries, per student
instructional funds, class size, teacher experience, percentage of teachers not certified,
percentage of black, Latino and low-income students and yearly dummy variables.
* ¼ significant at p < 0.05, two-tailed test.
terms for both networking and buffering, these coefficients are reported in
the table as well, in case the interaction achieves statistical significance at the
expense of inducing collinearity in the other parameter estimates. In only
three cases – overall TAAS scores, the Latino TAAS rate, and SAT scores – is
the interaction term statistically significant. In all three cases, the sign of the
ratio interaction coefficient is the opposite of the two nonlinear terms (one
indicator of collinearity),39 the size of the coefficients is not large, and the
coefficients of determination increase only marginally (not shown).
A conservative interpretation of the results in Table 6.14 is that the relation-
ship between networking and buffering regarding performance is linear
rather than a more complex nonlinear interaction.
The other possible nonlinear interaction is with the “X” variables repre-
senting external resources and constraints (Equation (6.18)). Because there
are eight such X variables, and a set of eight interaction terms would
generate an excessive number of coefficients, we converted and simplified
the interaction term by first regressing performance on the eight environ-
mental factors and saving the predicted values. This step creates a vector that
contributes the full amount of explained variation to the dependent variable.
Then we ran ten regressions, one for each of the dependent variables, with
the complete set of independent and control variables and included an
interaction term between this new resources vector and the reciprocal of
the buffering measure. These results are reported in Table 6.15. Again, the
232 Nonlinearities in public management
findings are not impressive enough to conclude that the nonlinear inter-
action term is a superior specification to the linear additive specification, at
least for this set of data. Only three of the interaction terms meet the
minimum level of statistical significance, and only one of these, for attend-
ance, appears to add anything more than a minimum level of explained
variation.
By examining the functional form of the buffering relationships in com-
parison with a linear additive model, we find that the nonlinear estimations
produce some interesting individual results but are not demonstrably super-
ior to the linear additive ones. In such a circumstance, the principle of
Occam’s razor holds that the simpler linear models are to be preferred. This
finding does not mean that these relationships are linear or noninteractive in
all circumstances. For instance, in this analysis we have not probed subsets of
the sample to determine if high performers or low performers operate in a
manner different from the median organization (see Chapter 4). Nor have
we examined different or unusual combinations of the resources and con-
straints provided or imposed by the environment (turbulent or stable
environments) to see if selected configurations might produce different
results regarding the functional form among these variables. All the same,
the results here do indicate that the rather more complicated specification
entailed in the full model is not necessary in at least some important
empirical cases.
Implications
In this section, we have treated buffering as a combination of managerial
efforts and structural features that limit the impact of environmental forces
on public organizations’ performance over time. Rather than differentiating
the micro-details of managerial buffering activities, which could be quite
subtle and varied, or the structural forms that buffers might take, we have
developed a buffering measure that is designed to tap all these by encom-
passing the results of buffering over a several-year period prior to the period
under direct examination. Developing such a measure has been particularly
helpful, in that it does not rely on the details of structural form or
managerial action but, instead, gathers their accumulated influences into
a single measurable term – one that can be tapped for many organizations.
We have used the measure to estimate the impacts of buffering, and also to
explore some theoretical expectations about the functional form of its
influence.
233 Findings
The results provide not only some support for the model’s assertions
but also some Occam-guided negative findings. A key bottom line is that
buffering can help performance. In seven of the ten linear estimations, this
conclusion is supported. In only one of the ten equations does buffering have
a statistically significant impact in the direction of impairing performance.
This general support for the buffering function appears in a set of well-
specified models that contain five other management influences and eight
controls for resources and constraints. These control variables rule out many
alternative explanations for performance fluctuations, such as socioeconomic
differences among the districts or personnel and management activities. It
seems clear, therefore, that the protection of organizational production from
potentially disturbing influences can be an important function for those who
care about performance, even if “protection” sometimes comes at the price of
missed opportunities to tap new resources or acquire new support or juris-
diction. To put the point another way: public organizations can benefit both
from protecting their operations internally – for instance, by stabilizing their
personnel in front-line and managerial positions (note the full estimation
sketched in Table 6.11 as an example) – and also by insulating internal
operations from externally generated perturbations.
The results of these analyses offer more than a simple brief for the
advantages of buffering, however. For school districts in Texas, buffering
clearly helps improve performance as measured by criteria pertaining, or of
most interest, to disadvantaged students. It helps little or not at all for those
who are advantaged. This distributional dimension of the results is striking,
and highly interesting as well. In an analysis reported in Chapter 3, we
showed that managerial networking also carries distributional consequences,
but with a pattern opposite to that found here for buffering. Networking by
top managers in school districts benefits the most advantaged students and
does little for those at the other end.
The results of this study also raise questions about the functional form
through which buffering operates. The model tested here includes complex-
ity: a reciprocal for buffering, plus interactions with both managerial behav-
ior (networking) and external forces (resources and constraints). The
empirical results show only limited and sporadic support for these features
over the considerably more straightforward linear form, however. The latter
represents the notion that buffering serves as a simple input to production.
If a linear functional form can be regularly shown to be just as efficient in
explanation as one incorporating the nonlinearities and reciprocal, these
features of the model should be rejected.40
234 Nonlinearities in public management
With one exception, neither management capacity nor buffering has been
used in other studies, so much evidence on the generality of the Texas
findings is not yet available. One study of management capacity and its
interactive effect does exist, however. Andrews et al. (2009) examine the
negative impact of unexpected immigration on the performance of local
governments in England using the national government’s evaluation score
for local governments. Immigration was a significant shock. The number of
immigrants who came to the United Kingdom with the expansion of the
European Union was seventeen times the anticipated number, and the influx
overwhelmed the services of some local governments. Andrews et al. create a
capacity measure based on central office bureaucracy similar to that for
Texas school districts, and find that local governments with greater manage-
ment capacity are able to mitigate this negative impact of immigration so
that the end result is no longer statistically significant.
NOTES
1. The section draws from the presentation by O’Toole and Meier (2010).
2. Huge and continuing shocks, whether budgetary or otherwise, would take their toll,
theoretically, but there are no existing studies of this in public management literature.
3. Other measures of managerial capacity might consider education levels, skills sets of
managers, or even years of experience.
4. There were no statistically significant losses in any of the ten performance measures in the
third or fourth years.
5. In some preliminary analysis, we find that increased staffing of the central office leads to
some tradeoffs likely to benefit more disadvantaged students at the expense of students
236 Nonlinearities in public management
with greater advantages. The relative size of the central office staff is positively
associated with increased student attendance and negatively associated with drop-
out rates, and these are both desired outcomes. There is also a negative relation-
ship between central office staff and the percentage of teachers the district employs
in gifted programs. In essence, there appears to be a clear tradeoff: build manager-
ial capacity if the goal is to help the disadvantaged students or build specialized
teaching capacity if the goal is to improve the performance of high achievers.
6. This section draws from the presentation by Meier, O’Toole, and Hicklin (2010).
7. All data are from the official records of the Texas Education Agency.
8. Using the entire set of 1,043 districts, including the smaller ones, has only modest impact
on the results. In this case, the weaker of the two influences, the “Katrina” coefficient
(explained shortly), fails to attain statistical significance (the direction and final results
still hold). The results for the “Rita” coefficient remain unchanged.
9. The results using all the days were very similar but were affected more by collinearity, since
many of the Katrina evacuee districts were closed for the Rita evacuation but did not sustain
physical damage that would have prevented them from opening the following week.
10. Here we count as districts affected by one or both shocks any district with a non-zero
value for enrolling Katrina evacuee students or sustaining a period of at least six days of
closure due to Rita.
11. The hurricane-impacted districts are not appreciably different from those not affected.
Both the Katrina and the Rita districts actually had lower revenues per pupil but higher
teacher salaries (for Katrina) and larger class sizes. These differences are in part a result of
the hurricane-impacted districts being in the region of the state where wages are likely to
be higher.
12. The equations in all tables were also estimated using a three-year average of prior TAKS
scores rather than just the previous year. The three-year average tends to underestimate
the district’s record, because the TAKS was a new exam created in 2003, and there is a
positive trend in overall scores as districts and students got used to the new exam. The
results of this estimation were generally the same as those presented but showed a slightly
larger impact from the hurricane, because it underestimated the prior performance of the
district.
13. The hurricane-affected districts did not do better as the result of an influx of aid.
Instructional expenditures per student go up by $645 in districts impacted by Katrina
(versus $658 for all districts) and $533 in the Rita districts (versus $661 for all other
districts). The influx of additional state or federal funds was overwhelmed by the total
number of new students who arrived.
14. The impact of Katrina might have been larger, but the majority of evacuee students were
distributed in a ring of school districts in the Houston metropolitan area that are generally
fairly high-performing and are known for talented instruction. The districts with Katrina
students, for example, had a TAKS pass rate of 62.8 percent in 2005 compared to 61.1
percent for all other districts. They achieved this despite having lower revenues per pupil
($8,643 versus $8,945) and higher student to teacher ratios (14.3 versus 12.7).
15. The use of the TAKS exam as the most sensitive performance indicator is corroborated by
the results for the commended pass rate. The respective coefficients for the model in
column 3 for that equation were –0.184 for the Katrina students and –0.039 for the days
237 Notes
missed. Both were significant but only at the 0.10 level. The commended rate impact of
both shocks is about one-third the size of the impact on the overall TAKS pass rate. The
attendance equations show no impact for the missed class days, and a coefficient of –
0.034 for the Katrina students (significant at the 0.10 level). The attendance impacts are
tiny and thus need not be considered in detail.
16. Hurricanes aside, many of the districts regularly receive a large number of students after
the start of the school year because the families of migrant workers return to Texas after
working harvests further north. These evaluation systems are generally administered by
central management in order to avoid disrupting the schools.
17. The findings are not the result of districts with greater central office capacity simply being
wealthier districts. The correlation between central office bureaucracy and property tax
wealth per student is 0.03 (not significant). There is a positive correlation between
revenues per student (which include state and federal funds) and central office bureau-
cracy of 0.26, but for districts with 1,500 students or more this correlation is an insignifi-
cant 0.04. The measure is the percentage of employees in the central office bureaucracy,
which is likely why the measure is unrelated to district wealth.
18. We also examined how personnel stability affects the impact of the hurricanes, and found
relatively similar results (see Meier, O’Toole, and Hicklin 2010).
19. This section draws from the presentation by Meier and O’Toole (forthcoming (a)).
20. The TEA does not report data if fewer than five students are in the category. In some
smaller school districts this might mean that fewer than five students take the college
boards, and thus the percentage of students scoring above 1,110 on the SAT or its ACT
equivalent will be missing.
21. The same pattern holds generally for the estimations with attendance and high-end
performance, as reported in Tables 6.9 and 6.10. A few of the management coefficients
there are not significant.
22. Calculating the slopes is relatively simple and is illustrated in the text. Calculating
the standard errors for the marginal standard errors is more complicated and
requires using the variance–covariance matrix from the regression (see Brambor,
Clark, and Golder 2006). If the formula for the conditional slope is represented by
slope ¼ b1 þ b2Z
where Z is the interacted variable, then the standard error at any point in the regression
line can be calculated by taking the square root of [var(b1) þ Z2var(b2) þ 2Zcov(b1b2)].
23. Texas school districts generally require the schools to keep track of attendance and do the
routine follow-ups. More elaborate programs focused on truancy are generally housed in
the central office. One district, for example, works with local law enforcement agencies to
have police visit the homes of absent students to let the parents know of an unexcused
absence. This district also has a program through which, on a given day, law enforcement
officers routinely stop all school-age children visible in public places during school hours
to determine why they are not in school.
24. Of course, these two are related. Management can undertake actions that build or alter
structural features of the organizations, for instance.
25. As indicated below, we do not develop separate measures for each of the “S” and “M4”
terms of the model. The measure used here is one for the entire buffering term,
238 Nonlinearities in public management
encompassing both elements. The model’s incorporation of the buffering concept sug-
gests that its impacts on performance are likely to be similar across outcomes. It may
nonetheless be that some kinds of performance, affecting certain kinds of groups, are
more or less sensitive to the impacts of organizational buffering. This notion is not
included in the general theoretical argument being examined but is analyzed empirically.
26. This argument is theoretical rather than empirical – that is, we have not demonstrated
that the measures of these concepts actually combine in this way, nor have we demon-
strated that the measures cover the full extent of the two concepts (see below).
27. Nor have we proposed and validated a measure of M3, the efforts of managers to tap or
exploit the environment.
28. Entia non sunt multiplicanda praeter necessitatem, or “No more things should be
presumed to exist than are absolutely necessary.” The principle is attributed to William
of Ockham, a fourteenth-century philosopher and logician.
29. For the remainder of the chapter we refer to the combination simply as structure.
30. Such structures can buffer other events. When 5,000 students arrived at HISD in
September 2005 as the result of relocations from Hurricane Katrina, they were assessed
and assigned in the same manner.
31. The logic works whether the “O” variable is defined either as outputs or outcomes.
32. All things are not equal, of course, because new environmental events enter this system
every year. More recent events could swamp the later-year impacts of this initial event,
depending on their size.
33. Coupling could actually be considered on two dimensions: the extensiveness of the
interdependent links with the environment and reverberation through time. Here we
focus on the latter and assume the former as a constant. For the empirical part of the
analysis in this book, this assumption is reasonable, since the full sample of organizations
are structurally alike and similarly specialized.
34. There can be both internal and external drivers of the autoregressive parameter. We
assume that the main source of influence over variations in the parameter, among
organizations of similar structure and function, is the set of externally generated influ-
ences – the “Xs” of the model – during the preceding cycles.
35. Essentially, we estimate over 1,000 regression equations, one for each school district, to
produce these estimates.
36. Some of our management and structural variables contain an element of this internal
dimension. The choice is between leaving out management elements that are more
general or including them even though they might operate within the organization.
37. We considered using dropouts as a performance measure, but the state of Texas made one
significant change in the dropout measure during this time period so that early dropout
rates are not comparable to later ones. Accordingly, we omitted this measure from the
analysis.
38. We also experimented with a quadratic estimation, and got similar results.
39. As an illustration, Table 3.12 shows that networking is positively and significantly related
to SAT scores while Table 6.14 produces a negative and insignificant coefficient.
40. This section of the chapter has offered such tests of certain portions of that model and
has raised questions regarding functional form. We are a long way from clearly rejecting –
or accepting – such theoretical expectations in toto, however. For one thing, Chapter 3
239 Notes
This chapter offers such an examination. While it certainly does not cover
the full terrain of how structural networks can shape results, it does show
some of the complex causal patterns that are part of today’s managerial
setting.
Sometimes, the word “network” has been used as a loose metaphor for the
interdependence characteristic of governance. Other analysts mean the term
to refer to relatively stable interorganizational structures, and they use the
246 Public management in intergovernmental networks
concepts and tools of sociology to dissect these and build empirical theory.
Yet other researchers focus primarily on networking: the actual connections
made between or among actors operating in some social space.
We avoid the metaphorical use of the term here, but we are interested in
the other two aspects of the network theme. Relatively stable arrays of
interdependent organizational actors are characteristic of the intergovern-
mental system. When grant programs continue over multi-year periods,
units develop elaborate formal understandings with each other, and the
networked sets of institutional actors approximate a structurally identifiable
cluster. (It is worth noting the use of images such as “picket fence federal-
ism” to describe US vertical links between or among donor and recipient
agencies that jointly administer public programs; see Wright 1988.) For
present purposes, in our treatment of intergovernmental relations and the
management of public education, we refer to this feature as the structural
network. Regardless of whether and how often actual interaction can be
observed between the linked entities, an ongoing fiscal link clearly defines
part of a structural relationship between the units involved.
In addition, managers may also be active in their networked environment
in efforts to build support for programs, attract partners for cooperative
effort, and fend off challenges from other actors. Some of these efforts may
in fact take place in concert with others involved in a structural network,
some may involve other dyads and other network actors – sporadically or
regularly. We refer to the set of these moves, which are in principle observ-
able, as the behavioral network, and the efforts of managers to be active in
this way as managerial networking.
Typically, researchers do not distinguish carefully between structural
features of networks and behavioral manifestations of networking. Both
signal some connection, perhaps interdependence, with other actors in a
public organization’s environment. These aspects may operate somewhat
independently of each other, however, and we view it as important to take
both into account in any comprehensive understanding of the network
theme in public management. Intergovernmental management, in particu-
lar, involves a consideration of both.
This study represents a first effort at combining structural and behavioral
networks. Accordingly, it raises a number of issues related to the substantive
area under consideration – educational policy – including what the relative
impacts of different funding sources are. Our primary focus is on manage-
ment and performance, however, and exploring these other issues is beyond
the scope of this book.
247 Intergovernmental networks: a formal treatment
In this chapter we begin once again with our model, but concentrate on only
its second term by deliberately underspecifying the full set of relationships
we have hypothesized, as follows:
Here X0t simply refers to the portion of the Xt vector besides the
intergovernmental structure – that is, all other environmental forces impin-
ging on the local government. These include a wide variety of resources (for
example, the extent of local wealth) and constraints (the task difficulty of
educating the children of a particular community; a school system educating
a more diverse or impoverished student population confronts a larger
challenge). We simplify further by not designating the stability relationship
as a reciprocal one:
Ot ¼ b2 Xi X0t Se M2 þ et
This leaves us with a highly complex four-way interaction between the
environment, intergovernmental structure, stability, and management. The
best test to determine if the relationships actually fit a four-way interaction
is with a set of nested hypothesis tests that contrast various interactions with
strict linear additive models. Doing so would require us to include not just
the four additive terms and the four-way interaction, but also four three-way
interactions and six two-way interactions. Such a set of tests puts a great deal
of stress on a data set by generating massive collinearity, and would likely
make pinpointing the precise relationships extremely difficult. To provide a
first step in assessing the linkage between the intergovernmental environ-
ment and the various forms of management and stability, we further sim-
plify the model to one with interactions between intergovernmental
structure and the remaining terms only.
Ot ¼ b2 Xi X0t þ Se þ M2 þ et
248 Public management in intergovernmental networks
Others might derive considerable financing from the state or the federal
government. These may be advantaged, in a sense, in having an additional
source of funds; but the management challenges in dealing with own-source
and intergovernmental funding streams, and the uncertainties connected to the
latter, render managerial networking (and perhaps other managerial functions)
more important. Those school districts with financial support stemming in
substantial measure from more than one intergovernmental funding stream
would seem to face more challenging and, potentially, more uncertain network
environments. For these reasons, the sheer diversity of funding across the
intergovernmental network can also be expected to be related to the requisites
of intergovernmental management. Dependence on state aid, in short, and
dependence on a more diverse and thus complex intergovernmental network
are features of the interdependent environment that should be related to school
district management, and also to performance.
Our data are drawn from the 1,000 plus Texas school districts. District
superintendents were sent a mail questionnaire on management styles, goals,
and time allocations (return rate 55 percent with 507 usable responses). We
pooled five years (1995 to 1999) of data on performance and control
variables to produce a total of 2,535 cases for analysis. All nonsurvey data
were from the Texas Education Agency.
Our measures can be discussed in terms of parts of the model: manage-
ment (M); elements of stability (Se); the vector of environmental forces (X’);
intergovernmental structures (Xi); and program outcomes (O), or perform-
ance. These items are covered in this order.
“M”: management
Two measures of public management are included as potential explanatory
variables in this analysis: managerial quality and managerial networking. We
treat them both here as elements of the M2 term in our simplified model but
leave them distinct in our efforts to develop estimations. Managerial quality, as
reported in Chapter 4, is based on the residual from a model explaining the
salaries of district superintendents. A second measure of management is
included, as well: managerial networking. To measure the behavioral network-
ing activity of school superintendents, we use the factor score from the reported
250 Public management in intergovernmental networks
interactions with five sets of actors from the organization’s environment: school
board members, local business leaders, other school superintendents, state
legislators, and the TEA. The managerial networking measure and the man-
agerial quality measure are uncorrelated with each other (r ¼ 0.01).6
“Se”: stability
We incorporate two aspects of personnel stability in this study, as developed
in Chapter 5. Managerial stability is simply the number of years the super-
intendent has been employed by the district in any capacity. Teacher stability
is measured as the percentage of teachers employed by the district during the
preceding year who continue to work for the district. For both measures,
then, higher scores mean more stability. Data on managerial stability were
obtained from the survey respondents; data on teacher stability were pro-
vided by the Texas Education Agency. Although these measures are treated as
stability features here and in the subsequent discussion, they can also be
considered aspects of management – what is usually referred to as personnel
management. While not totally under the control of school district leaders,
these variables are susceptible to influence by the individuals who make
decisions about how such organizations are run. In a real sense, therefore, all
four variables tap aspects of public management.
Findings
Notes: All equations control for teacher salaries, instructional funding, percentage of black students,
percentage of Latino students, percentage of low-income students, class size, teacher experience,
noncertified teachers, and individual year dummy variables. Numbers in parentheses are standard errors.
* ¼ significant at p < 0.10, one-tailed test.
Notes: All equations control for teacher salaries, instructional funding, percentage of black students,
percentage of Latino students, percentage of low-income students, class size, teacher experience,
noncertified teachers, and individual year dummy variables. Numbers in parentheses are standard
errors. * ¼ significant at p < 0.10, one-tailed test.
254 Public management in intergovernmental networks
Table 7.3 Management and dependence on state aid: college aspirations indicators
Dependent variables
Notes: All equations control for teacher salaries, instructional funding, percentage of black students,
percentage of Latino students, percentage of low-income students, class size, teacher experience,
noncertified teachers, and individual year dummy variables. Numbers in parentheses are standard
errors. * ¼ significant at p < 0.10, one-tailed test.
Dependent variables
Attendance Dropouts
Notes: All equations control for teacher salaries, instructional funding, percentage of black students,
percentage of Latino students, percentage of low-income students, class size, teacher experience,
noncertified teachers, and individual year dummy variables. Numbers in parentheses are standard
errors. * ¼ significant at p < 0.10, one-tailed test.
255 Findings
Notes: All equations control for teacher salaries, instructional funding, percentage of black students,
percentage of Latino students, percentage of low-income students, class size, teacher experience,
noncertified teachers, and individual year dummy variables. Numbers in parentheses are standard
errors. * ¼ significant at p < 0.10, one-tailed test.
Diversity Diversity
Notes: All equations control for teacher salaries, instructional funding, percentage of black students,
percentage of Latino students, percentage of low-income students, class size, teacher experience,
noncertified teachers, and individual year dummy variables. Numbers in parentheses are standard
errors. * ¼ significant at p < 0.10, one-tailed test.
256 Public management in intergovernmental networks
Dependent variables
Notes: All equations control for teacher salaries, instructional funding, percentage of black students,
percentage of Latino students, percentage of low-income students, class size, teacher experience,
noncertified teachers, and individual year dummy variables. Numbers in parentheses are standard
errors. * ¼ significant at p < 0.10, one-tailed test.
Dependent variables
Attendance Dropouts
Diversity Diversity
Notes: All equations control for teacher salaries, instructional funding, percentage of black students,
percentage of Latino students, percentage of low-income students, class size, teacher experience,
noncertified teachers, and individual year dummy variables. Numbers in parentheses are standard errors.
* ¼ significant at p < 0.10, one-tailed test.
257 Findings
Networking 8 1 1
Quality 3 7 0
Teacher stability 7 1 2
Management stability 5 2 3
Notes: Comparison of slopes for districts with a great deal of state aid with
those with less aid. Figures are which slope is larger. Neither is coded if
neither coefficient is significant or if they are equal. Median splits on all,
including federal aid.
Networking 2 8 0
Quality 2 7 1
Teacher stability 5 4 1
Management stability 7 1 2
partner in their structural network. Major financial benefits for the district
may be contingent on managers’ treating the issue of intergovernmental
support seriously, and external managerial effort does contribute more to
results. In this case, good behavioral networks mimic structural networks.
A second pattern is discernible in Tables 7.1 to 7.4. Personnel stability also
tends to matter more for performance in those settings more dependent on
state aid. The relationship is particularly clear for teacher stability. For seven
performance measures, teacher stability contributes more in the high-aid
districts, whereas for only one – high SAT performance – is the pattern
reversed. For two performance measures, ACT scores and dropout rate,
teacher stability is significant for neither half of the sample. In some
instances, such as the all-students’ TAAS pass rate, the teacher stability
impact for the high-aid districts is twice as large.
The pattern across the performance measures is similar for management
stability, although the results are a bit less straightforward. For five cases, the
high-state-aid half of the sample gets a bigger impact on performance from
superintendents’ stability than does the low-aid half; in two cases, the
pattern is reversed. Three cases do not involve statistically significant
impacts of management stability on performance, although two of these
are the instances focused on the low-end measures.
Personnel stability helps educational performance more in the more heavily
networked settings – at least, as measured by districts’ dependence on the
primary source of intergovernmental aid. This pattern is especially interesting.
Often the characterization of networks and network management suggests that
stability and networking are somehow opposed. Either stability impedes the
entrepreneurial networking often endorsed by network enthusiasts, or net-
working promises to break through the rust of overly entrenched bureaucracy.
The findings reported here point toward a more intriguing pattern: that
stability – at least of personnel – and intergovernmental network dependence
interact positively with respect to program outcomes. Stability in at least some
forms may be a platform on which managers and others can build effective
performance in heavily networked settings.
Another way of characterizing the findings is that personnel stability
may compensate for, and be especially important in dampening, some of
the disruptiveness of structurally less stable (more networked) settings.
A second possibility is that personnel stability allows the manager to turn
network interactions into repeat games, thus allowing each side to build
trust and make credible commitments. This characterization is close to
what researchers report as typical in instances of intergovernmental
260 Public management in intergovernmental networks
Conclusions
NOTES
1. Influences emanating from the environment of a public organization are properly treated
as part of the “X” term when one is analyzing management and performance at the
organizational level of analysis. If one were examining the system at the network level of
analysis, network structural arrangements would be considered part of the vector of
stabilizing features, Sn, of the larger array (see the coverage of modeling at the network
level in Chapter 2).
2. The analyses in this chapter follow the presentation by O’Toole and Meier (2004c).
3. We cite information here from earlier years, since the data we analyze in this chapter
pertain to an earlier five-year period, but the general points made about the fiscal structure
of the system and variation nationwide continue to hold.
266 Public management in intergovernmental networks
4. The total revenue for public school systems in United States for 1998/9 was
more than $200 billion, of which approximately $24 billion derived from the national
government. The vast majority of the nationwide elementary and secondary education
dollars are raised directly by local districts, primarily from their own taxes, with some
coming from other local governments and some from charges imposed by the
districts. See CSG 2002.
5. We use state funds rather than state and federal funds because, for most districts, the
percentage of federal funds is relatively small. For a small number of districts with major
federal facilities, such as military bases, federal aid is the largest source of funds. These
“federal impact” districts are fundamentally different from districts that depend on state
sources, in that federal funds essentially substitute for local monies. Including federal
funds in the analysis results in generally similar results to those reported here, but the
federal impact districts tend to muddy the findings. The diversity measure also picks up
the federal impact districts.
6. Management quality is also uncorrelated with both measures of personnel stability (–0.02
for each), as is managerial networking (0.04 correlation with teacher stability, –0.08 with
management stability).
7. The relationship between the percentage of students taking the tests and the test scores in
Texas is actually positive but explains less than 2 percent of the variance.
8. Of the twenty-eight non-significant relationships, nineteen are in the predicted direction.
9. For one performance measure, TAAS pass rates for low-income students, neither coeffi-
cient was statistically significant.
10. Even if it were, the slope is substantially smaller.
11. Their focus is on another aspect of stability: constancy of the key network organizational
members – in contracted relations for service provision – over a several-year period.
12. Given the findings analyzed here, this may be the case not only for M1, the internal
management of operations that has been omitted altogether in the simplified model, but
also for overall managerial quality.
13. For both networking and quality, the dropouts performance equation contained anom-
alous results. Given the quality of the data, therefore, the pattern can be considered even
stronger than the summary numbers suggest.
14. The equations for the two low-end performance measures all show insignificant results
for managerial stability.
15. For the dropout rate, the teacher coefficient was insignificant for both halves of the
sample.
8 Public management and performance:
what we know, and what we need
to know
This book has presented a perspective, a model, and a large set of empirical
findings. The results speak to a broad agenda occupying many scholars and
practitioners: understanding how public managers shape agency and
program performance. In this chapter we draw the volume to a close by
undertaking two tasks. First, we review and tie together what we have
learned about public management and performance. We then sketch a new
agenda for some of what, we believe, remains to be explored.
This research program has developed many findings about whether, how,
and how much public management influences the performance of public
organizations. Most findings explain what is going on in school districts
within one state; but, we argue strongly, this “limitation” should not dimin-
ish the record. Although this work should be replicated in other empirical
settings – and although we have initiated that ourselves, as have others
discussed in earlier chapters – the patterns analyzed here should not be
marginalized. First, the sample included in most of our empirical studies
consists of more than 1 percent of all governments in the United States.
Second, no larger sample of public organizations has ever been analyzed for
determinants of performance. Third, the analyses develop and report on
numerous types of managerial influence. While the findings sometimes
show that managers shape performance in ways that some might find to
be expected, the results do not merely theorize or speculate about such
channels of influence; they demonstrate the influence with systematic evi-
dence. This sort of contribution is unusual. The approach here, therefore, is
what can be considered to constitute evidence-based public management.
Fourth, the characteristics of these organizations suggest that many of the
results here are likely generalizable to other public organizations that are
267
268 Public management and performance
worth considering), can negotiate and receive technical assistance, can tap
the efforts and production potential of other organizations in patterns of
coproduction, and can strengthen the organization’s political position with
other actors and institutions. They can also help to fend off threats and
shocks from outside.
As Chapter 3 highlighted, we know that, in this set of public organiza-
tions, networking adds to performance not in a simple linear fashion but by
interacting with selective resources (opportunities) in the environment, thus
leveraging and strengthening the impact of these resources on the outcomes
of interest. In other words, the nonlinear, interactive relationship between
networking and environmental forces (the “X” term of our model) is
supported by the evidence. In a paradoxical finding, we discovered that
those organizations performing especially well are less inertial than those
seemingly more trapped in a mediocre production process.
We also know that it is possible to create a good measure of managerial
networking across many organizations without expending huge amounts of
time and expense in sketching the full networks in which managers may be
situated. Considering such networking as a general behavior and one that is
practically important makes sense: more networking by top managers means
better organizational performance. As one might expect, nevertheless, one
can overdo it. We have shown that the marginal contributions of managerial
networking by top managers decline at higher levels of networking –
although incorporating a consideration of managerial quality (an aspect to
be reviewed shortly) eliminates the diminishing marginal returns.
Although managerial networking improves performance, it does not do so
in an undifferentiated fashion. Because the externally oriented actions of
managers take place in a political environment, the external interactions
influence organizational performance to improve outcomes for the more
advantaged and powerful stakeholders in that environment. Performance is
improved on the most salient performance measure and those that are most
important to advantaged clientele, while there is little or no effect for
outcomes that matter most to the less advantaged. Managerial networking
has real payoffs, but not inevitably and not for everyone.
Although networking by top managers has been carefully investigated in
this book, we have not explored the impact of networking at other levels in
the organization. We know from the English local government data that
substantial networking takes place at different echelons in these governmental
organizations. We have not estimated any performance impacts of network-
ing at different levels within an organization, however.
271 What does the evidence show?
Mnetworking 0.01 x x x x x
Mstability 0.03 0.07 x x x x
Tstabililty 0.02 0.05 0.00 x x x
Buffering 0.05 0.05 0.05 0.05 x x
Capacity 0.10 0.04 0.04 0.12 0.27 x
Human resources M 0.07 0.05 0.10 0.12 0.04 0.002
Notes: 1 Technically, this term measures M4Se, the denominator of the second term in the model. It includes
a management component, and so we include it here.
(1) Managerial networking can lead to performance gains either through the acquisition of
technical knowledge or the development of political/public support.
(2) Managerial networking can interact with some organizational resources to increase their
impact several-fold. Given this relationship, managers need to exercise choice with
regard to how to pursue environmental opportunities.
(3) Managerial networking is subject to diminishing marginal returns; the best managers
limit their networking activities before reaching this point.
(4) Managerial networking has distributive consequences. Network demands are more likely
to come from well-established and well-endowed network nodes.
(5) The impact of managerial networking depends on the structural context. Managerial
networking is more valuable in structural networks.
(6) Management needs to build excess managerial capacity to deal with shocks and other
unexpected environment problems.
(7) Management capacity enhances the impact of managerial networking.
(8) Managers need to recognize that building managerial capacity results in tradeoffs. In
particular, investments in managerial capacity can limit current levels of production.
(9) Loosely coupled organizations generally perform better; this is especially the case with
regard to disadvantaged clientele.
(10) The stability of front-line workers leads to higher productivity. This relationship is
stronger for programs that affect disadvantaged clientele.
(11) Managerial stability is positively related to performance.
(12) The development of human capital is the management activity with potentially the
largest payoff for performance.
(13) Management actions are generally independent of each other, so that improvements in
one area are not necessarily related to management abilities in other areas.
This pattern is interesting, for at least two reasons. First, it suggests that the
contributions that various management functions make to performance can
be treated basically as additive. Second, the set of (non)relationships shows
that “good management” comes in many flavors – or, more precisely, that
management is clearly a multifunctional enterprise. Managers who excel at
one aspect are no more (or less) likely to do well at another. These results are
intriguing and call for more sustained analysis both within and among these
and other managerial functions.
Although our purpose has been to contribute to the scholarly literature on
public management rather than provide advice to practicing public man-
agers, we are aware that our work has significant implications for how
organizations should be managed. Under the guise of evidence-based public
management, we have discussed this issue in some detail (see Meier and
O’Toole 2009b). Table 8.2 provides a summary of findings that we think
have practical application to the real world of public management. These
277 What remains to be explored?
arrangements, but some of the relationships might operate differently in, for
instance, more corporatist settings. Some of the emergent work, therefore,
offers the potential to explore such themes of governance, which have been
considered important but essentially unverified in recent work in the field.
In addition to these ongoing projects, we are initiating work on the man-
agement of hospitals and nursing homes. Both data sets include public,
private, and nonprofit organizations.
We have also expanded the Texas schools data set by inviting other scholars
to nominate survey items for inclusion in the superintendent surveys. Several
such questions on performance management, social capital, trust, and diver-
sity were included in the 2009 survey. We are also at the early stages of
examining data on charter schools. We have collected data on these over time
and are now working with a colleague to examine public management in these
organizations, which effectively operate as nonprofit organizations subject to
some state regulation and funding. The analyses there may speak to the
themes developed in the research literature on nonprofit organizations.
What is likely to be more challenging by far is any effort to estimate the
full range of managerial influences in more thoroughly networked settings.
As explained in Chapter 2, we expect public management in networks to
be perhaps even more consequential than in more traditional settings
(O’Toole 2000b), but practical impediments make it especially difficult to
conduct large-N empirical explorations of the question. Modeling managerial
impacts in networks requires adding more management functions and
vectors of influence, managers themselves may have strategic reasons to
disguise their own efforts to shape results in such settings, multiple managers
in very different organizations may simultaneously be attempting to move
performance along (albeit not necessarily in the same direction), and the
structural dimensions of the program setting are less transparent and may
need to be mapped with significantly more labor-intensive research efforts.
This agenda item remains important, but progress is likely to be slow.
We are more optimistic about the agenda with regard to internal manage-
ment and performance. Thus far we have triangulated around the internal
management function but not specified it as completely as would be ideal.
A number of additional managerial efforts that are focused internally can be
examined in principle so long as the data are gathered systematically from
managers or other sources. Certain additional managerial functions have
already been the focus of research effort on our part. Along with colleagues,
we have explored whether the content of managers’ (and organizations’)
strategy is related to performance in the ways hypothesized by some generic
279 Politics and management
management theorists (see Meier et al. 2007 and Andrews et al. 2010a). Strategy
can be considered an aspect of management that entails both internal and
external attention. Other management efforts that are directed primarily at
internal coordination, planning, resource allocation, communication, and so
forth are all – in principle – amenable to empirical analysis. The research agenda
going forward needs to include such studies if we are to reach a fuller under-
standing of the management–performance relationship. Some of the points just
mentioned, along with a set of additional ones, can be unpacked more fully in
this coverage of the research agenda that remains to be addressed.
Governance structures
Social capital
that relies on citizen production also seeks to build social capital in the
community. The role that public management plays in fostering social
capital, particularly bridging social capital, could well be one of manage-
ment’s more important contributions to democracy.
One theme emphasized in this book has been that public organizations are
typically charged with multiple goals and, therefore, should be assessed via
multiple performance measures. We have done so in many of the analyses
presented in earlier chapters, and we have seen that the patterns revealed
across a full array of performance measures can be quite telling. This cannot
be the end of the story, though. In all the measures used in this study,
performance is interpreted implicitly as quantity of outputs or outcomes
over some designated time period, but additional ways of conceptualizing
performance should be considered as well.
As Boyne has pointed out (2003), performance can be considered along a
number of additional dimensions. Two of the most important are efficiency
(the ratio of outputs or outcomes to financial inputs) and equity (the
“fairness of the distribution of service costs and benefits between different
groups” (Boyne 2003: 368)). In this book we have ignored the subject of
efficiency, treating financial inputs as control variables as we have sought to
283 Another M?
Another M?
Our model was developed from the literature on public management, which
is based largely on case studies, and has been used to explore relationships in
public organizations. Nothing in the model is restricted only to traditional
government-owned organizations, however. We have already mentioned the
potential applicability to nonprofit organizations. In addition, the same
might be said with regard to private, for-profit organizations.
Here matters are not quite so simple, because “publicness” and “private-
ness” can be considered on more than one dimension, not simply ownership
(see Perry and Rainey 1988). In particular, the source of funding and the
form of social control also constitute criteria for distinguishing the sectors.
The public–private distinction might also be considered in terms of multiple
categories or via a continuum rather than a dichotomy. Bozeman (1987), for
example, has even argued that “all organizations are public” – at least in
some respects.
The research literature has not sorted out the question of whether pub-
licness, in whatever form, renders the managerial functions distinctive with
respect to determinants of organizational performance. To the extent that
management can be considered a generic function, an approach typically
taken by business management researchers, a model and set of findings valid
285 Better measures, more data
how well they operate as they tackle their responsibilities. While calling
for better measures and better data is almost a cliché, the fact is that
we will not make much more progress in understanding the relationship
between public management and performance without significant develop-
ments on both fronts.
There is much more work to be done, therefore, if we are to implement
fully the sort of research agenda that can demonstrate the entire range of
managerial impacts on the outputs and outcomes of public organizations.
It will take time, and many researchers, and undoubtedly some false starts.
At this point in the research program, we have begun the task, and a
number of other researchers have joined the effort, often by expanding
the range of questions that can be addressed with the data at hand and
sometimes by identifying new and promising sources – whether it be the
influence of diversity and representation on performance (Pitts 2005),
organizational leadership and its effects (Fernández 2005), gender and
performance (Johansen 2007), mayoral influences on results in Colombia
(Avellañeda 2009b), or managerial effects in state governments (Donahue
et al. 2004), to mention but a sample of the recent work. The questions are
large and important, the need for answers pressing, and the results thus far
promising. We welcome many more to join the challenge.
NOTES
Above criterion is a US college board score of more than 1,110 on the SAT or its ACT
equivalent. This is, essentially, equal to a score that would rank a student in the top 20 percent
nationally. The Texas Education Agency defines this score as one designating college-ready
students.
ACT is a college aptitude examination, formerly known as the American College Test, that high
school students take. The exam is used primarily by Midwestern colleges and universities.
All-pass rate is the percentage of students in a district who have passed all portions of the
TAAS or the TAKS exam for that year.
Anglo pass rate is the percentage of Anglo students (white non-Latinos) in a district who have
passed all portions of the TAAS or TAKS for that year.
Attendance is a performance indicator that is the percentage of all students in a district who
attend classes on average – i.e. the average of the average daily attendance percentages.
Autoregressive systems are inertial systems. In an autoregressive system, current outputs can
be expected to be strongly influenced by past outputs. Formal organizations are typically
designed to be autoregressive. See also Outputs.
Black pass rate is the percentage of black students in a district who have passed all portions
of the TAAS or TAKS exam for that year.
Buffering (SM4) is a measure of how loosely coupled the organization is, consistent with
the theoretical notion that a loosely coupled organization is more able to take a shock to the
system and dissipate it rapidly. This measure is based on the correlation of the organization’s
outputs from 1988 to 1994 (a time period before the current study). That correlation
subtracted from 1.0 is the measure of buffering used.
College boards are aptitude exams that are given to high school students to measure their
readiness for college. See ACT, SAT.
287
288 Glossary
Dropouts are students who leave school without completing their degree program. The state
of Texas has two dropout measures: the four-year dropout measure and the six-year dropout
measure. The difference is in whether the base measure is calculated over the last four years of
school or the last six. Dropouts are only rarely used as performance indicators in this book,
because they are conceded to contain substantial measurement error.
Governance, in today’s parlance, refers to the full set of formal institutions and informal ones,
along with the associated patterns of action that produce policy results. A governance system
for a particular policy or program may involve an organization such as a public agency or a
large and complex network of organizations and actors. Governance systems may include
public, for-profit, and nonprofit units.
Human resources management; see Internal management.
Independent school district is a US governance structure for school districts. These are
essentially special-purpose units that are created for the express purpose of operating public
schools. School districts generally do not have boundaries that are coterminous with other
jurisdictions – even those that share the same name. The “independent” portion of the title
means that the school district has an independently elected governing board and has the
authority to levy taxes for the support of public education. Except for a single municipal
school district, all districts in Texas are governed as independent school districts.
Internal management (M1) is management’s efforts to manage inside the organization. We
measure internal management with five items: the superintendent’s assessment of the quality
of the principals’ management skills, experienced teachers, professional development (on a
scale of 5 ¼ excellent to 1 ¼ inadequate), and whether the superintendent agreed or disagreed
on a four-point scale with two other items: “With the people I have in this organization, we
can make virtually any program work” and “I am quite likely to recommend a subordinate
for a superintendent position in another district.” The measure is a factor analysis of these
items, resulting in a single factor.
Latino pass rate is the percentage of Latino students in a district who have passed all portions
of the TAAS or TAKS exam for that year.
Low-income pass rate is the percentage of low-income students in a district who have passed
all portions of the TAAS or TAKS for that year.
Low-income student is a student who is eligible for free or reduced price school lunches. The
exact criteria are based on federal poverty levels for a given size of household.
M1; see Internal management.
of external actors. The initial measure included local business leaders, state legislators, other
superintendents, the Texas Education Agency, and school board members. Later measures
omitted contact with the school board and treated that as a separate measure (often termed
“managing upward”). The factor analysis consistently generates only a single significant
factor, with all indicators loading positively on that factor. An increase in the number of
external actors appears to have little impact on the measurement of this factor. Managerial
networking is also the measure of managing outward.
Managerial quality is a measure that is based on a regression equation predicting the salary of
the school superintendent. Essentially, the strategy (see Chapter 4) takes all the factors that
should predict a superintendent’s salary (district size, past performance, age, etc.) and uses
these as independent variables in a regression. The residual from this equation – that is, the
part that cannot be explained by known factors – is taken as a judgment by the school board
as to the quality of the manager.
Managerial stability (Sm) is the number of years the superintendent has been employed by the
district in any capacity.
Managing downward is a measure of how frequently the superintendent interacts with school
principals, on a scale of daily (6) to never (1).
Managing outward; see Managerial networking.
Managing upward is a measure of how frequently the superintendent interacts with members
of the school board, on a scale of daily (6) to never (1).
Principal is the title given to the individual who oversees a school within a school district.
Principals can be thought of as middle managers who oversee the production personnel
(the teachers) of the districts.
Public management is the coordination of people and resources toward the accomplishment
of collective purpose; public management also involves tapping the interdependent organiza-
tional environment in support of such purpose and to protect the organization’s efforts from
potential disturbances.
Sm; see Managerial stability.
Superintendent is the chief operating officer of the school district. The superintendent is
appointed by the school board, generally for a fixed-term contract.
TAAS is the Texas Assessment of Academic Skills, a standardized test administered to Texas
students until 2003. The test was administered to different grades of students in different
years (with a general expansion of the number of grades). There were also specialized tests
given to assess knowledge gained from specific courses – e.g. an end of algebra exam. This
evolved into a high-stakes test that students had to pass in order to receive a regular diploma
from the state of Texas. The data used are the percentage of students passing all TAAS exams
that they took. See TAKS.
TAKS is the Texas Assessment of Knowledge and Skills, a standardized test used in Texas from
2003 onward. It replaced the TAAS, and, although it is more difficult than the TAKS, the
scores under it are highly correlated. See TAAS.
Texas Education Agency is a state agency in Texas that oversees the state’s school districts.
The TEA is also the agency that collects a wide range of performance data on Texas schools
and school districts. The agency has regulatory authority and is the pass-through agency for
funds allocated to the school district from the states.
References
291
292 References
Avellañeda, Claudia N. 2009a. “Mayoral quality and local government finance.” Public
Administration Review 69, 3: 469–86.
2009b. “Municipal performance: does mayoral quality matter?” Public Administration
Research and Theory 19, 2: 285–312.
Ban, Carolyn. 1995. How Do Public Managers Manage? Bureaucratic Constraints, Organiza-
tional Culture, and the Potential for Reform. San Francisco: Jossey-Bass.
Ban, Carolyn, and Norma N. Riccucci (eds.). 2002. Public Personnel Management: Current
Concerns, Future Challenges, 3rd edn. New York: Longman.
Bardach, Eugene. 1998. Getting Agencies to Work Together: The Practice and Theory of
Managerial Craftsmanship. Washington, DC: Brookings Institution Press.
Barnard, Chester I. 1938. The Functions of the Executive. Cambridge, MA: Harvard University
Press.
Bartle, John R. 1996. “Coping with cutbacks: city response to aid cuts in New York state.”
State and Local Government Review 28, 1: 38–48.
Barzelay, Michael. 2001. The New Public Management: Improving Research and Policy
Dialogue. Berkeley: University of California Press.
Barzelay, Michael, and Babak J. Armajani. 1992. Breaking through Bureaucracy: A New Vision
for Managing in Government. Berkeley: University of California Press.
Beam, David R., Timothy J. Conlan, and David B. Walker. 1983. “Federalism: the challenge
of conflicting theories and contemporary practice.” In Ada W. Finifter (ed.). Political
Science: The State of the Discipline: 247–82. Washington, DC: American Political Science
Association.
Beam, George. 2001. Quality Public Management: What It Is and How It Can Be Improved and
Adapted. Chicago: Burnham.
Behn, Robert D. 1991. Leadership Counts: Lessons for Public Managers. Cambridge, MA:
Harvard University Press.
2001. Rethinking Democratic Accountability. Washington, DC: Brookings Institution Press.
Bennis, Warren. 1993. An Invented Life: Reflections on Leadership and Change. Reading, MA:
Addison-Wesley.
Bertelli, Anthony M., and Laurence E. Lynn, Jr. 2006. Madison’s Managers: Public Adminis-
tration and the Constitution. Baltimore: Johns Hopkins University Press.
Bilmes, Linda, and Jeffrey Neal. 2003. “The people factor: human resources reform in
government.” In John Donahue and Joseph Nye (eds.). For the People: Can We Fix Public
Service?: 113–33. Washington, DC: Brookings Institution Press.
Bingham, Lisa Blomgren, and Rosemary O’Leary. 2008. Big Ideas in Collaborative Public
Management. Armonk, NY: M. E. Sharpe.
Bloom, Nicholas, and John van Reenen. 2007. “Measuring and explaining management
practices across firms and countries.” Quarterly Journal of Economics 122, 4: 1351–408.
Bogason, Peter, and Theo A. J. Toonen (eds.). 1998. “Comparing networks.” Symposium in
Public Administration 76, 2: 205–407.
Bohte, John. 2004. “Examining the impact of charter schools on performance in traditional
public schools.” Policy Studies Journal 32, 4: 501–20.
Bohte, John, and Kenneth J. Meier. 2000. “Goal displacement: assessing the motivation for
organizational cheating.” Public Administration Review 60, 2: 173–82.
Bollen, Kenneth. 1989. Structural Equations with Latent Variables. New York: Wiley.
293 References
Bowles, Samuel, and Herbert Gintis. 1976. Schooling in Capitalist America: Educational
Reform and the Contradictions of Economic Life. New York: Routledge & Kegan Paul.
Boyd, Donald, Hamilton Lankford, Susanna Loeb, and James H. Wyckoff. 2003. “Analyzing
the determinants of the matching of public school teachers to jobs: estimating compensating
differentials in imperfect labor markets.” Working Paper no. 9878. Cambridge, MA: National
Bureau of Economic Research [NBER] (available at http://ssrn.com/abstract=430592).
Boyne, George A. 2003. “Sources of public service improvement: a critical review and research
agenda.” Journal of Public Administration Research and Theory 13, 3: 367–94.
Boyne, George A., and Alex A. Chen. 2007. “Performance targets and public service improve-
ment.” Journal of Public Administration Research and Theory 17, 3: 455–77.
Boyne, George A., Kenneth J. Meier, Laurence J. O’Toole, Jr., and Richard M. Walker (eds.). 2006.
Public Service Performance: Perspectives on Measurement and Management. Cambridge
University Press.
Boyne, George A., and Richard M.Walker. 2006. “Strategy content and public service organi-
zations.” Journal of Public Administration Research and Theory 14, 2: 231–52.
Bozeman, Barry. 1987. All Organizations Are Public: Bridging Public and Private Organiza-
tional Theories. San Francisco: Jossey-Bass.
Brambor, Thomas, William Roberts Clark, and Matt Golder. 2006. “Understanding inter-
action models: improving empirical analyses.” Political Analysis 14, 1: 63–82.
Bressers, Hans, Laurence J. O’Toole, Jr., and Jeremy Richardson (eds.). 1995. Networks for
Water Policy: A Comparative Perspective. London: Frank Cass.
Bretschneider, Stuart, Frederick J. Marc-Aurele, and Jiannan Wu. 2005. “‘Best practices’
research: a methodological guide for the perplexed.” Journal of Public Administration
Research and Theory 15, 2: 307–23.
Breul, Jonathan D., and Nicole W. Gardner (eds.). 2004. Human Capital 2004. New York:
Rowman & Littlefield.
Brewer, Gene A. 2005. “In the eye of the storm: frontline supervisors and federal agency
performance.” Journal of Public Administration Research and Theory 15, 4: 505–27.
2006. “All measures of performance are subjective: more evidence on US federal agencies.”
In George A. Boyne, Kenneth J. Meier, Laurence J. O’Toole, Jr., and Richard M. Walker
(eds.). Public Services Performance: Perspectives on Measurement and Management:
35–54. Cambridge University Press.
Brewer, Gene A., and Sally C. Selden. 2000. “Why elephants gallop: assessing and predicting
organizational performance in federal agencies.” Journal of Public Administrative
Research and Theory 10, 4: 685–711.
Burt, Ronald S. 1992. Structural Holes: The Social Structure of Competition. Cambridge, MA:
Harvard University Press.
1997. “The contingent value of social capital.” Administrative Science Quarterly, 42, 2:
339–65.
Burtless, Gary (ed.). 1996. Does Money Matter? The Effect of School Resources on Student
Achievement and Adult Success. Washington, DC: Brookings Institution Press.
Carmines, Edward, and R. Zeller. 1979. Reliability and Validity Assessment. Newbury Park,
CA: Sage.
Christensen, Robert K., and Beth Gazley. 2008. “Capacity and public administration: analysis
of meaning and measurement.” Public Administration and Development 28, 4: 265–79.
294 References
Chubb, John, and Terry M. Moe. 1990. Politics, Markets and America’s Schools. Washington,
DC: Brookings Institution Press.
Chun, Young Han, and Hal G. Rainey. 2005. “Goal ambiguity and organizational perform-
ance in US federal agencies.” Journal of Public Administration Research and Theory 15, 4:
529–57.
2006. “Consequences of goal ambiguity for public organizations.” In George A. Boyne, Kenneth
J. Meier, Laurence J. O’Toole, Jr., and Richard M. Walker (eds.). Public Services Performance:
Perspectives on Measurement and Management: 92–112. Cambridge University Press.
Coggburn, Jerrell D., and Saundra K. Schneider. 2003. “The quality of management and
government performance: an empirical analysis of the American states.” Public Adminis-
tration Review 63, 2: 206–13.
Cohen, David B., Justin S. Vaughn, and José D. Villalobos. 2010. “Subjective performance
indicators and White House management.” Paper presented at the sixty-eighth annual
national conference of the Midwest Political Science Association. Chicago, April 23.
Cohen, Steven, and William Eimicke. 1995. The New Effective Public Manager: Achieving
Success in a Changing Government. San Francisco: Jossey-Bass.
Conan Doyle, Arthur. 1894. The Memoirs of Sherlock Holmes. London: George Newnes.
Cook, Brian J. 1996. Bureaucracy and Self-Government: Reconsidering the Role of Public
Administration in American Politics. Baltimore: Johns Hopkins University Press.
Council of State Governments. 2002. The Book of the States 2002. Lexington, KY: CSG.
Cyert, Richard M., and James G. March. 1963. A Behavioral Theory of the Firm. Englewood
Cliffs, NJ: Prentice-Hall.
Dalton, Dan R., William D. Todor, Michael J. Spendolini, Gordon J. Fielding, and Lyman W.
Porter. 1980. “Organizational structure and performance: a critical review.” Academy of
Management Review 5, 1: 49–64.
Dee, Thomas, and Martin West. 2008. “The non-cognitive returns to class size.” Working
Paper no. 13994. Cambridge, MA: NBER (available at www.nber.org/papers/w13994).
Derthick, Martha. 1970. The Influence of Federal Grants: Public Assistance in Massachusetts.
Cambridge, MA: Harvard University Press.
Doig, Jameson W., and Erwin C. Hargrove. 1987. Leadership and Innovation: A Biographical
Perspective on Entrepreneurs in Government. Baltimore: Johns Hopkins University Press.
1990. Leadership and Innovation: A Biographical Perspective on Entrepreneurs in Govern-
ment, abridged edn. Baltimore: Johns Hopkins University Press.
Donahue, Amy K., Willow S. Jacobson, Mark D. Robbins, Ellen V. Rubin, and Sally C. Selden.
2004. “Management and performance outcomes in state government.” In Patricia W.
Ingraham and Laurence E. Lynn, Jr. (eds.). The Art of Governance: Analyzing Manage-
ment and Administration: 123–51. Washington, DC: Georgetown University Press.
Donahue, Amy K., Sally C. Selden, and Patricia W. Ingraham. 2000. “Measuring government
management capacity: a comparative analysis of city human resources management
systems.” Journal of Public Administration Research and Theory 10, 2: 381–411.
Drucker, Peter. 1967. The Effective Executive. New York: Harper & Row.
Dull, Matthew. 2006. “Why PART? The institutional politics of presidential budget reform.”
Journal of Public Administration Research and Theory 16, 2: 187–215.
Dunn, Delmer D. 1997. Politics and Administration at the Top: Lessons from Down Under.
University of Pittsburgh Press.
295 References
Edelenbos, Jurian, and Erik-Hans Klijn. 2007. “Trust in complex decision-making networks: a
theoretical and empirical exploration.” Administration and Society 39, 1: 25–50.
Ehrenberg, Ronald G., Richard P. Chaykowski, and Randy A. Ehrenberg. 1988a. “Determin-
ants of the compensation and mobility of school superintendents.” Industrial and Labor
Relations Review 41, 3: 386–401.
1988b. “Are school superintendents rewarded for performance?” In D. H. Monk (ed.).
Micro-Level School Finance: Issues and Implications for Policy: 337–64. Cambridge, MA:
Ballinger.
Ellingsen, Tore, and Magnus Johannesson. 2007. “Paying respect.” Journal of Economic
Perspectives 21, 4: 135–49.
Elmore, Richard F. 1997. “The paradox of innovation in education: cycles of reform and the
resilience of teaching.” In Alan A. Altshuler and Robert D. Behn (eds.). Innovation in
American Government: Challenges, Opportunities, and Dilemmas: 246–73. Washington,
DC: Brookings Institution Press.
Enticott, Gareth, George A. Boyne, and Richard M. Walker. 2009. “The use of multiple
informants in administration research: data aggregation using organizational echelons.”
Journal of Public Administration Research and Theory 19, 2: 229–53.
Fennell, Mary L., and Jeffrey A. Alexander. 1987. “Organizational boundary spanning in
institutionalized environments.” Academy of Management Journal 30, 3: 456–76.
Ferlie, Ewan, Lynn Ashburner, Louise Fitzgerald, and Andrew Pettigrew. 1996. The New Public
Management in Action. Oxford University Press.
Ferlie, Ewan, Laurence E. Lynn, Jr., and Christopher Pollitt (eds.). 2005. The Oxford Hand-
book of Public Management. Oxford University Press.
Fernández, Sergio. 2005. “Developing and testing an integrative framework of public sector
leadership: evidence from the public education arena.” Journal of Public Administration
Research and Theory 15, 2: 197–217.
Forbes, Melissa, and Laurence E. Lynn, Jr. 2005. “How does public management affect
government performance? Findings from international research.” Journal of Public
Administration Research and Theory 15, 4: 559–84.
Frederickson, H. George. 1999. “The repositioning of American public administration.” PS:
Political Science and Politics 32, 4: 701–11.
Freeman, J. Leiper. 1965. The Political Process: Executive Bureau–Legislative Committee
Relations. New York: Random House.
Gage, Robert W., and Myrna P. Mandell (eds.). 1990. Strategies for Managing Intergovern-
mental Policies and Networks. New York: Praeger.
Galbraith, Jay R. 1973. Designing Complex Organizations. Reading, MA: Addison-Wesley.
General Accounting Office. 1999. Managing for Results: Opportunities for Continued Improve-
ments in Agencies’ Performance Plans. Washington, DC: Government Printing Office.
Gerth, H. H., and C. Wright Mills (eds.). 1958. From Max Weber: Essays in Sociology. Oxford
University Press.
Gilmour, John D., and David E. Lewis. 2006. “Assessing performance budgeting at OMB.”
Journal of Public Administration Research and Theory 16, 2: 169–86.
Goerdel, Holly T. 2006. “Taking initiative: proactive management and organizational per-
formance in networked environments.” Journal of Public Administration Research and
Theory 16, 3: 351–67.
296 References
Golembiewski, Robert T. 1962. The Small Group: An Analysis of Research Concepts and
Operations. University of Chicago Press.
1990. “Differences in burnout, by sector: public vs. business estimates using phases.”
International Journal of Public Administration 13, 4: 545–59.
Goodsell, Charles. 1993. “Reinventing government or rediscovering it?” Public Administration
Review 53, 1: 85–6.
Gore, Al. 1993. From Red Tape to Results: Creating a Government that Works Better and Costs
Less. Washington, DC: Government Printing Office.
Graue, Elizabeth, Kelly Hatch, Kalpana Rao, and Denise Oen. 2007. “The wisdom of class size
reduction.” American Educational Research Journal 44, 3: 670–700.
Gulick, Luther. 1937. “Notes on the theory of organization.” In Luther Gulick and Lyndall
Urwick (eds.). Papers on the Science of Administration: 3–35. New York: Institute of
Public Administration.
Guyatt, G., J. Cairns, D. Churchill, et al. 1992. “Evidence-based medicine: a new approach
to teaching the practice of medicine.” Journal of the American Medical Association 268,
17: 2420–5.
Hall, Thad E., and Laurence J. O’Toole, Jr. 2000. “Structures for policy implementation: an
analysis of national legislation, 1965–1966 and 1993–1994.” Administration and Society
31, 6: 667–86.
2004. “Shaping formal networks through the regulatory process.” Administration and
Society 36, 2: 186–207.
Hamilton, James D. 1994. Time Series Analysis. Princeton University Press.
Hanushek, Eric. 1996. “School resources and student performance.” In Gary Burtless (ed.).
Does Money Matter? The Effect of School Resources on Student Achievement and Adult
Success: 43–73. Washington, DC: Brookings Institution Press.
Hanushek, Erik A., John F. Kain, Steven G. Rivkin. 1998. “Teachers, schools, and academic
achievement.” Working Paper no. 6691. Cambridge, MA: NBER (available at http://ssrn.
com/abstract=122569).
Hargrove, Erwin C., and J. C. Glidewell (eds.). 1990. Impossible Jobs in Public Management.
Lawrence, KS: University of Kansas Press.
Hawes, Daniel P. 2006. “Haven’t we been here before? Political institutions, public manage-
ment, and bureaucratic performance.” Paper presented at the conference “Empirical
studies of organizations and public management.” College Station, TX, May 6.
Heclo, Hugh. 1977. A Government of Strangers: Executive Politics in Washington. Washington,
DC: Brookings Institution Press.
Hedges, Larry V., and Rob Greenwald. 1996. “Have times changed? The relation between school
resources and student performance.” In Gary Burtless (ed.). Does Money Matter? The Effect
of School Resources on Student Achievement and Adult Success: 74–92. Washington, DC:
Brookings Institution Press.
Heinrich, Carolyn J. 2007. “Evidence-based policy and performance management.” American
Review of Public Administration 37, 3: 255–77.
Hennessey, J. Thomas. 1998. “‘Reinventing’ government: does leadership make the differ-
ence?” Public Administration Review 58, 5: 522–32.
Hess, Frederick M. 1999. Spinning Wheels: The Politics of Urban School Reform. Washington,
DC: Brookings Institution Press.
297 References
Hicklin, Alisa K. 2006. “The quest for diversity: increasing minority student representation at
American public universities.” Unpublished Ph.D. dissertation. Department of Political
Science, Texas A&M University, College Station.
Hicklin, Alisa, Laurence J. O’Toole, Jr., and Kenneth J. Meier. 2008. “Serpents in the sand:
managerial networking and nonlinear influences on organizational performance.” Journal
of Public Administration Research and Theory 18, 2: 253–73.
Hicklin, Alisa K., Laurence J. O’Toole, Jr., Kenneth J. Meier, and Scott E. Robinson. 2009.
“Calming the storms: collaborative public management, Hurricanes Katrina and Rita,
and disaster response.” In Rosemary O’Leary and Lisa Bingham (eds.). The Collaborative
Manager: New Ideas for the Twenty-First Century: 95–114. Washington, DC: Georgetown
University Press.
Hill, Carolyn J., and Laurence E. Lynn, Jr. 2005. “Is hierarchical governance in decline?
Evidence from empirical research.” Journal of Public Administration Research and Theory
15, 2: 173–95.
Hill, Gregory C. 2009. “The effect of frequent managerial turnover on organizational per-
formance.” Social Science Journal 46, 3: 557–70.
Holzer, Marc, and Kathe Callahan. 1998. Government at Work: Best Practices and Model
Programs. Thousand Oaks, CA: Sage.
Hood, Christopher. 1991. “A public management for all seasons.” Public Administration 69,
1: 3–19.
Hufen, Hans, and Arthur Ringeling (eds.). 1990. Beleidsnetwerken: Overheids-, semi-
overheids-, en particuliere organisaties in wisselwerking. The Hague: VUGA.
Huxham, Colin. 2000. “The challenge of collaborative governance.” Public Management
Review 2, 3: 337–52.
Ingraham, Patricia W. 1993. “Of pigs in pokes and policy diffusion: another look at pay for
performance.” Public Administration Review 23, 4: 348–56.
(ed.). 2007. In Pursuit of Performance: Management Systems in State and Local Government.
Baltimore: Johns Hopkins University Press.
Ingraham, Patricia W., Philip G. Joyce, and Amy Kneedler Donahue. 2003. Government
Performance: Why Management Matters. Baltimore: Johns Hopkins University Press.
Ingraham, Patricia W., and Laurence E. Lynn, Jr. 2004. The Art of Governance: Analyzing
Management and Administration. Washington, DC: Georgetown University Press.
Ingraham, Patricia W., Sally C. Selden, and Donald Moynihan. 2000. “People and perform-
ance: challenges for the future of the public service: the report from the Wye River
conference.” Public Administration Review 60, 1: 54–60.
Jacobs, Ronald L., and Christopher Washington. 2003. “Employee development and organi-
zational performance: a review of literature and directions for future research.” Human
Resource Development International 6, 3: 343–54.
Jacobson, Willow S., Christine Kelleher Palus, and Cynthia J. Bowling. 2010. “A woman’s
touch? Gendered management and performance in state administration.” Journal of
Public Administration Research and Theory 20, 2: 477–504.
Jencks, Christopher, and Meredith Phillips (eds.). 1998. The Black–White Test Score Gap.
Washington, DC: Brookings Institution Press.
Johansen, Morgen S. 2007. “The effect of female strategic managers on organizational
performance.” Public Organization Review 7, 3: 269–79.
298 References
2008. “Measuring middle manager quality and its effect on organizational performance.”
Paper presented at the third conference on “Empirical studies of organizations and
public management.” College Station, TX, May 2.
Jones, Bryan D. 1985. Governing Buildings and Building Government: A New Perspective on the
Old Party. University: University of Alabama Press.
Katz, Daniel, and Robert L. Kahn. 1978. The Social Psychology of Organizations, 2nd edn. New
York: Wiley.
Kaufman, Herbert. 1960. The Forest Ranger: A Study in Administrative Behavior. Baltimore:
Johns Hopkins University Press.
1991. Time, Chance, and Organizations: Natural Selection in a Perilous Environment, 2nd
edn. Chatham, NJ: Chatham House.
Keiser, Lael R., Vicky M. Wilkins, Kenneth J. Meier, and Catherine Holland. 2002. “Lipstick
or logarithms: gender, identity, institutions and representative bureaucracy.” American
Political Science Review 96, 3: 553–64.
Kellough, J. Edward. 2006. “Employee performance appraisal in the public sector: uses
and limitations.” In Norma M. Riccucci (ed.). Public Personnel Management: Current
Concerns, Future Challenges, 4th edn.: 177–89. New York: Longman.
Kellough, J. Edward, and Lloyd G. Nigro. 2006. “Personnel policy and public management:
the critical link.” In J. Edward Kellough and Lloyd G. Nigro (eds.). Civil Service Reform in
the States: Personnel Policy and Politics at the Subnational Level: 1–10. Albany, NY: SUNY
Press.
Kellough, J. Edward, and Will Osuna. 1995. “Cross-agency comparisons of quit rates in the
federal service: another look at the evidence.” Review of Public Personnel Administration
15, 4: 58–68.
Kelman, Steven. 2008. “Public administration and organization studies.” In James P. Walsh
and Arthur P. Brief (eds.). The Academy of Management Annals, vol. I: 225–67. New
York: Lawrence Erlbaum Associates.
Kickert, Walter J. M., Erik-Hans Klijn, and Joop F. M. Koppenjan (eds.). 1997. Managing
Complex Networks: Strategies for the Public Sector. London: Sage.
Kim, Sangmook. 2005. “Individual-level factors and organizational performance in govern-
ment organizations.” Journal of Public Administration Research and Theory 15, 2: 245–61.
Klijn, Erik-Hans. 1996. Regels en sturing in netwerken: De invloed van networkregels op de
herstructurering van naoorlogsewijken. Delft: Eburon.
Koch, Marianne J., and Rita G. McGrath. 1996. “Improving labor productivity: human
resource management policies do matter.” Strategic Management Journal 17, 5: 335–54.
Kooiman, Jan. 2003. Governing as Governance. London: Sage.
Kozol, Jonathan. 1991. Savage Inequalities: Children in America’s Schools. New York: Crown
Publishers.
Krause, George A., and James W. Douglas. 2005. “Institutional design versus reputational effects
on bureaucratic performance: evidence from US government macroeconomic and
fiscal projections.” Journal of Public Administration Research and Theory 15, 2: 281–306.
Krueathep, Weerasak, Norma M. Riccucci, and Charas Suwanmala. 2010. “Why do agencies
work together? The determinants of network formation at the subnational level of
government in Thailand.” Journal of Public Administration Research and Theory 20, 1:
157–85.
299 References
Laczko-Kerr, Ildiko, and David C. Berliner. 2002. “The effectiveness of ‘Teach for America’
and other under-certified teachers on student academic achievement: a case of harmful
public policy.” Education Policy Analysis Archives 10, 37, http://epaa.asu.edu/epaa/
v10n37.
Lankford, Hamilton, Susanna Loeb, and James Wyckoff. 2002. “Teacher sorting and the plight
of urban schools: a descriptive analysis.” Educational Evaluation and Policy Analysis 24, 1:
37–62.
Lawrence, Paul R., and Jay W. Lorsch. 1967. Organization and Environment: Managing
Differentiation and Integration. Cambridge, MA: Harvard University Press.
Lazear, Edward P., and Kathryn L. Shaw. 2007. “Personnel economics: the economist’s view of
human resources.” Journal of Economic Perspectives 21, 4: 91–114.
Levine, Charles H. 1978. “Organizational decline and cutback management.” Public Adminis-
tration Review 38, 4: 316–25.
(ed). 1980. Managing Fiscal Crisis: The Crisis in the Public Sector. Chatham, NJ: Chatham
House.
Li, Ling X. 2000. “An analysis of sources of competitiveness and performance of Chinese
manufacturers.” International Journal of Operations and Production Management 28, 3:
375–92.
Light, Paul C. 1997. The Tides of Reform: Making Government Work, 1945–1995. New Haven,
CT: Yale University Press.
1998. Sustaining Innovation: Creating Nonprofit and Government Organizations that Innov-
ate Naturally. San Francisco: Jossey-Bass.
1999. The True Size of Government. Washington, DC: Brookings Institution Press.
2008. “A government ill executed: the depletion of the federal service.” Public Adminis-
tration Review 68, 3: 413–19.
Lineberry, Robert. 1977. Equality and Urban Policy: The Distribution of Municipal Public
Services. Beverley Hills, CA: Sage.
Lipsky, Michael. 1980. Street-Level Bureaucracy: Dilemmas of the Individual in Public Services.
New York: Russell Sage Foundation.
Lundin, Martin. 2007. “Explaining cooperation: how resource interdependence, goal congru-
ence, and trust affect joint actions in policy implementation.” Journal of Public Adminis-
tration Research and Theory 17, 4: 651–72.
Lynn, Laurence E., Jr. 1984. “The Reagan administration and the renitent bureaucracy.” In
Lester M. Salamon (ed.). The Reagan Presidency and the Governing of America: 339–70.
Washington, DC: Urban Institute.
1996. Public Management as Art, Science, and Profession. Chatham, NJ: Chatham House.
2001. “The myth of the bureaucratic paradigm: what traditional public administration
really stood for.” Public Administration Review 61, 2: 144–60.
2006. Public Management: Old and New. New York: Routledge.
Lynn, Laurence E., Jr., Carolyn J. Heinrich, and Carolyn J. Hill. 2000. “Studying governance
and public management: Why? How?” In Carolyn J. Heinrich and Laurence E. Lynn, Jr.
(eds.). Governance and Performance: New Perspectives: 1–33. Washington, DC: Georgetown
University Press.
2001. Improving Governance: A New Logic for Empirical Research. Washington, DC: George-
town University Press.
300 References
Lynn, Monty L. 2005. “Organizational buffering: managing boundaries and cores.” Organiza-
tional Studies 26, 1: 37–61.
McGregor, Douglas. 1960. The Human Side of Enterprise. New York: McGraw-Hill.
2006. The Human Side of Enterprise, annotated edn., updated and with commentary by
J. Cutcher-Gershenfeld. New York: McGraw-Hill.
McGuire, Michael. 2006. “Collaborative public management: assessing what we know and
how we know it.” Public Administration Review 66, 6 (Supplement): 33–43.
Malysa, Lani Lee. 1996. “A comparative assessment of state planning and management
capacity: tidal wetlands protection in Virginia and Maryland.” State and Local Govern-
ment Review 28, 3: 205–18.
Mandell, Myrna P. (ed.). 2001. Getting Results through Collaboration: Networks and Network
Structures for Public Policy and Management. Westport, CT: Quorum Books.
Martin, Stephen, and Peter C. Smith. 2005. “Multiple public service indicators: towards
an integrated statistical approach.” Journal of Public Administration Research and Theory
15, 4: 599–613.
Meier, Kenneth J. 2007. “The public administration of politics, or what political science could
learn from public administration.” PS: Political Science and Politics 40, 1: 3–9.
Meier, Kenneth J., Carl Doerfler, Daniel Hawes, Alisa K. Hicklin, and Rene R. Rocha. 2006.
“The role of management and representation in improving performance of disadvan-
taged students: an application of Bum Phillips’s ‘Don Shula rule.’ ” Review of Policy
Research 23, 5: 1095–110.
Meier, Kenneth J., Warren Eller, and Michael Pennington. 2005. “Race, sex, and Clarence
Thomas: representation change in the EEOC.” Public Administration Review 65, 2: 171–9.
Meier, Kenneth J., and Jeff Gill. 2000. What Works: A New Approach to Program and Policy
Analysis. Boulder, CO: Westview Press.
Meier, Kenneth J., and Alisa K. Hicklin. 2008. “Employee turnover and organizational
performance: testing a hypothesis from classical public administration.” Journal of Public
Administration Research and Theory 18, 4: 573–90.
Meier, Kenneth J., and Jill Nicholson-Crotty. 2006. “Gender, representative bureaucracy,
and law enforcement: the case of sexual assault.” Public Administration Review 66, 6:
850–60.
Meier, Kenneth J., and Laurence J. O’Toole, Jr. 2001. “Managerial strategies and behavior in
networks: a model with evidence from US public education.” Journal of Public Adminis-
tration Research and Theory 11, 3: 271–95.
2002. “Public management and organizational performance: the impact of managerial
quality.” Journal of Policy Analysis and Management 21, 4: 629–43.
2003. “Public management and educational performance: the impact of managerial
networking.” Public Administration Review 63, 6: 675–85.
2004a. “Conceptual issues in modeling and measuring management and its impacts on
performance.” In Patricia W. Ingraham and Laurence E. Lynn (eds.). The Art of Govern-
ance: Analyzing Management and Administration: 195–223. Washington, DC: Georgetown
University Press.
2004b. “Unsung impossible jobs: the politics of public management.” Unpublished paper.
2005. “Managerial networking: issues of measurement and research design.” Administration
and Society 37, 5: 523–41.
301 References
Mladenka, Kenneth R. 1980. “The urban bureaucracy and the Chicago political machine: who
gets what and the limits to political control.” American Political Science Review 74, 4:
991–8.
Moe, Ronald C. 1994. “The ‘Reinventing government’ exercise: misinterpreting the problem,
misjudging the consequences.” Public Administration Review 54, 2: 111–22.
Molnar, Alex, Philip Smith, John Zahorik, Amanda Planer, and Anke Halbach. 1999. “Evalu-
ating the SAGE program: a pilot program in targeted pupil–teacher reduction in
Wisconsin.” Educational Evaluation and Policy Analysis 21, 2: 165–77.
Moore, Mark H. 1995. Creating Public Value: Strategic Management in Government. Cam-
bridge, MA: Harvard University Press.
Moynihan, Donald. 2006. “What do we talk about when we talk about performance?
Dialogue theory and performance budgeting.” Journal of Public Administration Research
and Theory 16, 2: 151–68.
2008. The Dynamics of Performance Management: Constructing Information and Reform.
Washington, DC: Georgetown University Press.
Murphy, Kevin R., and Jeanette Cleveland. 1995. Understanding Performance Appraisal: Social,
Organizational, and Goal-Based Perspectives. Thousand Oaks, CA: Sage.
National Commission on Excellence in Education. 1983. A Nation at Risk: The Imperative for
Education Reform. Washington, DC: Government Printing Office.
Nicholson-Crotty, Sean, and Laurence J. O’Toole, Jr. 2004. “Public management and organ-
izational performance: the case of law enforcement agencies.” Journal of Public Adminis-
tration Research and Theory 14, 1: 1–18.
Nigro, Lloyd, Felix Nigro, and J. Edward Kellough. 2007. The New Public Personnel Adminis-
tration, 6th edn. Belmont, CA: Thomson Wadsworth.
O’Leary, Rosemary, and Lisa Blomgren Bingham (eds.). 2009. The Collaborative Public
Manager: New Ideas for the Twenty-First Century. Washington, DC: Georgetown Univer-
sity Press.
O’Toole, Laurence J., Jr. 1990. “Theoretical developments in public administration: implica-
tions for the study of federalism.” Governance 3, 4: 394–415.
1996. “Rational choice and the public management of interorganizational networks.” In
Donald F. Kettl and H. Brinton Milward (eds.). The State of Public Management: 241–63.
Baltimore: Johns Hopkins University Press.
1997. “Treating networks seriously: practical and research-based agendas in public admini-
stration.” Public Administration Review 57, 1: 45–52.
1998. Institutions, Policy, and Outputs for Acidification: The Case of Hungary. Aldershot:
Ashgate.
(ed.). 2000a. American Intergovernmental Relations: Foundations, Perspectives, and Issues,
3rd edn. Washington, DC: CQ Press.
2000b. “Different public managements? Implications of structural context in hierarchies
and networks.” In Jeffrey Brudney, Laurence J. O’Toole, and Hal G. Rainey (eds.).
Advancing Public Management: New Developments in Theory, Methods, and Practice:
19–32. Washington, DC: Georgetown University Press.
O’Toole, Laurence J., Jr., and Kenneth J. Meier. 1999. “Modeling the impact of public
management: implications of structural context.” Journal of Public Administration
Research and Theory 9, 4: 505–26.
303 References
Petrovsky, Nicolai. 2006. “Public management theory and federal programs: a test using
PART scores.” Paper presented at the conference “Empirical studies of organizations and
public management.” College Station, TX, May 5.
Pfeffer, James. 2007. “Human resources from an organizational behavior perspective: some
paradoxes.” Journal of Economic Perspectives 21, 4: 115–34.
Pfeffer, Jeffrey, and Gerald R. Salancik. 1978. The External Control of Organizations:
A Resource Dependence Perspective. New York: Harper & Row.
Pindyck, Robert S., and Daniel L. Rubinfeld. 1991. Econometric Models and Economic
Forecasts. New York: McGraw-Hill.
Pitts, David W. 2005. “Diversity, representation, and performance: evidence about race and
ethnicity in public organizations.” Journal of Public Administration Research and Theory
15, 4: 615–31.
2009. “Diversity management, job satisfaction, and performance: evidence from US federal
agencies.” Public Administration Review 69, 2: 328–38.
Pollitt, Christopher. 1990. Managerialism and the Public Services: The Anglo-American Experi-
ence. Oxford: Blackwell.
Pollitt, Christopher, and Geert Bouckaert. 2000. Public Management Reform: A Comparative
Analysis. Oxford University Press.
Powell, Walter W., and Paul J. DiMaggio (eds.). 1991. The New Institutionalism in Organiza-
tional Analysis. University of Chicago Press.
Pressman, Jeffrey. 1975. Federal Programs and City Politics: The Dynamics of the Aid Process in
Oakland. Berkeley: University of California Press.
Pressman, Jeffrey, and Aaron Wildavsky. 1984. Implementation: How Great Expectations in
Washington Are Dashed in Oakland; Or, Why It’s Amazing that Federal Programs Work at
all, This Being a Saga of the Economic Development Administration as Told by Two
Sympathetic Observers Who Seek to Build Morals on a Foundation of Ruined Hopes,
3rd edn. Berkeley: University of California Press.
Provan, Keith G., and H. Brinton Milward. 1991. “Institutional-level norms and organiza-
tional involvement in a service-implementation network.” Journal of Public Adminis-
tration Research and Theory 1, 4: 391–417.
1995. “A preliminary theory of interorganizational network effectiveness: a comparative
study of four community mental health systems.” Administrative Science Quarterly 40, 1:
1–33.
Putnam, Robert. 1993. Making Democracy Work: Civic Traditions in Modern Italy. Princeton
University Press.
2000. Bowling Alone: The Collapse and Revival of American Community. New York: Simon &
Schuster.
Radin, Beryl A. 2006. Challenging the Performance Movement: Accountability, Complexity, and
Democratic Values. Washington, DC: Georgetown University Press.
Raffel, Jeffrey A. 2007. “Why has public administration ignored public education, and does
it matter?” Public Administration Review 67, 1: 135–51.
Rainey, Hal G. 2003. Understanding and Managing Public Organizations, 3rd edn. San
Francisco: Jossey-Bass.
2009. Understanding and Managing Public Organizations, 4th edn. San Francisco: Jossey-
Bass.
305 References
Rainey, Hal G., and Paula Steinbauer. 1999. “Galloping elephants: developing elements of
a theory of government organizations.” Journal of Public Administration Research and
Theory 9, 1: 1–32.
Rattsø, Jørn. 1999. “Aggregate local public sector investment and shocks: Norway 1946–
1990.” Applied Economics 31, 4: 577–84.
Rethemeyer, R. Karl, and Deneen M. Hatmaker. 2008. “Network management recon-
sidered: an inquiry into management of network structures in public sector
service provision.” Journal of Public Administration Research and Theory 18, 4:
617–46.
Rhodes, R. A. W. 1997. Understanding Governance: Policy Networks, Governance, Reflexivity
and Accountability. Maidenhead: Open University Press.
Riccucci, Norma M. 1995. Unsung Heroes: Federal Executives Making a Difference. Washing-
ton, DC: Georgetown University Press.
2005. How Management Matters: Street-Level Bureaucrats and Welfare Reform. Washington,
DC: Georgetown University Press.
Rittel, Horst, and Melvin Webber. 1973. “Dilemmas in a general theory of planning.” Policy
Sciences 4, 2: 155–69.
Rivkin, Steven, G., Erik A. Hanushek, and John F. Kain. 2005. “Teachers, schools, and
academic achievement.” Econometrica 73, 2: 417–58.
Robinson, Scott, Kenneth J. Meier, Floun’say Caver, and Laurence J. O’Toole, Jr. 2007.
“Explaining policy punctuations: bureaucratic centralization, organizational size, and
the punctuated equilibrium theory of public agency budgets.” American Journal of
Political Science 51, 1: 140–50.
Roch, Christine H., and David W. Pitts. 2010. “Differing effects of representative bureaucracy
in charter schools and traditional public schools.” Unpublished paper. Department of
Public Management and Policy, Georgia State University, Atlanta.
Roch, Christine H., David W. Pitts, and Ignacio Navarro. 2010. “Representative bureaucracy
and policy tools: ethnicity, student discipline and representation in public schools.”
Administration and Society 42, 1: 38–65.
Rose, Richard. 1993. Lesson-Drawing in Public Policy: A Guide to Learning across Time and
Space. Chatham, NJ: Chatham House.
Rubin, Irene S. 2005. The Politics of Public Budgeting: Getting and Spending, Borrowing and
Balancing, 5th edn. Washington, DC: CQ Press.
Salisbury, Robert. H. 1984. “Interest representation: the domination of institutions.” Ameri-
can Political Science Review 78, 1: 64–76.
Sandfort, Jodi R. 1999. “The structural impediments to human service collaboration: the case
of welfare reform.” Social Service Review 73, 3: 314–39.
Sargent, Stephen. 2009. “The impact of internal management on organizational perform-
ance.” Unpublished Ph.D. dissertation. Deptartment of Political Science, Texas A&M
University, College Station.
Schalk, Jelmer, René Torenvlied, and Jim Allen. 2010. “Network embeddedness and public
agency performance: the strength of strong ties in Dutch higher education.” Journal of
Public Administration Research and Theory 20, 3: 629–53.
Scharpf, Fritz W. (ed.). 1993. Games in Hierarchies and Networks: Analytical and Empirical
Approaches to the Study of Governance Institutions. Frankfurt: Campus.
306 References
1997. Games Real Actors Play: Actor-Centered Institutionalism in Policy Research. Boulder,
CO: Westview Press.
Schattschneider, E. E. 1960. The Semi-Sovereign People: A Realist’s View of Democracy in
America. New York: Holt, Rinehart and Winston.
Scholzman, Kay Lehman. 1984. “What accent the heavenly chorus? Political equality and the
American pressure system.” Journal of Politics 46, 4: 1006–32.
Seidman, Harold. 1998. Politics, Position, and Power: The Dynamics of Federal Organization,
5th edn. New York: Oxford University Press.
Selden, Sally C. 1997. The Promise of Representative Bureaucracy: Diversity and Responsiveness
in a Government Agency. New York: M. E. Sharpe.
Selden, Sally C., and Willow Jacobson. 2007. “Government’s largest investment: human
resource management in states, counties, and cities.” In Patricia W. Ingraham (ed.). In
Pursuit of Performance: Management Systems in State and Local Government: 82–116.
Baltimore: Johns Hopkins University Press.
Selznick, Philip. 1949. TVA and the Grass Roots: A Study in the Sociology of Formal Organiza-
tion. Berkeley: University of California Press.
Shafritz, Jay M., David H. Rosenbloom, Norma M. Riccucci, Katherine C. Naff, and Al C.
Hyde. 2001. Personnel Management in Government: Politics and Process, 5th edn.
New York: Marcel Dekker.
Simon, Herbert A. 1946. “The proverbs of administration.” Public Administration Review 6,
1: 53–67.
1997. Administrative Behavior: A Study of Decision-Making Processes in Administrative
Organizations, 4th edn. New York: Free Press.
Smith, Kevin B. 2003. The Ideology of Education: The Commonwealth, the Market and
America’s Schools. Albany, NY: SUNY Press.
Sorenson, Olav. 2003. “Interdependence and adaptability: organizational learning and the
long-term effect of integration.” Management Science 49, 4: 446–63.
Spicer, Michael W., and Larry D. Terry. 1993. “Legitimacy, history and logic: public adminis-
tration and the constitution.” Public Administration Review 53, 3: 239–45.
Stoker, Gerry (ed.). 1999. The New Management of British Local Governance. Basingstoke:
Macmillan.
Stoker, Robert. 1992. Reluctant Partners: Implementing Federal Policy. University of Pittsburgh
Press.
Terry, Larry D. 2002. Leadership of Public Bureaucracies: The Administrator as Conservator,
2nd edn. Armonk, NY: M. E. Sharpe.
Thompson, Fred, and Lawrence R. Jones. 1994. Reinventing the Pentagon: How the New Public
Management Can Bring Institutional Renewal. San Francisco: Jossey-Bass.
Thompson, James D. 1967. Organizations in Action: Social Science Bases of Administrative
Theory. New York: McGraw-Hill.
Todd, Petra E., and Kenneth I. Wolpin. 2003. “On the specification and estimation of the
production function for cognitive achievement.” Economic Journal 113, 1: F3–F33.
Tyack, David. 1974. The One Best System: A History of American Urban Education. Cambridge,
MA: Harvard University Press.
US Census Bureau. 2008. 2007 Census of Governments. Washington, DC: Government
Printing Office.
307 References
Vaughn, Justin, and José Villalobos. 2009. “The managing of the presidency: applying theory-
driven empirical models to the study of White House bureaucratic performance.”
Political Research Quarterly 62, 1: 158–63.
Verba, Sidney, and Norman Nie. 1972. Participation in America: Political Democracy and
Social Equality. New York: Harper & Row.
Wagner, Kevin, and Jeff Gill. 2005. “Bayesian inference in public administration research.”
International Journal of Public Administration 28, 1: 5–35.
Walker, David M. 2001. Human Capital: Taking Steps to Meet Current and Emerging Human
Capital Challenges. Washington, DC: General Accounting Office.
Walker, Richard M., and George A. Boyne. 2006. “Public management reform and organiza-
tional performance: an empirical assessment of the UK Labour government’s
public service improvement strategy.” Journal of Policy Analysis and Management 25, 2:
371–93.
Walker, Richard M., Laurence J. O’Toole, Jr., and Kenneth J. Meier. 2007. “It’s where you are
that matters: an empirical analysis of the networking behaviour of English local govern-
ment officers.” Public Administration 85, 3: 739–56.
Wamsley, Gary L., Robert N. Bacher, Charles T. Goodsell, Philip S. Kronenberg, John A. Rohr,
Camilla M. Stivers, Orion F. White, and James F. Wolf. 1990. Refounding Public Adminis-
tration. Newbury Park, CA: Sage.
Wenger, Jeffrey B, Laurence J. O’Toole, Jr., and Kenneth J. Meier. 2008. “Trading speed for
accuracy? Managing goal conflict and accommodation in the US Unemployment Insur-
ance Program.” Policy Studies Journal 36, 2: 175–98.
Wenglinsky, Harold. 1997. How Educational Expenditures Improve Student Performance and
How They Don’t. Princeton, NJ: Educational Testing Service.
Wilkins, Vicky M., and Lael R. Keiser. 2006. “Linking passive and active representation
by gender: the case of child support agencies.” Journal of Public Administration Research
and Theory 16, 1: 87–102.
Wilson, James Q. 1989. Bureaucracy: What Government Agencies Do and Why They Do It.
New York: Basic Books.
Wilson, Woodrow. 1887. “The study of administration.” Political Science Quarterly 2, 2: 197–222.
Wirt, Frederick, and Michael Kirst. 2005. The Political Dynamics of American Education.
Berkeley, CA: McCutchan Publishing.
Wolf, Patrick J. 1993. “A case survey of bureaucratic effectiveness in US Cabinet
agencies: preliminary results.” Journal of Public Administration Research and Theory 3,
2: 161–81.
Wong, Kenneth K. 1999. Funding Public Schools: Politics and Policies. Lawrence: University
Press of Kansas.
Wood, Stephen. 1999. “Human resource management and performance.” International Jour-
nal of Management Reviews 1, 4: 367–414.
Woodward, Joan. 1965. Industrial Organization: Theory and Practice. Oxford University Press.
Wright, Deil S. 1988. Understanding Intergovernmental Relations, 3rd edn. Pacific Grove, CA:
Brooks/Cole.
1990. “Federalism, intergovernmental relations, and intergovernmental management:
historical reflections and conceptual comparisons.” Public Administration Review 50, 2:
168–78.
308 References
Wrinkle, Robert D., Joseph Stewart, and Jerry L. Polinard. 1999. “Public school quality,
private schools and race.” American Journal of Political Science 43, 4: 1248–53.
Wulf, Henry S. 2002. “Trends in state government finances.” In Council of State Govern-
ments. The Book of the States 2002: 269–74. Lexington, KY: CSG.
Yukl, Gary. 2006. Leadership in Organizations, 6th edn. Upper Saddle River, NJ: Prentice Hall.
Zeigler, L. Harmon, and G. Wayne Peak. 1972. Interest Groups in American Society. Englewood
Cliffs, NJ: Prentice-Hall.
Index
309
310 Index