All going well, it will be out in November 2019. We are now at the proofing stage.
I was invited by Dr Emamian from the Governance and Policy Think Tank to deliver this short lecture at the first ‘governance and public policy conference’ in Iran. I was unable to attend, so recorded a set of short video presentations supplemented by blog discussion. The topics to be covered include the importance of a scholarly network for policy studies, the need for a set of core policy concepts to act as a technical language for that network, and the need to apply that language to explain shifts in government and regulation towards ‘regulatory governance’.
Please note that my choice to record the videos in my garden (while I look up) seemed good at the time, for some very good reasons that I won’t get into. However, you will see that I become increasingly cold and annoyed at being cold. I can only apologize for my face and the fact that I was too cold to remember to put on my professional voice.
Using shared concepts in a scholarly network of policy researchers
Our aim may be to produce a global network of policy scholars, in two main ways:
For example, when considering the applicability of US-inspired theories, think about their taken-for-granted assumptions about the nature of a political system, in which leaders in many levels and types of government are elected regularly, there is a constitution guaranteeing a division of powers across legislative-executive-judicial branches and between federal/subnational levels, and people describe a ‘pluralist’ system in which many groups mobilise and counter-mobilise to influence policy.
What happens when we stop taking this political context for granted? Do these theories remain as relevant?
Which concepts do we use?
I describe two main abstract concepts then invite you to think about how to apply them in more concrete circumstances.
No-one can understand fully the world in which we live. Individuals can only understand and pay attention to a tiny part of key aspects of the world such as political systems.
Indeed, a handy phrase to remember is that almost all people must ignore almost everything almost all of the time.
Yet, they must make choices despite uncertainty, perhaps by adopting ‘fast and frugal’ heuristics. In other words, we may see all human choices as flawed when compared with an ideal of perfect decision-making. On the other hand, we may marvel at the ways in which humans make often-good choices despite their limitations.
Individual policymakers use two short-cuts to gather enough information to make choices:
In that context, policy scholarship involves the study of how people make and influence those choices. One part is about the role of evidence, in which people produce information to reduce uncertainty about the nature of the world. However, the more important study is of how people understand the world in the first place. As policy scholars, we focus on ambiguity, to describe the many ways in which people choose to understand the same problems, and the exercise of power to influence those choices.
Things get more complicated when we move from the analysis of (a) key individuals to (b) the interaction between many individuals and organisations in a complex policymaking ‘system’ or ‘environment’. Policy scholars describe this environment in many different ways, using different concepts, but we can identify a core set of terms on which to focus:
In that context, policy scholarship focuses on producing theories to explain what happens when policymakers have limited control over their political systems and policymaking environments.
How far do these concepts travel?
As you can see, these concepts are widely applicable because they are abstract. What happens when we try to apply them to specific countries or case studies? For example:
This is where our global network becomes valuable, to help us describe how we make sense of the same concepts in very different ways, and consider the extent to which such discussions are comparable.
Example: how do governments address an ‘era of governance’?
One way to foster such discussion is to consider how governments address the limits to their powers. These limits are described in many different ways, from a focus on ‘complexity’ and policy outcomes which ‘emerge’ from local activity (despite attempts by central governments to control outcomes), to a focus on the shift from ‘government’ to ‘governance’.
As policy scholars, we can make several useful distinctions to describe these dynamics, such as to separate an actual shift in policymaking from government to governance, versus a shift in the way we now describe government.
Or, we can separate how governments can, do, and should address the limits to their powers.
I’d say that most policy scholarship focuses on how governments operate: how they actually address problems and what are the – intended and unintended – consequences.
However, these studies are trying to describe the tensions between what governments can do, given the limits I describe, and what they think they should do, given their position of authority and their need to describe their success.
For example, some systems may be more conducive to the support for ‘polycentric governance’, in which many authoritative venues cooperate to address problems, while others are built on the idea of central control and the concentration of authority in a small group of actors.
Therefore, the study of actual policymaking and outcomes will vary markedly according to the ways in which government actors feel they need to assert an image of control over a policy environment which is almost immune to control.
Perhaps an ‘era of governance’ describes some recognition by many governments that they need to find new ways to address their limited control over policy outcomes, both domestically and globally. However, an enduring theme in political science and policy studies is that we do not explain policymaking well if we restrict our attention to the ‘rational’ decisions of a small number of actors. Let’s not make too many assumptions about their power and motive.
These notes are for my brief panel talk at the European Parliament-European University Institute ‘Policy Roundtable’: Evidence and Analysis in EU Policy-Making: Concepts, Practice and Governance. As you can see from the programme description, the broader theme is about how EU institutions demonstrate their legitimacy through initiatives such as stakeholder participation and evidence-based policymaking (EBPM). So, part of my talk is about what happens when EBPM does not exist.
The post is a slightly modified version of my (recorded) talk for Open Society Foundations (New York) but different audiences make sense of these same basic points in very different ways.
The main limitation to ‘evidence-based policy-making’ is that no-one really knows what it is or what the phrase means. So, each actor makes sense of EBPM in different ways and you can tell a lot about each actor by the way in which they answer these questions:
‘Comprehensive rationality’ describes the absence of ambiguity and uncertainty when policymakers know what problem they want to solve and how to solve it, partly because they can gather and understand all information required to measure the problem and determine the effectiveness of solutions.
Instead, we talk of ‘bounded rationality’ and how policymakers deal with it. They employ two kinds of shortcut: ‘rational’, by pursuing clear goals and prioritizing certain kinds and sources of information, and ‘irrational’, by drawing on emotions, gut feelings, deeply held beliefs, habits, and familiarity, make decisions quickly.
I say ‘irrational’ provocatively, to raise a key strategic question: do you criticise emotional policymaking (describing it as ‘policy based evidence’) and try somehow to minimise it, adapt pragmatically to it, or see ‘fast thinking’ more positively in terms of ‘fast and frugal heuristics’? Regardless, policymakers will think that their heuristics make sense to them, and it can be counterproductive to simply criticise their alleged irrationality.
‘Policy cycle’ describes the idea that there is a core group of policymakers at the ‘centre’, making policy from the ‘top down’, and pursuing their goals in a series of clearly defined and well-ordered stages, such as: agenda setting, policy formulation, legitimation, implementation, and evaluation. In this context, one might identify how to influence a singular point of central government decision.
For stakeholders, an effective engagement strategy is not straightforward: it takes time to know ‘where the action is’, how and where to engage with policymakers, and with whom to form coalitions. For the Commission, it is difficult to know what will happen to policy after it is made (although we know the end point will not resemble the starting point). For the Parliament, it is difficult even to know where to look.
There are several principles of ‘good’ policymaking and only one is EBPM. Others relate to the value of pragmatism and consensus building, combining science advice with public values, improving policy delivery by generating ‘ownership’ of policy among key stakeholders, and sharing responsibility with elected national and local policymakers.
Our choice of which principle and forms of evidence to privilege are inextricably linked. For example, some forms of evidence gathering seem to require uniform models and limited local or stakeholder discretion to modify policy delivery. The classic example is a programme whose value is established using randomised control trials (RCTs). Others begin with local discretion, seeking evidence from stakeholders, professional groups, service user and local practitioner experience. This principle seems to rule out the use of RCTs, at least as a source of a uniform model to be rolled out and evaluated. Of course, one can try to pursue both approaches and a compromise between them, but the outcome may not satisfy advocates of either approach to EBPM or help produce the evidence that they favour.
These insights should prompt us to see how far we are willing, and should, go to promote the use of certain forms of evidence in policymaking
Where we go from there is up to you
The value of policy theory to this topic is to help us reject simplistic models of EBPM and think through the implications of more sophisticated and complicated processes. It does not provide a blueprint for action (how could it?), but instead a series of questions that you should answer when you seek to use evidence to get what you want. They are political choices based on value judgements, not issues that can be resolved by producing more evidence.
This week, we continue with the idea of two stories of British politics. In one, the Westminster model-style story, the moral is that the centralisation of power produces clear lines of accountability: you know who is in charge and, therefore, the heroes or villains. In another, the complex government story, the world seems too messy and power too diffuse to know all the main characters.
Although some aspects of these stories are specific to the UK, they relate to some ‘universal’ questions and concepts that we can use to identify the limits to centralised power. Put simply, some rather unrealistic requirements for the Westminster story include:
If life were that simple, I wouldn’t be asking you to read the following blog posts (underlined) which complicate the hell out of our neat story:
You don’t know what policy is, and it is not only made by a small number of actors at the heart of government.
We don’t really know what government policy is. In fact, we don’t even know how to define ‘public policy’ that well. Instead, a definition like ‘the sum total of government action, from signals of intent to the final outcomes’ raises more issues than it settles: policy is remarkably difficult to identify and measure; it is made by many actors inside, outside, and sort of inside/outside government; the boundary between the people influencing and making policy is unclear; and, the study of policy is often about the things governments don’t do.
Actors don’t possess comprehensive knowledge about the problems and solutions they describe
It’s fairly obvious than no-one possesses all possible information about policy problems and the likely effects of proposed solutions. It’s not obvious what happens next. Classic discussions identified a tendency to produce ‘good enough’ decisions based on limited knowledge and cognitive ability, or to seek other measures of ‘good’ policy such as their ability to command widespread consensus (and no radical movement away from such policy settlements). Modern discussions offer us a wealth of discussions of the implications of ‘bounded rationality’, but three insights stand out:
Policymakers cannot turn policy intent into policy outcomes in a straightforward way
The classic way to describe straightforward policymaking is with reference to a policy cycle and its stages. This image of a cycle was cooked up by marketing companies trying to sell hula hoops to policymakers and interest groups in the 1960s. It is not an accurate description of policymaking (but spirographs are harder to sell).
Instead, for decades we have tried to explain the ‘gap’ between the high expectations of policymakers and the actual – often dispiriting- outcomes, or wonder if policymakers really have such high expectations for success in the first place (or if they prefer to focus on how to present any of their actions as successful). This was a key topic before the rise of ‘multi-level governance’ and the often-deliberate separation of central government action and expected outcomes.
The upshot: in Westminster systems do you really know who is in charge and who to blame?
These factors combine to generate a sense of complex government in which it is difficult to identify policy, link it to the ‘rational’ processes associated with a small number of powerful actors at the heart of government, and trace a direct line from their choices to outcomes.
Of course, we should not go too far to argue that governments don’t make a difference. Indeed, many ministers have demonstrated the amount of damage (or good) you can do in government. Still, let’s not assume that the policy process in the UK is anything like the story we tell about Westminster.
In the seminar, I’ll ask you reflect on these limits and what they tell us about the ‘Westminster model’. We’ll start by me asking you to summarise the main points of this post. Then, we’ll get into some examples in British politics.
Try to think of some relevant examples of what happens when, for example, minsters seem to make quick and emotional (rather than ‘evidence based’) decisions: what happens next? Some obvious examples – based on our discussions so far – include the Iraq War and the ‘troubled families’ agenda, but please bring some examples that interest you.
In group work, I’ll invite you to answer these questions:
I’ll also ask you to identify at least one blatant lie in this blog post.
I want you to think about the simple presentation of complex thought.
To that end, this week we focus on two stories of politics, and next month you can use these questions to underpin your coursework.
Imagine the study of British politics as the telling of policymaking stories.
We can’t understand or explain everything about politics. Instead, we turn a complex world into a set of simple stories in which we identify, for example, the key actors, events and outcomes. Maybe we’ll stick to dry description, or maybe we’ll identify excitement, heroes, villains, and a moral. Then, we can compare these tales, to see if they add up to a comprehensive account of politics, or if they give us contradictory stories and force us to choose between them.
As scholars, we tell these stories to help explain what is happening, and do research to help us decide which story seems most convincing. However, we also study policymakers who use such stories to justify their action, or the commentators using them to criticise the ineffectiveness of those policymakers. So, one intriguing and potentially confusing prospect is that we can tell stories about policymakers (or their critics) who tell misleading stories!
Remember King Canute (Cnut)
If you’re still with me, have a quick look at Hay’s King Canute article (or my summary of it). Yes, that’s right: he got a whole article out of King Canute. I couldn’t believe it either. I was gobsmacked when I realised how good it was too. For our purposes, it highlights three things:
The two stories
This week, we’ll initially compare two stories about British politics: the Westminster Model and Complex Government. I present them largely as contrasting accounts of politics and policymaking, but only to keep things simple at first.
One is about central control in the hands of a small number of ministers. It contains some or all of these elements, depending on who is doing the telling:
Another is about the profound limits to the WM:
What is the moral of these stories?
For us, a moral relates to (a) how the world works or should work, (b) what happens when it doesn’t work in the way we expect, (c) who is to blame for that, and/ or (d) what we should do about it.
For example, what if we start with the WM as a good thing: you get strong, decisive, and responsible government and you know who is in charge and therefore to blame. If it doesn’t quite work out like that, we might jump straight to pragmatism: if elected policymakers can’t govern from the centre, you don’t get strong and decisive government, it makes little sense to blame elected policymakers for things outside of their control, and so we need more realistic forms of accountability (including institutional, local, and service-user).
Who would buy that story though? We need someone to blame!
Yet, things get complicated when you try to identify a moral built on who to blame for it:
There is a ‘universal’ part of the story, and it is difficult to hold a grudge against the universe. In other words, think of the aspects of policymaking that seem to relate to limitations such as ‘bounded rationality’. Ministers can only pay attention to a fraction of the things for which they are formally in charge. So, they pay disproportionate attention to a small number of issues and ignore the rest. They delegate responsibility for those tasks to civil servants, who consult with stakeholders to produce policy. Consequently, there is a blurry boundary between formal responsibility and informal influence, often summed up by the term governance rather than government. A huge number of actors are involved in the policy process and it is difficult to separate their effects. Instead, think of policy outcomes as the product of collective action, only some of which is coordinated by central government. Or, policy outcomes seem to ‘emerge’ from local practices and rules, often despite central government attempts to control them.
There is UK–specific part of the story, but it’s difficult to blame policymakers that are no longer in government. UK Governments have exacerbated the ‘governance problem’, or the gap between an appearance of central control and what central governments can actually do. A collection of administrative reforms from the 1980s, many of which were perhaps designed to reassert central government power, has reinforced a fragmented public landscape and a periodic sense that no one is in control. Examples include privatisation, civil service reforms, and the use of quangos and non-governmental organisations to deliver policies. Further, a collection of constitutional reforms has shifted power up to the EU and down to devolved and regional or local authorities.
How do policymakers (and their critics) tell these stories, how should they tell them, and what is the effect in each case?
Let’s see how many different stories we can come up with, perhaps with reference to specific examples. Their basic characteristics might include:
In broader terms, let’s discuss what happens when our two initial stories collide: when policymakers need to find a way to balance a pragmatic approach to complexity and the need to describe their activities in a way that the public can understand and support.
For example, do they try to take less responsibility for policy outcomes, to reflect their limited role in complex government, and/ or try to reassert central control, on the assumption that they may as well be more influential if they will be held responsible?
The answer, I think, is that they try out lots of solutions at the same time:
We might also talk, yet again, about Brexit. If Brexit is in part a response to these problems of diminished control, what stories can we identify about how ministers plan to take it back? What, for example, are the Three Musketeers saying these days? And how much control can they take back, given that the EU is one small part of our discussion?
Illustrative example: (1) troubled families
I can tell you a quick story about ‘troubled families’ policy, because I think it sums up neatly the UK Government’s attempt to look in control of a process over which it has limited influence:
Illustrative example: (2) prevention and early intervention
If you are still interested by this stage, look at this issue in its broader context, of the desire of governments to intervene early in the lives of (say) families to prevent bad things happening. With Emily St Denny, I ask why governments seem to make a sincere commitment to this task but fall far shorter than they expected. The key passage is here:
“Our simple answer is that, when they make a sincere commitment to prevention, they do not know what it means or appreciate scale of their task. They soon find a set of policymaking constraints that will always be present. When they ‘operationalise’ prevention, they face several fundamental problems, including: the identification of ‘wicked’ problems (Rittell and Webber, 1973) which are difficult to define and seem impossible to solve; inescapable choices on how far they should go to redistribute income, distribute public resources, and intervene in people’s lives; major competition from more salient policy aims which prompt them to maintain existing public services; and, a democratic system which limits their ability to reform the ways in which they make policy. These problems may never be overcome. More importantly, policymakers soon think that their task is impossible. Therefore, there is high potential for an initial period of enthusiasm and activity to be replaced by disenchantment and inactivity, and for this cycle to be repeated without resolution”.
Here is what I’ll ask you to do this week:
Two recent news features sum up the role of emotion and ‘chaos’ in policymaking.
The first is ‘Irritation and anger’ may lead to Brexit, says influential psychologist in The Telegraph. The headline suggests that people may vote Leave for emotional reasons, rather than with reference to a more ‘rational’ process in which people identify the best evidence and use it to weight up the short and long term consequences of action.
Yet, the article confirms that we’re all at it! To be human is to use emotional, gut-level, and habitual thinking to turn a complex world, with too much information, into a good enough decision in a necessary short amount of time.
In debate, evidence is mentioned a lot, but only to praise the evidence backing my decision and rejecting yours. Or, you only trust the evidence from people you trust. If you trust the evidence from certain scientists, you stress their scientific credentials. If not, you find some from other experts. Or, if all else is lost, you reject experts as condescending elites with a hidden agenda. Or, you say simply that they can’t be that clever if they agree with smarmy Cameron/ Johnson.
Lesson 1: you can see these emotional and manipulative approaches to policymaking play out in the EU referendum. Don’t assume that policymaking behind closed doors, on other issues, is any different.
The second feature is Lost in Transit: chaos in government research in The Economist.
It describes a Sense about Science report which (a) was commissioned ‘following a spate of media stories about government research being suppressed or delayed’, and (b) finds that ‘The UK government spends around £2.5 billion a year on research for policy, but does not know how many studies it has commissioned or which of them have been published’.
The Economist reports the perhaps-unexpected result of the inquiry:
But the main gripe is the sheer disorganisation of it all. The report’s afterword states that “Sir Stephen looked for suppression and found chaos”.
Such accounts reflect the two contradictory stories that we often tell about government. The first relates to the Westminster model of democratic accountability which helps concentrate power at the centre of government: if you know who is in charge, you know who to blame.
The second, regarding complex government, describes a complicated world of public policy in which no-one seems to be in control. For example, we make reference to: the huge size and reach of government; the potential for ministerial ‘overload’ and need to simplify decision-making; the blurry boundaries between the actors who make and influence policy; the multi-level nature of policymaking; and, the proliferation of rules and regulations, many of which may undermine each other.
The problem with the first story is that (a) although it is easy to tell during elections and inquiries, (b) you always struggle to find it when you actually study government.
The problem with the second is that, (a) although it seems realistic when you study government, (b) few people will buy it when they are seeking to hold ministers and governments to account. This problem may be exacerbated by the terms of reference of reports: few will accept a pragmatic response, based on the second story of complexity, if you start out by using the first story of central control to say that you will track down and solve the problem!
Lesson 2: if you assume central control you will find chaos (and struggle to produce feasible recommendations to deal with it). The manipulation of evidence takes place in a complex policymaking system over which no individual or ‘core executive’ has control. Indeed, no single person or organisation could even pay attention to all that goes on within government. This insight requires pragmatic inquiries and solutions, not the continuous reassertion of central control and discovery of ‘chaos’.
It might be possible to develop a third lesson if we put these two together. One part of the EU debate reflects our inability to understand EU policymaking and relate it to the relatively clear processes in the UK, in which you know who is in charge and therefore who to blame. The EU seems less democratic because it is so complex and remote. Yet, if we follow this other story about complexity in the UK, we often find that UK politics is also difficult to follow. Its image does not describe reality.
Lesson 3: when you find policymaking complexity in the EU, don’t assume it is any better in the UK! Instead, try to compare like with like.
I expand on both lessons in The Politics of Evidence-Based Policymaking