Tag Archives: Complex systems

Understanding Public Policy 2nd edition?

Almost. I have done a full draft that I will redraft one more time following external feedback and review (then during copy-editing). I am hoping that you might also read some of it and give me feedback, if only to point out big mistakes before it is too late. To be honest, by this stage, I won’t be adding major new sections or chapters (and I no longer want to read this thing), but please let me know if there are big gaps that I should fill in the third edition.

I have included below the introduction and conclusion (and each chapter should also have its own entry (or multiple entries) in the 1000 Words and 500 Words series) and invite you to get in touch – via email or Twitter DM – if you would like a copy of the whole thing.

Preface

Chapter 1 Introduction to policy and policymaking

Chapter 13 Conclusion

New references

Old references

If you would like to see the likely cover:

2nd ed cover

 

 

 

2 Comments

Filed under 1000 words, 500 words, agenda setting, Evidence Based Policymaking (EBPM), Policy learning and transfer, public policy

Policy in 500 Words: Ecology of Games

The ‘Ecology of Games Framework’ (EG) combines insights from many approaches to analyze ‘institutional complexity’ and ‘complex institutional systems’.

The focus is on actors learning how to secure ‘mutually beneficial outcomes’, cooperating to produce and deliver agreed solutions, and bargaining within a system over which no actor has control. Therefore, it is worth reading the posts on game theory, the IAD, and SES first (especially if, like me, you associated ‘game’ with tig, then Monopoly, then The Wire).

Dz3Hmy2VsAAoO72.png

Insights from three key approaches

EG connects Norton’s ‘ecology of games’, the IAD, and insights from complexity theory to reinforce the idea that institutional arrangements are not simple and orderly.

In simple games, we need only analyse the interaction between a small number of actors with reference to one set of self-contained rules providing clear sanctions or payoffs. In real world policymaking, many different games take place at the same time in different venues.

Some policy games may be contained within a geographical area – such as California – but there are no self-contained collective action problems:

  • Examples such as ‘biodiversity’, ‘ecology’ or ‘environmental’ policies command a collection of interdependent policies relating to issues like local planning, protected species, water management, air pollution, transport, energy use, and contributors to such policies or policy problems in other areas of government (such as public services).
  • Each contributor to policy may come from different institutions associated with many policymaking venues spread across many levels and types of government.

Consequently, many games interact with each other. The same actor might participate in multiple games subject to different rules. Further, each game produces ‘externalities’ for the others; the ‘payoffs’ to each game are connected and complicated.

A focus on ‘complex adaptive systems’ suggests that central governments do not have the resources to control – or understand fully – interaction at this frequency and scale. Rather, policymaking influences are:

  • Internal to the game, when actors (a) follow and shape the rules of each institution, and (b) learn through trial and error.
  • External to the game, when physical resources change, or central levels of government change the resources of local actors.

Insights from the wider literature

The EG brings in wider insights – from theories in the 500 and 1000 Words series – to analyse this process. Examples include:

Consequently, we have come a long way from simple assumptions about human behaviour outlined in our first post in this series.

As with the IAD, the EG emphasis is on (a) finding solutions to complex (largely environmental) policy problems, with reference to (b) initiatives consistent with self-organising systems such as ‘collaborative governance’. Like most posts in this series, it rejects a naïve attachment to a single powerful central government. Policymaking is multi-centric, and solutions to complex problems will emerge in that context.

See also:

Policy Concepts in 1000 Words: the Institutional Analysis and Development Framework (IAD) and Governing the Commons

Policy Concepts in 1000 Words: it’s time for some game theory

Policy in 500 Words: the Social-Ecological Systems Framework

Policy Concepts in 1000 Words: Rational Choice and the IAD (the older post for the 1st edition)

Policy Concepts in 1000 Words: Multi-centric Policymaking

How to Navigate Complex Policy Designs

How can governments better collaborate to address complex problems?

 

3 Comments

Filed under 500 words, public policy

The global study of governance and public policy

Cairney GPP Iran

I was invited by Dr Emamian from the Governance and Policy Think Tank to deliver this short lecture at the first ‘governance and public policy conference’ in Iran. I was unable to attend, so recorded a set of short video presentations supplemented by blog discussion. The topics to be covered include the importance of a scholarly network for policy studies, the need for a set of core policy concepts to act as a technical language for that network, and the need to apply that language to explain shifts in government and regulation towards ‘regulatory governance’.

Please note that my choice to record the videos in my garden (while I look up) seemed good at the time, for some very good reasons that I won’t get into. However, you will see that I become increasingly cold and annoyed at being cold. I can only apologize for my face and the fact that I was too cold to remember to put on my professional voice.

Using shared concepts in a scholarly network of policy researchers

Our aim may be to produce a global network of policy scholars, in two main ways:

  1. To foster meetings and discussion, such as via this conference and others such as the ICPP and ECPR
  2. To make sure that we are talking about the same thing. Most of the theories to which I refer are based on studies of countries like the US and UK. Their prominence contributes to a ‘global north’ perspective which can be useful in the abstract but with uncertain applicability across the globe.

For example, when considering the applicability of US-inspired theories, think about their taken-for-granted assumptions about the nature of a political system, in which leaders in many levels and types of government are elected regularly, there is a constitution guaranteeing a division of powers across legislative-executive-judicial branches and between federal/subnational levels, and people describe a ‘pluralist’ system in which many groups mobilise and counter-mobilise to influence policy.

What happens when we stop taking this political context for granted? Do these theories remain as relevant?

Which concepts do we use?

I describe two main abstract concepts then invite you to think about how to apply them in more concrete circumstances.

  1. Bounded rationality, not comprehensive rationality.

No-one can understand fully the world in which we live. Individuals can only understand and pay attention to a tiny part of key aspects of the world such as political systems.

Indeed, a handy phrase to remember is that almost all people must ignore almost everything almost all of the time.

Yet, they must make choices despite uncertainty, perhaps by adopting ‘fast and frugal’ heuristics. In other words, we may see all human choices as flawed when compared with an ideal of perfect decision-making. On the other hand, we may marvel at the ways in which humans make often-good choices despite their limitations.

Individual policymakers use two short-cuts to gather enough information to make choices:

  • ‘Rational’, in which they adopt measures to ensure that they have good enough information to inform decisions. For example, they prioritise certain written sources of information and draw on people they consider to be experts.
  • ‘Irrational’, in which they rely on things like gut instinct, habit, and emotion to make snap decisions.

In that context, policy scholarship involves the study of how people make and influence those choices. One part is about the role of evidence, in which people produce information to reduce uncertainty about the nature of the world. However, the more important study is of how people understand the world in the first place. As policy scholars, we focus on ambiguity, to describe the many ways in which people choose to understand the same problems, and the exercise of power to influence those choices.

  1. A complex policymaking environment, not a policy cycle.

Things get more complicated when we move from the analysis of (a) key individuals to (b) the interaction between many individuals and organisations in a complex policymaking ‘system’ or ‘environment’. Policy scholars describe this environment in many different ways, using different concepts, but we can identify a core set of terms on which to focus:

  • Actors. There are many policy influencers and policymakers in many authoritative venues spread across many levels and types of government.
  • Institutions. Each venue has its own rules, including the formal, written-down, and easy to understand rules, versus the informal norms, cultures, and practices which are difficult to identify and describe.
  • Networks. Policymakers and influencers form relationships based on factors such as trust, authority, and the exchange of resources such as information and support.
  • Ideas. People communicate their beliefs, about policy problems and potential solutions, within a wider understanding of the world (often described as a paradigm or hegemony). Some of that understanding is taken-for-granted and not described, and people limit their analysis and argument according to the ways in which they think other people see the world.
  • Socioeconomic context and events. Policymakers often have to respond to policy conditions and events over which they have limited control, such geographic, demographic, and economic factors. These factors help produce non-routine ‘events’ alongside more predictable events such as elections (or other means to ensure a change of government).

In that context, policy scholarship focuses on producing theories to explain what happens when policymakers have limited control over their political systems and policymaking environments.

How far do these concepts travel?

As you can see, these concepts are widely applicable because they are abstract. What happens when we try to apply them to specific countries or case studies? For example:

  1. We talk about policymakers using cognitive, moral, and emotional shortcuts, but those shortcuts can vary profoundly across the globe.
  2. Each political system has a different collection of authoritative venues, formal and informal rules of politics, networks of power, ways to describe how the world works and should work, and socioeconomic context.

This is where our global network becomes valuable, to help us describe how we make sense of the same concepts in very different ways, and consider the extent to which such discussions are comparable.

Example: how do governments address an ‘era of governance’?

One way to foster such discussion is to consider how governments address the limits to their powers. These limits are described in many different ways, from a focus on ‘complexity’ and policy outcomes which ‘emerge’ from local activity (despite attempts by central governments to control outcomes), to a focus on the shift from ‘government’ to ‘governance’.

As policy scholars, we can make several useful distinctions to describe these dynamics, such as to separate an actual shift in policymaking from government to governance, versus a shift in the way we now describe government.

Or, we can separate how governments can, do, and should address the limits to their powers.

I’d say that most policy scholarship focuses on how governments operate: how they actually address problems and what are the – intended and unintended – consequences.

However, these studies are trying to describe the tensions between what governments can do, given the limits I describe, and what they think they should do, given their position of authority and their need to describe their success.

For example, some systems may be more conducive to the support for ‘polycentric governance’, in which many authoritative venues cooperate to address problems, while others are built on the idea of central control and the concentration of authority in a small group of actors.

Therefore, the study of actual policymaking and outcomes will vary markedly according to the ways in which government actors feel they need to assert an image of control over a policy environment which is almost immune to control.

Perhaps an ‘era of governance’ describes some recognition by many governments that they need to find new ways to address their limited control over policy outcomes, both domestically and globally. However, an enduring theme in political science and policy studies is that we do not explain policymaking well if we restrict our attention to the ‘rational’ decisions of a small number of actors. Let’s not make too many assumptions about their power and motive.

Further reading:

The New Policy Sciences

How to Communicate Effectively with Policymakers

The Politics of Evidence Based Policymaking

Comparison of Theories of the Policy Process

Key policy theories and concepts in 1000 words.

Leave a comment

Filed under public policy

How can political actors take into account the limitations of evidence-based policy-making? 5 key points

These notes are for my brief panel talk at the European Parliament-European University Institute ‘Policy Roundtable’: Evidence and Analysis in EU Policy-Making: Concepts, Practice and Governance. As you can see from the programme description, the broader theme is about how EU institutions demonstrate their legitimacy through initiatives such as stakeholder participation and evidence-based policymaking (EBPM). So, part of my talk is about what happens when EBPM does not exist.

The post is a slightly modified version of my (recorded) talk for Open Society Foundations (New York) but different audiences make sense of these same basic points in very different ways.

  1. Recognise that the phrase ‘evidence-based policy-making’ means everything and nothing

The main limitation to ‘evidence-based policy-making’ is that no-one really knows what it is or what the phrase means. So, each actor makes sense of EBPM in different ways and you can tell a lot about each actor by the way in which they answer these questions:

  • Should you use restrictive criteria to determine what counts as ‘evidence’? Some actors equate evidence with scientific evidence and adhere to specific criteria – such as evidence-based medicine’s hierarchy of evidence – to determine what is scientific. Others have more respect for expertise, professional experience, and stakeholder and service user feedback as sources of evidence.
  • Which metaphor, evidence based or informed is best? ‘Evidence based’ is often rejected by experienced policy participants as unrealistic, preferring ‘informed’ to reflect pragmatism about mixing evidence and political calculations.
  • How far do you go to pursue EBPM? It is unrealistic to treat ‘policy’ as a one-off statement of intent by a single authoritative actor. Instead, it is made and delivered by many actors in a continuous policymaking process within a complicated policy environment (outlined in point 3). This is relevant to EU institutions with limited resources: the Commission often makes key decisions but relies on Member States to make and deliver, and the Parliament may only have the ability to monitor ‘key decisions’. It is also relevant to stakeholders trying to ensure the use of evidence throughout the process, from supranational to local action.
  • Which actors count as policymakers? Policymaking is done by ‘policymakers’, but many are unelected and the division between policymaker/ influencer is often unclear. The study of policymaking involves identifying networks of decision-making by elected and unelected policymakers and their stakeholders, while the actual practice is about deciding where to draw the line between influence and action.
  1. Respond to ‘rational’ and ‘irrational’ thought.

Comprehensive rationality’ describes the absence of ambiguity and uncertainty when policymakers know what problem they want to solve and how to solve it, partly because they can gather and understand all information required to measure the problem and determine the effectiveness of solutions.

Instead, we talk of ‘bounded rationality’ and how policymakers deal with it. They employ two kinds of shortcut: ‘rational’, by pursuing clear goals and prioritizing certain kinds and sources of information, and ‘irrational’, by drawing on emotions, gut feelings, deeply held beliefs, habits, and familiarity, make decisions quickly.

I say ‘irrational’ provocatively, to raise a key strategic question: do you criticise emotional policymaking (describing it as ‘policy based evidence’) and try somehow to minimise it, adapt pragmatically to it, or see ‘fast thinking’ more positively in terms of ‘fast and frugal heuristics’? Regardless, policymakers will think that their heuristics make sense to them, and it can be counterproductive to simply criticise their alleged irrationality.

  1. Think about how to engage in complex systems or policy environments.

Policy cycle’ describes the idea that there is a core group of policymakers at the ‘centre’, making policy from the ‘top down’, and pursuing their goals in a series of clearly defined and well-ordered stages, such as: agenda setting, policy formulation, legitimation, implementation, and evaluation. In this context, one might identify how to influence a singular point of central government decision.

However, a cycle model does not describe policymaking well. Instead, we tend to identify the role of less ordered and more unpredictable complex systems, or policy environments containing:

  • A wide range of actors (individuals and organisations) influencing policy at many levels of government. Scientists and practitioners are competing with many actors to present evidence in a particular way to secure a policymaker audience.
  • A proliferation of rules and norms maintained by different levels or types of government. Support for particular ‘evidence based’ solutions varies according to which organisation takes the lead and how it understands the problem.
  • Important relationships (‘networks’) between policymakers and powerful actors. Some networks are close-knit and difficult to access because bureaucracies have operating procedures that favour particular sources of evidence and some participants over others, and there is a language – indicating what ways of thinking are in good ‘currency’ – that takes time to learn.
  • A tendency for certain ‘core beliefs’ or ‘paradigms’ to dominate discussion. Well-established beliefs provide the context for policymaking: new evidence on the effectiveness of a policy solution has to be accompanied by a shift of attention and successful persuasion.
  • Policy conditions and events that can reinforce stability or prompt policymaker attention to lurch at short notice. In some cases, social or economic ‘crises’ can prompt lurches of attention from one issue to another, and some forms of evidence can be used to encourage that shift, but major policy change is rare.

For stakeholders, an effective engagement strategy is not straightforward: it takes time to know ‘where the action is’, how and where to engage with policymakers, and with whom to form coalitions. For the Commission, it is difficult to know what will happen to policy after it is made (although we know the end point will not resemble the starting point). For the Parliament, it is difficult even to know where to look.

  1. Recognise that EBPM is only one of many legitimate ‘good governance’ principles.

There are several principles of ‘good’ policymaking and only one is EBPM. Others relate to the value of pragmatism and consensus building, combining science advice with public values, improving policy delivery by generating ‘ownership’ of policy among key stakeholders, and sharing responsibility with elected national and local policymakers.

Our choice of which principle and forms of evidence to privilege are inextricably linked. For example, some forms of evidence gathering seem to require uniform models and limited local or stakeholder discretion to modify policy delivery. The classic example is a programme whose value is established using randomised control trials (RCTs). Others begin with local discretion, seeking evidence from stakeholders, professional groups, service user and local practitioner experience. This principle seems to rule out the use of RCTs, at least as a source of a uniform model to be rolled out and evaluated. Of course, one can try to pursue both approaches and a compromise between them, but the outcome may not satisfy advocates of either approach to EBPM or help produce the evidence that they favour.

  1. Decide how far you’ll go to achieve EBPM.

These insights should prompt us to see how far we are willing, and should, go to promote the use of certain forms of evidence in policymaking

  • If policymakers and the public are emotional decision-makers, should we seek to manipulate their thought processes by using simple stories with heroes, villains, and clear but rather simplistic morals?
  • If policymaking systems are so complex, should stakeholders devote huge amounts of resources to make sure they’re effective at each stage?
  • Should proponents of scientific evidence go to great lengths to make sure that EBPM is based on a hierarch of evidence? There is a live debate on science advice to government on the extent to which scientists should be more than ‘honest brokers’.
  • Should policymakers try to direct the use of evidence in policy as well as policy itself?

Where we go from there is up to you

The value of policy theory to this topic is to help us reject simplistic models of EBPM and think through the implications of more sophisticated and complicated processes. It does not provide a blueprint for action (how could it?), but instead a series of questions that you should answer when you seek to use evidence to get what you want. They are political choices based on value judgements, not issues that can be resolved by producing more evidence.

 

5 Comments

Filed under Evidence Based Policymaking (EBPM), public policy

Policymaking in the UK: do you really know who is in charge and who to blame? #POLU9UK

This week, we continue with the idea of two stories of British politics. In one, the Westminster model-style story, the moral is that the centralisation of power produces clear lines of accountability: you know who is in charge and, therefore, the heroes or villains. In another, the complex government story, the world seems too messy and power too diffuse to know all the main characters.

Although some aspects of these stories are specific to the UK, they relate to some ‘universal’ questions and concepts that we can use to identify the limits to centralised power. Put simply, some rather unrealistic requirements for the Westminster story include:

  1. You know what policy is, and that it is made by a small number of actors at the heart of government.
  2. Those actors possess comprehensive knowledge about the problems and solutions they describe.
  3. They can turn policy intent into policy outcomes in a straightforward way.

If life were that simple, I wouldn’t be asking you to read the following blog posts (underlined) which complicate the hell out of our neat story:

You don’t know what policy is, and it is not only made by a small number of actors at the heart of government.

We don’t really know what government policy is. In fact, we don’t even know how to define ‘public policy’ that well. Instead, a definition like ‘the sum total of government action, from signals of intent to the final outcomes’ raises more issues than it settles: policy is remarkably difficult to identify and measure; it is made by many actors inside, outside, and sort of inside/outside government; the boundary between the people influencing and making policy is unclear; and, the study of policy is often about the things governments don’t do.

Actors don’t possess comprehensive knowledge about the problems and solutions they describe

It’s fairly obvious than no-one possesses all possible information about policy problems and the likely effects of proposed solutions. It’s not obvious what happens next. Classic discussions identified a tendency to produce ‘good enough’ decisions based on limited knowledge and cognitive ability, or to seek other measures of ‘good’ policy such as their ability to command widespread consensus (and no radical movement away from such policy settlements). Modern discussions offer us a wealth of discussions of the implications of ‘bounded rationality’, but three insights stand out:

  1. Policymakers pay disproportionate attention to a tiny proportion of the issues for which they are responsible. There is great potential for punctuations in policy/ policymaking when their attention lurches, but most policy is made in networks in the absence of such attention.
  2. Policymakers combine ‘rational’ and ‘irrational’ ways to make decisions with limited information. The way they frame problems limits their attention to a small number of possible solutions, and that framing can be driven by emotional/ moral choices backed up with a selective use of evidence.
  3. It is always difficult to describe this process as ‘evidence-based policymaking’ even when policymakers have sincere intentions.

Policymakers cannot turn policy intent into policy outcomes in a straightforward way

The classic way to describe straightforward policymaking is with reference to a policy cycle and its stages. This image of a cycle was cooked up by marketing companies trying to sell hula hoops to policymakers and interest groups in the 1960s. It is not an accurate description of policymaking (but spirographs are harder to sell).

Instead, for decades we have tried to explain the ‘gap’ between the high expectations of policymakers and the actual – often dispiriting- outcomes, or wonder if policymakers really have such high expectations for success in the first place (or if they prefer to focus on how to present any of their actions as successful). This was a key topic before the rise of ‘multi-level governance’ and the often-deliberate separation of central government action and expected outcomes.

The upshot: in Westminster systems do you really know who is in charge and who to blame?

These factors combine to generate a sense of complex government in which it is difficult to identify policy, link it to the ‘rational’ processes associated with a small number of powerful actors at the heart of government, and trace a direct line from their choices to outcomes.

Of course, we should not go too far to argue that governments don’t make a difference. Indeed, many ministers have demonstrated the amount of damage (or good) you can do in government. Still, let’s not assume that the policy process in the UK is anything like the story we tell about Westminster.

Seminar questions

In the seminar, I’ll ask you reflect on these limits and what they tell us about the ‘Westminster model’. We’ll start by me asking you to summarise the main points of this post. Then, we’ll get into some examples in British politics.

Try to think of some relevant examples of what happens when, for example, minsters seem to make quick and emotional (rather than ‘evidence based’) decisions: what happens next? Some obvious examples – based on our discussions so far – include the Iraq War and the ‘troubled families’ agenda, but please bring some examples that interest you.

In group work, I’ll invite you to answer these questions:

  1. What is UK government policy on X? Pick a topic and tell me what government policy is.
  2. How did the government choose policy? When you decide what government policy is, describe how it made its choices.
  3. What were the outcomes? When you identify government policy choices, describe their impact on policy outcomes.

I’ll also ask you to identify at least one blatant lie in this blog post.

1 Comment

Filed under POLU9UK, Uncategorized

Week 2. Two stories of British politics: the Westminster model versus Complex Government #POLU9UK

I want you to think about the simple presentation of complex thought.

  • How do we turn a world which seems infinitely complex into an explanation which describes that world in a few minutes or seconds?
  • How do we choose the information on which to focus, at the expense of all other information, and generate support for that choice?
  • How do we persuade other people to act on that information?

To that end, this week we focus on two stories of politics, and next month you can use these questions to underpin your coursework.

Imagine the study of British politics as the telling of policymaking stories.

We can’t understand or explain everything about politics. Instead, we turn a complex world into a set of simple stories in which we identify, for example, the key actors, events and outcomes. Maybe we’ll stick to dry description, or maybe we’ll identify excitement, heroes, villains, and a moral. Then, we can compare these tales, to see if they add up to a comprehensive account of politics, or if they give us contradictory stories and force us to choose between them.

As scholars, we tell these stories to help explain what is happening, and do research to help us decide which story seems most convincing. However, we also study policymakers who use such stories to justify their action, or the commentators using them to criticise the ineffectiveness of those policymakers. So, one intriguing and potentially confusing prospect is that we can tell stories about policymakers (or their critics) who tell misleading stories!

Remember King Canute (Cnut)

King Canute

Source

If you’re still with me, have a quick look at Hay’s King Canute article (or my summary of it). Yes, that’s right: he got a whole article out of King Canute. I couldn’t believe it either. I was gobsmacked when I realised how good it was too. For our purposes, it highlights three things:

  1. We’ll use the same shorthand terms – ‘Westminster model’, ‘complex government’ – but let’s check if we tell the same stories in the same way.
  2. Let’s check if we pick the same moral. For example, if ministers don’t get what they want, is it because of bad policymaking or factors outside of their control? Further, are we making empirical evaluations and/or moral judgements?
  3. Let’s identify how policymakers tell that story, and what impact the telling has on the outcome. For example, does it help get them re-elected? Does the need or desire to present policymaking help or hinder actual policymaking? Is ‘heresthetic’ a real word?

The two stories

This week, we’ll initially compare two stories about British politics: the Westminster Model and Complex Government. I present them largely as contrasting accounts of politics and policymaking, but only to keep things simple at first.

One is about central control in the hands of a small number of ministers. It contains some or all of these elements, depending on who is doing the telling:

  1. Key parts of the Westminster political system help concentrate power in the executive. Representative democracy is the basis for most participation and accountability. The UK is a unitary state built on parliamentary sovereignty and a fusion of executive and legislature, not a delegation or division of powers. The plurality electoral system exaggerates single party majorities, the whip helps maintain party control of Parliament, the government holds the whip, and the Prime Minister controls membership of the government.
  2. So, you get centralised government and you know who is in charge and therefore to blame.

Another is about the profound limits to the WM:

  1. No-one seems to be in control. The huge size and reach of government, the potential for ministerial ‘overload’ and need to simplify decision-making, the blurry boundaries between the actors who make and influence policy, the multi-level nature of policymaking, and, the proliferation of rules and regulations, many of which may undermine each other, all contribute to this perception.
  2. If elected policymakers can’t govern from the centre, you don’t get top-down government.

What is the moral of these stories?

For us, a moral relates to (a) how the world works or should work, (b) what happens when it doesn’t work in the way we expect, (c) who is to blame for that, and/ or (d) what we should do about it.

For example, what if we start with the WM as a good thing: you get strong, decisive, and responsible government and you know who is in charge and therefore to blame. If it doesn’t quite work out like that, we might jump straight to pragmatism: if elected policymakers can’t govern from the centre, you don’t get strong and decisive government, it makes little sense to blame elected policymakers for things outside of their control, and so we need more realistic forms of accountability (including institutional, local, and service-user).

Who would buy that story though? We need someone to blame!

Yet, things get complicated when you try to identify a moral built on who to blame for it:

There is a ‘universal’ part of the story, and it is difficult to hold a grudge against the universe. In other words, think of the aspects of policymaking that seem to relate to limitations such as ‘bounded rationality’. Ministers can only pay attention to a fraction of the things for which they are formally in charge. So, they pay disproportionate attention to a small number of issues and ignore the rest. They delegate responsibility for those tasks to civil servants, who consult with stakeholders to produce policy. Consequently, there is a blurry boundary between formal responsibility and informal influence, often summed up by the term governance rather than government. A huge number of actors are involved in the policy process and it is difficult to separate their effects. Instead, think of policy outcomes as the product of collective action, only some of which is coordinated by central government. Or, policy outcomes seem to ‘emerge’ from local practices and rules, often despite central government attempts to control them.

There is UKspecific part of the story, but it’s difficult to blame policymakers that are no longer in government. UK Governments have exacerbated the ‘governance problem’, or the gap between an appearance of central control and what central governments can actually do. A collection of administrative reforms from the 1980s, many of which were perhaps designed to reassert central government power, has reinforced a fragmented public landscape and a periodic sense that no one is in control. Examples include privatisation, civil service reforms, and the use of quangos and non-governmental organisations to deliver policies. Further, a collection of constitutional reforms has shifted power up to the EU and down to devolved and regional or local authorities.

How do policymakers (and their critics) tell these stories, how should they tell them, and what is the effect in each case?

Let’s see how many different stories we can come up with, perhaps with reference to specific examples. Their basic characteristics might include:

  • Referring primarily to the WM, to blame elected governments for not fulfilling their promises or for being ineffectual. If they are in charge, and they don’t follow through, it’s their fault linked to poor judgement.
  • Referring to elements of both stories, but still blaming ministers. Yes, there are limits to central control but it’s up to ministers to overcome them.
  • Referring to elements of both stories, and blaming other people. Ministers gave you this task, so why didn’t you deliver?
  • Referring to CG, and blaming more people. Yes, there are many actors, but why the hell can’t they get together to fix this?
  • Referring to CG and wondering if it makes sense to blame anyone in particular. It’s the whole damn system! Government is a mystery wrapped in a riddle inside an enigma.

Joe Pesci JFK the system

In broader terms, let’s discuss what happens when our two initial stories collide: when policymakers need to find a way to balance a pragmatic approach to complexity and the need to describe their activities in a way that the public can understand and support.

For example, do they try to take less responsibility for policy outcomes, to reflect their limited role in complex government, and/ or try to reassert central control, on the assumption that they may as well be more influential if they will be held responsible?

The answer, I think, is that they try out lots of solutions at the same time:

  • They try to deliver as many manifesto promises as possible, and the manifesto remains a key reference point for ministers and civil servants.
  • They often deal with ‘bounded rationality’ by making quick emotional and moral choices about ‘target populations’ before thinking through the consequences
  • In cases of ‘low politics’ they might rely on policy communities and/ or seek to delegate responsibility to other public bodies
  • In cases of ‘high politics’, they need to present an image of governing competence based on central control, so they intervene regularly
  • Sometimes low politics becomes high politics, and vice versa, so they intervene on an ad hoc basis before ignoring important issues for long periods.
  • They try to delegate and centralise simultaneously, for example via performance management based on metrics and targets.

We might also talk, yet again, about Brexit. If Brexit is in part a response to these problems of diminished control, what stories can we identify about how ministers plan to take it back? What, for example, are the Three Musketeers saying these days? And how much control can they take back, given that the EU is one small part of our discussion?

Illustrative example: (1) troubled families

I can tell you a quick story about ‘troubled families’ policy, because I think it sums up neatly the UK Government’s attempt to look in control of a process over which it has limited influence:

  • It provides a simple story with a moral about who was to blame for the riots in England in 2011: bad parents and their unruly children (and perhaps the public sector professionals being too soft on them).
  • It sets out an immediate response from the centre: identify the families, pump in the money, turn their lives around.
  • But, if you look below the surface, you see the lack of control: it’s not that easy to identify ‘troubled families’, the government relies on many local public bodies to get anywhere, and few lives are actually being ‘turned around’.
  • We can see a double whammy of ‘wicked problems’: the policy problem often seems impervious to government action, and there is a lack of central control of that action.
  • So, governments focus on how they present their action, to look in control even when they recognise their limits.

Illustrative example: (2) prevention and early intervention

If you are still interested by this stage, look at this issue in its broader context, of the desire of governments to intervene early in the lives of (say) families to prevent bad things happening. With Emily St Denny, I ask why governments seem to make a sincere commitment to this task but fall far shorter than they expected. The key passage is here:

“Our simple answer is that, when they make a sincere commitment to prevention, they do not know what it means or appreciate scale of their task. They soon find a set of policymaking constraints that will always be present. When they ‘operationalise’ prevention, they face several fundamental problems, including: the identification of ‘wicked’ problems (Rittell and Webber, 1973) which are difficult to define and seem impossible to solve; inescapable choices on how far they should go to redistribute income, distribute public resources, and intervene in people’s lives; major competition from more salient policy aims which prompt them to maintain existing public services; and, a democratic system which limits their ability to reform the ways in which they make policy. These problems may never be overcome. More importantly, policymakers soon think that their task is impossible. Therefore, there is high potential for an initial period of enthusiasm and activity to be replaced by disenchantment and inactivity, and for this cycle to be repeated without resolution”.

Group exercise.

Here is what I’ll ask you to do this week:

  • Describe the WM and CG stories in some depth in your groups, then we’ll compare your accounts.
  • Think of historical and contemporary examples of decision-making which seem to reinforce one story or the other, to help us decide which story seems most convincing in each case.
  • Try to describe the heroes/ villains in these stories, or their moral. For example, if the WM doesn’t explain the examples you describe, what should policymakers do about it? Will we only respect them if they refuse to give up, like Forest Gump or the ‘never give up, never surrender’ guy in Galaxy Quest? Or, if we would like to see pragmatic politicians, how would we sell their behaviour as equally heroic?

7 Comments

Filed under POLU9UK, public policy, UK politics and policy

Is there any hope for evidence in emotional debates and chaotic government?

Two recent news features sum up the role of emotion and ‘chaos’ in policymaking.

The first is ‘Irritation and anger’ may lead to Brexit, says influential psychologist in The Telegraph. The headline suggests that people may vote Leave for emotional reasons, rather than with reference to a more ‘rational’ process in which people identify the best evidence and use it to weight up the short and long term consequences of action.

Yet, the article confirms that we’re all at it! To be human is to use emotional, gut-level, and habitual thinking to turn a complex world, with too much information, into a good enough decision in a necessary short amount of time.

In debate, evidence is mentioned a lot, but only to praise the evidence backing my decision and rejecting yours. Or, you only trust the evidence from people you trust. If you trust the evidence from certain scientists, you stress their scientific credentials. If not, you find some from other experts. Or, if all else is lost, you reject experts as condescending elites with a hidden agenda. Or, you say simply that they can’t be that clever if they agree with smarmy Cameron/ Johnson.

Lesson 1: you can see these emotional and manipulative approaches to policymaking play out in the EU referendum. Don’t assume that policymaking behind closed doors, on other issues, is any different.

The second feature is Lost in Transit: chaos in government research in The Economist.

It describes a Sense about Science report which (a) was commissioned ‘following a spate of media stories about government research being suppressed or delayed’, and (b) finds that ‘The UK government spends around £2.5 billion a year on research for policy, but does not know how many studies it has commissioned or which of them have been published’.

The Economist reports the perhaps-unexpected result of the inquiry:

But the main gripe is the sheer disorganisation of it all. The report’s afterword states that “Sir Stephen looked for suppression and found chaos”.

Such accounts reflect the two contradictory stories that we often tell about government. The first relates to the Westminster model of democratic accountability which helps concentrate power at the centre of government: if you know who is in charge, you know who to blame.

The second, regarding complex government, describes a complicated world of public policy in which no-one seems to be in control. For example, we make reference to: the huge size and reach of government; the potential for ministerial ‘overload’ and need to simplify decision-making; the blurry boundaries between the actors who make and influence policy; the multi-level nature of policymaking; and, the proliferation of rules and regulations, many of which may undermine each other.

The problem with the first story is that (a) although it is easy to tell during elections and inquiries, (b) you always struggle to find it when you actually study government.

The problem with the second is that, (a) although it seems realistic when you study government, (b) few people will buy it when they are seeking to hold ministers and governments to account. This problem may be exacerbated by the terms of reference of reports: few will accept a pragmatic response, based on the second story of complexity, if you start out by using the first story of central control to say that you will track down and solve the problem!

Lesson 2: if you assume central control you will find chaos (and struggle to produce feasible recommendations to deal with it). The manipulation of evidence takes place in a complex policymaking system over which no individual or ‘core executive’ has control. Indeed, no single person or organisation could even pay attention to all that goes on within government. This insight requires pragmatic inquiries and solutions, not the continuous reassertion of central control and discovery of ‘chaos’.

It might be possible to develop a third lesson if we put these two together. One part of the EU debate reflects our inability to understand EU policymaking and relate it to the relatively clear processes in the UK, in which you know who is in charge and therefore who to blame. The EU seems less democratic because it is so complex and remote. Yet, if we follow this other story about complexity in the UK, we often find that UK politics is also difficult to follow. Its image does not describe reality.

Lesson 3: when you find policymaking complexity in the EU, don’t assume it is any better in the UK! Instead, try to compare like with like.

See also

I expand on both lessons in The Politics of Evidence-Based Policymaking

Cock-up, not conspiracy, conceals evidence for policy

Government buries its own research – and that’s bad for democracy

The rationality paradox of Nudge: rational tools of government in a world of bounded rationality

6 Comments

Filed under Evidence Based Policymaking (EBPM), public policy, UK politics and policy