Category Archives: 1000 words

Policy Concepts in 1000 Words: Policy Change

Christopher M. Weible & Paul Cairney

Policy change is a central concern of policy research and practice. Some want to explain it. Some want to achieve it.

Explanation begins with the ‘what is policy?’ question, since we cannot observe something without defining it.  However, we soon find that: no single definition can capture all forms of policy change, the absence of policy change is often more important, and important changes can be found in the everyday application of rules and practices related to public policies.  Further, studies often focus on changes in public policies without a focus on societal outcomes or effects.

One pragmatic solution is to define public policies as decisions made by policymakers or policymaking venues such as legislatures, executives, regulatory agencies, courts, national and local governments (and, in some countries, citizen-led policy changes).  Focusing on this type of policy change, two major categories of insights unfold:

  1. Patterns of Policy Change: incrementalism, punctuations, and drift

A focus on decisions suggests that most policymaking venues contribute primarily to incremental policy change, or often show little change from year to year but with the occasional punctuation of major policymaking activity.  This pattern reflects a frequent story about governments doing too much or nothing at all. The logic is that policymaking attention is always limited, so a focus on one issue in any policymaking venue requires minimal focus on others.  Then, when attention shifts, we see instances of major policy change as attempts to compensate (or overcompensate) for what was ignored for too long.

An additional focus on institutions highlights factors such as policy drift, to describe slow and small changes to policies, or to aspects of their design, that accumulate eventually and can have huge impacts on outcomes and society.  These drifts often happen outside the public eye or are overlooked as being negative but trivial.  For example, rising economic inequality in the US resulted from the slow accumulation of policies – related to labor unions, tax structures, and corporate governance – as well as globalization and labor-saving technologies.

  1. Factors Associated with Policy Change

Many factors help us understand instances of policy change. We can separate them analytically (as below) but, in practice, they occur simultaneously or sequentially, and can reinforce or stifle each other.

Context

Context includes history, biophysical conditions, socio-economic conditions, culture, and basic institutional structures (such as a constitution).  For example, historical and geographic conditions are often viewed as funneling or constraining the type of policy decisions made by a government.

Events 

Policymaking venues are often described as being resistant to change or in a state of equilibrium of competing political forces.  As a result, one common explanation for change is a focusing event or shock.  Events by themselves don’t create policy change. Rather, they present an opportunity for people or coalitions to exploit.   Focusing events might include disasters or crises, tragic incidents, a terrorist attack, disruptive changes in technology, or more routine events such as elections. Events may have tangible qualities, but studies tend to highlight the ways in which people frame events to construct their meaning and implications for policy.

Public Opinion 

The relationship between public opinion and policy change is a difficult one to assess.  Some research shows that the preferences of the general public only matter when they coincide with the preferences of the elite or major interest groups.  Or, it matters only when the topic is salient and the public is paying attention. Little evidence suggests that public opinion matters when few are paying attention.  Others describe public opinion as setting the boundaries within which the government operates.

Learning

Learning is a process of updating understandings of the world in response to signals from the environment.  Learning is a political activity rather than simply a technical exercise in which people learn from teachers. Learning could involve becoming aware of the severity of a policy problem, evaluating outcomes to determine if a government intervention works, and learning to trust an opponent and reach compromise. For example, certain types of rules in a collaborative process can shape the ways in which individuals gain new knowledge and change their views about the scientific evidence informing a problem.

Diffusion of Ideas 

Sometimes governments learn from or transfer policies from other governments. For example, in collections of policymaking venues (such as US state governments or EU member states) it is common for one venue to adopt a policy and prompt this policy to spread across other venues in a process of diffusion.  There are many explanations for diffusion including learning, a response to competition, mimicking, and coercion. In each case, the explanation for policy change comes from an external impetus and an internal context.

Champions and Political Associations

All policy change is driven, to some extent, by individual or group agency.  Key players include public policy champions in the form of policy entrepreneurs or in groups of government and/or non-government entities in the form of coalitions, social movements, epistemic communities, and political parties.  In each case, individuals or organizations mobilize resources, capitalize on opportunities, and apply pressure to formulate and adopt public policies.

 

The presence of these factors does not always lead to policy change, and no single study can capture a full explanation of policy change. Instead, many quantitative studies focus on multiple instances of policy change and are often broad in geographic scope or spans of time, while many case study or qualitative studies focus intensely on a very particular instance of policy change. Both approaches are essential.

See also:

Policy in 500 Words: what is public policy and why does it matter?

Policy in 500 Words: how much does policy change?

Policy Concepts in 1000 Words: Policy change and measurement (podcast download)

Policy Concepts in 1000 Words: how do policy theories describe policy change?

 

 

Leave a comment

Filed under 1000 words, public policy

Who can you trust during the coronavirus crisis?

By Paul Cairney and Adam Wellstead, based on this paper.

Trust is essential during a crisis. It is necessary for cooperation. Cooperation helps people coordinate action, to reduce the need for imposition. It helps reduce uncertainty in a complex world. It facilitates social order and cohesiveness. In a crisis, almost-instant choices about who to trust or distrust make a difference between life and death.

Put simply, we need to trust: experts to help us understand and address the problem, governments to coordinate policy and make choices about levels of coercion, and each other to cooperate to minimise infection.

Yet, there are three unresolved problems with understanding trust in relation to coronavirus policy.

  1. What does trust really mean?

Trust is one of those words that could mean everything and nothing. We feel like we understand it intuitively, but would also struggle to define it well enough to explain how exactly it works. For example, in social science, there is some agreement on the need to describe individual motivation, social relationships, and some notion of the ‘public good’:

  • the production of trust helps boost the possibility of cooperation, partly by
  • reducing uncertainty (low information about a problem) and ambiguity (low agreement on how to understand it) when making choices, partly by
  • helping you manage the risk of making yourself vulnerable when relying on others, particularly when
  • people demonstrate trustworthiness by developing a reputation for competence, honesty, and/ or reliability, and
  • you combine cognition and emotion to produce a disposition to trust, and
  • social and political rules facilitate this process, from the formal and well-understood rules governing behaviour to the informal rules and norms shaping behaviour.

As such, trust describes your non-trivial belief in the reliability of other people, organisations, or processes. It facilitates the kinds of behaviour that are essential to an effective response to the coronavirus, in which we need to:

  1. Make judgements about the accuracy of information underpinning our choices to change behaviour (such as from scientific agencies).
  2. Assess the credibility of the people with whom we choose to cooperate or take advice (such as more or less trust in each country’s leadership).
  3. Measure the effectiveness of the governments or political systems to which we pledge our loyalty.

Crucially, in most cases, people need to put their trust in actions or outcomes caused by people they do not know, and the explanation for this kind of trust is very different to trusting people you know.

  1. What does trust look like in policymaking?

Think of trust as a mechanism to boost cooperation and coalition formation, help reduce uncertainty, and minimise the ‘transactions costs’ of cooperation (for example, monitoring behaviour, or producing or enforcing contracts). However, uncertainty is remarkably high because the policy process is not easy to understand. We can try to understand the ‘mechanisms’ of trust, to boost cooperation, with reference to these statements about trustees and the trusted:

  1. Individuals need to find ways to make choices about who to trust and distrust.
  2. However, they must act within a complex policymaking environment in which they have minimal knowledge of what will happen and who will make it happen.
  3. To respond effectively, people seek ways to cooperate with others systematically, such as by establishing formal and informal rules.

People seeking to make and influence policy must act despite uncertainty about the probability of success or risk of failure. In a crisis, it happens almost instantly. People generate beliefs about what they want to happen and how their reliance on others can help it happen. This calculation depends on:

  • Another person or organisation’s reputation for being trustworthy, allowing people the ability to increase certainty when they calculate the risk of engagement.
  • The psychology of trust and perceptions of another actor’s motives. To some extent, people gather information and use logic to determine someone’s competence. However, they also use gut feeling or emotion to help them decide to depend on someone else. They may also trust a particular source if the cognitive load is low, such as because (a) the source is familiar (e.g. a well-known politician or a celebrity, or oft-used source), or (b) the information is not challenging to remember or accept.

If so, facilitators of trust include:

  • People share the same characteristics, such as beliefs, norms, or expectations.
  • Some people have reputations for being reliable, predictable, honest, competent, and/ or relatively selfless.
  • Good experiences of previous behaviour, including repeated interactions that foster rewards and help predict future risk (with face to face contact often described as particularly helpful).
  • People may trust people in a position of authority (or the organisation or office), such as an expert or policymaker (although perhaps the threat of rule enforcement is better understood as a substitute for trust, and in practice it is difficult to spot the difference).

High levels of trust are apparent when effective practices – built on reciprocity, emotional bonds, and/ or positive expectations – become the norms or formalised and written down for all to see and agree. High levels of distrust indicate a need to deter the breach of agreements, by introducing expectations combined with sanctions for not behaving as expected.

  1. Who should you trust?

These concepts do not explain fully why people trust particular people more than others, or help us determine who you should trust during a crisis.

Rather, first, they help us reflect on the ways in which people have been describing their own thought processes (click here, and scroll to ‘Limiting the use of evidence’), such as trusting an expert source because they: (a) have a particular scientific background, (b) have proven to be honest and reliable in the past, (c) represent a wider scientific profession/ community, (d) are part of a systematic policymaking machinery, (e) can be held to account for their actions, (f) are open about the limits to their knowledge, and/or (g) engage critically with information to challenge simplistic rushes to judgement. Overall, note how much trust relates to our minimal knowledge about their research skills, prompting us to rely on an assessment of their character or status to judge their behaviour. In most cases, this is an informal process in which people may not state (or really know) why they trust or distrust someone so readily.

Then, we can reflect on who we trust, and why, and if we should change how we make such calculations during a crisis like the coronavirus. Examples include:

  • A strong identity with a left or right wing cause might prompt us only to trust people from one political party. This thought process may be efficient during elections and debates, but does it work so well during a crisis necessitating so high levels of cross-party cooperation?
  • People may be inclined to ignore advice because they do not trust their government, but maybe (a) high empathy for their vulnerable neighbours, and (b) low certainty about the impact of their actions, should prompt them to trust in government advice unless they have a tangible reason not to (while low empathy helps explain actions such as hoarding).
  • Government policy is based strongly on the extent to which policymakers trust people to do the right thing. Most debates in liberal democracies relate to the idea that (a) people can be trusted, so give advice and keep action voluntary, or cannot be trusted, so make them do the right thing, and that (b) citizens can trust their government. In other words, it must be a reciprocal relationship (see the Tweets in Step 3).

Finally, governments make policy based on limited knowledge and minimal control of the outcomes, and they often respond with trial-and-error strategies. The latter is fine if attention to policy is low and trust in government sufficiently high. However, in countries like the UK and US, each new choice prompts many people to question not only the competence of leaders but also their motivation. This is a worrying development for which everyone should take some responsibility.

See also:

Policy Concepts in 1000 Words: the Institutional Analysis and Development Framework (IAD) and Governing the Commons

The coronavirus and evidence-informed policy analysis (short version)

The coronavirus and evidence-informed policy analysis (long version)

 

5 Comments

Filed under 1000 words, 750 word policy analysis, Public health, public policy

Policy Concepts in 1000 Words: how do policy theories describe policy change?

The 1000 words and 500 words series already show how important but difficult it is to define and measure policy change. In this post, Leanne Giordono and I dig deeper into the – often confusingly different – ways in which different researchers conceptualise this process. We show why there is such variation and provide a checklist of questions to ask of any description of policy change.

Measuring policy change is more difficult than it looks

The measurement of policy change is important. Most ‘what is policy?’ discussions remind us that there can be a huge difference between policy as a (a)  statement of intent, (b) strategy, (c) collection of tools/ instruments and (d) contributor to policy outcomes.

Policy theories remind us that, while politicians and political parties often promise to sweep into office and produce radical departures from the past, most policy change is minor. There is a major gap between stated intention and actual outcomes, partly because policymakers do not control the policy process for which they are responsible. Instead, they inherit the commitments of their predecessors and make changes at the margins.

The 1000 words and 500 words posts suggest that we address this problem of measurement by identifying the use of a potentially large number of policy instruments or policy tools such as regulation (including legislation) and resources (money and staffing) to accentuate the power at policymaker’s disposal.

Then, they suggest that we tell a story of policy change, focusing on (a) what problem policymakers were trying to solve, and the size of their response in relation to the size of the problem, and (b) the precise nature of specific changes, or how each change contributes to the ‘big picture’.

This recommendation highlights a potentially major problem: as researchers, we can produce very different narratives of policy change from the same pool of evidence, by accentuating some measures and ignoring others, or putting more faith in some data than others.

Three ways to navigate different approaches to imagining and measuring change

Researchers use many different concepts and measures to define and identify policy change. It would be unrealistic – and perhaps unimaginative – to solve this problem with a call for one uniform approach.

Rather, our aim is to help you (a) navigate this diverse field by (b) identifying the issues and concepts that will help you interpret and compare different ways to measure change.

  1. Check if people are ‘showing their work’

Pay close attention to how scholars are defining their terms. For example, be careful with incomplete definitions that rely on a reference to evolutionary change (which can mean so many different things) or incremental change (e.g. does an increment mean small or non-radical)? Or, note that frequent distinctions between minor versus major change seem useful, but we are often trying to capture and explain a confusing mixture of both.

  1. Look out for different questions

Multiple typologies of change often arise because different theories ask and answer different questions:

  • The Advocacy Coalition Framework distinguishes between minor and major change, associating the former with routine ‘policy-oriented learning’, and the latter with changes in core policy beliefs, often caused by a ‘shock’ associated with policy failure or external events.
  • Innovation and Diffusion models examine the adoption and non-adoption of a specific policy solution over a specific period of time in multiple jurisdictions as a result of learning, imitation, competition or coercion.
  • Classic studies of public expenditure generated four categories to ask if the ‘budgetary process of the United States government is equivalent to a set of temporally stable linear decision rules’. They describe policy change as minor and predictable and explain outliers as deviations from the norm.
  • Punctuated Equilibrium Theory identifies a combination of (a) huge numbers of small policy change and (b) small numbers of huge change as the norm, in budgetary and other policy changes.
  • Hall distinguishes between (a) routine adjustments to policy instruments, (b) changes in instruments to achieve existing goals, and (c) complete shifts in goals. He compares long periods in which (1) some ideas dominate and institutions do not change, with (2) ‘third order’ change in which a profound sense of failure contributes to a radical shift of beliefs and rules.
  • More recent scholarship identifies a range of concepts – including layering, drift, conversion, and displacement – to explain more gradual causes of profound changes to institutions.

These approaches identify a range of possible sources of measures:

  1. a combination of policy instruments that add up to overall change
  2. the same single change in many places
  3. change in relation to one measure, such as budgets
  4. a change in ideas, policy instruments and/ or rules.

As such, the potential for confusion is high when we include all such measures under the single banner of ‘policy change’.

  1. Look out for different measures

Spot the different ways in which scholars try to ‘operationalize’ and measure policy change, quantitatively and/ or qualitatively, with reference to four main categories.

  1. Size can be measured with reference to:
  • A comparison of old and new policy positions.
  • A change observed in a sample or whole population (using, for example, standard deviations from the mean).
  • An ‘ideal’ state, such as an industry or ‘best practice’ standard.
  1. Speed describes the amount of change that occurs over a specific interval of time, such as:
  • How long it takes for policy to change after a specific event or under specific conditions.
  • The duration of time between commencement and completion (often described as ‘sudden’ or ‘gradual’).
  • How this speed compares with comparable policy changes in other jurisdictions (often described with reference to ‘leaders’ and ‘laggards’).
  1. Direction describes the course of the path from one policy state to another. It is often described in comparison to:
  • An initial position in one jurisdiction (such as an expansion or contraction).
  • Policy or policy change in other jurisdictions (such as via ‘benchmarking’ or ‘league tables’)
  • An ‘ideal’ state (such as with reference to left or right wing aims).
  1. Substance relates to policy change in relations to:
  • Relatively tangible instruments such as legislation, regulation, or public expenditure.
  • More abstract concepts such as in relation to beliefs or goals.

Take home points for students

Be thoughtful when drawing comparisons between applications, drawn from many theoretical traditions, and addressing different research questions.  You can seek clarity by posing three questions:

  1. How clearly has the author defined the concept of policy change?
  2. How are the chosen theories and research questions likely to influence the author’s operationalization of policy change?
  3. How does the author operationalize policy change with respect to size, speed, direction, and/or substance?

However, you should also note that the choice of definition and theory may affect the meaning of measures such as size, speed, direction, and/or substance.

 

7 Comments

Filed under 1000 words, public policy

A general theory of public policy

This is a placeholder for future work and discussion. It tails off at the end.

People sometimes talk about a ‘general theory’ of public policy to put in our minds a comparison with the physical sciences. Usually, the punchline is that there are ‘no general theories of public policy that are not bounded by space or time’ (p21). There may be some reference to the accumulation of knowledge or wisdom in policy studies, but based rarely on the understanding that policy studies contain the equivalent of general laws (I can only think of one possible exception).

This outcome is not too surprising in the social sciences, in which context really matters and we would expect a lot of variation in policy, policymaking, and outcomes.

On the other hand, we still need a way to communicate our findings, relate them to other studies, compare them, and wonder what it all adds up to. Few people go as far as expressing the sense that every study is unique (to the point of non-comparability) and that every description of policymaking does not compare to another.

In other words, we may be looking for a happy medium, to reject the idea of general laws but encourage – when appropriate or necessary – enough of a sense of common outlook and experience to help us communicate with each other (without descending too quickly into heated debate on our cross-purposes). Or, we can at least tell a story of policy studies and invite others to learn from, or challenge, its insights.

In my case, there are two examples in which it is necessary to project some sense of a common and initially-not-too-complicated story:

  1. When describing policy theory insights to students, on the assumption that it may be their gateway to more reading.

It is possible to choose how many words to devote to each topic, including 500 Words, 1000 Words, a 9000 word Understanding Public Policy chapter, more in the source material, and even more if students start to ‘snowball’.

It is also possible, if you have a clearly defined audience, to introduce some level of uncertainty about these descriptions and their limitations.

For example, I try to describe ‘the policy process’ in 500 words and 1000 words, but in the context of a wider discussion of images of the policy process.

Circle image policy process 24.10.18

It is also possible to provide more context, such as in this kind of introductory box, coupled with 12 things to know about studying public policy

Introduction box

(from Chapter 1)

You can also get into the idea that my story is one of many, particularly after students have invested in many versions of that story by the end of an introductory book

conclusion box

(from Chapter 13)

  1. When describing these insights to people – from other disciplines or professions – who do not have the time, inclination, or frame of reference to put in that kind of work.

In this case, one presentation or article may be the limit. People may want to know the answer to a question – e.g. Why don’t policymakers listen to your evidence?rather than hear all about the explanation for the answer.

You do your best, and then – if there is time – you talk about what you missed out.

For example, in this talk, the first question was: why didn’t you mention the role of power?

 

A general theory or a general understanding? Two key issues

That was a long-winded introduction to a more philosophical point about what we might want from general theories. My impression is that you might be seeking one of these two possibilities:

  1. To use theories and concepts to describe material reality. In producing a general theory, we seek a general understanding of the ways in which the real world works. If so, we may focus primarily on how well these concepts describe the world, and the extent to which we can produce methods to produce systematic and consistent findings. The lack of a general theory denotes too much complexity and context.
  2. To use theories and concepts to represent a useful story. In producing a general understanding, we focus on the ways in which people generate and communicate their understanding. If so, we may focus more on how people come together to produce and share meaning through concepts. The lack of a general theory could reflect the lack of agreement on how to study policymaking. Or, the presence of a general understanding could represent the exercise of power, to set the agenda and limit scholarly attention to a small number of theories.

I describe this distinction in the following audio clip, produced halfway through a run with the dogs, while jetlagged. The large gap in the middle happens when I am trying to see if the voice to text is working well enough for me to copy/paste it here (no).

Key examples of the exercise of power include:

  1. The act of dismissing an individual, social group, or population by undermining the value of their knowledge or claim to knowledge (discussed in power and knowledge and Chapter 3).
  2. Ongoing discussions about how we deal with (a) a relatively new focus (among the most-established policy theories) on policy studies in countries in the Global South, given that (b) the dominant interpretations of policymaking come from experiences in the Global North.

box 13.4 part 1box 13.4 part 2

So, if you read these posts or Chapter 13 you will find a story of a general understanding of policy followed, almost immediately, by a list of reasons for why you should engage with it critically and perhaps not accept it. I’m setting your agenda but also reminding you that I’m doing it.

That’s it really. To be continued.

Leave a comment

Filed under 1000 words, Academic innovation or navel gazing, agenda setting, public policy, Storytelling

Understanding Public Policy 2nd edition

All going well, it will be out in November 2019. We are now at the proofing stage.

I have included below the summaries of the chapters (and each chapter should also have its own entry (or multiple entries) in the 1000 Words and 500 Words series).

2nd ed cover

titlechapter 1chapter 2chapter 3chapter 4.JPG

chapter 5

chapter 6chapter 7.JPG

chapter 8

chapter 9

chapter 10

chapter 11

chapter 12

chapter 13

 

2 Comments

Filed under 1000 words, 500 words, agenda setting, Evidence Based Policymaking (EBPM), Policy learning and transfer, public policy

Policy Concepts in 1000 Words: the Institutional Analysis and Development Framework (IAD) and Governing the Commons

The IAD provides a language, and way of thinking, about the ways in which different institutions foster collective action. The language is so complicated that I have cheated by summarising key terms in this box (and describing polycentric governance in a different post) to stay within the 1000 words limit:

IAD box 2.2.19

Governing the Commons

For me, the best way to understand the IAD is through the lens of Governing the Commons (and the research agenda it inspired), which explains how to rethink ‘tragedies of the commons’ and encourage better management of common pool resources (CPRs).

Ostrom rejects the uncritical use of rational choice games to conclude – too quickly – that disastrous collective action problems are inevitable unless we ‘privatize’ commons or secure major government intervention (which is tricky anyway when global problems require international cooperation). The tragedy of the commons presents a too-bleak view of humanity, in which it would be surprising to find cooperation even when the fate of the world is in human hands.

Alternatively, what if there is evidence that people often work collectively and effectively without major coercion? People are social beings who share information, build trust by becoming known as reliable and predictable, and come together to produce, monitor and enforce rules for the group’s benefit. They produce agreements with each other that could be enforced if necessary.

The IAD helps us analyse these cooperative arrangements. Ostrom describes 8 ‘design principles’ of enduring and effective CPR management shared by many real world examples:

  1. CPRs have clear boundaries. Users know what they are managing, and can identify legitimate users.
  2. The rules suit local conditions. Users know what they (a) are expected to contribute to management and (b) receive from CPRs.
  3. The actors affected by the rules help shape them (at low cost).
  4. CPR monitors are users or accountable to users. They monitor (a) the conduct of users and (b) the state of the CPR. The costs of mutual monitoring are low, and their consequences felt quickly.
  5. The penalties for rule-breaking are low if the choice is a one-off and understandable under the circumstances (to avoid alienating the user). The penalties are high if the choice is part of a pattern which makes other users feel like ‘suckers’, or if rule-breaking would be catastrophic.
  6. Conflict resolution is frequent, rapid and low cost.
  7. Users have the right to self-organise without too much outside interference.
  8. Many projects are connected geographically and at different scales – local, regional, national – in ways that do not undermine individual projects.

These design principles help explain why some communities manage CPRs successfully. They allow users to share the same commitment and expect the long-term benefits to be worthwhile.

However, Ostrom stressed that there is no blueprint – no hard and fast rules – to CPR management. There are three particular complications:

  1. Trust

Good management requires high trust to encourage norms of reciprocity. Trust is crucial to minimizing the costs of compliance monitoring and enforcement. Trust may develop when participants communicate regularly, share an understanding of their common interests, reciprocate each other’s cooperation, and have proven reliable in the past.

Design principles are important to developing trust and solidarity, but so are evolutionary’ changes to behaviour. Actors have often learned about rule efficacy – to encourage cooperation and punish opportunism – through trial-and-error over a long period, beginning with simple, low-cost operational rules producing quick wins.

  1. Rules, rules on rules, more rules, then even more rules

Institutions contain a large, complicated set of rules that serve many different purposes, and need to be understood and analysed in different ways.

Different purposes include:

  • how many actors are part of an action situation, and the role they play
  • what they must/ must not do
  • who is eligible to participate
  • who can move from one role to another
  • who controls membership, and how
  • how many participants are involved in a choice
  • what will happen if there is no agreement
  • how to manage and communicate information
  • the rewards or sanctions
  • the range of acceptable actions or outcomes from action.

 

We also need to analyse the relative costs and simplicity of different rules, and the rules about the other rules, including

  • ‘operational’ rules on day-to-day issues (such as specific payoffs/ sanctions for behaviour)
  • ‘collective choice’ rules about how to make those rules
  • ‘constitutional’ rules on who can decide those rules and who can monitor and enforce, and
  • ‘metaconstitutional’ analysis of how to design these constitutions with reference to the wider political and social context.

 

  1. The world is too complex to break down into simple pieces

By now, you may be thinking that the IAD – and analysis of resource management – is complicated. This is true, partly because each case study – of the physical conditions and social practices regarding resource management – is different in some way. We can use the IAD to compare experiences, but accept that a profoundly successful scheme in one context may fail miserably in another.

Simplicity versus complexity: the world is complex, but should our analysis follow suit?

Indeed, this is why we need to think about rational choice games and the IAD simultaneously, to understand the analytical trade-offs.

Game theory laboratory experiments – built on simple rules and relatively small numbers of parameters – produce parsimonious analysis and results that we can understand relatively easily.

We may reject simple games as unrealistic, but what if we take this criticism to its extreme?

IAD in-depth field studies embrace complexity to try to understand the key dimensions of each study’s context. When we put them all together, there are too many concepts, variables, global applications, and variations-by-context, to contain in a simple theory.

The IAD addresses this trade off by offering a language to help organize research, encouraging people to learn it then use it to apply many different theories to explain different parts of the whole picture.

In other words, it is OK to reject simple models as unrealistic, but to embrace real-world complexity may require a rather complicated language.

See also:

Policy Concepts in 1000 Words: it’s time for some game theory

Policy Concepts in 1000 Words: Rational Choice and the IAD (the older post for the 1st edition)

Policy Concepts in 100 Words: Multi-centric Policymaking

Policy in 500 Words: the Social-Ecological Systems Framework

Policy in 500 Words: Ecology of Games

How to Navigate Complex Policy Designs

How can governments better collaborate to address complex problems?

 

 

12 Comments

Filed under 1000 words, public policy

Policy Concepts in 1000 Words: game theory and thought experiments

Rational choice theory provides a way of thinking about collective action problems. There is great potential for choices made by individuals to have an adverse societal effect when there is an absence of trust, obligation, or other incentives to cooperate. People may have collective aims that require cooperation, but individual incentives to defect. While the action of one individual makes little difference, the sum total of individual actions may be catastrophic.

Simple ‘games’ provide a way to think about these issues logically, by limiting analysis to very specific situations under rather unrealistic conditions, before we consider possible solutions under more realistic conditions. For example, in simple games we assume that individuals pursue the best means to fulfil their preferences: they are able to act ‘optimally’ by processing all relevant information to rank-order their preferences consistently.

Go with it just now, and then we can consider what to do next.

The ‘prisoner’s dilemma’

Two people are caught red-handed and arrested for a minor crime, placed in separate rooms and invited to confess to a major crime (they both did it and the police know it but can’t prove it). The payoffs are:

  • If Paul confesses and Linda doesn’t, then Paul walks free and Linda receives a 10 year jail sentence (or vice versa)
  • If both confess they receive a much higher sentence (8 years) than if neither confesses (1 year).

Also assume that they take no benefit from the shorter sentence of the other person (a non-cooperative game).

It demonstrates a collective action problem: although the best outcome for the group requires that neither confess (both would go to jail for a total of 2 years), the actual outcome is that both confess (16 years). The latter represents the ‘Nash equilibrium’ since neither would be better off by changing their strategy unilaterally. Think of it from an individual’s perspective:

  • Imagine Paul will confess. Linda knows that if she stays silent, she gets suckered into 10 years. If she confesses, she gets 8.
  • Imagine Paul will stay silent. Linda knows that if she stays silent, she gets 1 year. If she confesses, she suckers Paul into 10.

The effect of Paul and Linda acting as individuals is that they are worse off collectively. Both ‘defect’ (confess) when they should ‘cooperate’ (stay silent).

Table 7.1 prisoners

The ‘logic of collective action’

Olson argues that, as the membership of an interest group rises, so does:

(a) the belief among individuals that their contribution to the group would make little difference and

(b) their ability to ‘free ride’.

I may applaud the actions of a group, but can – and will try to – enjoy the outcomes without leaving my sofa, paying them, or worrying that they will fail without me or punish me for not getting involved.

The ‘tragedy of the commons’

The scenario is that a group of farmers share a piece of land that can only support so many cattle before deteriorating and becoming useless. Although each farmer recognizes the collective benefit to an overall maximum number of cattle, each calculates that the marginal benefit she takes from one extra cow for herself exceeds the extra cost of over grazing to the group. Individuals place more value on the resources they extract for themselves now than the additional rewards they could all extract in the future.

The tragedy is that if all farmers act on the same calculation then they will destroy the common resource. The group is too large to track individual behaviour, individuals place more value on current over future consumption, and there is low mutual trust, with minimal motive and opportunity to produce and enforce binding agreements

This ‘tragedy’ sums up current anxieties about one of the defining problems of our time: global ‘common pool resources’ are scarce and the world’s population and consumption levels are rising; there is no magic solution; and, collective action is necessary but not guaranteed. We may value sustainable water, air, energy, forests, crops, and fishing stocks, but find it difficult to imagine how our small contribution to consumption will make much difference. As a group we fear climate change and seek to change our ways but, as individuals, contribute to the problem.

Overall, these scenarios suggest that individuals have weak incentives to cooperate even if it is in their interests and they agree to do so. This problem famously prompted Hardin (to recommend ‘mutual coercion, mutually agreed upon’ to ensure collective action.

What happens when there are many connected games?

In real life, it is almost impossible to find such self-contained and one-off games.  In many repeated – or connected – games, the players know that thereare wider or longer-term consequences to defection.

  • In ‘nested games’, the behaviour of individuals often seems weird in one game until we recognise their involvement in a series. It may pay off to act ‘irrationally’ in the short term to support a longer-term strategy, or to lose in one to win in another.
  • In an ‘ecology of games’, many overlapping games take place at roughly the same time, and players to learn how to play one game while keeping an eye on many others, while some key players encourage a wider set of rules under which all games operate.

Evolutionary game theory explores how behaviour changes over multiple games to reflect factors such as (a) feedback and learning from trial and error, and (b) norms and norm enforcement.

For example, player 2 may pursue a ‘tit-for-tat’ strategy. She cooperates at first, then mimics the other player’s previous choice: defecting, to punish the other player’s defection, or cooperating if the other player cooperated. Knowledge of this strategy could provide player 1 with the incentive to cooperate. Further, norms develop when players enforce and expect sanctions for non-cooperation, foster socialisation to discourage norm violation, and some norms become laws.

In other words, this focus on the rules of repeated games gives us more hope than the tragedy of the commons. Indeed, it underpin Ostrom’s famous analysis of the conditions under which people can govern the commons more effectively.

See also:

This post is one of four updates to the post Policy Concepts in 1000 Words: Rational Choice and the IAD 

Policy Concepts in 1000 Words: the Institutional Analysis and Development Framework

Policy in 500 Words: the Social-Ecological Systems Framework

Policy in 500 Words: Ecology of Games

See also:

How to Navigate Complex Policy Designs

How can governments better collaborate to address complex problems?

See also this tweet – and many others paying homage to it – to explain the title of the post:

See also this tweet thread on Hardin:

4 Comments

Filed under 1000 words, public policy

Policy Concept in 1000 Words: Multi-centric Policymaking

Many theories in this 1000 words series describe multiple policymaking venues. They encourage us to give up on the idea of an all-knowing, all-powerful national central government. Instead, there are many venues in which to make authoritative choices, each contributing to what we call policy.

The word ‘multi-centric’ (coined by Professor Tanya Heikkila, with me and Dr Matt Wood) does not suggest that every venue is of equal importance or power. Rather, it prompts us not to miss something important by focusing too narrowly on one single (alleged) centre of authority.

To some extent, multi-centric policymaking results from choice. Many federal political systems have constitutions that divide power between executive, legislative, and judicial branches, or give some protection to subnational governments. Many others have become ‘quasi-federal’ more organically, by sharing responsibilities with supranational and subnational governments. In such cases, there is explicit choice to distribute power and share responsibility for making policy (albeit with some competition to assert power or shuffle-off responsibility).

However, for the most part, this series helps explain the necessity of multi-centric policymaking with reference to two concepts:

  1. Bounded rationality. Policymakers are only able to pay attention to – and therefore understand and seek to control – a tiny proportion of their responsibilities.
  2. Complex policymaking environments. Policymakers operate in an environment over which they have limited understanding and even less control. It contains many policymakers and influencers spread across many venues, each with their own institutions, networks, ideas (and ways to frame policy), and responses to socio-economic context and events.

Both factors combine to provide major limits to single central government control. Elected policymakers deal with bounded rationality by prioritising some issues and, necessarily, delegating responsibility for the rest. Delegation may be inside or outside of central government.

1000 Words theories describing multi-centric government directly

Multi-level governance describes the sharing of power vertically, between many levels of government, and horizontally, between many governmental, quasi-non-governmental and non-governmental organisations. Many studies focus on the diffusion of power within specific areas like the European Union – highlighting choice – but the term ‘governance’ has a wider connection to the necessity of MLG.

For example, part of MLG’s origin story is previous work to help explain the pervasiveness of policy networks:

  • Policymakers at the ‘top’ ask bureaucrats to research and process policy on their behalf
  • Civil servants seek information and advice from actors outside of government
  • They often form enduring relationships built on factors such as trust.
  • Such policymaking takes place away from a notional centre – or at least a small core executive – and with limited central attention.

Polycentricity describes (a) ‘many decision centers’ with their own separate authority, (b) ‘operating under an overarching set of rules’, but with (c) a sense of ‘spontaneous order’ in which no single centre controls the rules or outcomes. Polycentric governance describes ‘policymaking centres with overlapping authority; they often work together to make decisions, but may also engage in competition or conflict’.

This work on polycentric governance comes primarily from the Institutional Analysis and Development (IAD) framework that helps compare the effectiveness of institutions designed to foster collective action. For example, Ostrom identifies the conditions under which non-governmental institutions can help manage ‘common pool resources’ effectively, while IAD-inspired studies of municipal governance examine how many ‘centres’ can cooperate as or more effectively than a single central government.

Complexity theory has a less clear origin story, but we can identify key elements of complex systems:

  • They are greater than the sum of their parts
  • They amplify or dampen policymaking activity, so the same action can have a maximal or no impact
  • Small initial choices can produce major long term momentum
  • There are regularities of behaviour despite the ever-present potential for instability
  • They exhibit ‘emergence’. Local outcomes seem to defy central direction.

Systems contain many actors interacting with many other actors. They follow and reproduce rules, which help explain long periods of regular behaviour. Or, many actors and rules collide when they interact, producing the potential for many bursts of instability. In each case, the system is too large and unpredictable to be subject to central control.

1000 Words theories describing multi-centric government indirectly

Many other theories in this series describe multi-centric policymaking – or aspects of it – without using this term directly. Examples include:

Punctuated equilibrium theory suggests that (a) policymakers at the ‘centre’ of government could pay attention to, and influence, most issues, but (b) they can only focus on a small number and must ignore the rest. Very few issues reach the ‘macropolitical’ agenda. Multiple policymaking organisations process the rest out of the public spotlight.

Multiple streams analysis turns the notion of a policy cycle on its head, and emphasises serendipity over control. Policy does not change until three things come together at the right ‘window of opportunity’: attention to a problem rises, a feasible solution exists, and policymakers have the motive and opportunity to act. Modern MSA studies show that such windows exist at multiple levels of government.

The advocacy coalition framework describes the interaction between many policymakers and influencers. Coalitions contain actors from many levels and types of government, cooperating and competing within subsystems (see networks). They are surrounded by a wider context – over which no single actor has direct control – that provides the impetus for ‘shocks’ to each coalition.

In such accounts, the emphasis is on high levels of complexity, the potential for instability, and the lack of central control over policymaking and policy outcomes. The policy process is not well described with reference to a small group of policymakers at the heart of government.

The implications for strategy and accountability

Making Policy in a Complex World explores the implications of multi-centric policymaking for wider issues including:

  1. Accountability. How do we hold elected policymakers to account if we no longer accept that there is a single government to elect and scrutinise? See MLG for one such discussion.
  2. Strategy. How can people act effectively in a policy process that seems too complex to understand fully? See this page on ‘evidence based policymaking’

Further Reading:

Key policy theories and concepts in 1000 words

Policy in 500 words

5 images of the policy process

[right click for the audio]

Making Policy in a Complex World (preview PDF ) also provides a short explainer of key terms as follows:

multicentric box 1

20 Comments

Filed under 1000 words, public policy

Policy concepts in 1000 words: Institutional memory

Guest post by Jack Corbett, Dennis Grube, Heather Lovell and Rodney Scott

Democratic governance is defined by the regular rotation of elected leaders. Amidst the churn, the civil service is expected to act as the repository of received wisdom about past policies, including assessments of what works and what doesn’t. The claim is that to avoid repeating the same mistakes we need to know what happened last time and what were the effects. Institutional memory is thus central to the pragmatic task of governing.

What is institutional memory? And, how is it different to policy learning?

Despite increasing recognition of the role that memory can or should play in the policy process, the concept has defied easy scholarly definition.

In the classic account, institutional memory is the sum total of files, procedures and knowledge held by an organisation. Christopher Pollitt, who has pioneered the study of institutional memory, refers to the accumulated knowledge and experience of staff, technical systems, including electronic databases and various kinds of paper records, the management system, and the norms and values of the organizational culture, when talking about institutional memory. In this view, which is based on the key principles of the new institutionalism, memory is essentially an archive.

The problem with this definition is that it is hard to distinguish the concept from policy learning (see also here). If policy learning is in part about increasing knowledge about policy, including correcting for past mistakes, then we could perhaps conceive of a continuum from learning to memory with an inflection point where one starts and the other stops. But, this is easier to imagine than it is to measure empirically. It also doesn’t acknowledge the forms memories take and the ways memories are contested, suppressed and actively forgotten.

In our recent contribution to this debate (see here and here) we define memories as ‘representations of the past’ that actors draw on to narrate what has been learned when developing and implementing policy. When these narratives are embedded in processes they become ‘institutionalised’. It is this emphasis on embedded narratives that distinguishes institutional memory from policy learning. Institutional memory may facilitate policy learning but equally some memories may prohibit genuine adaptation and innovation. As a result, while there is an obvious affinity between the two concepts it is imperative that they remain distinct avenues of inquiry. Policy learning has unequivocally positive connotations that are echoed in some conceptualisations of institutional memory (i.e. Pollitt). But, equally, memory (at least in a ‘static’ form) can be said to provide administrative agents with an advantage over political principals (think of the satirical Sir Humphrey of Yes Minister fame). The below table seeks to distinguish between these two conceptualisations of institutional memory:

Key debates: Is institutional memory declining?

The scholar who has done the most to advance our understanding of institutional memory in government is Christopher Pollitt. His main contention is that institutional memory has declined over recent decades due to: the high rotation of staff in the civil service, changes in IT systems which prevent proper archiving, regular organisational restructuring, rewarding management skills above all others, and adopting new management ‘fads’ that favour constant change as they become popular. This combination of factors has proven to be a perfect recipe for the loss of institutional memory within organisations.  The result is a contempt for the past that leads to repeated policy failure.

We came to a different view. Our argument is that one of the key reasons why institutional memory is said to have declined is that it has been conceptualised in a ‘static’ manner more in keeping with an older way of doing government. This practice has assumed that knowledge on a given topic is held centrally (by government departments) and can be made explicit for the purpose of archiving. But, if government doesn’t actually work this way (see relevant posts on networks here) then we shouldn’t expect it to remember this way either. Instead of static repositories of summative documents holding a singular ‘objective’ memory, we propose a more ‘dynamic’ people-centred conceptualisation that sees institutional memory as a composite of intersubjective memories open to change. This draws to the fore the role of actors as crucial interpreters of memory, combining the documentary record with their own perspectives to create a story about the past. In this view, institutional memory has not declined, it is simply being captured in a fundamentally different way.

Corbett et al memory

Key debates: How can an institution improve how it remembers?

How an institution might improve its memory is intrinsically linked to how memory is defined and whether or not it is actually in decline. If we follow Pollitt’s view that memory is about the archive of accumulated knowledge that is being ignored or deliberately dismantled by managerialism then the answer involves returning to an older way of doing government that placed a higher value on experience. By putting a higher value on the past as a resource institutions would reduce staff turnover, stop regular restructures and changes in IT systems, etc. For those of us who work in an institution where restructuring and IT changes are the norm, this solution has obvious attractions. But, would it actually improve memory? Or would it simply make it easier to preserve the status quo (a process that involves actively forgetting disruptive but generative innovations)?

Our definition, relying as it does on a more dynamic conceptualisation of memory, is sceptical about the need to improve practices of remembering. But, if an institution did want to remember better we would favour increasing the opportunity for actors within an institution to reflect on and narrate the past. One example of this might be a ‘Wikipedia’ model of memory in which the story of a policy, it success and failure, is constructed by those involved, highlighting points of consensus and conjecture.

Additional reading:

 Corbett J, Grube D, Lovell H, Scott R. “Singular memory or institutional memories? Toward a dynamic approach”. Governance. 2018;00:1–19. https://doi.org/10.1111/gove.12340

 Pollitt, C. 2009. “Bureaucracies Remember, Post‐Bureaucratic Organizations Forget?” Public Administration 87 (2): 198-218.

Pollitt, C. 2000. “Institutional Amnesia: A Paradox of the ‘Information Age’?” Prometheus 18 (1): 5-16.

 

1 Comment

Filed under 1000 words, public policy, Uncategorized

Policy Concepts in 1000 Words: The Policy Process

We talk a lot about ‘the policy process’ without really saying what it is. If you are new to policy studies, maybe you think that you’ll learn what it is eventually if you read enough material. This would be a mistake! Instead, when you seek a definition of the policy process, you’ll find two common responses:

  1. Many will seek to define policy or public policy instead of ‘the policy process’.
  2. Some will describe the policy process as a policy cycle with stages.

Both responses seem inadequate: one avoids giving an answer, and another gives the wrong answer!

However, we can combine elements of each approach to give you just enough of a sense of ‘the policy process’ to continue reading the full ‘1000 words’ series:

1. The beauty of the ‘what is policy?’ question …

… is that we don’t give you an answer. It may seem frustrating at first to fail to find a definitive answer, but eventually you’ll accept this problem! The more important outcome is to use the ‘what is policy?’ question to develop analytical skills, to allow you to define policy in more specific circumstances (such as, what are the key elements of policy in this case study?), and ask more useful and specific questions about policy and policymaking. So, look at the questions we need to ask if we begin with the definition, ‘the sum total of government action, from signals of intent to the final outcomes’: does action include statements of intent? Do we include unintended policy outcomes? Are all policymakers in government? What about the things policymakers choose not to do? And so on.

2. The beauty of the policy cycle approach …

… is that it provides a simple way to imagine policy ‘dynamics’, or events and choices producing a never-ending sequence of other events and choices. Look at the stages model to identify many different tasks within one ‘process’, and to get the sense that policymaking is continuous and often ‘its own cause’. It’s not a good description of what actually happens, but it describes what some might like to happen, and used by many governments to describe what they do. Consequently, we can’t simply ignore it, at least without providing a better description, a better plan, and a better way for governments to justify what they do.

There are more complicated but better ways of describing policymaking dynamics

This picture is the ‘policy process’ equivalent of my definition of public policy. It captures the main elements of the policy process described – albeit in different ways – by most policy theories in this series. I present it here to give you enough of an answer – to ‘what is the policy process?’ – to help you ask more questions.

Cairney 2017 image of the policy process

In the middle is ‘policy choice’

At the heart of most policy theory is ‘bounded rationality’, which describes (a) the cognitive limits of all people, and (b) how policymakers overcome such limits to make decisions (in the absence of NZT). In short, they use ‘rational’ and ‘irrational’ shortcuts to action, but these are provocative terms to prompt further reading (on, for example, ‘evidence-based policymaking’).

‘Rational’ describes goal-oriented activity: people may have limits to their attention and ‘information processing’, but they find systematic ways to respond, by setting goals and producing criteria to find the best information. ‘Irrational’ describes aspects of psychology: people draw on habit, emotions, their ‘gut’ or intuition, well-established beliefs, and their familiarity with information to make often-almost-instant decisions.

Surrounding choice is what we’ll call the ‘policy environment’

Environment is a metaphor we’ll use to describe the combination of key elements of the policy process which (a) I describe separately in further 1000 words posts, and (b) policy theories bring together to produce an overall picture of policy dynamics.

There are 5 or 6 key elements. In the picture are 6, reflecting the way Tanya Heikkila and I describe it (and the fact that I had 7 boxes to fill). In real life, I describe 5 because I have 5 digits on each hand. If you are Count Tyrone Rugen you have more choice.

Policy environments are made up of:

  1. A wide range of actors (which can be individuals and organisations with the ability to deliberate and act) making or influencing policy at many levels and types of government.
  2. Institutions, defined as the rules followed by actors. Some are formal, written down, and easy to identify. Others are informal, reproduced via processes like socialisation, and difficult to spot and describe.
  3. Networks, or the relationships between policymakers and influencers. Some are wide open, competitive, and contain many actors. Others are relatively closed, insulated from external attention, and contain few actors.
  4. Ideas, or the beliefs held and shared by actors. There is often a tendency for certain beliefs or ‘paradigms’ to dominate discussion, constraining or facilitating the progress of new ‘ideas’ as policy solutions.
  5. Context and events. Context describes the policy conditions – including economic, social, demographic, and technological factors – that provide the context for policy choice, and are often outside of the control of policymakers. Events can be routine and predictable, or unpredictable ‘focusing’ events that prompt policymaker attention to lurch at short notice.

This picture is only the beginning of analysis, raising further questions that will make more sense when you read further, including: should policymaker choice be at the centre of this picture? Why are there arrows in the cycle but not in my picture? Should we describe complex policymaking ‘systems’ rather than ‘environments’? How exactly does each element in the ‘policy environment’ or ‘system’ relate to the other?

The answer to the final question can only be found in each theory of the policy process, and each theory describes this relationship in a different way. Let’s not worry about that just now! We’ll return to this issue at the end, when thinking about how to combine the insights of many theories.

 

 

 

24 Comments

Filed under 1000 words, public policy

Policy concepts in 1000 or 500 words

Imagine that your audience is a group of scientists who have read everything and are only interested in something new. You need a new theory, method, study, or set of results to get their attention.

Let’s say that audience is a few hundred people, or half a dozen in each subfield. It would be nice to impress them, perhaps with some lovely jargon and in-jokes, but almost no-one else will know or care what you are talking about.

Imagine that your audience is a group of budding scientists, researchers, students, practitioners, or knowledge-aware citizens who are new to the field and only interested in what they can pick up and use (without devoting their life to each subfield). Novelty is no longer your friend. Instead, your best friends are communication, clarity, synthesis, and a constant reminder not to take your knowledge and frame of reference for granted.

Let’s say that audience is a few gazillion people. If you want to impress them, imagine that you are giving them one of the first – if not the first – ways of understanding your topic. Reduce the jargon. Explain your problem and why people should care about how you try to solve it. Clear and descriptive titles. No more in-jokes (just stick with the equivalent of ‘I went to the doctor because a strawberry was growing in my arse, and she gave me some cream for it’).

At least, that’s what I’ve been telling myself lately. As things stand, my most-read post of all time is destined to be on the policy cycle, and most people read it because it’s the first entry on a google search. Most readers of that post may never read anything else I’ve written (over a million words, if I cheat a bit with the calculation). They won’t care that there are a dozen better ways to understand the policy process. I have one shot to make it interesting, to encourage people to read more. The same goes for the half-dozen other concepts (including multiple streams, punctuated equilibrium theory, the Advocacy Coalition Framework) which I explain to students first because I now do well in google search (go on, give it a try!).

I also say this because I didn’t anticipate this outcome when I wrote those posts. Now, a few years on, I’m worried that they are not very good. They were summaries of chapters from Understanding Public Policy, rather than first principles discussions, and lots of people have told me that UPP is a little bit complicated for the casual reader. So, when revising it, I hope to make it better, and by better I mean to appeal to a wider audience without dumping the insights. I have begun by trying to write 500-words posts as, I hope, improvements on the 1000-word versions. However, I am also open to advice on the originals. Which ones work, and which ones don’t? Where are the gaps in exposition? Where are the gaps in content?

This post is 500 words.

https://paulcairney.wordpress.com/1000-words/

https://paulcairney.wordpress.com/500-words/

Leave a comment

Filed under 1000 words, 500 words, Uncategorized

Social Construction and Policy Design

This is an updated and expanded discussion of Policy Concepts in 1000 Words: the Social Construction of Target Populations . It’s the theoretical summary for a paper I’m writing with Jonathan Pierce on the future for this approach. See also a separate post on empirical applications.

Policymakers articulate value judgements which underpin fundamental choices about which social groups should be treated positively or negatively by government bodies. When addressing highly politicised issues, they seek to reward ‘good’ groups with government support and punish ‘bad’ groups with sanctions (Schneider et al, 2014). This judgement is often described as ‘moral reasoning’ (Haidt, 2001) or ‘fast thinking’ (Kahneman, 2012: 20). Policymakers make quick, biased, emotional judgements, then back up their actions with selective facts to pursue their understanding of a policy problem and its solution:

Likes and dislikes are not the result of individual or collective reason and deliberation but mainly the product of emotion and heuristics … judgments begin with emotional reactions … and reason is used mainly to justify initial emotion responses (Schneider et al, 2014, drawing on Kahneman, 2012 and Haidt, 2001; 2012).

Yet, social constructions can also be based on conscious bias. Policies reflect the goal-driven use of constructions, ‘strategically manipulated for political gain … to create political opportunities and avoid political risks’ or, at least, an anxiety by politicians ‘not to be caught in opposition to prevailing values’ if it affects their performance in election (Schneider and Ingram, 1997: 6; 192). They aim to receive support from the populations they describe as ‘deserving’, as well as a wider public satisfied with describing others as ‘undeserving’ (1997: 6).

These judgements can have an enduring ‘feed-forward’ effect (Ingram et al, 2007: 112). Choices based on values are reproduced in ‘policy designs’, as the ‘content or substance of public policy’:

Policy designs are observable phenomena found in statutes, administrative guidelines, court decrees, programs, and even the practices and procedures of street level bureaucrats … [they] contain specific observable elements such as target populations (the recipients of policy benefits or burdens), goals or problems to be solved (the values to be distributed), rules (that guide or constrain action), rationales (that explain or legitimate the policy), and assumptions (logical connections that tie the other elements together) (Schneider and Ingram, 1997: 2).

Examples of feed-forward effects include policy designs: signaling that ‘elderly citizens are worthy of respect and deserving of the funds they receive’, prompting ‘a level of political participation rivaled by no other group’; introducing convoluted rules to diminish participation in areas such as housing entitlement; signaling to welfare recipients that they have themselves to blame and deserve minimal support; and, restricting voting rights directly (Schneider and Sidney, 2009: 110-11)

Policy designs based on moral choices often become routine and questioned rarely in government because they are ‘automatic rather than thought through’. Emotional assignments of ‘deservingness’ act as important ‘decision heuristics’ because this process is ‘easy to use and recall and hard to change’ (Schneider et al, 2014). They are difficult to overcome, because a sequence of previous policies, based on a particular framing of target populations, helps produce ‘hegemony’: the public, media and/ or policymakers take this set of values for granted, as normal or natural, and rarely question them when engaging in politics (Pierce et al, 2014; see also Gramsci, 1971; Bachrach and Baratz, 1970; Lukes, 2005).

This signal of limited deservingness impacts on citizens and groups, who participate more or less according to how they are characterised by government (Schneider and Ingram, 1993: 334). Only some groups have the resources to mobilise and challenge or reinforce the way they are perceived by policymakers (Schneider and Ingram, 1997: 21-4; 2005: 444; Pierce et al, 2014), or to mobilise to persuade the public, media and/ or government that there is a reason to make policy on their behalf. Some groups can be categorized differently over time, but this seems to be a non-routine outcome, at least in the absence of long term change in social attitudes, even though social constructions are – in theory – ‘inherently unstable’ (Ingram and Schneider, 2005: 10). For example, it can follow a major external event such as an economic crisis or game-changing election, exploited by ‘entrepreneurs’ to change the way that policymakers view particular groups (Ingram and Schneider, 2005: 10-11). Or, it can be prompted by policy design which, for example, is modified to suit powerful populations with spillover effects for the powerless (such as when drug treatment develops as an alternative to incarceration) (Schneider and Ingram, 2005: 639).

Ingram et al (2007: 102) depict this dynamic with a table in which there are two spectrums – one describes the positive or negative ways in which groups are portrayed by policymakers, the other describes the resources available to groups to challenge or reinforce that image – producing four categories of target population: advantaged, contenders, dependents, and deviants. The powerful and positively constructed are ‘advantaged’; the powerful and negatively constructed are ‘contenders’; the powerless and positively constructed are ‘dependents’; the powerless and negatively constructed are ‘deviants’ (Ingram et al, 2007: 102)

Schneider and Ingram (1997: 3) argue that, although the (US) political system may ‘meet some standard of fairness or openness’, the policies they produce may not be ‘conducive to democracy’. US public policies have failed to solve major problems – including inequality, poverty, crime, racism, sexism, and effective universal healthcare and education – and such policy failure contributes to the sense that the political process serves special interests at the expense of the general public (1997: 4-7). Policy designs ‘are strongly implicated in the current crisis of democracy’ because they have failed and they discourage many target populations (the ‘undeserving’, ‘deviant’, or ‘demons’) from public participation: ‘These designs send messages, teach lessons, and allocate values that exacerbate injustice, trivialize citizenship, fail to solve problems, and undermine institutional cultures that might be more supportive of democratic designs’ (1997: 5-6; 192).

Of course, although there is the unpredictable potential for issues to be politicised, many are not. Yet, low salience can exacerbate these problems of citizen exclusion. Policies dominated by bureaucratic interests often alienate citizens receiving services (1997: 79). Or, experts dominate policies (and many government agencies) when there is high scientific agreement and wider acceptance that the ‘public interest’ is served largely through the production and use of evidence. The process does not include ordinary citizens routinely. Rather, ‘experts with scientific credentials aid and abet the disappearance of the public sphere’, and this is a problem when issues ‘with important social value implications’ transform into ‘a matter of elite scientific and professional concern’ (such as when official calculations of economic activity override personal experiences) (1997: 153; 167).

Overall, they describe a political system with major potential to diminish democracy, with politicians faced with the choice of politicising issues to reward or punish populations or depoliticise issues with reference to science and objectivity, and policy designs uninformed by routine citizen participation. They describe an increasingly individualistic US system with declining rates of collective political participation (at least in elections), a tendency for actors to seek benefits for their own populations, and often ‘degenerative’ policy which produces major inequalities along sex, race, and ethnicity lines (Ingram and Schneider, 2005: 22-6).

Although SCPD began as a study of US politics, many of its concepts and insights are ‘universal’. In other words, they identify ‘policymaking issues that can arise in any time or place’ (Cairney and Jones, 2016: 38):

  1. The psychology of social construction: people make quick and emotional judgements about the populations of which they are a part, and other populations.
  2. Policymakers seek to exploit the ‘national mood’, or other indicators of social preferences, for political reward.
  3. These judgements inform policy design.
  4. Policy designs help send signals to citizens which can diminish their incentive to engage in politics.
  5. Low salience issues are often dominated by bureaucratic politics and scientific language, at a similar expense to citizen participation.

The time and place-specific nature of SCPD refers to specific social attitudes, the social construction of specific target populations (from a large list of potential constructions), and specific policy designs associated with each government.

7 Comments

Filed under 1000 words, public policy

Writing an essay on politics, policymaking, and policy change

I tend to set this simple-looking question for coursework in policy modules: what is policy, how much has it changed, and why? Students get to choose the policy issue, timeframe (and sometimes the political system), and relevant explanatory concepts.

On the face of it, it looks super-simple: A+ for everyone!

Give it a few more seconds, and you can see the difficulties:

  1. We spent a lot of time agreeing that it seems almost impossible to define policy (explained in 1000 Words and 500 Words)
  2. There are a gazillion possible measures of policy change (1000 Words and 500 Words)
  3. There is an almost unmanageable number of models, concepts, and theories to use to explain policy dynamics (I describe about 25 in 1000 Words each)

I try to encourage some creativity when solving this problem, but also advise students to keep their discussion as simple and jargon-free as possible (often by stretching an analogy with diving, in which a well-executed simple essay can score higher than a belly-flopped hard essay).

Choosing a format: the initial advice

  1. Choose a policy area (such as health) or issue (such as alcohol policy).
  2. Describe the nature of policy, and the extent of policy change, in a particular time period (such as in the post-war era, since UK devolution, or since a change in government).
  3. Select one or more policy concept or theory to help structure your discussion and help explain how and why policy has changed.

For example, a question might be: What is tobacco policy in the UK, how much has it changed since the 1980s, and why? I use this example because I try to answer that – UK and global – question myself, even though my 2007 article on the UK is too theory-packed to be a good model for an undergraduate essay.

Choosing a format: the cautionary advice

You may be surprised about how difficult it is to answer a simple question like ‘what is policy?’ and I will give you considerable credit for considering how to define and measure it, by identifying, for example, the use of legislation/ regulation, funding, staff, and ‘nodality’ and/ or by considering the difference between, say, policy as a statement of intent or a long term outcome. In turn, a good description and explanation of policy change is difficult. If you are feeling ambitious, you can go further, to compare, say, two issues (such as tobacco and alcohol) or places (such UK Government policy and the policy of another country), but sometimes a simple and narrow discussion can be as, or more, effective. Similarly, you can use many theories or concepts to aid explanation, but often one theory will do. Note that (a) your description of your research question, and your essay structure, is more important than (b) your decision on what topic to focus or concepts to use.

Choosing a topic: the ‘joined up’ advice

The wider aim is to encourage students to think about the relationship between different perspectives on policy theory and analysis. For example, in a blog and policy analysis paper they try to generate attention to a policy problem and advocate a solution. Then, they draw on policy theories and concepts to reflect on their papers, highlighting (say): the need to identify the most important audience; the importance of framing issues with a mixture of evidence and emotional appeals; and, the need to present ‘feasible’ solutions.

The reflection can provide a useful segue to the essay, since we’re already identifying important policy problems, advocating change, reflecting on how best to encourage it – such as by presenting modest objectives – and then, in the essay, trying to explain (say) why governments have not taken that advice in the past. Their interest in the policy issue can prompt interest in researching the issue further; their knowledge of the issue and the policy process can help them develop politically-aware policy analysis. All going well, it produces a virtuous circle.

Some examples from my pet subject

Let me outline how I would begin to answer the three questions with reference to UK tobacco policy. I’m offering a brief summary of each section rather than presenting a full essay with more detail (partly to hold on to that idea of creativity – I don’t want students to use this description as a blueprint).

What is modern UK tobacco policy?

Tobacco policy in the UK is now one of the most restrictive in the world. The UK government has introduced a large number of policy instruments to encourage a major reduction of smoking in the population. They include: legislation to ban smoking in public places; legislation to limit tobacco advertising, promotion, and sponsorship; high taxes on tobacco products; unequivocal health education; regulations on tobacco ingredients; significant spending on customs and enforcement measures; and, plain packaging measures.

[Note that I selected only a few key measures to define policy. A fuller analysis might expand on why I chose them and why they are so important].

How much has policy changed since the 1980s?

Policy has changed radically since the post-war period, and most policy change began from the 1980s, but it was not until the 2000s onwards that the UK cemented its place as one of the most restrictive countries. The shift from the 1980s relates strongly to the replacement of voluntary agreements and limited measures with limited enforcement with legislative measures and stronger enforcement. The legislation to ban tobacco advertising, passed in 2002, replaced limited bans combined with voluntary agreements to (for example) keep billboards a certain distance from schools. The legislation to ban smoking in public places, passed in 2006 (2005 in Scotland), replaced voluntary measures which allowed smoking in most pubs and restaurants. Plain packaging measures, combined with large and graphic health warnings, replace branded packets which once had no warnings. Health education warnings have gone from stating the facts and inviting smokers to decide, and the promotion of harm reduction (smoke ‘low tar’), to an unequivocal message on the harms of smoking and passive smoking.

[Note that I describe these changes in broad terms. Other articles might ‘zoom’ in on specific instruments to show how exactly they changed]

Why has it changed?

This is the section of the essay in which we have to make a judgement about the type of explanation: should you choose one or many concepts; if many, do you focus on their competing or complementary insights; should you provide an extensive discussion of your chosen theory?

I normally recommend a very small number of concepts or simple discussion, largely because there is only so much you can say in an essay of 2-3000 words.

For example, a simple ‘hook’ is to ask if the main driver was the scientific evidence: did policy change as the evidence on smoking (and then passive smoking) related harm became more apparent? Is it a good case of ‘evidence based policymaking’? The answer may then note that policy change seemed to be 20-30 years behind the evidence [although I’d have to explain that statement in more depth] and set out the conditions in which this driver would have an effect.

In short, one might identify the need for a ‘policy environment’, shaped by policymakers, and conducive to a strong policy response based on the evidence of harm and a political choice to restrict tobacco use. It would relate to decisions by policymakers to: frame tobacco as a public health epidemic requiring a major government response (rather than primarily as an economic good or issue of civil liberties); place health departments or organisations at the heart of policy development; form networks with medical and public health groups at the expense of tobacco companies; and respond to greater public support for control, reduced smoking prevalence, and the diminishing economic value of tobacco.

This discussion can proceed conceptually, in a relatively straightforward way, or with the further aid of policy theories which ask further questions and help structure the answers.

For example, one might draw on punctuated equilibrium theory to help describe and explain shifts of public/media/ policymaker attention to tobacco, from low and positive in the 1950s to high and negative from the 1980s.

Or, one might draw on the ACF to explain how pro-tobacco coalitions helped slow down policy change by interpreting new scientific evidence though the ‘lens’ of well-established beliefs or approaches (examples from the 1950s include filter tips, low tar brands, and ventilation as alternatives to greater restrictions on smoking).

One might even draw on multiple streams analysis to identify a ‘window of opportunity for change (as I did when examining the adoption of bans on smoking in public places).

Any of these approaches will do, as long as you describe and justify your choice well. One cannot explain everything, so it may be better to try to explain one thing well.

1 Comment

Filed under 1000 words, 500 words, POLU9UK, tobacco, tobacco policy, UK politics and policy

The politics of evidence-based best practice: 4 messages

Well, it’s really a set of messages, geared towards slightly different audiences, and summed up by this table:

Table 1 Three ideal types EBBP.JPG

  1. This academic journal article (in Evidence and Policy) highlights the dilemmas faced by policymakers when they have to make two choices at once, to decide: (1) what is the best evidence, and (2) how strongly they should insist that local policymakers use it. It uses the case study of the ‘Scottish Approach’ to show that it often seems to favour one approach (‘approach 3’) but actually maintains three approaches. What interests me is the extent to which each approach contradicts the other. We might then consider the cause: is it an explicit decision to ‘let a thousand flowers bloom’ or an unintended outcome of complex government?
  2. I explore some of the scientific  issues in more depth in posts which explore: the political significance of the family nurse partnership (as a symbol of the value of randomised control trials in government), and the assumptions we make about levels of control in the use of RCTs in policy.
  3. For local governments, I outline three ways to gather and use evidence of best practice (for example, on interventions to support prevention policy).
  4. For students and fans of policy theory, I show the links between the use of evidence and policy transfer.

Further reading (links):

My academic articles on these topics

The Politics of Evidence Based Policymaking

Key policy theories and concepts in 1000 words

Prevention policy

13 Comments

Filed under 1000 words, ESRC Scottish Centre for Constitutional Change, Evidence Based Policymaking (EBPM), Prevention policy, Scottish politics, UK politics and policy

Policy Concepts in 1000 Words: Feminism, Postcolonialism, and Critical Policy Studies

See also three more recent posts:

  1. Policy in 500 Words: Power and Knowledge
  2. Policy in 500 Words: Feminist Institutionalism
  3. Policy Analysis in 750 words: Linda Tuhiwai Smith (2012) Decolonizing Methodologies

In this post, let’s begin with a transition from two others: combining theories, and critical policy studies/ the NPF. Both posts raise the same basic question: what is science? This question leads to a series of concerns about the criteria we use to determine which theories are most worthy of our investment, and the extent to which social scientific criteria should emulate those in natural science.

One set of criteria, which you can find in the ‘policy shootout!’, relates to the methods and principles we might associate with some branches of natural science (and use, for example, to support astronomy but not astrology):

  • A theory’s methods should be explained so that they can be replicated by others.
  • Its concepts should be clearly defined, logically consistent, and give rise to empirically falsifiable hypotheses.
  • Its propositions should be as general as possible.
  • It should set out clearly what the causal processes are.
  • It should be subject to empirical testing and revision

If we were to provide a caricature of this approach, we might associate it with other explicit or implicit principles, such as:

  1. The world exists independently of our knowledge of it, and our role is to develop theories to help us understand its properties (for example, discover its general laws).
  2. These principles help us produce objective science: if the methods and results can be replicated, they do not depend on individual scientists.

In other words, the caricature is of a man in a white lab coat gathering knowledge of his object of study while remaining completely separate from it. Such principles are generally difficult to maintain, and relatively tricky in the study of the social world (and it seems increasingly common for one part of PhD training to relate to reflexivity – see what is our role in social scientific research)? However, critical challenges go far beyond this point about false objectivity.

The challenge to objective science: 1. the role of emancipatory research

One aspect of feminist and postcolonial social science is to go beyond the simple rejection of the idea of objective social science: a further key (or perhaps primary) aim is to generate research with emancipatory elements. This may involve producing research questions with explicit normative elements and combining research with recommendations on social and political change.

The challenge to objective science: 2. a rejection of the dominant scientific method?

A second aspect is the challenge to the idea that one dominant conception of scientific method is correct. Instead, one might describe the scientific rules developed by one social group to the exclusion of others. This may involve historical analysis to identify the establishment of an elite white male dominance of science in the ‘West’, and the ‘Western’ dominance of science across the world.

To such scientists, a challenge to these criteria seems ridiculous: why reject the scientific principles that help us produce objective science and major social and technological advances? To their challengers, this response may reflect a desire to protect the rules associated with elite privilege, and to maintain dominance over the language we use to establish which social groups should be respected as the generators of knowledge (the recipients of prestige and funding, and perhaps the actors most influential in policy).

The challenge to objective science: 3. the democratisation of knowledge production

A third is the challenge to the idea that only well-trained scientists can produce valuable knowledge. This may involve valuing the knowledge of lived experience as a provider of new perspectives (particularly when people are in the unusual position to understand and compare their perspective and those of others). It also involves the development of new research methods and principles, combined with a political challenge to the dominance of a small number of scientific methods (for example, see rejections of the hierarchy of knowledge at which the systematic review of randomised control trials is often at the top).

Revisiting the live debate on the NPF and critical/ interpretive studies

This seems like good context for some of the debate on the NPF (see this special issue). One part of the debate may be about fundamentally different ideas about how we do research: do we adhere to specific scientific principles, or reject them in favour of a focus on, for example, generating meaning from statements and actions in particular contexts?

Another part may reflect wider political views on what these scientific principles represent (an elitist and exclusionary research agenda, whose rules reinforce existing privileges) and the role of alternative methods, in which critical policy studies may play an important part. In other words, we may be witnessing such a heated debate because critical theorists see the NPF as symbolic of attempts by some scholars to (a) reassert a politically damaging approach to academic research and (b) treat other forms of research as unscientific.

Where do we go from here?

If so, we have raised the stakes considerably. When I wrote previously about the problems of combining the insights and knowledge from different theories, it often related to the practical problems of research resources and potential for conceptual misunderstanding. Now, we face a more overt political dimension to social research and some fundamentally different understandings of its role by different social groups.

Can these understandings be reconciled, or will they remain ‘incommensurable’, in which we cannot generate agreement on the language to use to communicate research, and therefore the principles on which to compare the relative merits of approaches? I don’t know.

Initial further reading

Paying attention to this intellectual and political challenge provides a good way ‘in’ to reading that may seem relatively unfamiliar, at least for students with (a) some grounding in the policy theories I describe, and (b) looking to expand their horizons.

Possibly the closest link to our focus is when:

First, we know that policy problems do not receive policymaker attention because they are objectively important. Instead, actors compete to define issues and maximise attention to that definition. Second, we do the same when we analyse public policy: we decide which issues are worthy of study and how to define problems. Bacchi (1999) argues that the ‘conventional’ policy theorists (including Simon, Bardach, Lindblom, Wildavsky) try to ‘stand back from the policy process’ to give advice from afar, while others (including Fischer, Drysek, Majone) “recognise the analysts’ necessarily normative involvement in advice giving” (1999: 200). Combining both points, Bacchi argues that feminists should engage in both processes – to influence how policymakers and analysts define issues – to, for example, challenge ‘constructions of problems which work to disempower women’ (1999: 204). This is a topic (how should academics engage in the policy process?) which I follow up in a study of EBPM.

For a wider discussion of feminist studies and methods, see:

  • Fonow and Cook’s ‘pragmatic’ discussion about how to do feminist public policy research based on key principles:

‘Our original analysis of feminist approaches to social science research in women’s studies revealed some commonalities, which we articulated as guiding principles of feminist methodology: first, the necessity of continuously and reflexively attending to the significance of gender and gender asymmetry as a basic feature of all social life, including the conduct of research; second, the centrality of consciousness-raising or debunking as a specific methodological tool and as a general orientation or way of seeing; third, challenging the norm of objectivity that assumes that the subject and object of research can be separated from each other and that personal and/or grounded experiences are unscientific; fourth, concern for the ethical implications of feminist research and recognition of the exploitation of women as objects of knowledge; and finally, emphasis on the empowerment of women and transformation of patriarchal social institutions through research and research results’ (Fonow and Cook, 2005: 2213).

  • Lovenduski on early attempts to reinterpret political science through the lens of feminist theory/ research.

Note the links between our analysis of power/ideas and institutions as the norms and rules (informal and formal, written and unwritten) which help produce regular patterns of behaviour which benefit some and exclude others (and posts on bounded rationality, EBPM and complexity: people use simple rules to turn a complex world into manageable strategies, but to whose benefit?).

With feminist research comes a shift of focus from sex (as a primarily biological definition) and gender (as a definition based on norms and roles performed by individuals), and therefore the (ideal-type) ‘codes of masculinity and femininity’ which underpin political action and even help define which aspects of public policy are public or private. This kind of research links to box 3.3 in Understanding Public Policy (note that it relates to my discussion of Schattschneider and the privatisation/ socialisation of conflict, which he related primarily to ‘big business’).

box 3.3 gender policy

Then see two articles which continue our theme of combining theories and insights carefully:

  • Kenny’s discussion of feminist institutionalism, which seems like one of many variants of new institutionalism (e.g. this phrase could be found in many discussions of new institutionalism: ‘seemingly neutral institutional processes and practices are in fact embedded in hidden norms and values, privileging certain groups over others’ – Kenny, 2007: 95) but may involve ‘questioning the very foundations and assumptions of mainstream institutional theory’. Kenny argues that few studies of new institutionalism draw on feminist research (‘there has been little dialogue between the two fields’) and, if they were to do so, may produce very different analyses of power and ‘the political’. This point reinforces the problems I describe in combining theories when we ignore the different meanings that people attach to apparently identical concepts.
  • Mackay and Meier’s concern (quoted here) that new institutionalism could be ‘an enabling framework – or an intellectual strait-jacket” for feminist scholarship’. Kenny and Mackay identify similar issues about ‘epistemological incompatibilities’ when we combine approaches such as feminist research and rational choice institutionalism.
  • These approaches receive more coverage in the 2nd edition of Understanding Public Policy, and are summarised in Policy in 500 Words: Feminist Institutionalism

Here is one example of a link between ‘postcolonial’ studies and public policy:

  • Munshi and Kurian’s identify the use of ‘postcolonial filters’ to reinterpret the framing of corporate social responsibility, describing ‘the old colonial strategy of reputation management among elite publics at the expense of marginalized publics’ which reflects a ‘largely Western, top-down way of doing or managing things’. In this case, we are talking about frames as structures or dominant ways to understand the world. Actors exercise power to reinforce a particular way of thinking which benefits some at the expense of others. Munshi and Kurian describe a ‘dominant, largely Western, model of economic growth and development’ which corporations seek to protect with reference to, for example, the ‘greenwashing’ of their activities to divert attention from the extent to which ‘indigenous peoples and poorer communities in a number of developing countries “are generally the victims of environmental degradation mostly caused by resource extractive operations of MNCs in the name of global development”’ (see p516).

It is also worth noting that I have, in some ways, lumped feminism and postcolonialism together when they are separate fields with different (albeit often overlapping and often complementary) traditions. See for example Emejulu’s Beyond Feminism’s White Gaze.

For more discussion, please see

Policy Analysis in 750 words: Linda Tuhiwai Smith (2012) Decolonizing Methodologies

5 Comments

Filed under 1000 words, agenda setting, feminism, public policy, Social change

What is Policy?

what is policy

Compare with What is the Policy Process? and What is public policy and why does it matter?

The first thing we do when studying public policy is to try to define it – as, for example, the sum total of government action, from signals of intent to the final outcomes. This sort of definition produces more questions:

  • Does ‘government action’ include what policymakers say they will do as well as what they actually do? An unfulfilled promise may not always seem like policy.
  • Does it include the effects of a decision as well as the decision itself? A policy outcome may not resemble the initial policy aims.
  • What is ‘the government’ and does it include elected and unelected policymakers? Many individuals, groups and organisations influence policy and help carry it out.
  • Does public policy include what policymakers do not do. Policy is about power, which is often exercised to keep important issues off the public, media and government agenda.

The second thing we do is point to the vast scale of government, which is too big to be understood without some simplifying concepts and theories. It is also too big to be managed. We soon learn that the vast majority of policymaking takes place in the absence of meaningful public attention. The ‘public’ simply does not have the time to pay attention to government. Even when it pays attention to some issues, the debate is simplified and does not give a good account of the complicated nature of policy problems.

We also learn that government is too big to be managed by elected policymakers. Instead, they divide government into manageable units and devolve almost all decisions to bureaucrats and organisations (including ‘street level’).  They are responsible for government, but they simply do not have the time to pay attention to anything but a tiny proportion.

So, a big part of public policy is about what happens when neither the public nor elected policymakers have the ability to pay attention to what goes on in their name. That’s what makes it seem so messed up and so interesting at the same time.

It’s also what makes policy studies look so weird. We often reject a focus on high-profile elected policymakers, because we know that the action takes place elsewhere. We often focus on the day-to-day practices of organisations far removed from the ‘top’ or the ‘centre’. We ‘zoom in’ and ‘zoom out’ to gain several perspectives on the same thing. We spend a lot of time gnashing our teeth about how you can identify and measure policy change (still, no-one has cracked this one) and compare it with the past and the experience of other countries. We try to come up with ways to demonstrate that inaction is often more significant than action. When you ask us a question, your eyes will glaze over while we try to explain, ‘well, that’s really 12 questions’. We come up with wacky names to describe policymaking and bristle if you call it ‘jargon’. It’s because policymaking is complicated and it takes skill, and some useful concepts, to make it look simple.

To read more, see: Policy Concepts in 1000 words

box 2.1 UPP

(to store the podcast, right click and save this link)

16 Comments

Filed under 1000 words, agenda setting, public policy, UK politics and policy

Policy Concepts in 1000 Words: the intersection between evidence and policy transfer

(podcast download)

We can generate new insights on policymaking by connecting the dots between many separate concepts. However, don’t underestimate some major obstacles or how hard these dot-connecting exercises are to understand. They may seem clear in your head, but describing them (and getting people to go along with your description) is another matter. You need to set out these links clearly and in a set of logical steps. I give one example – of the links between evidence and policy transfer – which I have been struggling with for some time.

In this post, I combine three concepts – policy transfer, bounded rationality, and ‘evidence-based policymaking’ – to identify the major dilemmas faced by central government policymakers when they use evidence to identify a successful policy solution and consider how to import it and ‘scale it up’ within their jurisdiction. For example, do they use randomised control trials (RCTs) to establish the effectiveness of interventions and require uniform national delivery (to ensure the correct ‘dosage’), or tell stories of good practice and invite people to learn and adapt to local circumstances? I use these examples to demonstrate that our judgement of good evidence influences our judgement on the mode of policy transfer.

Insights from each concept

From studies of policy transfer, we know that central governments (a) import policies from other countries and/ or (b) encourage the spread (‘diffusion’) of successful policies which originated in regions within their country: but how do they use evidence to identify success and decide how to deliver programs?

From studies of ‘evidence-based policymaking’ (EBPM), we know that providers of scientific evidence identify an ‘evidence-policy gap’ in which policymakers ignore the evidence of a problem and/ or do not select the best evidence-based solution: but can policymakers simply identify the ‘best’ evidence and ‘roll-out’ the ‘best’ evidence-based solutions?

From studies of bounded rationality and the policy cycle (compared with alternative theories, such as multiple streams analysis or the advocacy coalition framework), we know that it is unrealistic to think that a policymaker at the heart of government can simply identify then select a perfect solution, click their fingers, and see it carried out. This limitation is more pronounced when we identify multi-level governance, or the diffusion of policymaking power across many levels and types of government. Even if they were not limited by bounded rationality, they would still face: (a) practical limits to their control of the policy process, and (b) a normative dilemma about how far you should seek to control subnational policymaking to ensure the delivery of policy solutions.

The evidence-based policy transfer dilemma

If we combine these insights we can identify a major policy transfer dilemma for central government policymakers:

  1. If subject to bounded rationality, they need to use short cuts to identify (what they perceive to be) the best sources of evidence on the policy problem and its solution.
  2. At the same time, they need to determine if there is convincing evidence of success elsewhere, to allow them to: (a) import policy from another country, and/ or (b) ‘scale up’ a solution that seems to be successful in one of its regions.
  3. Then they need to decide how to ‘spread success’, either by (a) ensuring that the best policy is adopted by all regions within its jurisdiction, or (b) accepting that their role in policy transfer is limited: they identify ‘best practice’ and merely encourage subnational governments to adopt particular policies.

Note how closely connected these concerns are: our judgement of the ‘best evidence’ can produce a judgement on how to ‘scale up’ success

Here are three ideal-type approaches to using evidence to transfer or ‘scale up’ successful interventions. In at least two cases, the choice of ‘best evidence’ seems linked inextricably to the choice of transfer strategy:

3 ideal types EBPM

With approach 1, you gather evidence of effectiveness with reference to a hierarchy of evidence, with systematic reviews and RCTs at the top (see pages 4, 15, 33). This has a knock-on effect for ‘scaling up’: you introduce the same model in each area, requiring ‘fidelity’ to the model to ensure you administer the correct ‘dosage’ and measure its effectiveness with RCTs.

With approach 2, you reject this hierarchy and place greater value on practitioner and service user testimony. You do not necessarily ‘scale up’. Instead, you identify good practice (or good governance principles) by telling stories based on your experience and inviting other people to learn from them.

With approach 3, you gather evidence of effectiveness based on a mix of evidence. You seek to ‘scale up’ best practice through local experimentation and continuous data gathering (by practitioners trained in ‘improvement methods’).

The comparisons between approaches 1 and 2 (in particular) show us the strong link between a judgement on evidence and transfer. Approach 1 requires particular methods to gather evidence and high policy uniformity when you transfer solutions, while approach 2 places more faith in the knowledge and judgement of practitioners.

Therefore, our choice of what counts as EBPM can determine our policy transfer strategy. Or, a different transfer strategy may – if you adhere to an evidential hierarchy – preclude EBPM.

Further reading

I describe these issues, with concrete examples of each approach here, and in far more depth here:

Evidence-based best practice is more political than it looks: ‘National governments use evidence selectively to argue that a successful policy intervention in one local area should be emulated in others (‘evidence-based best practice’). However, the value of such evidence is always limited because there is: disagreement on the best way to gather evidence of policy success, uncertainty regarding the extent to which we can draw general conclusions from specific evidence, and local policymaker opposition to interventions not developed in local areas. How do governments respond to this dilemma? This article identifies the Scottish Government response: it supports three potentially contradictory ways to gather evidence and encourage emulation’.

Both articles relate to ‘prevention policy’ and the examples (so far) are from my research in Scotland, but in a future paper I’ll try to convince you that the issues are ‘universal’

 

 

9 Comments

Filed under 1000 words, Evidence Based Policymaking (EBPM), Prevention policy, public policy

‘Evidence-based Policymaking’ and the Study of Public Policy

This post accompanies a 40 minute lecture (download) which considers ‘evidence-based policymaking’ (EBPM) through the lens of policy theory. The theory is important, to give us a language with which to understand EBPM as part of a wider discussion of the policy process, while the lens of EBPM allows us to think through the ‘real world’ application of concepts and theories.

To that end, I’ll make three key points:

  1. Definitions and clarity are important. ‘Evidence-based policymaking’, ‘evidence-based policy’ and related phrases such as ‘policy based evidence’ are used incredibly loosely in public debates. A focus on basic questions in policy studies – what is policy, and how can we measure policy change? – helps us clarify the issues, reject superficial debates on ‘evidence-based policy versus policy-based evidence’, and in some cases identify the very different assumptions people make about how policymaking works and should work.
  2. Realistic models are important. Discussing EBPM helps us identify the major flaws in simple models of policymaking such as the ‘policy cycle’. I’ll discuss the insights we gain by considering how policy scholars describe the implications of policymaker ‘bounded rationality’ and policymaking complexity.
  3. Realistic strategies are important. There is a lot of academic discussion of the need to overcome ‘barriers’ between evidence and policy. It is often atheoretical, producing naïve recommendations about improving the supply of evidence and training policymakers to understand it. I identify two more useful (but potentially controversial) strategies: be manipulative and learn where the ‘action’ is.

Definitions and clarity are important, so what is ‘evidence-based policymaking’?

What is Policy? It is incredibly difficult to say what policy is and measure how much it has changed. I use the working definition, ‘the sum total of government action, from signals of intent to the final outcomes’ to raise important qualifications: (a) it is problematic to conflate what people say they will do and what they actually do; (b) a policy outcome can be very different from the intention; (c) policy is made routinely through cooperation between elected and unelected policymakers and actors with no formal role in the process; (d) policymaking is also about the power not to do something. It is also important to identify the many components or policy instruments that make up policies, including: the level of spending; the use of economic incentives/ penalties; regulations and laws; the use of voluntary agreements and codes of conduct; the provision of public services; education campaigns; funding for scientific studies or advocacy; organisational change; and, the levels of resources/ methods dedicated to policy implementation (2012a: 26).

In that context, we are trying to capture a process in which actors make and deliver ‘policy’ continuously, not identify a set-piece event which provides a single opportunity to use a piece of scientific evidence to prompt a policymaker response.

Who are the policymakers? The intuitive definition is ‘people who make policy’, but there are two important distinctions: (1) between elected and unelected participants, since people such as civil servants also make important decisions; (2) between people and organisations, with the latter used as a shorthand to refer to a group of people making decisions collectively. There are blurry dividing lines between the people who make and influence policy. Terms such as ‘policy community’ suggest that policy decisions are made by a collection of people with formal responsibility and informal influence. Consequently, we need to make clear what we mean by ‘policymakers’ when we identify how they use evidence.

What is evidence? We can define evidence as an argument backed by information. Scientific evidence describes information produced in a particular way. Some describe ‘scientific’ broadly, to refer to information gathered systematically using recognised methods, while others refer to a specific hierarchy of scientific methods, with randomized control trials (RCTs) and the systematic review of RCTs at the top. This is a crucial point:

policymakers will seek many kinds of information that many scientists would not consider to be ‘the evidence’.

This discussion helps identify two key points of potential confusion when people discuss EBPM:

  1. When you describe ‘evidence-based policy’ and EBPM you need to clarify what the policy is and who is making it. This is not just about some elected politicians making announcements.
  2. When you describe ‘evidence’ you need to clarify what counts as evidence and what an ‘evidence-based’ policy response would look like. This point is at the heart of often fruitless discussions about ‘policy based evidence’, which seems to describe almost a dozen alleged mistakes by policymakers (relating to ignoring evidence, using the wrong kinds, and/ or producing a disproportionate response).

Realistic models are important, so what is wrong with the policy cycle?

One traditional way to understand policymaking in the ‘real world’ is to compare it to an ideal-type: what happens when the conditions of the ideal-type are not met? We do this in particular with the ‘policy cycle and ‘comprehensive rationality’.

So, consider this modified ideal-type of EBPM:

  • There is a core group of policymakers at the ‘centre’, making policy from the ‘top down’, breaking down their task into clearly defined and well-ordered stages;
  • Scientists are in a privileged position to help those policymakers make good decisions by getting them as close as possible to the ideal of ‘comprehensive rationality’ in which they have the best information available to inform all options and consequences.

So far, so good (although you might stop to consider who is best placed to provide evidence, and who – or which methods of evidence gathering – should be privileged or excluded), but what happens when we move away from the ideal-type? Here are two insights from a forthcoming paper (Cairney Oliver Wellstead 26.1.16).

Lessons from policy theory: 1. Identify multi-level policymaking environments

First, policymaking takes place in less ordered and predictable policy environment, exhibiting:

  • a wide range of actors (individuals and organisations) influencing policy at many levels of government
  • a proliferation of rules and norms followed by different levels or types of government
  • close relationships (‘networks’) between policymakers and powerful actors
  • a tendency for certain beliefs or ‘paradigms’ to dominate discussion
  • shifting policy conditions and events that can prompt policymaker attention to lurch at short notice.

A focus on this bigger picture shifts our attention from the use of scientific evidence by an elite group of elected policymakers at the ‘top’ to its use by a wide range of influential actors in a multi-level policy process. It shows scientists and practitioners that they are competing with many actors to present evidence in a particular way to secure a policymaker audience. Support for particular solutions varies according to which organisation takes the lead and how it understands the problem. Some networks are close-knit and difficult to access because bureaucracies have operating procedures that favour particular sources of evidence and some participants over others, and there is a language – indicating what ways of thinking are in good ‘currency’ (such as ‘value for money’) – that takes time to learn. Well-established beliefs provide the context for policymaking: new evidence on the effectiveness of a policy solution has to be accompanied by a shift of attention and successful persuasion. In some cases, social or economic ‘crises’ can prompt lurches of attention from one issue to another, and some forms of evidence can be used to encourage that shift. In this context, too many practitioner studies analyse, for example, a singular point of central government decision rather than the longer term process. Overcoming barriers to influence in that small part of the process will not provide an overall solution.

Lessons from policy theory: 2. Policymakers use two ‘shortcuts’ to make decisions

How do policymakers deal with their ‘bounded rationality’? They employ two kinds of shortcut: ‘rational’, by pursuing clear goals and prioritizing certain kinds and sources of information, and ‘irrational’, by drawing on emotions, gut feelings, deeply held beliefs, habits, and the familiar to make decisions quickly. Consequently, the focus of policy theories is on the links between evidence, persuasion, and framing (in the wider context of a tendency for certain beliefs to dominate discussion).

Framing refers to the ways in which we understand, portray, and categorise issues. Problems are multi-faceted, but bounded rationality limits the attention of policymakers, and actors compete to highlight one image at the expense of others. The outcome of this process determines who is involved (for example, portraying an issue as technical limits involvement to experts), who is responsible for policy, how much attention they pay, and what kind of solution they favour. For example, tobacco control is more likely when policymakers view it primarily as a public health epidemic rather than an economic good, while ‘fracking’ policy depends on its primary image as a new oil boom or environmental disaster (I discuss both examples in depth here).

Scientific evidence plays a part in this process, but we should not exaggerate the ability of scientists to win the day with reference to evidence. Rather, policy theories signal the strategies that practitioners may have to adopt to increase demand for their evidence:

  • to combine facts with emotional appeals, to prompt lurches of policymaker attention from one policy image to another (punctuated equilibrium theory)
  • to tell simple stories which are easy to understand, help manipulate people’s biases, apportion praise and blame, and highlight the moral and political value of solutions (narrative policy framework)
  • to interpret new evidence through the lens of the pre-existing beliefs of actors within coalitions, some of which dominate policy networks (advocacy coalition framework)
  • to produce a policy solution that is feasible and exploit a time when policymakers have the opportunity to adopt it (multiple streams analysis).

Further, the impact of a framing strategy may not be immediate, even if it appears to be successful. Scientific evidence may prompt a lurch of attention to a policy problem, prompting a shift of views in one venue or the new involvement of actors from other venues. However, for example, it can take years to produce support for an ‘evidence-based’ policy solution, built on its technical and political feasibility (will it work as intended, and do policymakers have the motive and opportunity to select it?).

This discussion helps identify two key points of potential confusion when people discuss the policy cycle and comprehensive rationality:

  1. These concepts are there to help us understand what doesn’t happen. What are the real world implications of the limits to these models?
  2. They do not help you give good advice to people trying to influence the policy process. A focus on going through policymaking ‘stages’ and improving ‘rationality’ is always relevant when you give advice to policymakers. However unrealistic these models are, you would still want to gather the maximum information and go through a process of stages. This is very different from (a) giving advice on how to influence the process, or (b) evaluating the pros and cons of a political system with reference to ideal-types.

Realistic strategies are important, so how far should you go to overcome ‘barriers’ between evidence and policy?

You can’t take the politics out of EBPM. Even the selection of ‘the evidence’ is political (should evidence be scientific, and what counts as scientific evidence?).

Further, providers of scientific evidence face major dilemmas when they seek to maximise the ‘impact’ of their research. Armed with this knowledge of the policy process, how should you seek to engage and influence decisions made within it?

If you are interested in this final discussion, please see the short video here and the follow up blog post: Political science improves our understanding of evidence-based policymaking, but does it produce better advice?

See also:

This post is one of many on EBPM. The full list is here: https://paulcairney.wordpress.com/ebpm/

To bridge the divide between evidence and policy: reduce ambiguity as much as uncertainty

 

12 Comments

Filed under 1000 words, Evidence Based Policymaking (EBPM), public policy

How not to write a public policy article (combining theory & empirical study)*

There is no ‘general theory’ of public policy.

No theory can help explain or describe all of the details, of decisions and events, in a case study.

All theories have gaps and flaws.

So, what do we do about it?

The simplest strategy is to adopt a well-established theory (some examples here), get to know it in great detail, describe its literature comprehensively, and show how its insights help explain something important. You’d get a decent PhD from this approach and could, I think, build a solid academic career by keeping things this simple.

The alternative is to be more ambitious, to seek to make your mark on policy theory. In this case, it’s hard to say how to do it, but it is important to stress what not to do:

  1. Assert that existing theories should be rejected without demonstrating an inside-out knowledge of them.
  2. Propose a new hybrid theory without explaining its original elements or describing how the new study can be compared to the old.
  3. Build an argument for a new theory on the insights from one case study (not to be confused with scholars using cases as illustrative examples, to help give form to abstract concepts).

I say that as someone who: (a) reads 10-20 journal article submissions per year and sees the same combination of these three mistakes, and (b) reviews collections of articles, often struggling to see how they relate to each other, even when they claim to represent the same theory.

What I see is a tendency for scholars to underplay the importance of the old/ established literature and overreach when making claims for their new approach. Then, they provide a detailed case study, with elements not explained by the old theory, to justify the new.

I guess the driver is an incentive in academia that produces unintended consequences. When starting out as academics we soon get the sense that we need to establish our academic credentials by showing how we provide ‘added value’ to knowledge. So:

Who wants to read an article from someone who is just diligent and competent, can explain a theory in depth, and demonstrate its ability to help you ask the right questions and answer them well? I do.

Wouldn’t you rather read about a brand new theory that sweeps aside everything that came before? Usually, no. Not unless you can demonstrate its added value in a systematic way, rather than simply saying that other relevant theories fail to explain something and are flawed. There is no ‘general theory’ of public policy that explains everything. No theory can help explain or describe all of the details, of decisions and events, in a case study. All theories have gaps and flaws. So, building a new theory primarily on the back of the flaws of an old one shouldn’t really impress anyone.

 

*in my humble/ grumpy opinion/ Other opinions are available

 

1 Comment

Filed under 1000 words, public policy, Uncategorized

Policy Concepts in 1000 Words: the Social Construction of Target Populations

(podcast download)

The ‘social construction of target populations’ (SCTP) literature identifies:

  1. The value judgements that policymakers express when justifying their agendas to legislatures and the public.
  2. The enduring impact of these value-driven policies beyond the terms of single elections (and often long after they have left office).

Schneider, Ingram and Deleon identify the importance of this process in three main steps.

First, when competing for elected public office, people articulate value judgements and make fundamental choices about which social groups should be treated differently by government bodies. They present arguments for rewarding ‘good’ groups with government support and punishing ‘bad’ groups with sanctions. This description, which may seem rather simplistic, highlights the tendency of policymakers to make quick and superficial judgements, and back up their impressions with selective facts, before distributing rewards and sanctions. There is a crucial ‘fast thinking’ element to policymaking. Policymakers make quick, biased, emotional judgements, then back up their actions with selective facts to ‘institutionalize’ their understanding of a policy problem and its solution.

Second, these judgements can have an enduring ‘feed-forward’ effect: fundamental choices based on values are reproduced in the institutions devoted to policy delivery. Policy designs based on emotionally-driven thinking often become routine and questioned rarely in government.

Third, this decision has an impact on citizens and groups, who participate more or less in politics according to how they are characterised by government. Some groups can become more or less powerful, and categorised differently, if they have the resources to mobilise and challenge the way they are perceived by policymakers (and the media and public). However, this outcome may take decades in the absence of a major event, such as an economic crisis or game-changing election.

Overall, past policies, based on rapid emotional judgements and policymakers’ values, provide key context for policymaking. The distribution of rewards and sanctions is cumulative, influencing future action by signalling to target populations how they are described and will be treated. Social constructions are difficult to overcome, because a sequence of previous policies, based on a particular framing of target populations, produces ‘hegemony’: the public, media and/ or policymakers take this set of values for granted, as normal or natural, and rarely question them when engaging in politics.

SCTP builds on classic discussions of power, in which actors exercise power to reinforce or challenge policymaker and social attitudes. For example, if most people assume that people in poverty deserve little government help, because they are largely responsible for their own fate, policymakers have little incentive to intervene. In such cases, power and powerlessness relates to the inability of disadvantaged groups to persuade the public, media and/ or government that there is a reason to make policy or a problem to be solved. Or, people may take for granted that criminals should be punished because they are engaging in deviant behaviour. To challenge policies based on this understanding, groups have to challenge fundamental public assumptions, reinforced by government policy, regarding what constitutes normal and deviant behaviour. Yet, many such groups have no obvious way in which to mobilise to pursue their collective interests.

SCTP depicts this dilemma with a notional table (page 102) in which there are two spectrums: one describes the positive or negative ways in which groups are portrayed by policymakers, the other describes the resources available to groups to challenge or reinforce that image. The powerful and positively constructed are ‘advantaged’; the powerful and negatively constructed are ‘contenders’; the powerless and positively constructed are ‘dependents’; the powerless and negatively constructed are ‘deviants’. As such, the table represents an abstract account of policymaking context, in which some groups are more likely to be favoured or stigmatised by government, and some groups are better able to exploit their favourable, or challenge their unfavourable, image.

 sctp 2007

It represents the starting point to empirical analysis since, although some examples seem intuitive (many ‘criminals’ are punished by government and have minimal ways in which to mobilise to influence policy), many are time-specific (the ‘feminist movement’ has been more or less active over time) and place-specific (gun manufacturers are high profile in the US, but not the UK). Different populations are also more or less favoured by policymakers at different levels of government – for example, ‘street level’ professionals may treat certain ‘deviant’ populations, such as intravenous drug users, more sympathetically – and may, for example, find it easier to mobilise at local than national levels. Further, people do not fit neatly into these categories – many ‘mothers’ are also ‘scientists’ and/ or part of the ‘feminist movement’ – and may mobilise according to their own perception of their identity.

Still, SCTP demonstrates that policymakers can treat people in certain ways, based on a quick, emotional and simplistic understanding of their background, and that this way of thinking should not be forgotten simply because it is taken for granted. Indeed, governments may go one step further to reinforce these judgements: capitalising on ‘fast thinking’ in the population by constructing simple ‘narratives’ designed to justify policy action to a public that may be prone to accept simple stories that seem plausible, confirm their biases, exploit their emotions, and/ or come from a source they trust. Actors compete to tell ‘stories, to quickly assign blame to one group of people, or praise another, even though that group is heterogeneous and cause/effect is multifaceted. The winner of this competition may help produce a policy response which endures for years, if not decades.

This post is part of the ‘1000 words’ series https://paulcairney.wordpress.com/1000-words/

For more on social construction, see:

Social Construction and Policy Design

Who are the most deserving and entitled to government benefits?

 

9 Comments

Filed under 1000 words, agenda setting, public policy