Tag Archives: policy design

The politics of policy design

This post summarizes the conclusion of ‘The politics of policy design’ for a Design and Policy Network workshop (15th June).  A separate post summarizes the discussion and links to video presentations.

My contribution to this interdisciplinary academic-practitioner discussion is to present insights from political science and policy process research, which required me to define some terms (background) before identifying three cautionary messages.

Background

A broad definition of policy design as an activity is to (1) define policy aims, and (2) identify the tools to deliver those aims (compare with policy analysis).

However, note the verb/noun distinction, and common architectural metaphor, to distinguish between the (a) act of design, and (b) the output (e.g. the blueprints).

In terms of the outputs, tools can be defined narrowly as policy instruments – including tax/spending, regulations, staff and other resources for delivery, information sharing, ‘nudging’, etc. – or more widely to include the processes involved in their formulation (such as participatory and deliberative). Therefore, we could be describing:

  • A highly centralized process, involving very few people, to produce the equivalent of a blueprint.
  • A decentralized, and perhaps uncoordinated, process involving many people, built on the principle that to seek a blueprint would be to miss the point of participation and deliberation.

Policymaking research tends to focus on

(1) measuring policy change with reference to the ‘policy mix’ of these tools/ instruments, and generally showing that most policy change is minor (and some is major) (link1, link2, link3, link4), and/ or

(2) how to understand the complex policymaking systems or environments in which policy design processes take place.

These studies are the source of my messages of doom.

Three cautionary messages about new policy design

There is a major gap between the act of policy design and actual policies and policy processes. This issue led to the decline of old policy design studies in the 1980s.

While ‘new policy design’ scholars seek to reinvigorate the field, the old issues serve as a cautionary tale, reminding us that (1) policy design is not new, and (2) its decline did not relate to the lack of sophisticated skills or insights among policy designers.

In other words, these old problems will not simply be solved by modern scientific, methodological, or policy design advances. Rather, I encourage policy designers to pay particular attention to:

1. The gap between functional requirements and real world policymaking.

Policy analysts and designers often focus on what they need, or require to get their job done or produce the outcomes they seek.

Policy process researchers identify the major, inevitable, gaps between those requirements and actual policy processes (to the extent that the link between design and policy is often difficult to identify).

2. The strong rationale for the policy processes that undermine policy design.

Policy processes – and their contribution to policy mixes – may seem incoherent from a design perspective. However, they make sense to the participants involved.

Some relate to choice, including to share responsibility for instruments across many levels or types of government (without focusing on how those responsibilities will connect or be coordinated).

Some result from necessity, to delegate responsibility to many policy communities spread across government, each with their own ways to define and address problems (without the ability to know how those responsibilities will be connected).

3. The policy analysis and design dilemmas that cannot be solved by design methods alone.

When seen from the ‘top down’, design problems often relate to the perceived lack of delivery or follow-through in relation to agreed high level design outputs (great design, poor delivery).

When seen from the ‘bottom up’, they represent legitimate ways to incorporate local stakeholder and citizen perspectives. This process will inevitably produce a gap between different sources and outputs of design, making it difficult to separate poor delivery (bad?) from deviation (good?).

Such dynamics are solved via political choice rather than design processes and  techniques.

You can hear my presentation below (it took a while to get going because I wasn’t sure who could hear me):

Notes on the workshop discussion

The workshop discussion prompted us initially to consider how many different people would define it. The range of responses included seeing policy design as:

  • a specific process with specific tools to produce a well-defined output (applied to specific areas conducive to design methods)
  • a more general philosophy or way of thinking about things like policy issues (compare with systems thinking)
  • a means to encourage experimentation (such as to produce a prototype policy instrument, use it, and reflect or learn about its impact) or change completely how people think about an issue
  • the production of a policy solution, or one part of a large policy mix
  • a niche activity in one unit of government, or something mainstreamed across governments
  • something done in government, or inside and outside of government
  • producing something new (like writing on a blank sheet of paper), adding to a pile of solutions, or redesigning what exists
  • primarily a means to empower people to tell their story, or as a means to improve policy advocacy (as in discussions of narrative/ storytelling)
  • something done with authoritative policymakers like government ministers (in other words, people with the power to make policy changes after they participate in design processes) or given to them (in other words, the same people but as the audience for the outcomes of design)

These definitions matter since they have very different implications for policy and practice. Take, for example, the link – made by Professor Liz Richardson – between policy design and the idea of evidence-based policymaking, to consider two very different scenarios:

  1. A minister is directly involved in policy design processes. They use design thinking to revisit how they think about a policy problem (and target populations), seek to foster participation and deliberation, and use that process – perhaps continuously – to consider how to reconcile very different sources of evidence (including, say, new data from randomized control trials and powerful stories from citizens, stakeholders, service users). I reckon that this kind of scenario would be in the minds of people who describe policy design optimistically.
  2. A minister is the intended audience of a report on the outcomes of policy design. You assume that their thoughts on a policy problem are well-established. There is no obvious way for them to reconcile different sources of policy-relevant evidence. Crucially, the fruits of your efforts have made a profound impact on the people involved but, for the minister, the outcome is just one of too-many sources of information (likely produced too soon before or after they want to consider the issue).

The second scenario is closer to the process that I describe in the main post, although policy studies would warn against seeing someone like a government minister as authoritative in the sense that they reside in the centre of government. Rather, studies of multi-centric policymaking remind us that there are many possible centres spread across political systems. If so, policy design – according to approaches like the IAD – is about ways to envisage a much bigger context in which design success depends on the participation and agreement of a large number of influential actors (who have limited or no ability to oblige others to cooperate).

See also

Dr Jocelyn Bailey, Tensions and resistances in the field of design in policy

Further Reading

Paul Cairney (2022) ‘The politics of policy design’, EURO Journal on Decision Processes  https://doi.org/10.1016/j.ejdp.2021.100002

Paul Cairney, Tanya Heikkila, and Matthew Wood (2019) Making Policy in a Complex World (Cambridge Elements) PDF Blog

Complex systems and systems thinking (part of a series of thematic posts on policy analysis)

3 Comments

Filed under agenda setting, Evidence Based Policymaking (EBPM), Policy learning and transfer, public policy

Policy Analysis in 750 Words: policy analysis for marginalized groups in racialized political systems

Note: this post forms one part of the Policy Analysis in 750 words series overview.

For me, this story begins with a tweet by Professor Jamila Michener, about a new essay by Dr Fabienne Doucet, ‘Centering the Margins: (Re)defining Useful Research Evidence Through Critical Perspectives’:

Research and policy analysis for marginalized groups

For Doucet (2019: 1), it begins by describing the William T. Grant Foundation’s focus on improving the ‘use of research evidence’ (URE), and the key questions that we should ask when improving URE:

  1. For what purposes do policymakers find evidence useful?

Examples include to: inform a definition of problems and solutions, foster practitioner learning, support an existing political position, or impose programmes backed by evidence (compare with How much impact can you expect from your analysis?).

  1.   Who decides what to use, and what is useful?

For example, usefulness could be defined by the researchers providing evidence, the policymakers using it, the stakeholders involved in coproduction, or the people affected by research and policy (compare with Bacchi, Stone and Who should be involved in the process of policy analysis?).

  1. How do critical theories inform these questions? (compare with T. Smith)

First, they remind us that so-called ‘rational’ policy processes have incorporated research evidence to help:

‘maintain power hierarchies and accept social inequity as a given. Indeed, research has been historically and contemporaneously (mis)used to justify a range of social harms from enslavement, colonial conquest, and genocide, to high-stakes testing, disproportionality in child welfare services, and “broken windows” policing’ (Doucet, 2019: 2)

Second, they help us redefine usefulness in relation to:

‘how well research evidence communicates the lived experiences of marginalized groups so that the understanding of the problem and its response is more likely to be impactful to the community in the ways the community itself would want’ (Doucet, 2019: 3)

In that context, potential responses include to:

  1. Recognise the ways in which research and policy combine to reproduce the subordination of social groups.
  • General mechanisms include: the reproduction of the assumptions, norms, and rules that produce a disproportionate impact on social groups (compare with Social Construction and Policy Design).
  • Specific mechanism include: judging marginalised groups harshly according to ‘Western, educated, industrialized, rich and democratic’ norms (‘WEIRD’)
  1. Reject the idea that scientific research can be seen as objective or neutral (and that researchers are beyond reproach for their role in subordination).
  2. Give proper recognition to ‘experiential knowledge’ and ‘transdiciplinary approaches’ to knowledge production, rather than privileging scientific knowledge.
  3. Commit to social justice, to help ‘eliminate oppressions and to emancipate and empower marginalized groups’, such as by disrupting ‘the policies and practices that disproportionately harm marginalized groups’ (2019: 5-7)
  4. Develop strategies to ‘center race’, ‘democratize’ research production, and ‘leverage’ transdisciplinary methods (including poetry, oral history and narrative, art, and discourse analysis – compare with Lorde) (2019: 10-22)

See also Doucet, F. (2021) ‘Identifying and Testing Strategies to Improve the Use of Antiracist Research Evidence through Critical Race Lenses

Policy analysis in a ‘racialized polity’

A key way to understand these processes is to use, and improve, policy theories to explain the dynamics and impacts of a racialized political system. For example, ‘policy feedback theory’ (PFT) draws on elements from historical institutionalism and SCPD to identify the rules, norms, and practices that reinforce subordination.

In particular, Michener’s (2019: 424) ‘Policy Feedback in a Racialized Polity’ develops a ‘racialized feedback framework (RFF)’ to help explain the ‘unrelenting force with which racism and White supremacy have pervaded social, economic, and political institutions in the United States’. Key mechanisms include (2019: 424-6):

  1. Channelling resources’, in which the rules, to distribute government resources, benefit some social groups and punish others.
  • Examples include: privileging White populations in social security schemes and the design/ provision of education, and punishing Black populations disproportionately in prisons (2019: 428-32).
  • These rules also influence the motivation of social groups to engage in politics to influence policy (some citizens are emboldened, others alienated).
  1. Generating interests’, in which ‘racial stratification’ is a key factor in the power of interest groups (and balance of power in them).
  2. Shaping interpretive schema’, in which race is a lens through which actors understand, interpret, and seek to solve policy problems.
  3. The ways in which centralization (making policy at the federal level) or decentralization influence policy design.
  • For example, the ‘historical record’ suggests that decentralization is more likely to ‘be a force of inequality than an incubator of power for people of color’ (2019: 433).

Insufficient attention to race and racism: what are the implications for policy analysis?

One potential consequence of this lack of attention to race, and the inequalities caused by racism in policy, is that we place too much faith in the vague idea of ‘pragmatic’ policy analysis.

Throughout the 750 words series, you will see me refer generally to the benefits of pragmatism:

In that context, pragmatism relates to the idea that policy analysis consists of ‘art and craft’, in which analysts assess what is politically feasible if taking a low-risk client-oriented approach.

In this context, pragmatism may be read as a euphemism for conservatism and status quo protection.

In other words, other posts in the series warn against too-high expectations for entrepreneurial and systems thinking approaches to major policy change, but they should not be read as an excuse to reject ambitious plans for much-needed changes to policy and policy analysis (compare with Meltzer and Schwartz, who engage with this dilemma in client-oriented advice).

Connections to blog themes

This post connects well to:

6 Comments

Filed under 750 word policy analysis, Evidence Based Policymaking (EBPM), public policy, Storytelling

Policy Analysis in 750 words: William Dunn (2017) Public Policy Analysis

Please see the Policy Analysis in 750 words series overview before reading the summary. This book is a whopper, with almost 500 pages and 101 (excellent) discussions of methods, so 800 words over budget seems OK to me. If you disagree, just read every second word.  By the time you reach the cat hanging in there baby you are about 300 (150) words away from the end.

Dunn 2017 cover

William Dunn (2017) Public Policy Analysis 6th Ed. (Routledge)

Policy analysis is a process of multidisciplinary inquiry aiming at the creation, critical assessment, and communication of policy-relevant knowledge … to solve practical problemsIts practitioners are free to choose among a range of scientific methods, qualitative as well as quantitative, and philosophies of science, so long as these yield reliable knowledge’ (Dunn, 2017: 2-3).

Dunn (2017: 4) describes policy analysis as pragmatic and eclectic. It involves synthesising policy relevant (‘usable’) knowledge, and combining it with experience and ‘practical wisdom’, to help solve problems with analysis that people can trust.

This exercise is ‘descriptive’, to define problems, and ‘normative’, to decide how the world should be and how solutions get us there (as opposed to policy studies/ research seeking primarily to explain what happens).

Dunn contrasts the ‘art and craft’ of policy analysts with other practices, including:

  1. The idea of ‘best practice’ characterised by 5-step plans.
  • In practice, analysis is influenced by: the cognitive shortcuts that analysts use to gather information; the role they perform in an organisation; the time constraints and incentive structures in organisations and political systems; the expectations and standards of their profession; and, the need to work with teams consisting of many professions/ disciplines (2017: 15-6)
  • The cost (in terms of time and resources) of conducting multiple research and analytical methods is high, and highly constrained in political environments (2017: 17-8; compare with Lindblom)
  1. The too-narrow idea of evidence-based policymaking
  • The naïve attachment to ‘facts speak for themselves’ or ‘knowledge for its own sake’ undermines a researcher’s ability to adapt well to the evidence-demands of policymakers (2017: 68; 4 compare with Why don’t policymakers listen to your evidence?).

To produce ‘policy-relevant knowledge’ requires us to ask five questions before (Qs1-3) and after (Qs4-5) policy intervention (2017: 5-7; 54-6):

  1. What is the policy problem to be solved?
  • For example, identify its severity, urgency, cause, and our ability to solve it.
  • Don’t define the wrong problem, such as by oversimplifying or defining it with insufficient knowledge.
  • Key aspects of problems including ‘interdependency’ (each problem is inseparable from a host of others, and all problems may be greater than the sum of their parts), ‘subjectivity’ and ‘artificiality’ (people define problems), ‘instability’ (problems change rather than being solved), and ‘hierarchy’ (which level or type of government is responsible) (2017: 70; 75).
  • Problems vary in terms of how many relevant policymakers are involved, how many solutions are on the agenda, the level of value conflict, and the unpredictability of outcomes (high levels suggest ‘wicked’ problems, and low levels ‘tame’) (2017: 75)
  • ‘Problem-structuring methods’ are crucial, to: compare ways to define or interpret a problem, and ward against making too many assumptions about its nature and cause; produce models of cause-and-effect; and make a problem seem solve-able, such as by placing boundaries on its coverage. These methods foster creativity, which is useful when issues seem new and ambiguous, or new solutions are in demand (2017: 54; 69; 77; 81-107).
  • Problem definition draws on evidence, but is primarily the exercise of power to reduce ambiguity through argumentation, such as when defining poverty as the fault of the poor, the elite, the government, or social structures (2017: 79; see Stone).
  1. What effect will each potential policy solution have?
  • Many ‘forecasting’ methods can help provide ‘plausible’ predictions about the future effects of current/ alternative policies (Chapter 4 contains a huge number of methods).
  • ‘Creativity, insight, and the use of tacit knowledge’ may also be helpful (2017: 55).
  • However, even the most-effective expert/ theory-based methods to extrapolate from the past are flawed, and it is important to communicate levels of uncertainty (2017: 118-23; see Spiegelhalter).
  1. Which solutions should we choose, and why?
  • ‘Prescription’ methods help provide a consistent way to compare each potential solution, in terms of its feasibility and predicted outcome, rather than decide too quickly that one is superior (2017: 55; 190-2; 220-42).
  • They help to combine (a) an estimate of each policy alternative’s outcome with (b) a normative assessment.
  • Normative assessments are based on values such as ‘equality, efficiency, security, democracy, enlightenment’ and beliefs about the preferable balance between state, communal, and market/ individual solutions (2017: 6; 205 see Weimer & Vining, Meltzer & Schwartz, and Stone on the meaning of these values).
  • For example, cost benefit analysis (CBA) is an established – but problematic – economics method based on finding one metric – such as a $ value – to predict and compare outcomes (2017: 209-17; compare Weimer & Vining, Meltzer & Schwartz, and Stone)
  • Cost effectiveness analysis uses a $ value for costs, but compared with other units of measurement for benefits (such as outputs per $) (2017: 217-9)
  • Although such methods help us combine information and values to compare choices, note the inescapable role of power to decide whose values (and which outcomes, affecting whom) matter (2017: 204)
  1. What were the policy outcomes?
  • ‘Monitoring’ methods help identify (say): levels of compliance with regulations, if resources and services reach ‘target groups’, if money is spent correctly (such as on clearly defined ‘inputs’ such as public sector wages), and if we can make a causal link between the policy inputs/ activities/ outputs and outcomes (2017: 56; 251-5)
  • Monitoring is crucial because it is so difficult to predict policy success, and unintended consequences are almost inevitable (2017: 250).
  • However, the data gathered are usually no more than proxy indicators of outcomes. Further, the choice of indicators reflect what is available, ‘particular social values’, and ‘the political biases of analysts’ (2017: 262)
  • The idea of ‘evidence based policy’ is linked strongly to the use of experiments and systematic review to identify causality (2017: 273-6; compare with trial-and-error learning in Gigerenzer, complexity theory, and Lindblom).
  1. Did the policy solution work as intended? Did it improve policy outcomes?
  • Although we frame policy interventions as ‘solutions’, few problems are ‘solved’. Instead, try to measure the outcomes and the contribution of your solution, and note that evaluations of success and ‘improvement’ are contested (2017: 57; 332-41).  
  • Policy evaluation is not an objective process in which we can separate facts from values.
  • Rather, values and beliefs are part of the criteria we use to gauge success (and even their meaning is contested – 2017: 322-32).
  • We can gather facts about the policy process, and the impacts of policy on people, but this information has little meaning until we decide whose experiences matter.

Overall, the idea of ‘ex ante’ (forecasting) policy analysis is a little misleading, since policymaking is continuous, and evaluations of past choices inform current choices.

Policy analysis methods are ‘interdependent’, and ‘knowledge transformations’ describes the impact of knowledge regarding one question on the other four (2017: 7-13; contrast with Meltzer & Schwartz, Thissen & Walker).

Developing arguments and communicating effectively

Dunn (2017: 19-21; 348-54; 392) argues that ‘policy argumentation’ and the ‘communication of policy-relevant knowledge’ are central to policymaking’ (See Chapter 9 and Appendices 1-4 for advice on how to write briefs, memos, and executive summaries and prepare oral testimony).

He identifies seven elements of a ‘policy argument’ (2017: 19-21; 348-54), including:

  • The claim itself, such as a description (size, cause) or evaluation (importance, urgency) of a problem, and prescription of a solution
  • The things that support it (including reasoning, knowledge, authority)
  • Incorporating the things that could undermine it (including any ‘qualifier’, the communication of uncertainty about current knowledge, and counter-arguments).

The key stages of communication (2017: 392-7; 405; 432) include:

  1. ‘Analysis’, focusing on ‘technical quality’ (of the information and methods used to gather it), meeting client expectations, challenging the ‘status quo’, albeit while dealing with ‘political and organizational constraints’ and suggesting something that can actually be done.
  2. ‘Documentation’, focusing on synthesising information from many sources, organising it into a coherent argument, translating from jargon or a technical language, simplifying, summarising, and producing user-friendly visuals.
  3. ‘Utilization’, by making sure that (a) communications are tailored to the audience (its size, existing knowledge of policy and methods, attitude to analysts, and openness to challenge), and (b) the process is ‘interactive’ to help analysts and their audiences learn from each other.

 

hang-in-there-baby

 

Policy analysis and policy theory: systems thinking, evidence based policymaking, and policy cycles

Dunn (2017: 31-40) situates this discussion within a brief history of policy analysis, which culminated in new ways to express old ambitions, such as to:

  1. Use ‘systems thinking’, to understand the interdependence between many elements in complex policymaking systems (see also socio-technical and socio-ecological systems).
  • Note the huge difference between (a) policy analysis discussions of ‘systems thinking’ built on the hope that if we can understand them we can direct them, and (b) policy theory discussions that emphasise ‘emergence’ in the absence of central control (and presence of multi-centric policymaking).
  • Also note that Dunn (2017: 73) describes policy problems – rather than policymaking – as complex systems. I’ll write another post (short, I promise) on the many different (and confusing) ways to use the language of complexity.
  1. Promote ‘evidence based policy, as the new way to describe an old desire for ‘technocratic’ policymaking that accentuates scientific evidence and downplays politics and values (see also 2017: 60-4).

In that context, see Dunn’s (47-52) discussion of comprehensive versus bounded rationality:

  • Note the idea of ‘erotetic rationality’ in which people deal with their lack of knowledge of a complex world by giving up on the idea of certainty (accepting their ‘ignorance’), in favour of a continuous process of ‘questioning and answering’.
  • This approach is a pragmatic response to the lack of order and predictability of policymaking systems, which limits the effectiveness of a rigid attachment to ‘rational’ 5 step policy analyses (compare with Meltzer & Schwartz).

Dunn (2017: 41-7) also provides an unusually useful discussion of the policy cycle. Rather than seeing it as a mythical series of orderly stages, Dunn highlights:

  1. Lasswell’s original discussion of policymaking functions (or functional requirements of policy analysis, not actual stages to observe), including: ‘intelligence’ (gathering knowledge), ‘promotion’ (persuasion and argumentation while defining problems), ‘prescription’, ‘invocation’ and ‘application’ (to use authority to make sure that policy is made and carried out), and ‘appraisal’ (2017: 42-3).
  2. The constant interaction between all notional ‘stages’ rather than a linear process: attention to a policy problem fluctuates, actors propose and adopt solutions continuously, actors are making policy (and feeding back on its success) as they implement, evaluation (of policy success) is not a single-shot document, and previous policies set the agenda for new policy (2017: 44-5).

In that context, it is no surprise that the impact of a single policy analyst is usually minimal (2017: 57). Sorry to break it to you. Hang in there, baby.

hang-in-there-baby

 

13 Comments

Filed under 750 word policy analysis, public policy

Understanding Public Policy 2nd edition

All going well, it will be out in November 2019. We are now at the proofing stage.

I have included below the summaries of the chapters (and each chapter should also have its own entry (or multiple entries) in the 1000 Words and 500 Words series).

2nd ed cover

titlechapter 1chapter 2chapter 3chapter 4.JPG

chapter 5

chapter 6chapter 7.JPG

chapter 8

chapter 9

chapter 10

chapter 11

chapter 12

chapter 13

 

2 Comments

Filed under 1000 words, 500 words, agenda setting, Evidence Based Policymaking (EBPM), Policy learning and transfer, public policy

Evidence-informed policymaking: context is everything

I thank James Georgalakis for inviting me to speak at the inaugural event of IDS’ new Evidence into Policy and Practice Series, and the audience for giving extra meaning to my story about the politics of ‘evidence-based based policymaking’. The talk (using powerpoint) and Q&A is here:

 

James invited me to respond to some of the challenges raised to my talk – in his summary of the event – so here it is.

I’m working on a ‘show, don’t tell’ approach, leaving some of the story open to interpretation. As a result, much of the meaning of this story – and, in particular, the focus on limiting participation – depends on the audience.

For example, consider the impact of the same story on audiences primarily focused on (a) scientific evidence and policy, or (b) participation and power.

Normally, when I talk about evidence and policy, my audience is mostly people with scientific or public health backgrounds asking why do policymakers ignore scientific evidence? I am usually invited to ruffle feathers, mostly by challenging a – remarkably prevalent – narrative that goes like this:

  • We know what the best evidence is, since we have produced it with the best research methods (the ‘hierarchy of evidence’ argument).
  • We have evidence on the nature of the problem and the most effective solutions (the ‘what works’ argument).
  • Policymakers seems to be ignoring our evidence or failing to act proportionately (the ‘evidence-policy barriers’ argument).
  • Or, they cherry-pick evidence to suit their agenda (the ‘policy based evidence’ argument).

In that context, I suggest that there are many claims to policy-relevant knowledge, policymakers have to ignore most information before making choices, and they are not in control of the policy process for which they are ostensibly in charge.

Limiting participation as a strategic aim

Then, I say to my audience that – if they are truly committed to maximising the use of scientific evidence in policy – they will need to consider how far they will go to get what they want. I use the metaphor of an ethical ladder in which each rung offers more influence in exchange for dirtier hands: tell stories and wait for opportunities, or demonise your opponents, limit participation, and humour politicians when they cherry-pick to reinforce emotional choices.

It’s ‘show don’t tell’ but I hope that the take-home point for most of the audience is that they shouldn’t focus so much on one aim – maximising the use of scientific evidence – to the detriment of other important aims, such as wider participation in politics beyond a reliance on a small number of experts. I say ‘keep your eyes on the prize’ but invite the audience to reflect on which prizes they should seek, and the trade-offs between them.

Limited participation – and ‘windows of opportunity’ – as an empirical finding

NASA launch

I did suggest that most policymaking happens away from the sphere of ‘exciting’ and ‘unruly’ politics. Put simply, people have to ignore almost every issue almost all of the time. Each time they focus their attention on one major issue, they must – by necessity – ignore almost all of the others.

For me, the political science story is largely about the pervasiveness of policy communities and policymaking out of the public spotlight.

The logic is as follows. Elected policymakers can only pay attention to a tiny proportion of their responsibilities. They delegate the rest to bureaucrats at lower levels of government. Bureaucrats lack specialist knowledge, and rely on other actors for information and advice. Those actors trade information for access. In many cases, they develop effective relationships based on trust and a shared understanding of the policy problem.

Trust often comes from a sense that everyone has proven to be reliable. For example, they follow norms or the ‘rules of the game’. One classic rule is to contain disputes within the policy community when actors don’t get what they want: if you complain in public, you draw external attention and internal disapproval; if not, you are more likely to get what you want next time.

For me, this is key context in which to describe common strategic concerns:

  • Should you wait for a ‘window of opportunity’ for policy change? Maybe. Or, maybe it will never come because policymaking is largely insulated from view and very few issues reach the top of the policy agenda.
  • Should you juggle insider and outsider strategies? Yes, some groups seem to do it well and it is possible for governments and groups to be in a major standoff in one field but close contact in another. However, each group must consider why they would do so, and the trade-offs between each strategy. For example, groups excluded from one venue may engage (perhaps successfully) in ‘venue shopping’ to get attention from another. Or, they become discredited within many venues if seen as too zealous and unwilling to compromise. Insider/outsider may seem like a false dichotomy to experienced and well-resourced groups, who engage continuously, and are able to experiment with many approaches and use trial-and-error learning. It is a more pressing choice for actors who may have only one chance to get it right and do not know what to expect.

Where is the power analysis in all of this?

image policy process round 2 25.10.18

I rarely use the word power directly, partly because – like ‘politics’ or ‘democracy’ – it is an ambiguous term with many interpretations (see Box 3.1). People often use it without agreeing its meaning and, if it means everything, maybe it means nothing.

However, you can find many aspects of power within our discussion. For example, insider and outsider strategies relate closely to Schattschneider’s classic discussion in which powerful groups try to ‘privatise’ issues and less powerful groups try to ‘socialise’ them. Agenda setting is about using resources to make sure issues do, or do not, reach the top of the policy agenda, and most do not.

These aspects of power sometimes play out in public, when:

  • Actors engage in politics to turn their beliefs into policy. They form coalitions with actors who share their beliefs, and often romanticise their own cause and demonise their opponents.
  • Actors mobilise their resources to encourage policymakers to prioritise some forms of knowledge or evidence over others (such as by valuing scientific evidence over experiential knowledge).
  • They compete to identify the issues most worthy of our attention, telling stories to frame or define policy problems in ways that generate demand for their evidence.

However, they are no less important when they play out routinely:

  • Governments have standard operating procedures – or institutions – to prioritise some forms of evidence and some issues routinely.
  • Many policy networks operate routinely with few active members.
  • Certain ideas, or ways of understanding the world and the nature of policy problems within it, becomes so dominant that they are unspoken and taken for granted as deeply held beliefs. Still, they constrain or facilitate the success of new ‘evidence based’ policy solutions.

In other words, the word ‘power’ is often hidden because the most profound forms of power often seem to be hidden.

In the context of our discussion, power comes from the ability to define some evidence as essential and other evidence as low quality or irrelevant, and therefore define some people as essential or irrelevant. It comes from defining some issues as exciting and worthy of our attention, or humdrum, specialist and only relevant to experts. It is about the subtle, unseen, and sometimes thoughtless ways in which we exercise power to harness people’s existing beliefs and dominate their attention as much as the transparent ways in which we mobilise resources to publicise issues. Therefore, to ‘maximise the use of evidence’ sounds like an innocuous collective endeavour, but it is a highly political and often hidden use of power.

See also:

I discussed these issues at a storytelling workshop organised by the OSF:

listening-new-york-1-11-16

See also:

Policy in 500 Words: Power and Knowledge

The politics of evidence-based policymaking

Palgrave Communications: The politics of evidence-based policymaking

Using evidence to influence policy: Oxfam’s experience

The UK government’s imaginative use of evidence to make policy

 

6 Comments

Filed under agenda setting, Evidence Based Policymaking (EBPM), Policy learning and transfer, Psychology Based Policy Studies, public policy, Storytelling

Teaching evidence based policy to fly: how to deal with the politics of policy learning and transfer

This post provides (a generous amount of) background for my ANZSOG talk Teaching evidence based policy to fly: transferring sound policies across the world.

The event’s description sums up key conclusions in the literature on policy learning and policy transfer:

  1. technology and ‘entrepreneurs’ help ideas spread internationally, and domestic policymakers can use them to be more informed about global policy innovation, but
  2. there can be major unintended consequences to importing ideas, such as the adoption of policy solutions with poorly-evidenced success, or a broader sense of failed transportation caused by factors such as a poor fit between the aims of the exporter/importer.

In this post, I connect these conclusions to broader themes in policy studies, which suggest that:

  1. policy learning and policy transfer are political processes, not ‘rational’ or technical searches for information
  2. the use of evidence to spread policy innovation requires two interconnected choices: what counts as good evidence, and what role central governments should play.
  3. the following ’11 question guide’ to evidence based policy transfer serves more as a way to reflect than a blueprint for action.

As usual, I suggest that we focus less on how we think we’d like to do it, and more on how people actually do it.

anzog auckland transfer ad

Policy transfer describes the use of evidence about policy in one political system to help develop policy in another. Taken at face value, it sounds like a great idea: why would a government try to reinvent the wheel when another government has shown how to do it?

Therefore, wouldn’t it be nice if I turned up to the lecture, equipped with a ‘blueprint’ for ‘evidence based’ policy transfer, and declared how to do it in a series of realistic and straightforward steps? Unfortunately, there are three main obstacles:

  1. ‘Evidence based’ is a highly misleading description of the use of information in policy.
  2. To transfer a policy blueprint completely, in this manner, would require all places and contexts to be the same, and for the policy process to be technocratic and apolitical.
  3. There are general academic guides on how to learn lessons from others systematically – such as Richard Rose’s ‘practical guide’  – but most academic work on learning and transfer does not suggest that policymakers follow this kind of advice.

Rose 10 lessons rotated

Instead, policy learning is a political process – involving the exercise of power to determine what and how to learn – and it is difficult to separate policy transfer from the wider use of evidence and ideas in policy processes.

Let’s take each of these points in turn, before reflecting on their implications for any X-step guide:

3 reasons why ‘evidence based’ does not describe policymaking

In a series of ANZSOG talks on ‘evidence based policymaking’ (EBPM), I describe three main factors, all of which are broadly relevant to transfer:

  1. There are many forms of policy-relevant evidence and few policymakers adhere to a strict ‘hierarchy’ of knowledge.

Therefore, it is unclear how one government can, or should, generate evidence of another government’s policy success.

  1. Policymakers must find ways to ignore most evidence – such as by combining ‘rational’ and ‘irrational’ cognitive shortcuts – to be able to act quickly.

The generation of policy transfer lessons is a highly political process in which actors adapt to this need to prioritise information while competing with each other. They exercise power to: prioritise some information and downplay the rest, define the nature of the policy problem, and evaluate the success of another government’s solutions. There is a strong possibility that policymakers will import policy solutions without knowing if, and why, they were successful.

  1. They do not control the policy process in which they engage.

We should not treat ‘policy transfer’ as separate from the policy process in which policymakers and influencers engage. Rather, the evidence of international experience competes with many other sources of ideas and evidence within a complex policymaking system.

The literature on ‘policy learning’ tells a similar story

Studies of the use of evaluation evidence (perhaps to answer the question: was this policy successful?) have long described policymakers using the research process for many different purposes, from short term problem-solving and long-term enlightenment, to putting off decisions or using evidence cynically to support an existing policy.

We should therefore reject the temptation to (a) equate ‘policy learning’ with a simplistic process that we might associate with teachers transmitting facts to children, or (b) assume that adults simply change their beliefs when faced with new evidence. Rather, Dunlop and Radaelli describe policy learning as a political process in the following ways:

1.It is collective and rule-bound

Individuals combine cognition and emotion to process information, in organisations with rules that influence their motive and ability to learn, and in wider systems, in which many actors cooperate and compete to establish the rules of evidence gathering and analysis, or policymaking environments that constrain or facilitate their action.

2.’Evidence based’ is one of several types of policy learning

  • Epistemic. Primarily by scientific experts transmitting knowledge to policymakers.
  • Reflection. Open dialogue to incorporate diverse forms of knowledge and encourage cooperation.
  • Bargaining. Actors learn how to cooperate and compete effectively.
  • Hierarchy. Actors with authority learn how to impose their aims; others learn the limits to their discretion.

3.The process can be ‘dysfunctional’: driven by groupthink, limited analysis, and learning how to dominate policymaking, not improve policy.

Their analysis can produce relevant take-home points such as:

  • Experts will be ineffective if they assume that policy learning is epistemic. The assumption will leave them ill-prepared to deal with bargaining.
  • There is more than one legitimate way to learn, such as via deliberative processes that incorporate more perspectives and forms of knowledge.

What does the literature on transfer tell us?

‘Policy transfer’ can describe a spectrum of activity:

  • driven voluntarily, by a desire to learn from the story of another government’s policy’s success. In such cases, importers use shortcuts to learning, such as by restricting their search to systems with which they have something in common (such as geography or ideology), learning via intermediaries such as ‘entrepreneurs’, or limiting their searches for evidence of success.
  • driven by various forms of pressure, including encouragement by central (or supranational) governments, international norms or agreements, ‘spillover’ effects causing one system to respond to innovation by another, or demands by businesses to minimise the cost of doing business.

In that context, some of the literature focuses on warning against unsuccessful policy transfer caused by factors such as:

  • Failing to generate or use enough evidence on what made the initial policy successful
  • Failing to adapt that policy to local circumstances
  • Failing to back policy change with sufficient resources

However, other studies highlight some major qualifications:

  • If the process is about using ideas about one system to inform another, our attention may shift from ‘transfer’ to ‘translation’ or ‘transformation’, and the idea of ‘successful transfer’ makes less sense
  • Transfer success is not the same as implementation success, which depends on a wider range of factors
  • Nor is it the same as ‘policy success’, which can be assessed by a mix of questions to reflect political reality: did it make the government more re-electable, was the process of change relatively manageable, and did it produce intended outcomes?

The use of evidence to spread policy innovation requires a combination of profound political and governance choices

When encouraging policy diffusion within a political system, choices about: (a) what counts as ‘good’ evidence of policy success have a major connection to (b) what counts as good governance.

For example, consider these ideal-types or models in table 1:

Table 1 3 ideal types of EBBP

In one scenario, we begin by relying primarily on RCT evidence (multiple international trials) and import a relatively fixed model, to ensure ‘fidelity’ to a proven intervention and allow us to measure its effect in a new context. This choice of good evidence limits the ability of subnational policymakers to adapt policy to local contexts.

In another scenario, we begin by relying primary on governance principles, such as to respect local discretion as well as incorporate practitioner and user experience as important knowledge claims. The choice of governance model relates closely to a less narrow sense of what counts as good evidence, but also a more limited ability to evaluate policy success scientifically.

In other words, the political choice to privilege some forms of evidence is difficult to separate from another political choice to privilege the role of one form of government.

Telling a policy transfer story: 11 questions to encourage successful evidence based policy transfer  

In that context, these steps to evidence-informed policy transfer serve more to encourage reflection than provide a blueprint for action. I accept that 11 is less catchy than 10.

  1. What problem did policymakers say they were trying to solve, and why?
  2. What solution(s) did they produce?
  3. Why?

Points 1-3 represent the classic and necessary questions from policy studies: (1) ‘what is policy?’ (2)  ‘how much did policy change?’ and (3) why? Until we have a good answer, we do not know how to draw comparable lessons. Learning from another government’s policy choices is no substitute for learning from more meaningful policy change.

4. Was the project introduced in a country or region which is sufficiently comparable? Comparability can relate to the size and type of country, the nature of the problem, the aims of the borrowing/ lending government and their measures of success.

5. Was it introduced nationwide, or in a region which is sufficiently representative of the national experience (it is not an outlier)?

6. How do we account for the role of scale, and the different cultures and expectations in each policy field?

Points 4-6 inform initial background discussions of case study reports. We need to focus on comparability when describing the context in which the original policy developed. It is not enough to state that two political systems are different. We need to identify the relevance and implications of the differences, from another government’s definition of the problem to the logistics of their task.

7. Has the project been evaluated independently, subject to peer review and/ or using measures deemed acceptable to the government?

8. Has the evaluation been of a sufficient period in proportion to the expected outcomes?

9. Are we confident that this project has been evaluated the most favourably – i.e. that our search for relevant lessons has been systematic, based on recognisable criteria (rather than reputations)?

10. Are we identifying ‘Good practice’ based on positive experience, ‘Promising approaches’ based on positive but unsystematic findings, ‘Research–based’ or based on ‘sound theory informed by a growing body of empirical research’, or ‘Evidence–based’, when ‘the programme or practice has been rigorously evaluated and has consistently been shown to work’?

Points 7-10 raise issues about the relationships between (a) what evidence we should use to evaluate success or potential, and (b) how long we should wait to declare success.

11. What will be the relationship between evidence and governance?

Should we identify the same basic model and transfer it uniformly, tell a qualitative story about the model and invite people to adapt it, or focus pragmatically on an eclectic range of evidential sources and focus on the training of the actors who will implement policy?

In conclusion

Information technology has allowed us to gather a huge amount of policy-relevant information across the globe. However, it has not solved the limitations we face in defining policy problems clearly, gathering evidence on policy solutions systematically, and generating international lessons that we can use to inform domestic policy processes.

This rise in available evidence is not a substitute for policy analysis and political choice. These choices range from how to adjudicate between competing policy preference, to how to define good evidence and good government. A lack of attention to these wider questions helps explain why – at least from some perspectives – policy transfer seems to fail.

Paul Cairney Auckland Policy Transfer 12.10.18

 

 

8 Comments

Filed under Evidence Based Policymaking (EBPM), Policy learning and transfer

What do we need to know about the politics of evidence-based policymaking?

Today, I’m helping to deliver a new course – Engaging Policymakers Training Programme – piloted by the Alliance for Useful Evidence and the UCL. Right now, it’s for UCL staff (and mostly early career researchers). My bit is about how we can better understand the policy process so that we can engage in it more effectively.  I have reproduced the brief guide below (for my two 2-hour sessions as part of a wider block). If anyone else is delivering something similar, please let me know. We could compare notes. 

This module will be delivered in two parts to combine theory and practice

Part 1: What do we need to know about the politics of evidence-based policymaking?

Policy theories provide a wealth of knowledge about the role of evidence in policymaking systems. They prompt us to understand and respond to two key dynamics:

  1. Policymaker psychology. Policymakers combine rational and irrational shortcuts to gather information and make good enough decisions quickly. To appeal to rational shortcuts and minimise cognitive load, we reduce uncertainty by providing syntheses of the available evidence. To appeal to irrational shortcuts and engage emotional interest, we reduce ambiguity by telling stories or framing problems in specific ways.
  2. Complex policymaking environments. These processes take place in the context of a policy environment out of the control of individual policymakers. Environments consist of: many actors in many levels and types of government; engaging with institutions and networks, each with their own informal and formal rules; responding to socioeconomic conditions and events; and, learning how to engage with dominant ideas or beliefs about the nature of the policy problem. In other words, there is no policy cycle or obvious stage in which to get involved.

In this seminar, we discuss how to respond effectively to these dynamics. We focus on unresolved issues:

  1. Effective engagement with policymakers requires storytelling skills, but do we possess them?
  2. It requires a combination of evidence and emotional appeals, but is it ethical to do more than describe the evidence?
  3. The absence of a policy cycle, and presence of an ever-shifting context, requires us to engage for the long term, to form alliances, learn the rules, and build up trust in the messenger. However, do we have and how should we invest the time?

The format will be relatively informal. Cairney will begin by making some introductory points (not a powerpoint driven lecture) and encourage participants to relate the three questions to their research and engagement experience.

Gateway to further reading:

  • Paul Cairney and Richard Kwiatkowski (2017) ‘How to communicate effectively with policymakers: combine insights from psychology and policy studies’, Palgrave Communications
  • Paul Cairney and Kathryn Oliver (2017) ‘Evidence-based policymaking is not like evidence-based medicine, so how far should you go to bridge the divide between evidence and policy?’ Health Research Policy and Systems (HARPS), DOI: 10.1186/s12961-017-0192-x
  • Paul Cairney, Kathryn Oliver, and Adam Wellstead (2016) ‘To Bridge the Divide between Evidence and Policy: Reduce Ambiguity as Much as Uncertainty’, Public Administration Review, Early View (forthcoming) DOI:10.1111/puar.12555 PDF

Part 2: How can we respond pragmatically and effectively to the politics of EBPM?

In this seminar, we move from abstract theory and general advice to concrete examples and specific strategies. Each participant should come prepared to speak about their research and present a theoretically informed policy analysis in 3 minutes (without the aid of powerpoint). Their analysis should address:

  1. What policy problem does my research highlight?
  2. What are the most technically and politically feasible solutions?
  3. How should I engage in the policy process to highlight these problems and solutions?

After each presentation, each participant should be prepared to ask questions about the problem raised and the strategy to engage. Finally, to encourage learning, we will reflect on the memorability and impact of presentations.

Powerpoint: Paul Cairney A4UE UCL 2017

1 Comment

Filed under Evidence Based Policymaking (EBPM), Psychology Based Policy Studies, public policy

Who are the most deserving and entitled to government benefits?

desrving-and-entitled-book-cover

Schneider and Ingram’s work on Social Construction and Policy Design identifies the populations deemed by policymakers to deserve the benefits or punishments of government policy.

The most concerted attempt to use this theoretical framework empirically is in Schneider and Ingram’s (2005b) edited book Deserving and Entitled, which focuses primarily on the social construction of particular target populations and its largely degenerative effect on US policy design (introduction here).

In this post, I summarise their insights in about 3000 words, splitting their five parts into seven main insights (that way, I can provide a far shorter summary in a journal article, and refer to this page for more discussion).

Insight 1: Policy designs that we take for granted now were built on social constructions of selective deservingness in the (often very distant) past, with key choices setting a precedent for policy design expansion.

Selective group entitlement to state benefits can be traced to the rules created in 1818, initially for very specific ‘veterans of the American Revolution’, providing benefits if they were: men who had travelled extensively to fight for at least nine months and were now ‘poor or unable to work’ (Jensen, 2005: 37). This excluded women, people who were otherwise poor, and veteran militia who fought locally. Officers were paid $20 per month but soldiers $8 (2005: 57). By 1832, pension entitlement extended to all who served for two years, and in 1836 it was expanded to their dependents if they died from war injuries. In 1871, Congress approved a non-means tested pension for those who served in the War of 1812 (and their widows) if they had demonstrated their patriotism by remaining ‘loyal to the United Stated during the Civil War’ and swearing an ‘oath to support the Constitution’, which excluded ‘aged southerners’ (2005: 58). Each expansion encouraged veteran participation: sending a signal about the entitlements that they would receive, or could campaign for if they didn’t.

Selective group exclusion from the ‘universal’ electoral franchise can be traced to a similar time, when many politicians equated popular participation with ‘mob rule’ and sought to limit inclusion. Schriner (2005: 66-7; 73; 76) identifies attempts to exclude ‘idiots’ and the ‘insane’ as the ‘antithesis of the democratic citizen’. For many politicians, they lacked the ‘intellectual competence necessary for political participation’ and/or were mistrusted by the politicians who equated incompetence with deviance, ‘moral degeneracy, dependency, and crime’ (2005: 76). These exclusions only came under serious challenge when social reformers had some success in shifting wider social constructions on mental capacity, highlighting the cruelty of asylums and challenging the link between intellectual incompetence and moral deviance (2005: 76).

Insight 2: Successful challenges to the social construction of target populations are possible but seem exceptional (and, can be at the expense of other minority groups).

Dialto (2005: 81) suggests that the image of Japanese-Americans shifted profoundly between 1941-61, from the hostility and fear of immigrant aliens underpinning WW2 relocation and interment (preceded by late 19th and early 20th century legal rulings which excluded naturalisation and the ability to buy land) to the tag of ‘model minority’ and good citizen. Strategies to change this image did not challenge discrimination directly: finding legal loopholes on land ownership through American-born children; internalising ‘their negative social construction’ and focusing on earning US citizenship (both before WW2); and, crucially, forming a Japanese-American US Army unit which earned war hero status (2005: 90-8). These efforts were reinforced by shifting contexts: internally, Japanese Americans were seen as less of an economic threat (internment left them ‘economically devastated’), and externally, Japan shifted from a threat to a common force against communism and new source of trade (2005: 98).

Court cases in the 1950s helped shift the rules of naturalisation and land ownership. Media coverage in the 1960s used positive portrayals of Japanese Americans, as working hard to overcome hardship, to contrast them with negative portrayals of others and ‘keep other minorities, such as blacks and Chicanos, in their place’ (2005: 99). The US President effectively apologised for internment in 1976, and Congress approved one-off compensation for internment survivors in 1988, and key federal court cases in the late 1980s challenged the War Department’s basis for discriminatory behaviour and convictions (2005: 100). Still, the ‘model minority’ tag has profound drawbacks, in which Japanese Americans perceive the need to live up to a stereotype to gain acceptance, while still facing social discrimination and violence (2005: 100). In other words, the shifting social construction of a social group does not necessarily indicate its growing power.

Insight 3: Advocates have used national policymaking institutions as a source of major change in policy design, but often with limited effects on delivery and/ or profound unintended consequences.

Although often contributing to degenerative policy design, Congress has proved a key organisation to challenging negative social constructions based on race. However, advocates of housing reform to reduce desegregation addressed major opposition (including public, congressional, and business) by assigning deserving/ undeserving status within racial minorities. The narrative underpinning legislative change on fair housing in 1968 was that only some black people deserved to benefit from policy: advocates told individual stories of the black middle class rejecting the life of the black rioter, who ‘deserved to escape the ghettos’, which helped create a race-based underclass (Sidney, 2005: 114-5). Further, this strategy secured very limited policy and social change, partly because few black people could afford the market price of homes in white areas (2005: 118). As predicted by Schneider and Ingram, the ‘benefits to weak groups’ are ‘undersubscribed and conferred at levels insufficient to change behaviour to an extent that it would remediate the problem’ (2005: 119). Policy changes in the late 70s and 80s were based on a ‘diluted’ message on race, focusing for example on the negative role of financial institutions, wider sources (such as class and age) of potential discrimination in housing, or on specific regions (not populations) that might benefit from community investment: the long term benefits of policy to reduce racial desegregation ‘remain fragile and open to dilution or contestation’ (2005: 137).

Congress also acted positively on immigration in 1965, making it ‘no longer acceptable’ for policies to ‘single out groups for exclusion on the base of race or national origin’. In 1986, it gave amnesty to illegal immigrants working in the US for five years, and punished employers not individuals for illegal immigration (Netwon, 2005: 139; 143). Yet, there remain fluctuations in social constructions of which target populations are willing and able to assimilate to achieve legitimate American citizenship, measured according to: legal citizenship, positive values regarding ‘hard work and self sufficiency’, and negative connotations of foreigners committing crimes, procreating excessively, claiming welfare and, during times of economic uncertainty, taking ‘scarce jobs from Americans’ (2005: 139-40; 142).

These negative constructions informed legislation from 1996 which increased southern border patrol staff, equipment, barriers, and detention facilities, made it easier to deport, raised the bar for employers to demonstrate continuously and adequately paid jobs, and reduced entitlement to social security, housing, and higher education subsidies to ‘remove the lure of public benefits’ for ‘problem’ immigrants (2005: 145-6; 151). In congressional debate, ways to define ‘unworthy’ immigrants related to arguments such as: they are freeloaders not paying taxes, but their children get access to free schools; if they break the law to get here, they’ll break the law while here; immigrants are causing a ‘lawless border’ that local law enforcement can’t control; and, an ineffective federal government is hindering border enforcement and blaming employers rather than the criminals (2005: 151-7). Further, rather than challenging such positions with positive counter narratives, opponents used a ‘cure worse than disease’ argument which pointed to the major unintended consequences of policy (for example, removing school entitlement will worsen crime) (2005: 163). Overall, congressional debates signal ‘who matters’ and which people (primarily Mexican) are the ‘wrong kinds of immigrants’ (2005: 166).

Insight 4: public and non-governmental bodies have some discretion to make policy when they deliver. The evidence is mixed on the extent to which those actors use that chance to reframe target populations more positively.

The social and welfare organisations funded to help target populations are often the bodies identifying many as undeserving. For example, Jurik and Cowgill (2005: 173) describe the difference between a potentially positive rationale and negative experience of ‘microenterprise development programs’. MDPs are often initially designed to reduce poverty by helping low-income people of colour with ‘business loans and training’, avoid the stigmatising and unintended consequences of ‘welfare schemes’, and providing programmes to encourage ‘women’s entrepreneurship’ and challenge male conceptions of business strategy and success (2005: 175). However, as philanthropic funding reduces and bodies become more reliant on government and other highly-conditional funding, MDP bodies feel they must demonstrate high performance and distinguish their work from ‘welfare programmes’, and staff become more risk averse to reduce financial losses (2005: 185). They make value judgements based on ‘white, middle-class, male centred standards of business’ to ‘evaluate client worthiness and attempt to resocialize them as well as shape access to further services’ (2005: 174). Worthiness is linked to likely success, and bodies engage in ‘creaming’ (focusing on the easiest, cheapest cases), use implicit moral assessments of character to identify a good attitude and reject ‘entitlement seekers’ and ‘dreamers’, with assessments often ‘class-laden, gendered, and racialized’ (2005: 177; 183). Consequently, people with the lowest incomes and levels of education are less likely to receive significant loans, and most likely to continue to be viewed as ‘helpless deviants … scorned by policymakers’ when they fail to “’lift’ themselves out of poverty” (2005: 196).

Camou (2005: 197-8) identifies a more positive story based on an unusual mix, in small ‘neighborhood organizations’ (non-profit, advocacy, and resident organizations), of constructing often-marginalised groups positively but to ‘resocialize them into an acceptable way of life’ containing the “‘correct’ ‘norms and values”. Most of the studied programs combine a focus on the ‘deficits’ of target populations (such as drug addiction, and low employability and education) and belief that they can’t ‘take control of their lives without interventions’ with the hope that they ‘can reject street values in favour of mainstream ones, including employment, nonviolence, family cohesion, delayed gratification, and respect for property’ (2005: 203). They combine direct interventions, such as programs to enhance employability, with indirect strategies based on some individuals leading by example and encouraging new rules (2005: 204-5). There is minimal emphasis on welfare and structural/ environmental factors such as housing supply, or on challenging a small number of deviants ruining the neighbourhood while helping the upwardly mobile or middle class population (2005: 206-13). Programs ‘tend not to “cream”’, particularly when staff live or recently lived in the same area: their focus is on challenging highly visible and vivid examples of ‘street values’ rather than encouraging the less visible and already positive behaviour (2005: 213-5). Camou (2005: 215) identifies a commitment to a form of ‘tough love’ that ‘would assume a different connotation if pursued by outsiders’; it might punish ‘deviants’ but it also ‘rewards the successful’ users of programs designed to help disadvantaged target populations.

Insight 5: only a small proportion of the many potentially demonised groups receive sustained negative policymaker attention, aided by the ‘moral entrepreneurs’, policy analysts, and ‘policy champions’ who translate specific social constructions into policy design.

Policymakers, the media, and public can only pay attention to a tiny proportion of the issues that could be described as policy problems. So, sustained public anxiety and political attention to a target population requires three conditions (Nicholson-Crotty and Meier, 2005: 224). First, a group is already perceived negatively by many, perhaps with the additional sense that their behaviour is ‘out of control’. Second, a ‘moral entrepreneur’ draws attention to the group successfully: the public, or powerful sections or institutions within it, perceive the entrepreneur as an expert on the social value and group’s deviance; and, those powerful actors perceive a threat that extends from the deviant group to ‘the rest of society’ (2005: 225-7). Moral entrepreneurs use ‘typification’, using the behaviour visible in certain individuals to represent behaviour of a larger group, to identify a ‘dangerous class’ that can be blamed for many more social problems than linked to initial behaviour (2005: 227). Third, there must be ‘sufficient political profit’ to entice a ‘policy champion’ to set the agenda and pursue policy change (2005: 227).

For example, moral entrepreneurs such as Jacob Riis turned broad and widespread suspicion of Chinese immigrants, in the mid to late 19th century, into a specific concern about the spillover effects of their opium smoking: opium addiction spreading to the white population, with the danger of Chinese men using ‘cruel cunning’ to encourage young female ‘promiscuity’ in ‘opium dens’ (2005: 230). Policy champions, such as State Department Secretary Root, proposed legislation to prohibit the import of opium for smoking, thus restricting its effect largely to the Chinese population without prompting opposition from, for example, doctors using opiates for therapeutic purposes (2005: 233).

By the 1980s, a rapid increase in public fear of crime became linked closely to racially-charged fears of social change (2005: 235). Moral entrepreneurs such as James Q Wilson encouraged then used such concerns to generate support for a major shift in policy rationale, from a focus on the structural causes of crime (such as poverty), to a focus on individual responsibility or out of control gangs. Policy champions such as President Reagan and Representative Dan Lundgren pursued legislation (the Comprehensive Crime Act 1984) on the back of ‘organised crime’, ‘the drug racketeers who are poisoning our young people’, and testimony of victims (2005: 239). The effect of such policies is to identify approximately five million people as members of a ‘dangerous class’ (2005: 242).

Insight 6: well-intentioned but problematic social constructions produce unintended consequences if policy designs fail to address major socio-economic inequalities.

Bensonsmith (2005: 244-5) describes the ‘War on Poverty’ programs fostered by President Johnson from 1965, describing key actors such as Daniel Moynihan – author of The Negro Family (‘Moynihan Report’) – as moral entrepreneur and policy champion. Moynihan was part of a ‘new breed of public servants’ with social scientific training and seeking to define as well as solve policy problems (2005: 246). His report identified lower poverty in white and higher in black populations, arguing that the main cause was the ‘disintegration of the African-American family’, in which racism undermined the role of black men as breadwinners, contributing to family breakdown and deviant behaviour (2005: 246). Bensonsmith (2005: 247) argues that the report contributes to black stereotypes that endured from times of slavery, including the ‘shiftless black male’ and the ‘overly fertile and lazy welfare mother’, and that such stereotypes contributed to the idea that welfare dependency helped cause ‘pathological behavior’: ‘broken homes’ have a ‘matriarchal structure’ (aided by female social workers) with no ‘strong father figure’, and a key solution for black men is the ‘masculine world’ of military service (2005: 251). This social construction informed key welfare policies in two main steps. First, black mothers were often initially excluded from social security measures designed for the widows and their dependent children: the state would take on the male role if he died, not if he chose to leave. Second, as entitlement became defined more widely, it became more closely associated with the often-incorrect idea that a disproportionate number of black families received welfare benefits. The association between welfare and race, along with a greater focus on individual responsibility for a culture of dependency, helps cause victim blaming and program retrenchment (2005: 255-6).

Schram (2005: 261) provides an often-different interpretation, arguing that the failure to recognise major ‘racial disparities in the US economy’ helps ‘whitewash’ them rather than asking the ‘hard questions’ in the pursuit of ‘racial justice’. Going too far, to argue that welfare is used more by white than black families – as argued by the Welfare Law Centre’s Welfare Myths in 1996 – can be misleading (from 1985, only the absolute figures on first time use, but not more regular use, and not proportionate calculations, support its position). It is also counterproductive because ‘racial minorities’ were ‘more likely to be living in poverty and in need of public assistance at higher rates’ (2005: 267-70). Similarly, it is tempting for advocacy groups to generate support for welfare rights by associating them with white, middle class and recently divorced mothers as ‘job ready’ and in transition from welfare to work, but problematic because it helps produce insufficient public support for other groups (2005: 281). Programs become ‘bifurcated’, with the predominantly-white male ‘breadwinner’ able to benefit from social insurance based on their previous employment, and others reliant on less generous ‘public assistance’ (2005: 282).

Insight 7: social constructions of (a) deservedness and entitlement create ‘positive identities and participation’ in politics, (b) unworthiness create ‘alienation, resignation, and failure to participate politically’ (Ingram and Schneider, 2005c: 289).

Soss (2005: 291) examines the signals that a bifurcated US social welfare system sends to specific target populations, and how they feel and respond. He examines the idea that US welfare programs have become influenced by ‘new paternalism’, focusing on the ways in which programs are designed ostensibly to encourage good citizenship. In paternalist regimes, they may be associated with ‘civility, self-restraint, and compliance with social expectations’, reflecting the pursuit of ‘social order over social justice and civic compliance over political engagement’ (2005: 292). Different programs also provide profoundly different signals about citizenship, and the signal that a person gets from one key public organization affects their views of government as a whole (2005: 309).

The ‘superior tier’ consists of depersonalised federal ‘social security’ programs, primarily for the ‘elderly or disabled’, pegged to inflation and previous earnings, and producing a positive signal to ‘rights bearing’ recipients (2005: 294-5). The rules are stringent but recipients are encouraged and rewarded, to ‘come away feeling that their claims are welcome’ (2005: 297). Recipients often receive the financial security that allows them to participate in public life as much as the general population, a signal from government that their participation efforts would have a tangible effect, and do not generate feelings of stigma that undermine collective action (2005: 308).

The ‘lower tier’ consists of less generous public assistance ‘that disproportionately serve disadvantaged groups such as people of color, women, and people who have lived in poverty’ (2005: 295). They send negative signals, with recipients attached to state or local case workers and following convoluted and dispiriting rules to establish limited entitlement. Recipients become ‘clients’, vulnerable to bureaucratic rules, entitled to very little privacy (following invasive questions, fingerprinting, and/ or drug testing in some cases), made to attend in person despite limited access to transport, and subject to ‘unpleasant procedures’ in unwelcoming offices (‘authoritarian’ in design and appearance). Many are left vulnerable, with the feeling that ‘they are not valued and their claims unwanted’ and some ‘feeling exposed and humiliated’, powerless, or ‘like cattle’ (2005: 296-9). Recipients are living in poverty and/or fleeing abusive relationships, with minimal choice but to accept these rules without complaint, left with the felling that their feedback would not alter government staff behaviour, and feeling the stigma and lack of self-worth that undermines collective action (2005: 306-7; 310).

Yet, these perceptions are not inevitable. Rather, the key example of Head Start, in which parents participate in collective decisions about the running of local services for their children, ‘provide citizens with evidence that participation can be effective and fulfilling’ (2005: 305), and expose other programs for the minimal extent to which they encourage civic engagement (2005: 321).

If you want to read part two, here it is: scpd-more-empirical-insights-section-31-12-16

3 Comments

Filed under agenda setting, public policy, Storytelling

Social Construction and Policy Design

This is an updated and expanded discussion of Policy Concepts in 1000 Words: the Social Construction of Target Populations . It’s the theoretical summary for a paper I’m writing with Jonathan Pierce on the future for this approach. See also a separate post on empirical applications.

Policymakers articulate value judgements which underpin fundamental choices about which social groups should be treated positively or negatively by government bodies. When addressing highly politicised issues, they seek to reward ‘good’ groups with government support and punish ‘bad’ groups with sanctions (Schneider et al, 2014). This judgement is often described as ‘moral reasoning’ (Haidt, 2001) or ‘fast thinking’ (Kahneman, 2012: 20). Policymakers make quick, biased, emotional judgements, then back up their actions with selective facts to pursue their understanding of a policy problem and its solution:

Likes and dislikes are not the result of individual or collective reason and deliberation but mainly the product of emotion and heuristics … judgments begin with emotional reactions … and reason is used mainly to justify initial emotion responses (Schneider et al, 2014, drawing on Kahneman, 2012 and Haidt, 2001; 2012).

Yet, social constructions can also be based on conscious bias. Policies reflect the goal-driven use of constructions, ‘strategically manipulated for political gain … to create political opportunities and avoid political risks’ or, at least, an anxiety by politicians ‘not to be caught in opposition to prevailing values’ if it affects their performance in election (Schneider and Ingram, 1997: 6; 192). They aim to receive support from the populations they describe as ‘deserving’, as well as a wider public satisfied with describing others as ‘undeserving’ (1997: 6).

These judgements can have an enduring ‘feed-forward’ effect (Ingram et al, 2007: 112). Choices based on values are reproduced in ‘policy designs’, as the ‘content or substance of public policy’:

Policy designs are observable phenomena found in statutes, administrative guidelines, court decrees, programs, and even the practices and procedures of street level bureaucrats … [they] contain specific observable elements such as target populations (the recipients of policy benefits or burdens), goals or problems to be solved (the values to be distributed), rules (that guide or constrain action), rationales (that explain or legitimate the policy), and assumptions (logical connections that tie the other elements together) (Schneider and Ingram, 1997: 2).

Examples of feed-forward effects include policy designs: signaling that ‘elderly citizens are worthy of respect and deserving of the funds they receive’, prompting ‘a level of political participation rivaled by no other group’; introducing convoluted rules to diminish participation in areas such as housing entitlement; signaling to welfare recipients that they have themselves to blame and deserve minimal support; and, restricting voting rights directly (Schneider and Sidney, 2009: 110-11)

Policy designs based on moral choices often become routine and questioned rarely in government because they are ‘automatic rather than thought through’. Emotional assignments of ‘deservingness’ act as important ‘decision heuristics’ because this process is ‘easy to use and recall and hard to change’ (Schneider et al, 2014). They are difficult to overcome, because a sequence of previous policies, based on a particular framing of target populations, helps produce ‘hegemony’: the public, media and/ or policymakers take this set of values for granted, as normal or natural, and rarely question them when engaging in politics (Pierce et al, 2014; see also Gramsci, 1971; Bachrach and Baratz, 1970; Lukes, 2005).

This signal of limited deservingness impacts on citizens and groups, who participate more or less according to how they are characterised by government (Schneider and Ingram, 1993: 334). Only some groups have the resources to mobilise and challenge or reinforce the way they are perceived by policymakers (Schneider and Ingram, 1997: 21-4; 2005: 444; Pierce et al, 2014), or to mobilise to persuade the public, media and/ or government that there is a reason to make policy on their behalf. Some groups can be categorized differently over time, but this seems to be a non-routine outcome, at least in the absence of long term change in social attitudes, even though social constructions are – in theory – ‘inherently unstable’ (Ingram and Schneider, 2005: 10). For example, it can follow a major external event such as an economic crisis or game-changing election, exploited by ‘entrepreneurs’ to change the way that policymakers view particular groups (Ingram and Schneider, 2005: 10-11). Or, it can be prompted by policy design which, for example, is modified to suit powerful populations with spillover effects for the powerless (such as when drug treatment develops as an alternative to incarceration) (Schneider and Ingram, 2005: 639).

Ingram et al (2007: 102) depict this dynamic with a table in which there are two spectrums – one describes the positive or negative ways in which groups are portrayed by policymakers, the other describes the resources available to groups to challenge or reinforce that image – producing four categories of target population: advantaged, contenders, dependents, and deviants. The powerful and positively constructed are ‘advantaged’; the powerful and negatively constructed are ‘contenders’; the powerless and positively constructed are ‘dependents’; the powerless and negatively constructed are ‘deviants’ (Ingram et al, 2007: 102)

Schneider and Ingram (1997: 3) argue that, although the (US) political system may ‘meet some standard of fairness or openness’, the policies they produce may not be ‘conducive to democracy’. US public policies have failed to solve major problems – including inequality, poverty, crime, racism, sexism, and effective universal healthcare and education – and such policy failure contributes to the sense that the political process serves special interests at the expense of the general public (1997: 4-7). Policy designs ‘are strongly implicated in the current crisis of democracy’ because they have failed and they discourage many target populations (the ‘undeserving’, ‘deviant’, or ‘demons’) from public participation: ‘These designs send messages, teach lessons, and allocate values that exacerbate injustice, trivialize citizenship, fail to solve problems, and undermine institutional cultures that might be more supportive of democratic designs’ (1997: 5-6; 192).

Of course, although there is the unpredictable potential for issues to be politicised, many are not. Yet, low salience can exacerbate these problems of citizen exclusion. Policies dominated by bureaucratic interests often alienate citizens receiving services (1997: 79). Or, experts dominate policies (and many government agencies) when there is high scientific agreement and wider acceptance that the ‘public interest’ is served largely through the production and use of evidence. The process does not include ordinary citizens routinely. Rather, ‘experts with scientific credentials aid and abet the disappearance of the public sphere’, and this is a problem when issues ‘with important social value implications’ transform into ‘a matter of elite scientific and professional concern’ (such as when official calculations of economic activity override personal experiences) (1997: 153; 167).

Overall, they describe a political system with major potential to diminish democracy, with politicians faced with the choice of politicising issues to reward or punish populations or depoliticise issues with reference to science and objectivity, and policy designs uninformed by routine citizen participation. They describe an increasingly individualistic US system with declining rates of collective political participation (at least in elections), a tendency for actors to seek benefits for their own populations, and often ‘degenerative’ policy which produces major inequalities along sex, race, and ethnicity lines (Ingram and Schneider, 2005: 22-6).

Although SCPD began as a study of US politics, many of its concepts and insights are ‘universal’. In other words, they identify ‘policymaking issues that can arise in any time or place’ (Cairney and Jones, 2016: 38):

  1. The psychology of social construction: people make quick and emotional judgements about the populations of which they are a part, and other populations.
  2. Policymakers seek to exploit the ‘national mood’, or other indicators of social preferences, for political reward.
  3. These judgements inform policy design.
  4. Policy designs help send signals to citizens which can diminish their incentive to engage in politics.
  5. Low salience issues are often dominated by bureaucratic politics and scientific language, at a similar expense to citizen participation.

The time and place-specific nature of SCPD refers to specific social attitudes, the social construction of specific target populations (from a large list of potential constructions), and specific policy designs associated with each government.

7 Comments

Filed under 1000 words, public policy