Below is the draft introduction to a paper that I am writing for a Special Issue paper on Teaching Policy Analysis for Gestión y Análisis de Políticas Públicas (GAPP) (here is the version with the references if you want to sing along).
When we teach policy analysis, we can focus on how to be a policy analyst or how to situate the act of policy analysis within a much wider policymaking context. Ideally, we would teach and learn about both. Indeed, this aim is central to Lasswell’s vision for the policy sciences, in which the analysis of policy (and policymaking) informs analysis for policy, and both are essential to the pursuit of equality and dignity.
There is the potential to achieve this vision for the policy sciences. Policy analysis texts focus on the individual and professional skills required to act efficiently and effectively in a time-pressured political environment. Further, they are supported by the study of policy analysts to reflect on how analysis takes place, and policy is made, in the real world.
The next step would be to harness the wealth of policy concept- and theory-informed studies to help understand how real world contexts inform policy analysis insights. First, for example, almost all mainstream studies assume or demonstrate that there is no such thing as a policy cycle with clearly-defined and well-ordered stages of policymaking, from defining problems and generating solutions to evaluating their effect. If so, how can policy analysts understand their far more complex policymaking environment, and what skills and strategies do they need to develop to engage effectively? Indeed, these discussions may be essential to preventing the demoralisation of analysts: if they do not learn in advance about the processes and factors than can minimise their influence, how can they generate realistic expectations? Second, if the wider aim is human equality and dignity, insights from critical policy analysis are essential. They help analysts think about what those concepts mean, how to identify and support marginalised populations, and how policy analysis skills and techniques relate to those aims. In particular, they warn against treating policy analysis as a technocratic profession devoid of politics, which may contribute to exclusive research gathering practices, producing too-narrow definitions of problems, insufficient consideration of feasible solutions, and recommendations made about target populations without engaging with the people they claim to serve.
However, this aim is much easier described than achieved. Policy analysis texts, focusing on how to do it, often use insights from policy studies. However, they do so without fully explaining key concepts and theories or exploring their implications. There is simply not enough time and space to do justice to every element, from the technical tools of policy analysis (including cost-benefit analysis) to the empirical findings from policy theories and normative insights from critical policy analysis approaches (e.g. Weimer and Vining, 2017 is already 500 pages long). Policy process research, focusing on what actually happens, may have practical implications for analysts. However, they are often hidden behind layers of concepts and jargon, and – with notable exceptions – their authors seem uninterested in describing the normative importance of, or practical lessons from, theory-informed empirical studies. Further, the cumulative size of this research is overwhelming and beyond the full understanding of experienced specialist scholars. Indeed, it is even difficult to recommend a small number of texts to sum up each approach, which makes it difficult to predict how much time and energy it would take to understand this field, and therefore to demonstrate the payoff from that investment. Further, critical policy analysis is essential, but often ignored in policy analysis texts, and the potential for meaningful conversations with mainstream policy scholars remains largely untapped or resisted .
In that context, policy analysis students embody the problem of ‘bounded rationality’ described famously by Simon. Indeed, Simon’s phrase ‘to satisfice’ sums up a goal-oriented response to bounded rationality: faced with the inability to identify, process, or understand all relevant information, they must seek ways to gather enough information to inform ‘good enough’ choices. Further, since then, policy studies have sought to incorporate insights from individual human, social, and organisational psychology to understand (1) the other cognitive shortcuts that humans use, including gut-level instinct, habit, familiarity with an issue, deeply-held beliefs, and emotions, and (2) their organisations equivalents (since organisations also use rules and standard operating procedures to close off information searches and limit analysis). Human cognitive shortcuts can be described negatively as cognitive biases or more positively as ‘fast and frugal heuristics’. However, the basic point remains: if people draw on allegedly ‘rational’ and ‘irrational’ shortcuts to information, we need to find ways to adapt to their ways of thinking, rather than holding onto an idealised version of humans (and policymaking organisations) that do not exist in the real world .
While these insights focus generally on policymakers, they are also essential to engaging with students. Gone – I hope – are the days of lecturers giving students an overwhelmingly huge reading list and expecting them to devour every source before each class, which may help some students but demoralise many others (especially since it seems inevitable that most students’ first engagement with specialist texts and technical jargon will already induce fears about their own ignorance). In their place should be a thoughtful exploration of how much students can actually learn about the wider policy analysis context, focusing on (1) the knowledge and skills they already possess, (2) the time they have to learn, and (3) how new knowledge or skills would relate to their ambitions. If students are seeking fast and frugal heuristics to learn about policy analysis, how should we help them, and what should we teach?
To help answer such questions, first I describe the rationale for the blog that I developed in tandem with teaching public policy, initially at an undergraduate level as part of a wider politics programme, before developing a Master of Public Policy and contributing to shorter executive courses or one-off workshops. This range matters, since the answer to the question ‘what can students learn?’ will vary according to their existing knowledge and time. Second, I describe some examples of the valuable intersection between policy analysis, policy process research, and critical policy analysis to demonstrate the potential payoffs to wider insights. Third, I summarise the rationale for the coursework that I use to foster public policy knowledge and policy analysis skills, including skills in critical thinking and reflection to accompany more specialist analytical skills.
This post is a shortened version of The Politics of Policy Analysis Annex A. It shows how to use insights from policy process research in policy analysis and policymaking coursework (much like the crossover between Scooby-Doo and Batman). It describes a range of exercises, including short presentations, policy analysis papers, blog posts, and essays. In each case, it explains the rationale for each exercise and the payoff to combining them.
If you prefer me to describe these insights less effectively, there is also a podcast:
One step to combining policy analysis and policy process research is to modify the former according to the insights of the latter. In other words, consider how a ‘new policy sciences’ inspired policy analysis differs from the analyses already provided by 5-step guides.
It could turn out that the effects of our new insights on a policy briefing could be so subtle that you might blink and miss them. Or, there are so many possibilities from which to choose that it is impossible to provide a blueprint for new policy science advice. Therefore, I encourage students to be creative in their policy analysis and reflective in their assessment of their analysis. Our aim is to think about the skills you need to analyse policy, from producing or synthesising evidence, to crafting an argument based on knowing your audience, and considering how your strategy might shift in line with a shifting context.
To encourgage creativity, I set a range of tasks so that students can express themselves in different ways, to different audiences, with different constraints. For example, we can learn how to be punchy and concise from a 3-minute presentation or 500-word blog, and use that skill to get to the point more quickly in policy analysis or clarify the research question in the essay.
The overall effect should be that students can take what they have learned from each exercise and use it for the others.
In each section below, I reproduce the ways in which I describe this mix of coursework to students then, in each box, note the underlying rationale.
1. A 3-minute spoken presentation to your peers in a seminar.
In 3 minutes, you need to identify a problem, describe one or more possible solutions, and end your presentation in a convincing way. For example, if you don’t make a firm recommendation, what can you say to avoid looking like you are copping out? Focus on being persuasive, to capture your audience’s imagination. Focus on the policy context, in which you want to present a problem as solvable (who will pay attention to an intractable problem?) but not make inflated claims about how one action can solve a major problem. Focus on providing a memorable take home message.
The presentation can be as creative as you wish, but it should not rely on powerpoint in the room. Imagine that none of the screens work or that you are making your pitch to a policymaker as you walk along the street: can you make this presentation engaging and memorable without any reference to someone else’s technology? Can you do it without just reading out your notes? Can you do it well in under 3 minutes? We will then devote 5 minutes to questions from the audience about your presentation. Being an active part of the audience – and providing peer review – is as important as doing a good presentation of your own.
BOX A1: Rationale for 3-minute presentation.
If students perform this task first (before the coursework is due), it gives them an initial opportunity to see how to present only the most relevant information, and to gauge how an audience responds to their ideas. Audience questions provide further peer-driven feedback. I also plan a long seminar to allow each student (in a group of 15-20 people) to present, then ask all students about which presentation they remember and why. This exercise helps students see that they are competing with each other for limited policymaker attention, and learn from their peers about what makes an effective pitch. Maybe you are wondering why I discourage powerpoint. It’s largely because it will cause each presenter to go way over time by cramming in too much information, and this problem outweighs the benefit of being able to present an impressive visualisation. I prefer to encourage students to only tell the audience what they will remember (by only presenting what they remember).
2. A policy analysis paper, and 3. A reflection on your analysis
Provide a policy analysis paper which has to make a substantive argument or recommendation in approximately two pages (1000 words), on the assumption that busy policymakers won’t read much else before deciding whether or not to pay attention to the problem and your solutions. Then provide a reflection paper (also approximately 1000 words) to reflect your theoretical understanding of the policy process. You can choose how to split the 2000 word length, between analysis and reflection. You can give each exercise 1000 each (roughly a 2-page analysis), provide a shorter analysis and more reflection, or widen the analysis and reject the need for conceptual reflection. The choice is yours to make, as long as you justify your choice in your reflection.
When writing policy analysis, I ask you to keep it super-short on the assumption that you have to make your case quickly to people with 99 other things to do. For example, what can you tell someone in one paragraph or a half-page to get them to read all 2 pages? It is tempting to try to tell someone everything you know, because everything is connected and to simplify is to describe a problem simplistically. Instead, be smart enough to know that such self-indulgence won’t impress your audience. In person, they might smile politely, but their eyes are looking at the elevator lights. In writing, they can skim your analysis or simply move on. So, use these three statements to help you focus less on your need to supply information and more on their demand:
Your aim is not to give a full account of a problem. It is to get powerful people to care about it.
Your aim is not to give a painstaking account of all possible solutions. It is to give a sense that at least one solution is feasible and worth pursuing.
Your guiding statement should be: policymakers will only pay attention to your problem if they think they can solve it, and without that solution being too costly.
Otherwise, I don’t like to give you too much advice because I want you to be creative about your presentation; to be confident enough to take chances and feel that you’ll see the reward of making a leap. At the very least, you have three key choices to make about how far you’ll go to make a point:
Who is your audience? Our discussion of the limits to centralised policymaking suggest that your most influential audience will not necessarily be an elected policymaker, but who else would it be?
How ‘manipulative’ should you be? Our discussions of ‘bounded rationality’ and ‘evidence-based policymaking’ suggest that policymakers combine ‘rational’ and ‘irrational’ shortcuts to gather information and make choices. So, do you appeal to their desire to set goals and gather a lot of scientific information, make an emotional appeal, or rely on Riker-style heresthetics?
What is your role? Contemporary discussions of science advice to government highlight unresolved debates about the role of unelected advisors: should you simply lay out some possible solutions or advocate one solution strongly?
For our purposes, there are no wrong answers to these questions. Instead, I want you to make and defend your decisions. That is the aim of your policy paper ‘reflection’: to ‘show your work’. You still have some room to be creative in your reflection: tell me what you know about policy theory and how it informed your decisions. Here are some examples, but it is up to you to decide what to highlight:
Show how your understanding of policymaker psychology helped you decide how to present information on problems and solutions.
Extract insights from policy theories, such as from punctuated equilibrium theory on policymaker attention, multiple streams analysis on timing and feasibility, or the NPF on how to tell persuasive stories.
Explore the implications of the lack of ‘comprehensive rationality’ and absence of a ‘policy cycle’: feasibility is partly about identifying the extent to which a solution is ‘doable’ when central governments have limited powers. What ‘policy style’ or policy instruments would be appropriate for the solution you favour?
I use the following questions to guide the marking on the policy paper: Tailored properly to a clearly defined audience? Punchy and concise summary? Clearly defined problem? Good evidence or argument behind the solution? Clear recommendations backed by a sense that the solution is feasible? Evidence of substantial reading, accompanied by well explained further reading?
In my experience of marking, successful students gave a very clear and detailed account of the nature and size of the policy problem. The best reports used graphics and/ or statistics to describe the problem in several ways. Some identified a multi-faceted problem – such as in health outcomes, and health inequalities – without presenting confusing analysis. Some were able to present an image of urgency, to separate this problem from the many others that might grab policymaker attention. Successful students presented one or more solutions which seemed technically and/ or politically feasible. By technically feasible, I mean that there is a good chance that the policy will work as intended if implemented. For example, they provided evidence of its success in a comparable country (or in the past) or outlined models designed to predict the effects of specific policy instruments. By politically feasible, I mean that you consider how open your audience would be to the solution, and how likely the suggestion is to be acceptable to key policymakers. Some students added to a good discussion of feasibility by comparing the pros/ cons of different scenarios. In contrast, some relatively weak reports proposed solutions which were vague, untested, and/ or not likely to be acted upon.
BOX A2: Rationale for policy analysis and reflection
Students already have 5-step policy analysis texts at their disposal, and they give some solid advice about the task. However, I want to encourage students to think more about how their knowledge of the policy process will guide their analysis. First, what do you do if you think that one audience will buy your argument, and another reject it wholeheartedly? Just pretend to be an objective analyst and put the real world in the ‘too hard’ pile? Or, do you recognise that policy analysts are political actors and make your choices accordingly? For me, an appeal to objectivity combined with insufficient recognition of the ways in which people respond emotionally to information, is a total cop-out. I don’t want to contribute to a generation of policy analysts who provide long, rigorous, and meticulous reports that few people read and fewer people use. Instead, I want students to show me how to tell a convincing story with a clear moral, or frame policy analysis to grab their audience’s attention and generate enthusiasm to try to solve a problem. Then, I want them to reflect on how they draw the line between righteous persuasion and unethical manipulation.
Second, how do you account for policymaking complexity? You can’t assume that there is a cycle in which a policymaker selects a solution and it sets in train a series of stages towards successful implementation. Instead, you need to think about the delivery of your policy as much as the substance. Students have several choices. In some cases, they will describe how to deliver policy in a multi-level or multi-centric environment, in which, say, a central government actor will need to use persuasion or cooperation rather than command-and-control. Or, if they are feeling energetic, they might compare a top-down delivery option with support for Ostrom-style polycentric arrangements. Maybe they’ll recommend pilots and/ or trial and error, to monitor progress continuously instead of describing a one-shot solution. Maybe they’ll reflect on multiple streams analysis and think about how you can give dependable advice in a policy process containing some serendipity. Who knows? Policy process research is large and heterogeneous, which opens the possibility for some creative solutions that I won’t be able to anticipate in advance.
4. One kind of blog post (for the policy analysis)
Write a short and punchy blog post which recognises the need to make an argument succinctly and grab attention with the title and first sentence/ paragraph, on the assumption that your audience will be reading it on their phone and will move on to something else quickly. In this exercise, your blog post is connected to your policy analysis. Think, for example, about how you would make the same case for a policy solution to a wider ‘lay’ audience. Or, use the blog post to gauge the extent to which your client could sell your policy solution. If they would struggle, should you make this recommendation in the first place?
Your blog post audience is wider than your policy analysis audience. You are trying to make an argument that will capture the attention of a larger group of people who are interested in politics and policy, but without being specialists. They will likely access your post from Twitter/ Facebook or via a search engine. This constraint produces a new requirement, to: present a punchy title which sums up the whole argument in under 280 characters (a statement is often better than a vague question); to summarise the whole argument in approximately 100 words in the first paragraph (what is the problem and solution?); then, to provide more information up to a maximum of 500 words. The reader can then be invited to read the whole policy analysis.
The style of blog posts varies markedly, so you should consult many examples before attempting your own (for example, compare the LSE with The Conversation and newspaper blogs to get a sense of variations in style). When you read other posts, take note of their strengths and weaknesses. For example, many posts associated with newspapers introduce a personal or case study element to ground the discussion in an emotional appeal. Sometimes this works, but sometimes it causes the reader to scroll down quickly to find the main argument. Perhaps ironically, I recommend storytelling but I often skim past people’s stories. Many academic posts are too long (well beyond your 500 limit), take too long to get to the point, and do not make explicit recommendations, so you should not emulate them. You should aim to be better than the scholars whose longer work you read. You should not just chop down your policy analysis to 500 words; you need a new kind of communication.
Hopefully, by the end of this fourth task, you will appreciate the transferable life skills. I have generated some uncertainty about your task to reflect the sense among many actors that they don’t really know how to make a persuasive case and who to make it to. We can follow some basic Bardach-style guidance, but a lot of this kind of work relies on trial-and-error. I maintain a short word count to encourage you to get to the point, and I bang on about ‘stories’ in modules to encourage you to present a short and persuasive story to policymakers.
This process seems weird at first, but isn’t it also intuitive? For example, next time you’re in my seminar, measure how long it takes you to get bored and look forward to the weekend. Then imagine that policymakers have the same attention span as you. That’s how long you have to make your case! Policymakers are not magical beings with an infinite attention span. In fact, they are busier and under more pressure than us, so you need to make your pitch count.
BOX A3: Rationale for blog post 1
This exercise forces students to make their case in 500 words. It helps them understand the need to communicate in different ways to different audiences. It suggests that successful communication is largely about knowing how your audience consumes information, rather than telling people all you know. I gauge success according to questions such as: Punchy and eye grabbing title? Tailored to an intelligent ‘lay’ audience rather than a specific expert group? Clearly defined problem? Good evidence or argument behind the solution? Clear recommendations backed by a sense that the solution is feasible? Well embedded weblinks to further relevant reading?
5. Writing a theory-informed essay
I tend to set this simple-looking question for coursework in policy modules: what is policy, how much has it changed, and why? Students get to choose the policy issue, timeframe, political system, and relevant explanatory concepts.
On the face of it, it looks very straightforward. Give it a few more seconds, and you can see the difficulties:
We spend a lot of time in class agreeing that it seems almost impossible to define policy
There are many possible measures of policy change
There is an almost unmanageable number of models, concepts, and theories to use to explain policy dynamics.
I try to encourage some creativity when solving this problem, but also advise students to keep their discussion as simple and jargon-free as possible (often by stretching an analogy with competitive diving, in which a well-executed simple essay can score higher than a belly-flopped hard essay).
Choosing a format: the initial advice
Choose a policy area (such as health) or issue (such as alcohol policy).
Describe the nature of policy, and the extent of policy change, in a particular time period (such as in a particular era, after an event or constitutional change, or after a change in government).
Select one or more policy concepts or theory to help structure your discussion and help explain how and why policy has changed.
For example, a question might be: What is tobacco policy in the UK, how much has it changed since the 1980s, and why? I use this example because I try to answer that question myself, even though some of my work is too theory-packed to be a good model for a student essay (Cairney, 2007 is essentially a bad model for students).
Choosing a format: the cautionary advice
You may be surprised about how difficult it is to answer a simple question like ‘what is policy?’ and I will give you a lot of credit for considering how to define and measure it; by identifying, for example, the use of legislation/ regulation, funding, staff, and information sharing, and/ or by considering the difference between, say, policy as a statement of intent or a long term outcome. In turn, a good description and explanation of policy change is difficult. If you are feeling ambitious, you can go further, to compare, say, two issues (such as tobacco and alcohol) or places (such UK Government policy and the policy of another country), but sometimes a simple and narrow discussion can be more effective. Similarly, you can use many theories or concepts to aid explanation, but one theory may do. Note that (a) your description of your research question, and your essay structure, is more important than (b) your decision on what topic or concepts to use.
BOX A4: Rationale for the essay
The wider aim is to encourage students to think about the relationship between differentperspectives on policy theory and analysis. For example, in a blog and policy analysis paper they try to generate attention to a policy problem and advocate a solution. Then, they draw on policy theories and concepts to reflect on their papers, highlighting (say): the need to identify the most important audience; the importance of framing issues with a mixture of evidence and emotional appeals; and, the need to present ‘feasible’ solutions.
The reflection can provide a useful segue to the essay, since we’re already identifying important policy problems, advocating change, reflecting on how best to encourage it – such as by presenting modest objectives – and then, in the essay, trying to explain (say) why governments have not taken that advice in the past. Their interest in the policy issue can prompt interest in researching the issue further; their knowledge of the issue and the policy process can help them develop politically-aware policy analysis. All going well, it produces a virtuous circle.
BOX A5: Rationale for blog post 2
I get students to do the analysis/reflection/blog combination in the first module, and an essay/ blog combo in the second module. The second blog post has a different aim. Students use the 500 words to present a jargon-free analysis of policy change. The post represents a useful exercise in theory translation. Without it, students tend to describe a large amount of jargon because I am the audience and I understand it. By explaining the same thing to a lay audience, they are obliged to explain key developments in a plain language. This requirement should also help them present a clearer essay, because people (academics and students) often use jargon to cover the fact that they don’t really know what they are saying.
These posts introduce you to key concepts in the study of public policy. They are all designed to turn a complex policymaking world into something simple enough to understand. Some of them focus on small parts of the system. Others present ambitious ways to explain the system as a whole. The wide range of concepts should give you a sense of a variety of studies out there, but my aim is to show you that these studies have common themes.
Paul Cairney: Politics & Public Policy 