The language of complexity does not mix well with the language of Westminster-style accountability

A common argument in British politics is that the UK Government has exacerbated its own ‘governance problem’. A collection of post-war reforms, many of which were perhaps designed to reinforce central control, has produced a fragmented public landscape and a periodic sense that no one is in control. This outcome presents major problems for the ‘Westminster’ narrative of central government and ministerial accountability to the public via Parliament. If ministers are not in control of their departments, how can we hold them to account in a meaningful way?

Yet, in many cases, it is misleading to link these outcomes to specific decisions or points in time, since many aspects of the ‘governance problem’ are universal: policymakers can only pay attention to a small fraction of the issues for which they are responsible; they do not have enough information to make decisions without major uncertainty; policy problems are too multi-faceted and ‘cross-cutting’ to allow policymaking without ambiguity; there is an inescapable logic to delegating decisions to ‘policy communities’ which may not talk to each other or account meaningfully to government; and, delivery bodies will always have discretion in the way they manage competing government demands.

In this context, policymaking systems can be described usefully as complex systems, in which behaviour is always difficult to predict, and outcomes often seem to emerge in the absence of central control. Further, the literature on complexity provides some advice about how governments should operate within complex systems. Unfortunately, much of this literature invites policymakers to give up on the idea that they can control policy processes and outcomes. While this may be a pragmatic response, it does not deal well with the need for elected policymakers to account for their actions in a very particular way. What seems sensible to one audience may be indefensible to another. In particular, the language of complexity does not mix well with the language of Westminster-style accountability.

What we need is a response that sets out a governmental acknowledgement of the limits to its powers, combined with the sense that we can still hold elected policymakers to account in a meaningful way. Ideally, this response should be systematic enough to allow us to predict when ministers will take responsibility for their actions, redirect attention to other accountable public bodies, and/ or identify the limited way in which they can be held responsible for certain outcomes. Beyond this ideal, we may settle for a government strategy based on explicit trade-offs between pragmatism, in which governments acknowledge the effect of administrative devolution (or, in the case of local authorities, political devolution), and meaningful representation, in which they maintain some degree of responsibility for decisions made in their name.

The aim of this post’s further reading (updated 10.5.2022) is to draw lessons largely from the Scottish experience, which demonstrates an attempt to mix strategic responsibility with an element of flexibility and delegation. While we should not exaggerate the coherence of government strategies, we can meaningfully describe a ‘Scottish policy style’, identified in empirical studies, and a ‘Scottish approach’ as a self-styled description of policymaking by the Scottish Government. Further, the Scottish context is comparable enough to the UK to offer lessons. Although much of the rhetoric of ‘new Scottish politics’ suggests that it is markedly different from ‘old Westminster’, it has inherited a Westminster-style focus on government accountability to the public via Parliament (and an assumption that ‘the government governs’). Although Scotland is smaller, and the Scottish Government is able to design a governance style based on greater personal contact with interest groups and public bodies, this only serves to reinforce the importance of ‘universal’ problems when the problems that arise in Scotland resemble those faced in the UK. Overall, Scottish policymaking demonstrates that many problems related to ‘governance’ cannot be solved. Rather, the Scottish experience prompts us to identify important trade-offs between the delegation of administrative functions and the maintenance of central accountability.

To explain these issues, several papers:

1. Summarize how UK or Scottish governments have allegedly exacerbated governance problems
2. Separate this focus on specific outcomes from the universal constraints on central control common to all complex policymaking systems
3. Contrasts the practical advice that arises from a focus on complexity theory with the political imperative, in Westminster systems, to present policy outcomes as the responsibility of ministers.
4. Identify the balance struck between accountability and delegation by the Scottish Government since 2007, and the transferable lessons to other systems.

The relevant publications include:

1. Paul Cairney (2015) ‘How Can Policy Theory Have an Impact on Policy Making?’ Teaching Public Administration, 33, 1, 22-39 PDF
2. Paul Cairney (2015) ‘What is complex government and what can we do about it?’ Public Money and Management, 35, 1, 3-6 PDF
3. Paul Cairney (2015) ‘Scotland’s Future Political System’, Political Quarterly, 86, 2, 217-25 PDF
4. Paul Cairney (2016) ‘The future of Scottish government and public policy: a distinctive Scottish style?’ in (ed) McTavish, D. Politics in Scotland (London: Routledge) PDF
5. Paul Cairney, Siabhainn Russell and Emily St Denny (2016) “The ‘Scottish approach’ to policy and policymaking: what issues are territorial and what are universal?” Policy and Politics, 44, 3, 333-50 PDF
6. Paul Cairney (2017) “Evidence-based best practice is more political than it looks: a case study of the ‘Scottish Approach’”, Evidence and Policy, 13, 3, 499-515 PDF
7. Paul Cairney and Kathryn Oliver (2017) ‘Evidence-based policymaking is not like evidence-based medicine, so how far should you go to bridge the divide between evidence and policy?’ Health Research Policy and Systems (HARPS), DOI: 10.1186/s12961-017-0192-x PDF AM
8. Paul Cairney, Malcolm Harvey and Emily St Denny (2017) ‘Constitutional Change, Social Investment and Prevention Policy in Scotland’ in (ed.) Keating, M. A Wealthier, Fairer Scotland (Edinburgh: Edinburgh University Press)  PDF
9. Paul Cairney and Emily St Denny (2020) Why Isn’t Government Policy More Preventive? (Oxford University Press) Preview Introduction Preview Conclusion (Google Books) Blogs
10. Paul Cairney (2020) “The ‘Scottish Approach’ to Policymaking’ in (ed) Michael Keating The Oxford Handbook of Scottish Politics (Oxford: Oxford University Press), 463-80 Preprint
11. Paul Cairney, Emily St Denny, and Sean Kippin (2021) ‘Policy learning to reduce inequalities: the search for a coherent Scottish gender mainstreaming policy in a multi-level UK’, Territory, Politics and Governance, 9, 3, 412-33 https://doi.org/10.1080/21622671.2020.1837661 PDF
12. Paul Cairney, Emily St Denny, and Sean Kippin (2021) ‘Policy learning to reduce inequalities: the search for a coherent Scottish gender mainstreaming policy in a multi-level UK’, Territory, Politics and Governance, 9, 3, 412-33 https://doi.org/10.1080/21622671.2020.1837661 PDF
13. Paul Cairney (2021) ‘The contested relationship between governance and evidence’ in (eds) Christopher Ansell and Jacob Torfing Handbook on Theories of Governance (Cheltenham: Edward Elgar) PDF
14. Paul Cairney (2021) ‘Would Scotland’s political structures and policy-making change with independence?’ in (eds) Eve Hepburn, Michael Keating and Nicola McEwen Scotland’s New Choice: Independence after Brexit (Edinburgh: Centre on Constitutional Change and The Hunter Foundation) PDF whole book

Some of the wider issues are discussed here:

Policy Concepts in 1000 Words: the Westminster Model and Multi-level Governance

Policy Concepts in 1000 Words: Complex Systems

What is ‘Complex Government’ and what can we do about it?

Sharing professional and academic knowledge: The role of academic-practitioner workshops (on turning policy and complexity theories into something consistent with Westminster politics)

Life goes on after the Scottish independence referendum (3000 words and a lecture)

The Scottish political system and policy process share the same ‘complex government’ features as any country (LSE 1200 words)

You can also find these themes in a half-written book called Politics and Policymaking in the UK.