Spain Part 3 - Democracy in a Generation
A connection through “Systems that outlast us”: Trace institutions and inherited rules that continue to shape the present.
Why the modern British state cannot build, deliver, or stay still. A mechanical autopsy of four interlocking design flaws — Treasury optic, municipal hollowing, discretionary planning, and generalist churn — and the three structural reforms that follow from the arithmetic.
On a wet Tuesday in November 2023, the Department for Transport confirmed that the northern leg of High Speed 2 — the section that gave the project its strategic purpose — would not be built. The cost of the truncated southern stub, originally estimated at £32.7bn for the entire London-to-Manchester route, had passed £67bn for less than half of it. Some of the most expensive miles ran underneath the Chilterns, in a 16km tunnel that existed because the planning system, asked to weigh a hedge against a high-speed railway, had repeatedly chosen the hedge.
The cost overrun was not a failure of engineering. It was the wiring diagram doing exactly what it was designed to do.
The modern British state presents a single, awkward paradox. Measured by the share of public expenditure controlled from the centre, the share of tax revenue retained locally, and the degree of executive dominance over the legislature, the United Kingdom is the most centralised major democracy in the developed world. Measured by capital project delivery, public-service stability, regional productivity, or the speed at which a hospital, a tramline or a reservoir can move from proposal to completion, it ranks at or near the bottom of its peer group.
The standard reading attributes this to politics — the wrong party, the wrong chancellor, the wrong decade. In Failed State (2024), Sam Freedman argues for a different diagnosis. The British state is not failing because of who runs it. It is failing because of how it is wired. He distils the design fault into three pressures.
Overloaded. The centre has progressively absorbed responsibilities that used to sit with local government, school governors, regional health authorities and water boards, and is now expected to micro-manage them from Whitehall. Overpowered. A first-past-the-post system, an unwhipped second chamber, and a tradition of broad ministerial prerogative have eroded the parliamentary scrutiny that used to catch legislative errors before they became operational ones. Overdrive. A 24-hour media cycle and a personalised social-media environment reward ministers who announce, and punish ministers who deliver.
This report does not argue Freedman's diagnosis. It assumes it, and then audits the four pieces of state architecture that produce it: HM Treasury, local government, the planning system, and the civil service career structure. Each is survivable in isolation. Together they form a feedback loop in which no single actor can be reasonably blamed and no single act of Parliament can fix the result.
The British state is not under-resourced. It is mis-wired. The same circuit that concentrates power at the centre also prevents the centre from using it.
HM Treasury is unusual among finance ministries in the OECD. It is simultaneously the finance ministry (managing the public balance sheet), the economics ministry (forecasting and macro policy), and the spending ministry of last resort (signing off every other department's budget envelope). In Germany the equivalent functions are split across the Bundesministerium der Finanzen and the Bundesministerium für Wirtschaft. In France, the Direction Générale du Trésor sits inside Bercy alongside a separate Commissariat for industrial strategy. In the United States, the Treasury, the OMB, the Council of Economic Advisers and the Commerce Department divide the labour. In London, the labour is not divided.
Concentration of mandate produces concentration of optic. The institutional memory of the building is not neutral. It is dominated by two episodes that defined the careers of every senior official now in post or recently retired: the 1976 IMF programme, in which the Bank of England burned roughly £2.8bn of reserves before signing the largest standby in the Fund's history; and Black Wednesday, 16 September 1992, in which the cost of defending sterling inside the ERM was approximately £3.4bn in a single afternoon. Both events were resolved by financial markets imposing discipline on a politically unpopular outcome. Both lessons reinforced the same operational instinct: in any contested call between long-term ambition and short-term fiscal containment, contain.
This is "Treasury Orthodoxy" in its modern form. It is not, in the main, ideological. It is institutional. The combined mandate means that every long-horizon capital commitment is scored, in the same building, against the cost it imposes on the gilt curve over the next 18 months. The optic always wins.
The Treasury's strength is its scepticism. Its weakness, if I may put it that way, is that the scepticism does not stop at bad ideas. It also extends to good ones that are simply slow to mature.
— Nicholas Macpherson, Permanent Secretary to the Treasury 2005–2016, evidence to the Treasury Select Committee, 2015
The operational expression of Treasury Orthodoxy is the Green Book — the official guidance on appraising and evaluating public spending. Its analytical machinery is, in principle, neutral: every department uses the same methodology, every project is converted into a single net present value, and the Cabinet can in theory compare a reservoir, a railway, and a digital identity scheme on the same metric.
The methodology is anchored by two parameters. The first is the social discount rate, set at 3.5% per annum for the first thirty years of a project and 3.0% thereafter. The present value of a future cash flow X in year t is X / (1 + r)t. The exponent matters. Apply 3.5% to a £1m public benefit accruing fifty years from today, and it is worth £183,120 in present-value terms. Apply the lower 1.5% rate that the Green Book reserves for health-related benefits — to avoid systematically undervaluing future lives — and the same benefit is worth £475,005. The choice of discount rate is doing more than half the arithmetic.
| Year | PV of £1m (r = 3.5%) | PV of £1m (r = 1.5%) | % retained at 3.5% | % retained at 1.5% |
|---|---|---|---|---|
| 0 (today) | £1,000,000 | £1,000,000 | 100.0% | 100.0% |
| 10 | £708,918 | £861,667 | 70.9% | 86.2% |
| 30 | £356,278 | £639,762 | 35.6% | 64.0% |
| 50 | £183,120 | £475,005 | 18.3% | 47.5% |
| 100 | £37,013 | £225,607 | 3.7% | 22.6% |
Sources: HM Treasury, The Green Book: Central Government Guidance on Appraisal and Evaluation (2022 edition; 2026 update). Discounting calculations applied to a single notional £1m benefit at the standard and health discount rates.
The second parameter is the Benefit-Cost Ratio. The Green Book asks departments to monetise the principal benefits of a project — typically travel time savings, land value uplifts, productivity effects — and divide by the capital and operating costs. The BCR is then the headline number a minister sees. The mathematical content of that number is, however, almost entirely a function of two prior choices: the discount rate above, and the unit prices used to monetise the benefits. Travel time savings are valued at local wage rates. Land uplifts are valued at prevailing local land prices. Both are systematically higher in London and the South East than in Sunderland or the Welsh valleys.
The result is mechanical, not malicious. A tram extension in Greater Manchester is appraised against the wages and land values of Greater Manchester. A Crossrail extension in central London is appraised against the wages and land values of central London. Even before any political weighting, the second project will always show a higher monetised return per pound of capital. The Treasury's methodology, applied honestly by competent officials, will systematically recommend reinvesting in the region that is already richest.
The 2020 and 2026 Green Book reviews acknowledged the problem and introduced "Place-Based Business Cases" and "strategic programme" appraisals intended to widen the lens. The underlying machinery — exponential discounting against market-anchored unit prices — has not changed. It cannot, without unwinding the analytical foundation of the document.
The same Treasury optic that devalues long-horizon benefits also caps the capital departmental expenditure limit (CDEL) in each spending round. The cap is necessary; it is the mechanism by which the Treasury keeps the public balance sheet on a glide path. It is also operationally rigid. A school roof that fails in March cannot wait for the comprehensive spending review that opens in October.
The historical workaround was the Private Finance Initiative. By signing a 25-to-30-year service contract with a private consortium that built and then "rented" the asset back, departments moved the capital cost off the public ledger and into an annual unitary charge funded from resource budgets. By 2008, the capital value of signed PFI contracts had reached £68bn, with estimated future non-discretionary payments of around £215bn. The 2011 National Audit Office review (HC 920) concluded the available data did not demonstrate value for money.
The contemporary equivalents — public-private partnerships, regulated asset base (RAB) financing for nuclear, contingent liability structures sitting outside the headline borrowing measures — are not identical. The mechanic is. Faced with a hard short-term cap and a soft long-term liability, the rational departmental response is always the same: pay the higher long-run cost in exchange for the lower short-run number on the Treasury's spreadsheet. The cap is doing the work. The cost is doing the consequences.
English local government, measured by the share of total public revenue raised locally, is the most fiscally hollowed-out tier of any major democracy. Council tax is capped centrally. Business rates, since 1990, have been pooled and redistributed by Whitehall. The Revenue Support Grant has been progressively withdrawn. Local authorities now raise roughly 5% of total tax revenue in England, against 25–40% in Germany, the United States, or the Nordic states. Almost everything else is a transfer.
The transfer mechanism is itself part of the problem. In place of stable, formula-based block grants, the Treasury operates a system of fragmented, ring-fenced, competitive bidding pots. A 2022 audit by the Institute for Government identified 53 distinct funding schemes administered across 10 separate central departments, each with bespoke eligibility criteria, bespoke reporting requirements, and bespoke timescales rarely longer than three years. A single English council spends a non-trivial share of its administrative capacity not on running services, but on writing applications for the right to attempt to run services.
| Attribute | Centralised English model | Devolved peer states (DE, NL, US, Nordics) |
|---|---|---|
| Share of tax revenue raised locally | ~5% | 25–40% |
| Primary funding mechanism | Short-term competitive bids for ring-fenced pots | Formula-based block grants plus local tax-raising powers |
| Local fiscal discretion | Very low; central caps on council tax and rates | High; municipalities set property, income or sales surcharges |
| Whitehall / federal workload | High — micro-management of operational delivery | Low — strategic coordination and macro policy |
| Capital project lead times | Long; bid-driven and politically contingent | Shorter; predictable multi-year capital envelopes |
| Execution risk | Externalised to private outsourcers; liability stays public | Mostly delivered in-house by municipal or regional bodies |
Sources: Institute for Government, A Whitehall full of holes (2022); OECD Fiscal Decentralisation Database; Eurostat regional government finance accounts.
Three consequences follow, each of them mechanical.
First, the bidding system functions as an administrative lottery. Councils cannot plan multi-year capital programmes against funding they will not know they have received until the relevant minister announces it. Coherent regional industrial strategy is structurally impossible.
Second, capacity has been hollowed out. A council that does not know whether it will run a service in three years' time does not retain in-house engineers, social workers, or procurement specialists. The capability is sold off, contracted out, and very rarely rebuilt. When the contract underperforms — Carillion, Capita's PIP assessments, several regional probation contracts — there is no in-house team left to take the work back.
Third, every local failure escalates to a national minister. A regional bus collapse in West Yorkshire, a children's home failure in Doncaster, a tower-block fire in Kensington — all are routed upward through the media to Whitehall, where they consume the attention of officials whose statutory role does not include operating bus networks, children's homes, or fire safety inspections.
Freedman argues that outsourcing public services to private providers requires three conditions to hold simultaneously. There must be real competition, with several viable suppliers. There must be measurable outcomes that can be specified in a contract and audited from outside. And there must be a genuine transfer of risk, such that an underperforming provider bears the financial and operational consequences. Where all three hold — refuse collection, simple custodial services, parts of the prison estate — outsourcing has produced credible savings. Where any one of them fails, outsourcing converts public failure into private rent extraction.
Children's residential care is the textbook case in which all three fail at once. Local authorities, having dismantled their in-house provision over two decades, have no fallback capacity. Private equity has consolidated the market: three-quarters of children's homes in England are now owned by for-profit providers, of which the largest groups are owned by leveraged private equity vehicles. Outcomes are not contractually measurable in any meaningful sense — placement stability, educational attainment, mental health trajectories are visible only over years. And risk does not transfer: when a placement fails, the child returns to the local authority, not to the provider.
The arithmetic at the placement level is brutal. The most recent Competition and Markets Authority study (March 2022) found average weekly fees of £4,800 per child for residential placements, with leading private equity-owned providers charging £6,000 and above. Provider operating margins averaged 23% — well above the levels generally observed in genuinely competitive markets, where 5–10% would be normal.
The geography compounds the problem. To minimise property costs, private operators concentrate facilities in the cheapest areas of England — coastal towns such as Blackpool and inland post-industrial areas such as Burnley. Local authorities in the South East then routinely place vulnerable children hundreds of miles from their families, schools, and support networks, because no closer provision exists at any price. The cost is paid by the local authority budget. The dislocation is paid by the child. The dividend is paid to the equity holder.
The Town and Country Planning Act 1947 did something that, sixty years later, no peer democracy has replicated. It nationalised the development value of land. The right to build, historically attached to freehold ownership, was severed from the land and vested in the state. The 100% development charge through which the post-war Labour government intended to capture the resulting uplift was repealed by the Conservatives in 1953. The nationalisation of the right to build was not.
This is the constitutional anomaly at the centre of the British planning system. In a rules-based zoning regime — operative across most of continental Europe, all of North America, and most of East Asia — a local authority publishes a binding spatial plan that designates permitted uses, building heights, and densities for each parcel of land. A development that complies with the published code is, as of right, permitted. The burden of proof to block it lies with the planning authority. Disputes are technocratic, not political.
In England, the equivalent local plan is indicative. It is a planning consideration, not a rule. Every proposal, no matter how closely it aligns with the published plan, is reviewed individually by a politically constituted committee, against an open list of "material considerations" that the courts have declined to exhaustively define. The burden of proof to obtain permission lies with the developer. Disputes are political, frequently litigated, and structurally uncertain.
| UK discretionary planning (TCPA 1947) | Rules-based zoning (EU, North America, East Asia) | |
|---|---|---|
| Legal right to build | Nationalised; no automatic right exists | Presumed; landowners may build if code-compliant |
| Status of the local development plan | Indicative; a 'material consideration' | Binding; legally enforceable bylaw |
| Burden of proof | Developer must justify the proposal | Authority must justify refusal |
| Primary decision-maker | Politically constituted planning committee | Technocratic compliance check against the zoning code |
| Predictability | Low — subject to political pressure, NIMBY opposition, judicial review | High — compliant proposals receive permission as of right |
| Typical consent timeline (major scheme) | 2–5 years, frequently longer | 6–18 months |
Sources: Town and Country Planning Act 1947 and successor legislation; comparative analysis in Cheshire & Hilber (LSE Spatial Economics Research Centre) and OECD Land-Use Planning Systems in the OECD (2017).
Three downstream effects follow from the discretionary regime. Housing supply is structurally disconnected from housing demand — the United Kingdom has built fewer net additional homes per capita than almost any peer over four decades. Investor uncertainty is priced in: developers carry the cost of detailed proposals through years of consultation, judicial review, and political negotiation with no guarantee of consent, and that cost is recovered in higher sale prices or simply by not building. And national infrastructure projects must purchase, individually, thousands of consents along their route, each of which can be opposed on grounds that the courts will not let the project foreclose in advance.
The popular reading of NIMBYism — "Not In My Back Yard" — frames it as a cultural defect of comfortable homeowners. The fiscal reading is more useful. In a system where local authorities retain only a small share of the tax revenue generated by additional development, but bear all the visible costs of the resulting traffic, school places, GP appointments and physical change, opposing development is the rational position of a competent local representative acting in the financial interests of their council.
The arithmetic is straightforward. A council that approves 5,000 new homes captures very little of the resulting council tax expansion (capped), business rates (largely pooled), or income tax (entirely national). It is responsible, however, for the new primary school, the additional library service, the highways resurfacing, the GP catchment pressure, and the political cost of the protest meeting in the parish hall. The "insiders" who already own property — and who vote at substantially higher rates than incoming residents who do not yet exist — have a powerful incentive to lobby against, and councillors have a rational incentive to listen.
HS2 was the limiting case. Routed under and around dozens of constituencies that captured no growth benefit and most of the disturbance, the project was forced to buy political consent in the form of engineering. The 16km Chiltern tunnel, the green-roofed cuttings through the Buckinghamshire greenbelt, the relocated viaducts, the bespoke noise barriers — none were demanded by the engineering. All were demanded by the consent process. Independent benchmarking by Greengauge 21 and others put the construction cost per kilometre at multiples of comparable European high-speed lines (France's LGV Sud Europe Atlantique came in at roughly €25m per kilometre; HS2 Phase 1 estimates ran above £200m per kilometre on the most expensive sections).
NIMBYism is not irrational. It is the only rational response available to a council whose fiscal upside has been confiscated and whose political downside has been left in place.
The Northcote-Trevelyan Report of 1854 — the founding document of the modern British civil service — explicitly designed an administrative cadre of intelligent generalists, selected by competitive examination, who could be deployed across departments as required. The model worked, at scale, for the imperial state of the late nineteenth century, where administration meant the application of broad legal and procedural judgement to a small number of well-understood functions. It does not work for the technical, capital-intensive, software-dependent state of the twenty-first.
The structural problem is not the principle of broad recruitment. It is the operational consequence of restricting horizontal pay progression. Within any single department, a senior civil servant can rarely secure a promotion or a substantive pay rise by staying in role and getting better at the substance. The only viable mechanism is to apply, every two years or so, for a vacant post in a different department. The pay system actively rewards departmental hopping. It penalises domain mastery.
The compound effect is the systematic destruction of institutional memory. A rail procurement specialist who has spent five years learning how rolling-stock leases interact with track-access charges and Network Rail's enhancement plan is, the moment that knowledge starts to compound, the prime candidate for a director-grade vacancy at the Department for Education or the Home Office. The portfolio they leave behind passes to a generalist who learns the basics for nine months and then begins the same upward rotation.
The vacuum that opens at the technical layer is filled, predictably, by external consultancies. The Big Four and McKinsey have built large UK public-sector practices precisely because the British state lacks the domain depth to brief its own contractors. The cost of this dependency runs into hundreds of millions of pounds a year on consulting fees alone, before any consideration of the second-order cost — that the consultancies are rotated as fast as the officials, and the institutional learning vests, when it vests at all, in firms that are paid by the day to forget on schedule.
The British civil service is not short of intelligent people. It is short of intelligent people who have been allowed to stay long enough in one place for their intelligence to compound. The rotation is not a feature of British government. It is its defining failure.
— Sam Freedman, Failed State: Why Nothing Works and How We Fix It, 2024
Read in isolation, none of these four design faults would be fatal. A Treasury orthodoxy too cautious on capital can be corrected by an industrial strategy. A hollowed-out local government can be re-funded. A discretionary planning regime can be reformed. A churning civil service can be professionalised. The reason the British state is stuck is that the four faults interact, and the interactions reinforce one another.
The Treasury's short optic encourages off-balance-sheet financing, which requires sophisticated commercial counterparties. The hollowed-out civil service cannot supply the technical expertise to negotiate with those counterparties, so it hires consultants. The consultants do not know the local geography, so they design schemes that fail at the planning stage. The planning failures fall on local authorities that lack both the fiscal upside to absorb them and the political incentive to approve them. The resulting national press cycle returns to Whitehall, where the Treasury concludes that the original capital allocation was poorly spent and tightens the next departmental envelope. The loop closes. The next project starts from a more constrained position than the last.
The British state is, in this reading, not a malfunctioning machine. It is a functioning machine producing the output its design selects for: announcements rather than buildings, contracts rather than capabilities, and a permanent state of administrative firefighting that absorbs the cognitive capacity that would otherwise be available to design something better.
Three structural reforms follow from the audit. None is partisan. Each addresses one of the load-bearing failures in the wiring diagram, and each, in isolation, would relieve pressure on the others.
1. Devolve fiscal autonomy to Mayoral Combined Authorities. Extend MCAs across the whole of England and grant them genuine tax-raising powers — at minimum, full retention of business rates and a meaningful share of property tax revenue. Abolish the fragmented Whitehall bidding pots in their current form and replace them with stable, formula-based multi-year block grants. Give MCAs the first right of refusal on service delivery and procurement, so that the in-house capacity destroyed over four decades can be rebuilt at the regional, rather than central, tier.
2. Transition from discretionary planning to a rules-based zoning system. Convert local development plans from indicative documents into binding spatial codes. Replace open-ended "material considerations" with codified "material designations" — height, density, use class, design parameters — that, if met, guarantee permission as of right. The political element of planning moves upstream into the design of the code, where it belongs, and out of the case-by-case consenting of individual proposals, where it does not.
3. Reconstruct the civil service into domain-specific professional careers. End the dependence of pay progression on horizontal rotation. Establish parallel professional tracks — digital and data, major project procurement, scientific delivery, regulatory economics — in which seniority and reward are tied to depth of expertise and the long-term success of delivered programmes, not the next vacancy in another building. Pay the senior technical specialists what the consultancies pay them, and recover the consulting spend in-house within a parliament.
The reforms are not glamorous. They are plumbing. The cost of not doing them is paid every time a hospital cannot open, a railway cannot finish, or a child cannot be placed.
None of the four design faults audited here is the result of a single act of policy. Each accumulated over decades, under governments of both colours, in response to immediate political incentives that were individually rational. The Treasury's caution was bought on the back of two genuine sterling crises. Local government was hollowed out partly to suppress political opposition, but also because the centre genuinely believed it could deliver more efficiently. Discretionary planning was the price of a post-war settlement that wanted both private housebuilding and public control of land. The generalist civil service was, for a long time, a real comparative advantage of the British state.
That history matters because it tells us what the reforms are not. They are not a moral judgement on any of the politicians or officials who built the present system. They are an audit of a machine that has outlived the conditions it was designed for. The arithmetic of the wiring diagram is not contested. The question is whether the political class that benefits most from the existing concentration of power can be persuaded to disperse it — and, if so, on whose timetable.
The cost of not asking the question is now showing up on the balance sheet. The cost of asking it, and answering it honestly, is the next thirty years.
The diagnostic spine of this report draws on Sam Freedman's Failed State: Why Nothing Works and How We Fix It (Macmillan, 2024). Green Book discount-rate calculations are derived directly from HM Treasury's 2022 Green Book and the 2026 update. Children's residential care figures are taken from the Competition and Markets Authority's Children's social care market study (final report, March 2022) and subsequent Ofsted market reports. The 53-pots-across-10-departments figure is from the Institute for Government's A Whitehall full of holes (2022). PFI capital and future-payment figures are from the National Audit Office's Lessons from PFI and other projects (HC 920, April 2011). Civil service turnover and ministerial tenure series are taken from the Institute for Government's Whitehall Monitor annual editions, 2020–2024. HS2 cost-per-kilometre comparisons draw on Greengauge 21 benchmarking and the National Audit Office's 2020 progress review. Comparative planning analysis follows the OECD's Land-Use Planning Systems in the OECD (2017) and the LSE Spatial Economics Research Centre's working paper series under Cheshire and Hilber.
You’ve looked beneath the surface.
A connection through “Systems that outlast us”: Trace institutions and inherited rules that continue to shape the present.
A connection through “Systems that outlast us”: Trace institutions and inherited rules that continue to shape the present.
A connection through “Systems that outlast us”: Trace institutions and inherited rules that continue to shape the present.