UK Statistics Authority response to the Public Administration and Constitutional Affairs Committee report on the work of the Authority

Published:

Government data sharing

“The Cabinet Office and the UKSA should update us on the long-term plan to improve data sharing across government in light of the failure of the Integrated Data System in its response to this report and quarterly thereafter. In particular, the Government should clarify where responsibility for integration of the work of the IDS with the National Data Library’s Kickstarter Programme now sits, following the closure of the Department of Science, Innovation and Technology (DSIT).” (Paragraph 34) 

This is a particularly important recommendation: improving data sharing across government is essential to delivering better statistics, stronger evidence for public policy, and better value from data already held across the public sector. The success of the current government’s priorities on devolution and re-wiring the state will depend upon a step change. We also recognise the Committee’s concern that previous approaches, including the Integrated Data Service, did not deliver the scale of change originally intended. As observed by Professor Lievesley, and in turn the Committee, the Integrated Data Service (IDS) did not have a clear enough scope but also faced systematic and cultural barriers to responsible data sharing across government. Overcoming these barriers will require cross-government action, buy-in from the wider data ecosystem, and moving beyond individual successes, as discussed in OSR’s State of the UK Statistical System 2026 report.

There has been progress, but it has required huge commitment and determination; and the potential from data sharing is far from realised. We are not yet in a position to give you a full answer on the long-term plan but this initial update does set out what needs to be done and by whom. 

On the positive side:

  • An excellent example of increased use of administrative data is the fact that ONS migration data is now purely based on administrative data, and no longer relies on the International Passenger Survey. And PAYE Real Time Information is also being used in a range of core statistics, supported by more regular and automated supply. It has been shared with ONS and NISRA, and work is under way with National Records of Scotland, which will support more coherent statistics across the four nations.
  • The National Statistician’s Office has worked with colleagues across GSS to support the promotion and accessibility of guidance, training and tools that help practitioners make effective use of administrative data for statistical purposes.
  • The ONS is developing its offer in support of the Government’s Rewiring the State agenda, to support local authorities and Mayoral Strategic Authorities, building on the ONS Local service as a front door to ONS expertise, supporting local users to navigate existing data and analytical products, and improving other dissemination tools, geography and statistical infrastructure. 

But there are real issues and risks too. New data shares require a huge amount of determination and friction to overcome. Existing data supplies do not have the resilience required. For example: 

  • In the ONS, increasing the use of administrative data in the production of critical statistics has the potential to deliver great value, but also creates a significant dependency on an effective and consistent supply chain for those data, a supply chain which is fragile. Two recent delays and failures in the supply of administrative data to the ONS by government departments have risked core migration and labour market outputs being delayed. Continuity and security of supply are as important as new shares.
  • Administrative data has huge potential for use in Census 2031, for example, improving the address frame, helping to target field activity, informing quality assurance, and adding value through linkage to other data sources. But it also depends on guarantee of supply.
  • The Devolved Governments have been frustrated by reliance on the ONS for onward shares of key data sets.

In terms of what happens next:

  • The Authority, working through the ONS, OSR and the National Statistician’s leadership of the GSS, will continue to play its part by identifying priority data sources for official statistics on an annual basis.
  • The ONS will continue to develop a more coherent approach to stewarding data and managing data supplies, as set out in The data that matter. 
  • The Authority will use its voice to make clear where it has concerns about data supply on key statistical processes, and communicate what needs to happen to ensure security of supply. 
  • The incoming National Statistician will provide leadership across the GSS and work with colleagues across government. But it is for the Government to set out how responsibility for enabling and ensuring cross-government data sharing now sits across the Cabinet Office, the Authority and the relevant delivery bodies following machinery of government changes, including the splitting of the Central Digital and Data Office across the Department for Digital, Culture, Media and Sport (DCMS), the Government Digital Service (GDS) and the Department for Business, Innovation, Science and Technology (BIST). It would also be useful for the Government to clarify how the learning from the Integrated Data Service is being carried forward into the National Data Library and Strategic Data Roadmap, including how statistical, analytical and operational data priorities will be aligned and governed.
  • We accept the Committee’s recommendation to provide updates on progress. We propose writing again with a substantive update once the National Statistician has had time to review the approach. We propose to follow up with a further response jointly with the Cabinet Office, once the longer-term operating model for government data sharing and the National Data Library is agreed. We would then welcome discussion with the Committee on the most appropriate reporting cadence. Our view is that a time-limited reporting arrangement, or an annual public update on priority data sources and data-sharing progress, would provide greater transparency while avoiding an open-ended quarterly process that risks duplicating existing reporting routes.