Appendices

Appendix A: Acronyms

GSS IDSC – Government Statistical Service Inclusive Data Subcommittee

IDTF – Inclusive Data Taskforce

NSIDAC – National Statisticians Inclusive Data Advisory Committee

MARP – Methodological Assurance Review Panel

Appendix B: RAG status for each Inclusive Data Principle

About Principle 1:

Create an environment of trust and trustworthiness which allows and encourages everyone to count and be counted in UK data and evidence.

Of the 37 commitments mapped to Principle 1, 81% were assessed as completed or on track (65% and 16%, respectively) while 19% were reported to either have delays (14%) or be significantly delayed or paused (5%).

Base: 37 IDTF commitment projects mapped to IDP1

About Principle 2:

Take a whole system approach, working in partnership with others to improve the inclusiveness of UK data and evidence.

Of the 44 commitments under Principle 2, 84% were completed (75%) or on track to deliver (9%) while 16% were delayed (14%) or severely delayed/ paused (2%), as shown in Figure 10.

Base: 44 Inclusive Data Commitment projects mapped to IDP2

About Principle 3:

Ensure that all groups are robustly captured across key areas of life in UK data and review practices regularly.

There are 70 commitments under Principle 3, suggesting more activity is happening here than in any other area. Although 87% of commitments in this area were complete or on track (46% and 41% respectively), 7% were assessed as significantly delayed or paused (red), as shown in Figure 11.

Base: 70 IDTF commitments mapped to IDP3

About Principle 4:

Improve UK data infrastructure to enable robust and reliable disaggregation and intersectional analysis across the full range of relevant groups and populations, and at differing levels of geography.

There are 51 commitments under Principle 4. Figure 12 shows that 88% of commitments under IDP 4 are complete (55%) or on track to deliver (33%) while 12% were delayed (10%) or significantly delayed/ paused (2%).

Base: 51 IDTF commitments mapped to IDP4

About Principle 5:

Ensure appropriateness and clarity over the concepts being measured across all data collected.

There are 36 commitments under Principle 5. Figure 13 shows most commitments (94%) were complete or green (47% each) while 6% were delayed (3%) or severely delayed/ paused (3%).

Base: 36 IDTF commitments mapped to IDP5

About Principle 6:

Broaden the range of methods routinely used and create new approaches to understanding experiences across the population of the UK.

There are 32 commitments under Principle 6. Figure 14 shows the distribution of the commitments by their RAG status. Most commitments were either complete (50%) or green (34%). There were no commitments reported as red as with Principle 6. However, 16% were delayed.

Base: 32 commitments mapped to IDP6

About Principle 7:

Harmonised standards for relevant groups and populations should be reviewed at least every five years and updated and expanded where necessary, in line with changing social norms and respondent and user needs.

There are 23 commitments under Principle 7. Figure 15 shows the distribution of the commitments by their RAG status. 91% of the commitments were complete or green (61% and 30% respectively).

Base: 23 commitments mapped to IDP7

About Principle 8:

Ensure UK data and evidence are equally accessible to all, while protecting the identity and confidentiality of those sharing their data.

There are 46 commitments under Principle 8. Figure 16 shows the distribution of the commitments by their RAG status. 98% of the commitments were complete or on track (52% and 46% respectively). There were no commitments reported as red and 2% were assessed as delayed (amber).

Base: 46 commitments mapped to IDP 8

Back to top

Appendix C: Research methods for understanding factors contributing to ‘red’ or ‘amber’ RAG statuses and plans for overcoming barriers to progress

Approach to thematic analysis of reasons for ‘red’ or ‘amber’ RAG status

Using a deductive thematic analysis approach, initial themes were identified building on analysis of similar data from the previous year while allowing additional themes to emerge from the current reporting year. Using the previous year’s updates helped to contextualise the more recent data which asked commitment owners to provide a ‘route to green status’ instead of specifically explaining why the work was assessed as red or amber.

Codes

A code is a ‘label’ applied to a word phrase, sentence or portion of a text. It is a means of categorising and breaking down the data into smaller units in order to make useful comparisons across cases.

The codes from the analysis are shown below:

CodeProposed theme
Changes in ministerial priorityDe-prioritisation
Further research requiredDependency
Previous resource constraintsResource
Strategic changeStrategy
Prioritisation
Previously de-prioritisedPrioritisation
De-prioritisation
De-prioritisedPrioritisation
De-prioritisation
Judged as ineffectivePrioritisation
Not being pursuedDe-prioritisation
Avoiding duplication of workDe-prioritisation
Unfeasible initial timeline based on data collectionDependency
Delay in transferring dataData access
Dependency
Unable to acquire dataData access
Dependency
Limited resourceResource
Previously awaited funding decisionResource
Funding
Previously awaited prioritisation decisionPrioritisation
Dependency
Temporary lack of responsible ownerDe-prioritisation
Lack of resourceResource
Reduced fundingResource
Funding
Awaiting organisational strategyDependency
Strategy
Awaiting data collectionDependency
Data
Unable to recover previous delaysTime constraints
Dependency on GSS harmonisation reviewsDependency
Dependency on GSS harmonisation standardsDependency
Dependent on larger programme of workDependency
Awaiting evaluationFurther research
Dependency
No publication timelineNo publication timeline
Dependent on user feedbackDependency
Uncertainty about outcome deliveryRe-prioritisation
Previously awaited a decisionDecision
Dependency
Awaiting strategic directionDependency
Previously awaited approvalDecision
Dependency

From Codes to Themes

Approach: Three analysts undertook an internal workshop to develop themes from the codes.

The categorisation of codes into themes is shown below:

Code:

  • Lack of resource
  • Reduced funding
  • Awaiting funding
  • Previous lack of funding
  • Previous resource constraints

Theme:

Resource

Code:

  • Re-prioritisation
  • Changes in ministerial priority
  • De-prioritised
  • Not cost effective
  • Judged as ineffective
  • Avoiding duplication of work
  • Uncertainty about outcome delivery
  • Not being pursued
  • Strategic change
  • Temporary lack of responsible owner

Theme:

Reprioritisation

Code:

  • Previously awaited a decision
  • Dependent on larger programme of work
  • Dependency on GSS harmonisation standards
  • Dependency on GSS harmonisation reviews
  • Delay in transferring data
  • Unable to acquire data
  • Awaiting evaluation
  • Dependent on user feedback
  • Awaiting data collection
  • Further research required
  • Awaiting strategic direction
  • Awaiting organisational strategy
  • Unfeasible initial timeline based on data collection
  • Previously awaited a prioritisation decision
  • Previously awaited approval

Theme:

Dependency

Approach to understanding future plans for overcoming barriers to progress

Thematic analysis of commitment holder feedback was used to understand future plans for amber or red commitments. In some cases (7 commitments), the initial response provided in the Quarter 4 update included detailed information on plans to get the project back on track and/or completed. For another 11 projects, data collected through the previous update was supplemented by a discussion with the commitment holder to obtain more details.

Where the update did not provide enough detail for this approach, a survey was sent to commitment owners to gather further information about plans to progress or complete the work (i.e., a ‘route to green’ RAG status). Data on 15 commitment projects was obtained through the survey.  The data collected in these various ways helped to provide a holistic picture of future plans for IDTF projects assessed as amber or red.

Back to top

Appendix D: Definitions

Commitments

Definition: Commitments are initiatives that government departments and non-governmental organisations stated they will do. Each commitment falls under an Inclusive Data Principle. (Response by the National Statistician to the Inclusive Data Taskforce (IDTF) Report and recommendations)

Inclusive Data Principle (Principle)

Definition:Refers to one of the eight Inclusive Data Principles. Each has specific recommendations to improve the UK inclusive data infrastructure (Leaving no-one behind: How can we be more inclusive in our data).

RAG status

Definition:Complete, Red, Amber, Green status. This is subjective and based on information from commitment owners.

Key commitments

Definition: Key commitments are those originating from the IDTF 2022 Implementation plan. They were the big initiatives (work strands, projects, programmes) that could make structural step change on inclusive data across the UK.

Non-key commitments

Definition: Refers to other commitments which were not classified as key.

Back to top