Ian Bobbett, Chief Data Officer at Crimson, explores why councils continue to struggle to turn data into confident, day-to-day decisions, and how a practical data governance strategy can help organisations move forward.
Local authorities are not short of data. Every day, information is collected across children’s services, adult social care, housing, finance, customer services and partner organisations. Yet despite this volume, many councils still struggle to translate data into timely, confident decisions that improve outcomes for residents.
The challenge is not simply access to data. It is how information is structured, connected, trusted and governed within day-to-day services.
For many councils, the difficulty is not understanding the problem. It is identifying a practical way forward without adding complexity or pressure to already stretched teams.
In many councils, information sits across multiple systems that do not easily connect. Data can be incomplete, duplicated, or held in formats that make analysis difficult. Some of the most valuable insights also exist in unstructured notes, observations and professional judgement rather than neatly organised datasets.
This creates a gap between what is known and what can be acted on.
Practitioners often build a complete picture of a resident or case through experience, conversations and local knowledge. However, without a joined-up and well-governed view across systems, decision-making can become slower, more reactive and harder to evidence.
It also makes collaboration more difficult. Different teams may be working from different versions of the same story, limiting visibility and reducing the organisation’s ability to respond effectively to changing needs.
Councils making progress are not attempting wholesale system replacement. Instead, they focus on creating a connected and governed view of priority data, making it accessible at the point decisions are made.
When discussing data, the focus often falls on systems and technology. However, many of the biggest barriers to an effective data governance strategy are cultural.
Frontline services, particularly within social care, are fundamentally human-centred. Professional judgement, experience and personal interaction play a critical role in decision-making. As a result, data is not always embedded within decision-making in the same way it is in finance or performance teams.
This is not a criticism. It reflects how these professions operate.
The challenge is creating an environment where data supports professional judgement rather than competing with it. Confidence grows when practitioners can see how governed trusted information helps them make better decisions, improve outcomes and reduce administrative burden.
The most effective data governance strategies start with services, not data. Understanding the decisions practitioners need to make help shape how information should be structured, governed and presented.
Most councils already hold enough data to generate valuable insight. The greater challenge is ensuring that data is reliable, consistent and trusted.
If users question the accuracy of information, confidence quickly disappears. Teams spend time validating data, cross-checking systems and searching for missing context rather than acting on what they know.
Improving data quality is a core part of any data governance strategy. It delivers benefits beyond reporting:
Ultimately, better data quality leads to better outcomes.
When teams trust the information in front of them, they can act earlier, with greater clarity and less rework.
At the same time, pressure on frontline teams continues to grow. Social workers, housing officers and support staff spend a significant proportion of their time capturing and duplicating information across systems.
Administrative demands take time away from direct work with residents.
This is often where poor data governance has the biggest impact. Information needs to be entered multiple times across disconnected systems, each with its own formats and requirements.
In high-pressure services such as social care, practitioners may need to review detailed case histories across multiple systems before making decisions, then record updates repeatedly to meet compliance requirements.
When teams are under pressure, the focus shifts to completing tasks rather than extracting insight.
Improving how data is governed, captured, and reused can reduce duplication, improve consistency, and give teams time back.
Many councils have invested in technology over several years yet still struggle to create a connected view of information.
One reason is that systems were designed to support operational processes rather than a broader data governance strategy or data-driven decision-making.
As a result, valuable information remains locked within individual systems, documents or service areas.
Before councils can realise the benefits of advanced analytics and AI, they need strong data governance foundations, built on accessible, connected and well-managed data.
In practice, this means:
These are the building blocks of effective data governance.
The conversation around AI is shifting.
Rather than focusing on technology alone, councils are exploring how AI can support practical, everyday activities. However, AI is only effective when built on a strong data governance strategy.
In practice, this means bringing together fragmented information, surfacing relevant insights and automating repetitive tasks such as case note summarisation, document handling and data entry.
In social care, this can help practitioners quickly understand case history across multiple systems. In housing, it can connect tenancy, arrears and support data to provide a clearer view of need and risk.
Importantly, this does not replace professional judgement. It strengthens it by making governed, trusted information easier to access.
Over time, a strong data governance strategy enables a shift from reactive to proactive services.
When information is easier to interpret and act upon, councils can:
Improved visibility across services helps leaders allocate resources more effectively and deliver preventative action.
The result is not just greater efficiency, but better outcomes for residents and more resilient services.
Councils making the greatest progress are not those investing in the most technology.
They are organisations that build confidence in how data is governed, shared and used. Strong data governance, combined with practical AI use, enables councils to improve services without unnecessary complexity or enhanced risk.
Progress is strongest when improvements are embedded into existing processes and focused on measurable outcomes.
Turning data into confident decisions is not about having more information. It is about making the right information accessible, usable and meaningful in the moments that matter.
This requires a shift in how data is governed, from something collected and stored to something that actively supports day-to-day work.
For councils looking to move forward, Crimson’s Local Government AI Consortium brings organisations together to explore real use cases, share learning and build confidence in how data governance and AI can be applied in practice.
By working collaboratively, councils can accelerate progress while reducing duplication and risk.
When data is governed effectively, the impact is felt across the organisation. Teams are better supported, services become more proactive and decisions are made with greater confidence