Privacy, made operational. Discover → Classify → Map → Consent → Evidence
← All insights
Article 21 — The Next Privacy Layer

AI Has a Data Governance Problem Before It Has an AI Governance Problem

6 min readSeptember 2026iConsent Insights

When an organisation begins an AI governance programme, the first questions often concern models: who approved them, how they are tested, and whether their outputs are monitored.

Those questions matter. But before a model can be governed, an organisation needs to understand the data that enters it.

AI governance starts upstream, with data provenance, quality, context and permitted use.

Start with the input

AI initiatives draw on training data, prompts, retrieval sources, fine-tuning sets, evaluation examples and live operational records. These inputs may come from internal systems, public sources, vendors or combinations of them.

A dataset that appears useful technically may contain personal information, confidential material, outdated records or data collected for a different purpose. If teams cannot identify its source and context, they cannot reliably assess whether it is appropriate for the intended use.

The model inherits data context

Data does not lose its governance history when it is copied into an analytics environment or supplied to an AI service. Its origin, purpose, sensitivity, quality and access conditions still matter.

Combining datasets can also change the risk. Seemingly ordinary attributes may become identifying or revealing when joined with other information. Outputs may expose patterns that were not apparent in the source data.

A model can only be as accountable as the organisation's understanding of the information it uses.

Governance needs lineage

For a consequential AI use, teams should be able to trace data from source through preparation, transformation, storage and model use. Lineage makes it easier to investigate quality issues, respond to correction or deletion requests, review vendor processing and explain how an output was produced.

This does not require every organisation to build a perfect map before starting. It does require a proportionate record of important datasets, owners, transformations, access and downstream uses, with stronger scrutiny for higher-impact applications.

Reuse needs a purpose check

Data gathered for one business activity is not automatically suitable for every later use. Before reusing personal data in an AI workflow, teams should document the intended purpose, assess applicable legal and contractual requirements, check notices and permissions where relevant, and identify controls that need to travel with the data.

Privacy, security, product, data and legal stakeholders should take part early enough to influence the design. A review after a system is deployed is often more expensive and less effective.

Build the data foundation

A practical foundation connects discovery and classification with processing records, retention, access controls and model inventories. That gives teams a way to find relevant data, understand its context and identify where an AI use needs assessment.

Start with the datasets used by one priority AI application. Identify their sources and owners, record transformations and recipients, confirm the planned use, and define how changes to the source data will be handled. Then improve the process as the portfolio grows.

AI governance is not a separate island. It depends on strong data governance that can explain what information is used, why it is used and how it is controlled.

Privacy, made operational

Start AI governance with data you understand.

Connect discovery, purpose and controls across your privacy programme.

Explore the suite