Why AI Projects Fail in Production: The Critical Role of Customer Data Quality
A successful proof of concept, followed by a difficult path to production. Why do AI projects in sales, marketing and customer service so often run into problems with customer identification, data relationships and duplicate records? And what are the four key steps to making customer data ready for reliable AI-powered processes?
Many businesses struggle with the quality of their customer and organisational data. This includes customer accounts, corporate structures, locations, contacts, contracts and the relationships between them, spread across CRM systems, ERPs and customer service platforms.
Why does this matter so much? In business processes, AI needs to do more than generate answers. It must identify the right entities, make decisions and trigger actions. To do this reliably, it needs data that is consistent, unambiguous and fit for use in real-world operating environments.
A successful proof of concept, but a more complicated path to production
Many AI projects get off to a promising start. Proofs of concept (PoCs), pilot projects and initial demonstrations often deliver encouraging results. At this stage, gaps in the underlying data can easily go unnoticed. Someone manually completes missing fields, matches identifiers across systems or removes duplicates to keep the test running smoothly.
But when the solution moves into production, the situation changes. AI must now contend with the reality of enterprise data. What initially appeared to be straightforward to automate becomes a succession of edge cases requiring human intervention.
A BARC study, Lessons from the Leading Edge, based on 408 respondents surveyed in late 2025, confirms the scale of the challenge: 44% of respondents identified data quality as a barrier to AI adoption, compared with 19% the previous year.
How can you identify the problem? When even simple AI tasks fail
Example 1: Generating a customer service summary
Task: “Summarise the situation: who is the customer, what has happened, and what issues remain unresolved?” (CRM + ticketing system + ERP)
👉 The task seems straightforward until the CRM, ticketing system and ERP each provide a different version of the customer’s situation.
Example 2: Linking a ticket to the right customer
Task: “Create a ticket and link it to the correct customer, location and contract.” (Ticketing system + CRM + contract data)
👉 This task can only be automated reliably if the relationships between the customer, location and contract are clearly defined and consistent across systems.
In both cases, the outcome is similar: instead of making teams’ lives easier, AI generates requests for clarification and manual corrections, gradually undermining confidence in automation.
Why is customer data so critical?
In many businesses, customer and organisational data present several challenges:
- It is critical to business performance: it affects sales pipelines, revenue, service levels and billing.
- It is spread across multiple systems: CRM platforms, ERPs, customer service tools, marketing platforms and spreadsheets all coexist.
- It has evolved over time: mergers and acquisitions, international expansion and changing business processes have created inconsistent data structures.
- It relies on complex relationships: customer accounts, organisations, locations, contracts and contacts must all be linked correctly.
AI can often work with incomplete data. It struggles much more when information is contradictory or ambiguous, particularly when it needs to make a decision or trigger an action within a business process.
The most common data quality issues in practice
When it comes to customer and organisational data, the same problems tend to crop up again and again.
❌ Missing information
Some mandatory fields are left blank, contacts are not properly identified, or reference data is incomplete.
❌ Incorrectly populated fields
An industry, region or sales segment is recorded inaccurately or too loosely. AI may then draw incorrect conclusions and produce unreliable results.
❌ Data silos
The CRM contains one version of the information, the ERP another, and the customer service tool a third. Without a clearly defined source of truth, it becomes difficult to determine which information should take precedence.
❌ No common data model
The same term (“account”, “customer”, “location” or “entity”) can refer to different things depending on the system or team. Matching records across systems then becomes uncertain.
❌ Duplicate records and inconsistent relationships
Several records may refer to the same customer, or the links between accounts, locations and contracts may be incorrect. The question “Which organisation does this customer belong to?” can become a major obstacle to automation.
The bottom line: AI needs a reliable data environment
Shawn Rogers and Merv Adrian of BARC summarise the challenge well:
“AI success is not about building an exceptional model, but about creating an environment in which powerful models can deliver their full potential.”
In business processes, that environment rests on four foundations: reliable identities, clearly defined relationships, sufficiently complete data and continuous quality monitoring in production.
4 ways to make customer data reliable enough for AI
1. Identify every customer unambiguously with a Golden Record
AI needs to determine whether several records refer to one and the same customer. This requires rules for matching, consolidating and prioritising information from different data sources.
2. Clarify relationships and hierarchies
Customer ↔ Organisation ↔ Location ↔ Contract ↔ Contact
If these relationships are missing, unclear or contradictory, automation can produce errors even when individual records appear to be correct.
3. Ensure critical data is complete
There is no need to make every record perfect before deploying AI. What matters is ensuring that the information essential to each process is reliable: the associated contract, the relevant location, an identified owner, an up-to-date status, and so on.
4. Build in data quality checks and continuous monitoring
Data quality cannot be fixed through a one-off clean-up exercise. Once AI is in production, businesses need to measure and monitor data quality continuously. This includes tracking duplicate rates, completion rates for mandatory fields, compliance with consistency rules and the emergence of new anomalies.
Taking action without launching an endless data transformation project
One of the most common mistakes is trying to clean up all enterprise data before launching any AI initiative. This approach can consume significant resources and unnecessarily delay the benefits AI could deliver.
A targeted approach, directly aligned with AI requirements, is often more effective:
✅ 1. Select one or two business processes that AI needs to improve reliably. Examples include ticket classification, customer account summaries (account insights) and lead routing.
✅ 2. Identify the essential fields and relationships required for those processes to work correctly (Critical Data Elements).
✅ 3. Assess the quality of existing data: completeness, duplicates, consistency and discrepancies between sources.
✅ 4. Prioritise one or two high-impact improvements: establishing a Golden Record, clarifying relationships between entities, or doing both.
✅ 5. Implement continuous data quality monitoring to maintain reliable data once AI is in production.
This approach helps businesses achieve measurable results sooner while creating the conditions for reliable, everyday AI adoption.
Quick assessment: is the problem your AI model or your data?
If several of the following situations sound familiar, your customer data quality probably deserves closer attention:
- AI struggles to identify the correct customer, location or contract unambiguously.
- Duplicate records and conflicting account hierarchies are commonplace.
- Essential relationships between locations, contracts and contacts are missing or incorrect.
- The CRM, ERP and customer service tools provide contradictory information.
- AI-powered automations regularly require manual checks and corrections.
In these situations, improving the AI model alone may not be enough. It is equally important to ensure that the data the model relies on is reliable and consistent.
Conclusion
When AI suddenly hits a wall in business processes, the model itself is not necessarily to blame. The underlying issue is often customer data that is ambiguous, incorrectly linked or insufficiently monitored once the solution is in production.
The good news is that progress does not always require a large-scale data transformation programme. A handful of targeted improvements can make a meaningful difference: a reliable Golden Record, consistent relationships and hierarchies, complete critical data and continuous quality monitoring.
What you can do today
Want to identify the improvements that will have the greatest impact on the reliability of your customer and organisational data?
Let’s spend 30 minutes reviewing your challenges and identifying the priorities based on the business processes you want to make more reliable with AI.
About DQE
Because data quality is essential to customer knowledge and the construction of a lasting relationship, since 2008, DQE has provided its clients with innovative and comprehensive solutions that facilitate the collection of reliable data.
18
Years of
expertise
1,000
Clients in all
sectors
10Bn
Queries per
year
240
International
repositories