Where AI fits
The moments when clarity starts to break down
First of all, when we say AI, what we really mean are the current Large Language Models (LLMs) which can all interpret information and draw conclusions. The information (data) can be either textual (subjective) or numeric (objective).
AI tends to become most useful at a specific kind of moment in a process: the moment when the next step can no longer be defined purely through clear pre-prepared instructions, but some level of lesser defined exploration is needed to make sense of the data. Up to that point, work may feel relatively structured. Almost like a formula or programmed set of steps, which follow each other in a standardised and predictable sequence. Information moves through the process, and although there may be inefficiencies, there’s still a clear and shared understanding of what should happen next.
Then something shifts. A handover starts to depend on who is working that day, a decision takes longer than it should, or two experienced people look at the same information and reach slightly different conclusions. These are the moments where interpretation has become the real work, and where maintaining consistency through manual judgement, at any kind of scale, starts to become difficult to sustain. Over time, that difficulty tends to slow things down or introduce exactly the kind of variation that’s hard to get under control through standardisation alone.
AI provides a way of navigating that variation. Rather than relying on a fixed set of rules, it works with patterns in data to support a judgement about what’s likely to be appropriate in a given situation, whether that’s classifying information, flagging risk, summarising content, or suggesting a course of action based on what’s happened in similar cases before.
For improvement practitioners, this feels like familiar territory. PDSA is carried out all the time by experienced people who know the process and its systemic environment inside out, instinctively knowing how best to proceed. But if you’re new, you clearly have to develop that expertise, and AI can support PDSA in action by exploring theories, ‘what if’ scenarios, and depending on the outcome, help you develop new theories and insights. It can be your friend in accelerating your understanding and taking meaningful next steps.
One caveat is worth adding here. What we see is that there’s a natural pull towards reaching immediately for AI wherever post analysis judgement is involved, but in many cases the real issue sits slightly earlier in the process of interest. Variation has already crept in: inputs may be inconsistent, criteria may not be fully agreed, or different teams may be applying their own unwritten assumptions without realising it. Introducing AI into that situation can produce outputs that seem useful in isolation but don’t hold together consistently when used more broadly. AI works well where there’s still a degree of structure in place. The process doesn’t need to be rigid, but it does need enough shape that inputs are understood and outcomes are broadly aligned.
In summary, AI works best when the process of interest is well understood, defined and standardised so we ensure and are assured that the analysis is meaningful for insights and decision making.