The most misunderstood capability in AI transformation
Looking Twice: Decisions in the age of AI
This is part of Looking Twice: Decisions in the age of AI, a series examining what happens when AI enters organisations already depleted by decades of digital transformation. Earlier posts explored how AI amplifies existing patterns rather than correcting them, why smart people often perform worse with AI assistance, the invisible work that keeps systems functioning, and why AI acts as an organisational mirror. This post identifies the missing capability that determines whether AI extends judgment or erodes it.
There is a great deal of conversation about skills in the AI era. We all need to learn prompting, be AI literate and fluent in how the different models work. We value this technical understanding and change readiness in our people and all of these matter, however none of them touch the core issue. What is missing is not skill in the usual sense, it is a capacity. Specifically, the capacity to notice how we are thinking while we are thinking, and to adjust in response to that noticing, which is known as metacognition.
Metacognition is not new and it is not exotic. It sits beneath good judgment, sound decision making, and the ability to operate under uncertainty without collapsing into certainty too early. It is what allows a person, or a group, to pause and ask whether the frame they are using still fits the situation they are in.
In the context of AI, this capacity becomes critical.
As we have already seen, AI systems do not simply produce outputs. They shape the cognitive environment in which decisions are made. They influence what feels salient, what feels complete, and what feels unnecessary to revisit. In that environment, the ability to monitor one’s own reasoning is no longer a nice to have. It is a safety mechanism.
Without it, people drift. However, at first this drift does not look dramatic. It looks like competence, moving smoothly from question to answer with confidence and it looks like work getting done. What disappears is the moment of self-interrogation, the quiet check that asks whether the answer is grounded, whether the assumptions still hold, whether the situation has shifted in ways the system cannot see.
Research into professional use of generative AI consistently shows this pattern. When people actively plan, monitor, and adjust their thinking, AI can improve outcomes. When they do not, performance stagnates or declines, even among highly capable professionals. The difference is not intelligence...it is metacognitive engagement.
This is why so many AI initiatives feel simultaneously impressive and fragile. The outputs are fluent, the systems appear to work and yet something essential feels thinner, less robust and more easily knocked off course. That something is reflective capacity.
What makes this particularly challenging is that metacognition does not announce itself. You cannot mandate it through policy. You cannot install it through software. You cannot replace it with governance language. It shows up in how conversations are held, how disagreement is tolerated, how uncertainty is handled, and how quickly people feel pressured to resolve ambiguity.
In this sense, AI transformation is inseparable from organisational culture, not because culture is a soft backdrop, but because culture determines whether reflective pauses are possible at all.
This is where the connection to foresight and futures becomes unavoidable. Good futures work does not begin with prediction; it begins with noticing. Noticing which assumptions are being treated as fixed, which trajectories are being extrapolated without question, and which possibilities are being excluded because they are uncomfortable, inconvenient, or destabilising to current plans.
Integral foresight rests on the same capacity as metacognitive AI use. The ability to step outside a dominant frame, to hold multiple perspectives at once, and to remain oriented to purpose rather than momentum. Without that capacity, futures work collapses into trend watching, and AI work collapses into acceleration. In both cases, the failure mode is the same, acting more quickly inside an unquestioned worldview.
This is why metacognition is so often misunderstood in organisational settings. It is mistaken for introspection, or hesitation, or lack of decisiveness. In reality, it is what allows decisiveness to remain aligned with reality as conditions change.
Organisations that lack this capacity tend to oscillate between overconfidence and paralysis. They rush forward until something breaks, then slow everything down in response. What they rarely do is build the steady reflective muscle that allows them to move with care without stopping entirely.
AI amplifies this dynamic, so in organisations where reflective capacity is already present, AI can extend it. It can surface patterns, test assumptions, and support more thoughtful sensemaking. In organisations where reflective capacity is thin or suppressed, AI accelerates drift because it rewards fluency over understanding and speed over judgment.
This is why training people to use AI without strengthening metacognition is not just insufficient, it is actively risky. Prompting skills increase output but they do not increase discernment. Technical literacy improves access but not judgment. Without metacognitive capacity, these skills simply make it easier to move quickly in the wrong direction.
The most important work of AI transformation, then, does not sit in the technology roadmap. It sits in the conditions that allow people to notice when they are being carried along by coherence rather than conviction, by momentum rather than meaning.
This is slow work, but it is not optional. It is the work that makes the difference between AI as an accelerant of existing patterns and AI as a companion in rethinking how work is actually done.
If the previous post argued that AI reflects the organisation back to itself, this one names the capacity required to look at that reflection without flinching, and without rushing to either denial or control.
The question that remains is whether organisations are willing to invest in that capacity, or whether they will continue to search for substitutes that feel easier to scale.
The Art of Unravelling is offered as a gift, sustained by those who feel called to support the weaving. If you’d like to help tend the fabric of this work, you can contribute via the link below.