01 / VALUE REALISATION
The pilot-to-production gap is the whole game
MIT Media Lab's Project NANDA reported that around 95% of generative AI pilots studied produced no measurable profit-and-loss impact—and attributed the failure to a learning and workflow gap rather than to the models.
What changed
The GenAI Divide research reviewed executive interviews, leader surveys and public deployments, and found a small minority extracting significant value while the large majority remained stuck at pilot. The differentiator was not which model was used. It was whether the tool entered the daily workflow it was meant to change, and whether anyone had measured the before state well enough to detect an improvement.
Why it matters commercially
For a buyer, this reframes the risk. The question is not whether the technology is capable—it demonstrably is—but whether your engagement includes process mapping, integration into the systems people already use, change management and a measurement baseline. A proposal that is all model and no workflow is a proposal for a pilot that will quietly end.
What we do about it
- Capture a cost and volume baseline before any build begins, so improvement is provable
- Scope the first release as one complete workflow rather than a broad assistant
- Deliver into the tool people already open daily, not a new destination they must remember
- Budget for adoption support and iteration, not only for build
- Agree in writing what result would justify expansion and what would justify stopping
Summary signals
- Root cause is integration and process, not model quality
- Back-office and document-heavy work shows the clearest returns
- Pilots without a baseline cannot prove value even when they create it