I’ve been working in data warehousing since the year 2000. Over that time, I’ve seen technologies come and go, architectures rise and fall, and plenty of “next big things” quietly disappear again. What hasn’t changed is the question people keep asking:
Not theoretical value. Not something we promise for “phase three”. Real value that helps a business make better decisions, earn more money, or spend less of it.
The longer I work in this field, the more I realise that the answer is much simpler than most data discussions make it.
People often talk about agility in data projects, but I’ve stopped using the word when I talk to business stakeholders. Not because agility isn’t important — but because the word itself doesn’t mean much outside IT.
What does make sense to everyone is delay.
If an important insight arrives too late, the decision based on it is also too late. And that delay has a cost. Sometimes it’s lost revenue. Sometimes it’s unnecessary spending. Sometimes it’s just missed opportunity.
That’s how I think about agility: it’s simply about reducing the cost of delay. Automation, tools, and frameworks only matter if they help us do that.
Another pattern I see often starts with good intentions. Companies want flexibility, so they assemble a stack of open-source tools and build their own platform.
What they don’t always realize is that they’ve just signed up for a second job.
Suddenly, the data team isn’t just delivering insights. They’re also maintaining frameworks, upgrading tools, documenting custom solutions, and training new colleagues on a setup that only exists inside that company.
I like to ask a simple question here:
If data management is as complex as ERP, would you build your own ERP system?
Most companies wouldn’t — and for good reasons. The same logic should apply to data platforms.
If there’s one thing I’d like people to take away, it’s this:
Data projects don’t fail because people are incompetent.
They fail because value arrives too late, or in the wrong form, or at too high a cost.
If we stay close to the business, keep things simple, deliver early, and automate what doesn’t need human creativity, data can finally do what it was always supposed to do — help people make better decisions.
And that, in the end, is what this work is really about.