Wake-Up Call
On foundations, trust, and the war already underway.
“The victorious strategist only seeks battle after the victory has been won, whereas he who is destined to defeat first fights and afterwards looks for victory.” ~ The Art of War, by Sun Tzu.
Picture a fund that has finally decided it’s time. The board has spent a year asking about AI, the budget is signed, and the talent is in the building—AI specialists, data scientists and engineers who cost more than some of the portfolio managers they were hired to outthink—and yet a year later, with the ambition genuine and the models sound and the mandate as clear as it could be, the effort has quietly stalled. The most expensive bet of the decade, and almost nothing to show for it. It’s a more familiar ending than anyone in that building would like to admit.
Over the last fifteen years, I’ve had the rare privilege of working inside some of the world’s most sophisticated investment institutions—global trading desks, equity research powerhouses, multi-billion dollar funds running strategies across every conceivable asset class and geography. These are organizations with considerable pockets, brilliant people, and cutting-edge technology. And yet they’re wrestling with the kinds of challenges that eventually find every data-intensive business—just at a speed, scale and complexity that make any weaknesses with dire consequences impossible to ignore.
The game itself has become almost incomprehensibly complex. Consider the scale alone: fifty thousand publicly traded companies scattered across dozens of exchanges worldwide. Millions of individual bond instruments, each with its own covenants, credit risk, and maturity profile. More than a billion open derivative contracts—options, futures, swaps—that derive their value from underlying assets that are themselves constantly moving. And that’s just counting the traditional stuff, before you get into structured products, private markets or the expanding universe of digital assets.
But scale is only part of the story. What makes this environment particularly unforgiving is the relentless acceleration of everything. By the time I entered this world in 2011, the transformation was already well underway—electronic trading had long replaced the vast majority of shouting traders on exchange floors, and high-frequency algorithms were already the dominant force, accounting for more than half of equity trading volume. Colocation wasn’t a novelty: firms were paying millions to place their servers mere feet closer to exchange matching engines, because microseconds had become the difference between profit and loss. Information that once took minutes to disseminate now moved at nearly the speed of light through fiber-optic cables. Human investment decisions now had to account for trading patterns triggered by machines executing thousands of trades per second on signals no person could see.
And then there’s the complexity—not just of volume or velocity, but of interdependence. A single trade today touches dozens of systems and parties: from alpha research and portfolio rebalancing, through pre-trade risk and compliance engines, exchange order books, trade capture, clearing houses and settlement engines, out to regulatory reporting, reconciliation tools and the firm’s total exposure updates. Each system speaks its own language, maintains its own version of truth, and operates on its own schedule. When something doesn’t reconcile, the problem isn’t just technical anymore—it’s confidence. Trust in the numbers slowly erodes, decisions take longer, and people stop relying on the systems that were meant to give them an edge.
We’re not done yet. Then came the disruptions—the migration to cloud infrastructure, the democratization of machine learning, the recent explosion of generative AI—each one fundamentally reshaping what’s possible and what’s expected, often reshuffling the cards of market leaders in each domain. Regulatory requirements multiplied, adding layers of reporting, compliance, and risk management that would have been unthinkable two decades ago. And the talent needed to navigate all of this became scarce and expensive—data scientists, cloud architects, quants and ML specialists—roles that barely existed in finance fifteen years ago are now critical, costly, and often set up to fail by the very systems they are meant to modernize.
And then there’s the data explosion itself. Traditional market data and company fundamentals—the bedrock of investment analysis for decades—are no longer enough. The competitive edge today comes from connecting dots across entirely new data sources. Satellite imagery tracking retail parking lots to predict quarterly sales. Credit card transactions revealing consumer spending shifts before they appear in earnings. Social media sentiment anticipating product launches or reputational crises. Supply chain data exposing bottlenecks or exposure risks weeks before they hit the market. Web scraped data capturing real-time pricing dynamics across thousands of e-commerce sites. The alternative data market has exploded from virtually nothing a decade ago to a multi-billion dollar industry, with hundreds of vendors and thousands of datasets that arrive in every format imaginable—each with its own quality quirks, delivery schedules, licensing constraints, and integration headaches. The firms that can transform this chaos into reliable intelligence gain an edge.
In this environment, everything—the speed, the scale, the operational precision, the ability to adapt when markets shift—rests on a foundation that must be built deliberately. And that foundation isn’t only technology. It’s the overall strategy and the organization behind it. Its test is whether people trust the outcome when the pressure is on. A stale price feed, a misclassified security, an unhedged market disruption—any of these can be fatal. Algorithms don’t pause for reconciliation. Markets don’t wait while you sort out your foundation.
And here’s what I’ve come to understand: this isn’t a finance problem. Healthcare networks coordinating patient care across hospital systems face the same challenge. So do logistics companies routing millions of packages, energy grids balancing supply and demand in real-time, municipal agencies coordinating emergency response, regional banks assessing credit risk, and specialty manufacturers tracking quality across global supply chains. The scale varies. The stakes are equally real. Get the foundation right, and something else becomes possible: teams can experiment, build new capabilities, discover opportunities that were invisible before. Get it wrong, and you’re fighting fires while your competitors pull ahead.
This data foundation isn’t a byproduct of doing business or a side-project before getting back to the “real work.” No one builds a skyscraper and treats the foundation as an afterthought—it’s the first thing you get right, the thing you invest in before anything else can stand. The same applies here. Data foundation requires explicit strategy, dedicated leadership, and execution discipline—a first-class organizational capability. It demands commitment at the highest levels of the firm, and a deliberate structure to turn that commitment into organizational DNA.
Scale offers no protection. Geography provides no sanctuary. The most dangerous threats come from angles you’re not monitoring, from competitors building capabilities you haven’t identified yet. The only ground you control is the ground you’ve built. You’re already at war.