The $200 Billion Commodity Paradox: How Diversification Destroyed Itself#

In the first week of May 2026, investors pushed $4.2 billion into broad-based commodity ETFs — a record weekly inflow, triggered by the UAE’s surprise exit from OPEC and a creeping sense that the world was becoming a more dangerous place. Several large pension funds, the Financial Times reported, responded by bumping up their commodity index allocations by two to five percentage points.

None of this would have surprised Gary Gorton. In 2006, Gorton and his co-author K. Geert Rouwenhorst published a paper that became, in the world of institutional investing, something close to gospel. The core finding was elegant and, for portfolio managers, almost impossible to resist: commodity futures had historically delivered equity-like returns with low correlation to stocks and bonds. Add commodities to a diversified portfolio, and you could cut risk without giving up return. The research was rigorous. The data was convincing. The conclusion was ready-made for action.

It was also, as we’ll see, a passport — a document that cleared the way for hundreds of billions of dollars to move from pension funds, endowments, and sovereign wealth funds into a market that was never built to absorb them.

The Two Pillars#

The academic case for commodity investing stood on two legs, and each one deserves a closer look.

The first was diversification. Historical data showed that commodity prices moved on their own track, largely independent of equity and bond markets. When stocks fell, commodities didn’t necessarily fall with them — and sometimes they rose. For a pension fund manager whose deepest fear was correlated losses sweeping across the entire portfolio, this was powerfully attractive. A five or ten per cent commodity allocation could, in theory, smooth out returns, cushion drawdowns, and sharpen the fund’s risk-adjusted performance.

The second was inflation hedging. Commodities are, almost by definition, the physical inputs whose rising prices are inflation. If the cost of oil, wheat, and copper goes up, commodity futures go up with them. A pension fund sitting on long-term liabilities in nominal terms — retirement cheques that have to be written in thirty years, no matter what a dollar is worth by then — had a natural appetite for assets that gained value precisely when inflation was eating away at everything else in the portfolio.

Both arguments were, in their original context, sound. The data was real. The correlations were genuinely low — historically. The inflation hedging properties held up — under certain conditions.

The catch was that both arguments carried a hidden assumption: that the act of investing in commodities wouldn’t itself change the very properties that made commodities attractive in the first place.

The Paradox of Success#

This is the central irony of the “commodities as an asset class” thesis, and it’s worth sitting with for a moment because the dynamic it reveals reaches well beyond oil markets.

The low correlation between commodities and equities was an empirical fact drawn from decades in which commodity markets were run by physical participants — producers and consumers whose motivations were fundamentally different from those of equity investors. A wheat farmer hedging next year’s harvest isn’t reacting to the same signals as a portfolio manager rebalancing a stock portfolio. The farmer’s trades are driven by weather, storage costs, and planting cycles — not by Federal Reserve policy, corporate earnings, or shifts in risk appetite.

But when a pension fund buys commodity futures because of their low correlation with equities, it injects equity-market logic straight into the commodity market. The pension fund’s commodity allocation isn’t driven by the fundamentals of oil supply and demand. It’s driven by the same portfolio construction models, the same risk budgets, and the same institutional decision-making that governs its stock allocation. When equity markets crash and the pension fund has to cut risk across the board, it sells commodities alongside stocks — not because anything has changed in the oil market, but because its risk models say so.

Scale that behaviour across hundreds of institutional investors, and the result is inevitable: the correlation between commodity prices and equity prices rises. The very act of treating commodities as a portfolio diversifier erodes the diversification benefit.

This isn’t a theoretical prediction. It happened. By 2008, the correlation between crude oil futures and the S&P 500 had climbed well above its historical levels. Post-crisis studies confirmed what should have been obvious: when the same investors hold the same assets for the same portfolio-construction reasons, those assets start moving together.

The academic passport was never revoked. But its premises had expired.

The Pressure Source#

For this book’s argument, the “commodities as an asset class” thesis matters not because it was wrong — the academic debate over commodity correlations and returns goes on, and reasonable people disagree — but because it generated the pressure that forced capital through the infiltration pipeline.

Trace the mechanics. A pension fund’s investment committee reads the Gorton-Rouwenhorst paper, consults its asset allocation advisers, and green-lights a five per cent commodity allocation. The fund calls Goldman Sachs, which sells it a total return swap linked to the Goldman Sachs Commodity Index. Goldman’s swap desk hedges by buying futures on NYMEX through its J. Aron subsidiary. The futures position gets classified by the CFTC as “commercial.” No position limits apply.

Every step in this chain is, on its own, rational and legal. The pension fund is diversifying. The bank is hedging. The regulator is applying its rules. But the cumulative effect — repeated across CalPERS, the Government Pension Investment Fund of Japan, the Abu Dhabi Investment Authority, the Harvard endowment, and dozens of others — is a wall of capital slamming into the oil futures market with zero connection to oil supply and demand.

The academic literature supplied the justification. The swap dealers supplied the mechanism. The CFTC’s classification system supplied the regulatory cover. And the oil futures market, designed for a world where the main players were oil companies and airlines, absorbed a flood of institutional money it was structurally unprepared to handle.

Between 2003 and 2008, assets allocated to commodity index strategies ballooned from an estimated $15 billion to over $200 billion. The pressure wasn’t speculative in the classic sense — pension funds weren’t “betting” on oil the way a hedge fund might. They were following a strategic asset allocation model. They were patient, long-only, and methodical. But their capital had exactly the same effect on futures prices as any speculative long position: it pushed prices up.

The academic passport made it respectable. The swap dealer valve made it possible. The scale made it consequential.

And here’s the final, uncomfortable irony: the very institutions whose money helped inflate the shadow oil price were, in many cases, also the ones most damaged by the resulting spike in energy costs. The pension funds of public school teachers were pouring into commodity indices that contributed to higher gasoline prices for those same teachers. The circularity wasn’t poetic. It was structural.

We’ve now mapped the pressure source and the valve. Next, we turn to the returns that commodity index investors actually received — and discover that the infiltration pipeline, having taken their money, gave them remarkably little in return.