From 35% to 85%: How Speculative Money Quietly Conquered the Oil Futures Market#

In the first week of May 2026, managed money net long positions in crude oil futures dropped thirty-five per cent — the steepest weekly decline in over a year, according to the CFTC’s Commitments of Traders report. Thirty-five per cent. One week. No refinery blew up. No war started or stopped. The UAE announced it was leaving OPEC, and several hundred fund managers in New York, London, and Greenwich simultaneously recalculated whether holding oil futures was still worth the trouble. Reuters tracked the unwinding in near real-time: net speculative length in WTI fell to the lowest level since early 2024, reflecting what the wire service called “deep uncertainty about future supply dynamics.”

That a geopolitical announcement about production quotas could trigger a capital exit of that speed and scale tells you something fundamental about the oil market today. The participants who move prices the hardest aren’t the ones producing oil or consuming it. They’re the ones trading it — on paper, for financial return, with zero intention of ever touching a barrel.

But how big, exactly, is this speculative presence? And how did it grow large enough to dominate a market that was originally built to serve physical hedgers?

Both questions lead to a dataset the CFTC was pressured into publishing in late 2008 — data that, once properly read, reveals something the agency had spent years pushing back against: speculative capital hadn’t become a marginal force in oil futures markets. It had become the dominant one.

The Old Meter#

To see why the growth in speculative interest hid in plain sight for so long, you need to understand the classification system that did the hiding.

Since the 1960s, the CFTC and its predecessor had sorted futures market participants into two buckets: “commercial” and “non-commercial.” The idea was simple, at least on paper. Commercial participants were the ones with a legitimate hedging stake in the physical commodity — oil producers, refineries, airlines, shipping companies. Non-commercial participants were everyone else: speculators, hedge funds, floor traders.

Under this two-bucket system, the oil futures market looked comfortably stable. Commercial players consistently held around sixty to sixty-five per cent of total open interest. Non-commercial players — the speculators — held the other thirty-five to forty per cent. The ratio had barely budged in years. And it was exactly this ratio the CFTC pointed to, again and again, when batting away claims that speculation was warping oil prices.

The reasoning was clean: if speculators hold only a third of the market, they can’t be the ones calling the shots. Supply and demand — represented by the commercials — must be driving prices. Argument over.

One problem. The meter was broken.

The Misclassified Pipeline#

The flaw in the CFTC’s binary system wasn’t some fine-print technicality. It was structural, and it revolved around one type of player: the swap dealer.

Swap dealers — mainly the big investment banks — sat in a peculiar spot in the commodity futures ecosystem. A pension fund in Sacramento wanting oil exposure wouldn’t normally buy futures contracts itself. Instead, it would enter into an over-the-counter swap with an investment bank. The bank then hedged its swap obligation by buying futures on NYMEX. From the bank’s view, the futures position was a hedge against a financial liability. From the pension fund’s view, the swap was a speculative bet on commodity prices.

Under the CFTC’s rules, the swap dealer’s futures position got tagged as “commercial” — it was hedging a real financial exposure, after all. The fact that the source of that exposure was a speculative play by a pension fund? Irrelevant, for classification purposes. Speculative intent walked in through the front door, but by the time it reached the futures exchange, it was wearing a commercial hedger’s badge.

This wasn’t a rounding error. By 2008, swap dealers were the single largest group in crude oil futures. Their average open interest in the first half of that year hit roughly 948,000 contracts. For context: hedge funds and floor traders combined held around 750,000. The actual commercial participants — producers, refiners, and merchants who physically handled oil — held substantially less than either.

The bucket the CFTC labelled “commercial” was being run by participants whose activity was, in economic reality, speculative.

Recalibrating the Meter#

In September 2008, under heavy political pressure — fuelled partly by the hearings we looked at in Chapter 3.1 — the CFTC started publishing a new, disaggregated version of its Commitments of Traders report. For the first time, swap dealers got their own category, separate from both traditional commercial hedgers and non-commercial speculators.

The results landed like a shockwave.

Under the old binary system, the market had looked roughly two-thirds commercial, one-third speculative. Under the new four-way split — producers/merchants, swap dealers, managed money (hedge funds), and other reportables — the picture flipped entirely.

Pure commercial participants — the companies that actually produced, refined, or burned physical oil — accounted for about fifteen per cent of total open interest. Fifteen per cent. The other eighty-five per cent belonged to participants whose interest in oil was primarily or entirely financial: swap dealers funnelling index fund capital, hedge funds riding momentum, and floor traders playing spreads.

Let me put that number down again, because it deserves to hit with its full force. In the world’s most important commodity futures market, the participants with an actual connection to the physical commodity held roughly one-sixth of all positions. The remaining five-sixths were financial players — people for whom oil was not a raw material or an energy source, but a line on a portfolio statement.

The market the CFTC had been describing as fundamentals-driven was, in fact, financially dominated. The agency hadn’t lied about its data. It had been reading the wrong data.

The Growth Trajectory#

The disaggregated numbers also made it possible, for the first time, to trace how speculative interest had grown over time. The trajectory was staggering.

In 2000, swap dealers were a footnote in crude oil futures. Their positions were small, reflecting the early days of commodity index investing. By 2004, they’d grown meaningfully, propelled by the post-Gorton-Rouwenhorst wave of enthusiasm for commodities as a diversification tool. By 2008, they were the biggest single category — bigger than hedge funds, bigger than commercial hedgers, bigger than anyone else.

The growth wasn’t random. It tracked, with striking precision, the growth of commodity index investing — a topic we’ll dig into in a later chapter. As more pension funds, endowments, and sovereign wealth funds poured money into commodity indices, the investment banks selling them those products had to hedge by buying more futures. Each new allocation meant more capital flowing through the swap dealer pipeline into the futures market. Each new futures position pushed open interest higher. And each bump in open interest nudged the speculative share of the market further from the thirty-five per cent the CFTC had been reporting, toward the eighty-five per cent the disaggregated data would eventually expose.

This wasn’t a sudden flood. It was a steady, compounding drip — each year a little more capital, a few more index products, a few more pension fund allocations — that over the course of a decade rewired the fundamental character of the oil futures market.

What the Numbers Mean#

The eighty-five per cent figure doesn’t, by itself, prove that speculation drove oil prices higher. Correlation isn’t causation, as the CFTC’s defenders never tired of pointing out. In theory, a market can be dominated by financial players and still produce prices that accurately reflect physical supply and demand. Possible — but, as we’ll see in the chapters on bubble pathology, increasingly hard to believe.

What the number does prove, beyond serious dispute, is that the CFTC’s pre-2008 analysis of speculation in oil markets rested on a classification error so basic that every conclusion built on it was unreliable. Every study the agency ran using the old binary data — every reassurance it offered Congress, every time it waved away the speculation hypothesis — was grounded in a meter that couldn’t tell the difference between a pension fund betting on commodity prices and an airline hedging its jet fuel.

This isn’t just a history lesson. As of May 2026, with speculative positions lurching in response to geopolitical shocks — the UAE’s OPEC departure, Iran tensions, the latest Goldman Sachs call — the question of how much speculative capital is sitting in oil markets is as live as ever. The Financial Times noted that the latest weekly plunge in managed money positions was the sharpest in over a year, a reminder that the speculative tide doesn’t just rise — it can reverse with brutal speed. The CFTC now publishes disaggregated data as standard practice. But the core dynamic that the 2008 reclassification laid bare — a market where financial participants vastly outnumber physical ones — hasn’t changed. If anything, the gap has widened.

The pipeline has been measured. Its flow rate is known. The next question is mechanical: how, exactly, does the largest single conduit in this pipeline — the swap dealer channel — actually work?

That’s what the next chapter is about.