Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Time-Series Models Show Near-Chance Stock Forecasting Accuracy

AI summary

In a benchmark reported by one author, TimesFM 3.0, Chronos-2 and Toto 2.0 were tested zero-shot on 24 large US stocks and ETFs using daily and intraday data. Next-day directional accuracy ranged from 49.9% to 51.1%, compared with 52.2% for an always-up baseline. The models achieved approximately the same accuracy on actual stock prices and simulated random walks. In one stock-or-cash strategy with 0.05% transaction costs per switch, model strategies ended with $10,893 to $12,181, below buy-and-hold at $15,036. The author said the experiment covered one strategy and was not an exhaustive evaluation of trading profitability.

In-depth insight

The reported results provide setup-specific evidence that these time-series foundation models did not beat simple baselines in the tested financial-forecasting tasks.

I may be naive, but I've been curious whether the recent wave of time-series foundation models can actually extract useful predictive signals from financial markets. Models like Google's TimesFM 3.0, Amazon's Chronos-2, and Datadog's Toto 2.0 are impressive general-purpose forecasters from the first sight. But stock prices are difficult to predict, so I wanted to see how these models perform against very simple baselines. I ran a series of zero-shot experiments on 24 US stocks and ETFs, including daily and intraday data, and compared their predictions against naive forecasting strategies and also simulated random walks. TL;DR none of the three models showed any meaningful predictive power for stock price movements in this setup. Code is here Experimental setup i used: I also evaluated the models on hourly and 5-minute price bars. https://preview.redd.it/npb9z5o67t0i1.png?width=596&format=png&auto=webp&s=d49f50fabc0a67d3297277a372dc418419b02a47 Directional accuracy is essentially a coin flip Across the three models, next-day directional accuracy ranged from 49.9% to 51.1%. Simply predicting that the market would go up every day achieved 52.2% (yep). Even more interestingly, when I fed the models simulated random walks, which contain no exploitable predictive signal at all by construction, they achieved approximately the same directional accuracy as on actual stock prices. I also tested a simple long-or-cash: hold a stock when the model predicts an increase, otherwise stay in cash. Starting with $10,000 and accounting for 0.05% transaction costs per switch: Obviously, this is just one simple strategy and not an exhaustive evaluation of trading profitability. But still, tells something I guess. I repeated the experiments using hourly and 5-minute bars. The results were similar: directional accuracy remained around chance level, and on 5-minute data, a simple one-line mean-reversion heuristic performed better. The repo with code is here: https://github.com/moneyheap/tsfm-stocks Well, I really wanted this to work, but, duh %) submitted by /u/AdelSexy [link] [comments]

#TimesFM 3.0#Chronos-2#Toto 2.0

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.