It’s not trading anything, in which case the above still wouldn’t be true. It’s just answering financial questions, so if it hallucinates and tells you Tesla isn’t a public company 40% of the time then what’s the point? I’m using a very simple example here, I’m sure the model makes more intricate mistakes.

Sometimes, they release them the day before but you're right here. They actually link the published paper in the article and I missed it: https://arxiv.org/abs/2303.17564