Readit NewsAlso, this announcement has wiped out any plans of buying tech products this year, plus a holiday to the US and Canada later in the year. Good thing too, as the entire globe is probably staring down the barrel of a recession.
If not is supabase the most painless way to get started?
Thanks for the great work and bringing some much needed sanity in the node.js tooling space!
Qwen 2.5 32B on openrouter is $0.16/million output tokens. At your 16 tokens per second, 1 million tokens is 17 continuous hours of output.
Openrouter will charge you 16 cents for that.
I think you may want to reevaluate which is the real budget choice here
Edit: elaborating, that extra 16GB ram on the Mac to hold the Qwen model costs $400, or equivalently 1770 days of continuous output. All assuming electricity is free
Also, macOS devices are not very good inference solutions. They are just believed to be by diehards.
I don't think Digits will perform well either.
If NVIDIA wanted you to have good performance on a budget, it would ship NVLink on the 5090.
And we know why they won't ship NVLink anymore on prosumer GPUs: they control almost the entire segment and why give more away for free? Good for the company and investors, bad for us consumers.
That said, enthusiasts do help drive a lot of the improvements to the tech stack so if they start using this, it’ll entrench NVIDIA even more.
Surely a smaller market than gamers or datacenters for sure.
You're right, I could probably finish my motorcycle build projects without videos. But why??