Websockets are great for this. Initialize the completion with an id, and store the token stream while emitting as a websocket event. Keep the id in state somewhere on the client (url works great with pushstate). If the client disconnects then just replay the event stream for the id.
Readit Newsbinarymax commented on SSE sucks for transporting LLM tokens zknill.io/posts/sse-sucks... · Posted by u/zknill
binarymax commented on Google de-indexed Bear Blog and I don't know why journal.james-zhan.com/go... · Posted by u/nafnlj
I guess they use this blogging platform: https://bearblog.dev/
Makes sense. Hadn't heard of that platform before but looks really nice.
binarymax commented on Google de-indexed Bear Blog and I don't know why journal.james-zhan.com/go... · Posted by u/nafnlj
binarymax commented on Getting a Gemini API key is an exercise in frustration ankursethi.com/blog/gemin... · Posted by u/speckx
The same billing experience applies to the Google programmable search api. Easy to get a key, but a Byzantine maze to pay for more than the free version.
Deleted Comment
binarymax commented on Microsoft increases Office 365 and Microsoft 365 license prices office365itpros.com/2025/... · Posted by u/taubek
Most people using excel and word would be just as functional using office '98.
SaaS is largely just a cancer on society. Monthly subscription to pay for features you never use and bug fixes you never should have needed.
The only main feature post 98 is that the file format is zipped xml documents. Before that it was proprietary binaries.
binarymax commented on OpenAI declares 'code red' as Google catches up in AI race theverge.com/news/836212/... · Posted by u/goplayoutside
Heard all the news how Gemini 3 is passing everyone on benchmarks, so quickly tested and still find it a far cry from ChatGPT in real world use when testing questions on both platforms. But importantly the ChatGPT app experience at least for iPhone/Mac users is drastically superior vs Google which feels very Google still. So Gemini would have to be drastically better answer wise than ChatGPT to lure users from a better UI/UX experience to Gemini. But glad to see competition since certainly don't want only one winner in this race.
Benchmaxxing galore by lots of teams in this space.
Dead Comment
binarymax commented on Ask HN: What is the purpose of all these AI spam comments? · Posted by u/GaryBluto
My theory is that these bots are tests to eventually have a decent config to gain enough age&karma to have some voting clout. Then the upvotes are used to boost the attackers stories and avoid voting rings.
binarymax commented on Ask HN: What is the purpose of all these AI spam comments? · Posted by u/GaryBluto
If the account is shadowbanned, it's not worth much to a spammer.
Myself, I suspect that it's people trying to tune or test drive their own personal LLMs.
How does voting work with shadowbanned accounts? Selling upvotes on stories is the real game, nobody cares about comments.