Readit Newssfkgtbor commented on GPT-4.5 or GPT-5 being tested on LMSYS? rentry.co/GPT2... · Posted by u/atemerev
*Assuming you don't mean mathematically prove.*
I can't test the bot right now, because it seems to have been hugged to death. But there's quite a lot of simple tests LLMs fail. Basically anything where the answer is both precise/discrete and unlikely to be directly in its training set. There's lots of examples in this [1] post, which oddly enough ended up flagged. In fact this guy [2] is offering $10k to anybody that create a prompt to get an LLM to solve a simple replacement problem he's found they fail at.
They also tend to be incapable of playing even basic level chess, in spite of there being undoubtedly millions of pages of material on the topic in their training base. If you do play, take the game out of theory ASAP (1. a3!? 2. a4!!) such that the bot can't just recite 30 moves of the ruy lopez or whatever.
[1] - https://news.ycombinator.com/item?id=39959589
[2] - https://twitter.com/VictorTaelin/status/1776677635491344744
Multiple people found prompts to make LLM solve the problem, and the $10k has been awarded: https://twitter.com/VictorTaelin/status/1777049193489572064
I really like seeing references to the Culture series when naming things:
sfkgtbor commented on Using load shedding to avoid overload aws.amazon.com/builders-l... · Posted by u/kristianpaul
I think the blog post about load shedding by Netflix has some good examples.
"Keeping Netflix Reliable Using Prioritized Load Shedding" https://netflixtechblog.com/keeping-netflix-reliable-using-p...
sfkgtbor commented on Real-world data show that filters clean Covid-causing virus from air nature.com/articles/d4158... · Posted by u/bruceb
In the same way that people are dumbfounded that natural immunity from having it is superior than the vaccine.
It’s as if we all forgot how viruses work.
In terms of safety, vaccines are much better then getting COVID.
One of the big factors of "better protection" of immunity gained after recovering from the virus is survivor bias. In data about mortality after reinfection there are no people who died after getting it for the 1st time. This leaves only ones who had body strong enough to recover.
There's no surprise that later that group fares better.
Personally I use it for labeling physical things - mainly boxes. With a corresponding note in my Obsidian vault it really helps with getting content, context, and history about random stuff in my basement.
Python oneliner for generating them I've aliased in my Bash config: python3 -c "import base64; import secrets; print(''.join(secrets.choice(base64._b32alphabet.decode()) for _ in range(4)))"