It’s remarkable we’ve hit a threshold where so much can be done with synthetic data. The reasoning race seems an utterly solvable problem now (thanks mostly to the verifiability of results). I guess the challenge then becomes non-reasoning domains, where qualitative and truly creative results are desired.
Readit Newswhoistraitor commented on The Illustrated DeepSeek-R1 newsletter.languagemodels... · Posted by u/amrrs
There are only about 400 million native English speakers. You can't just add up the population of English speaking countries, because that excludes immigrants living in these countries, and people born there who did not learn English as their first language.
As for people who learned it later, even in Europe, only about 40% self-identify as being able to speak English. If you visit places like China or Indonesia, you'll soon notice that very few people know more than a few basic words in English once you leave the tourist areas.
IMO first-or-not is moot. It’s estimated that around one billion people speak English to a reasonably fluent level. Included in that is many of the commonwealth countries in which English often holds second spot as a lingua franca (eg. India). It’s an incredibly global language.
Perplexity is listed, but do they actually abide by llms.txt? And how can we prove they do? Is it all good faith? I wish there were a better way.
whoistraitor commented on OpenAI O3 breakthrough high score on ARC-AGI-PUB arcprize.org/blog/oai-o3-... · Posted by u/maurycy
The general message here seems to be that inference-time brute-forcing works as long as you have a good search and evaluation strategy. We’ve seemingly hit a ceiling on the base LLM forward-pass capability so any further wins are going to be in how we juggle multiple inferences to solve the problem space. It feels like a scripting problem now. Which is cool! A fun space for hacker-engineers. Also:
> My mental model for LLMs is that they work as a repository of vector programs. When prompted, they will fetch the program that your prompt maps to and "execute" it on the input at hand. LLMs are a way to store and operationalize millions of useful mini-programs via passive exposure to human-generated content.
I found this such an intriguing way of thinking about it.
whoistraitor commented on Ask HN: SWEs how do you future-proof your career in light of LLMs? · Posted by u/throwaway_43793
If an LLM can give you feedback on a way to proceed it sounds more like you might be the junior? :P
LLMs seems to be ok'ish at solving trivial boilerplate stuff. 20 attempts deep I have not yet seen it able to even remotely solve anything I have been stuck enough on to have to sit down and think hard.
Curious: what kind of problem domain to you work on? I use LLMs every day on pretty hard problems and they are always net positive. But I imagine they’re not well trained on material related to your work if you don’t find them useful.
Became a fan of Mullvad when I visited China. It was the most reliable VPN app I tested and you can have up to 5 devices per account.
It is probably the most reliable yeh, tho spending time here I’ve grown increasingly aware that the great firewall is more than aware of this vpn traffic, even if it’s wrapped up to look like normal traffic. They periodically will seem to ‘dial down’ the internet, especially at politically sensitive times. They are fully aware great swathes of the populace and visitors use VPNs, and they choose to allow it. They’d rather control and monitor than inspire even more opaque channels.
How do you stop agents from prompt injecting each other?
Don’t know what OP might suggest but my first take is: never allow unstructured output from one LLM (or random human) of N privilege as input to another of >N privilege. Eg, use typed tool/function calling abstractions or similar to mediate all interactions to levers of higher privilege.
How is this related?
Ah apologies I misread the architecture. But it does fit the spirit of finding disproportionately higher performance in smaller networks. Still promises of finding smaller sub networks. Running on mediocre mobile devices doesn’t seem a dream when stuff like this is released. Exciting!
Cool! Seems we’re moving closer and closer to realizing the Lottery Ticket Hypothesis https://arxiv.org/abs/1803.03635
Essex accents had travelled well into Hertfordshire by the 1970s. Cockney has evaporated and the condensate largely landed in Essex and Hertfordshire.
Do people really speak Kentish in most of Kent? Or is it a mix of Modern Estuary, MLE (multicultural London English) and RP (received pronunciation)?
I know the author says that the map will always be wrong, I understand that, but this map is badly out of date.