I made a tool for this! It's an essay writing platform that tracks the edits and keystrokes rather than the final output, so its AI detection accuracy is _much_ higher than other tools:
https://collie.ink/
Readit Newsenjeyw commented on Implications of AI to schools twitter.com/karpathy/stat... · Posted by u/bilsbie
enjeyw commented on Neuroscientists track the neural activity underlying an “aha” quantamagazine.org/how-yo... · Posted by u/wjb3
I've been exploring this concept in LLMs for the last week or so, to see if I can RL train one into being inherently curious.
I haven't got any beyond my own working notes and some basic plots, but I've unceremoniously dumped them into a document here incase anyone else finds them interesting. If so I'd _love_ to chat with you. enjeyw @ google's email provder.
https://thealephengine.substack.com/p/67e3786f-8e84-41bd-888...
> "As a leader, you’ll often find yourself in the position of mediating between groups with differing mandates."
Unifying a team in a singular direction is both the simplest way to ensure success and the most delicate part of managing any project with more than 1 other person involved.
Yeah, I've often found that getting everyone pulling in the same direction is much more important than what the direction actually is.
If lots of smart people have thought about something and still disagree on the correct approach, pick one and move one.
enjeyw commented on The maths you need to start understanding LLMs gilesthomas.com/2025/09/m... · Posted by u/gpjt
Apologies for the metacomment, but HN is a funny place. There is a certain type of learning that is deemed good ('math for AI') and a certain type of learning that is deemed bad ('leetcode for AI').
I mean I kind of get it - overgeneralising (and projecting my own feelings), but I think HN favours introducing and discussing foundational concepts over things that are closer to memorising/wrote-learning. I think AI Math vs Leetcode broadly fits into that category.
enjeyw commented on CDC officials’ resignation emails insidemedicine.substack.c... · Posted by u/Anon84
You don't say.
My bad; Missed the sarcasm!
enjeyw commented on CDC officials’ resignation emails insidemedicine.substack.c... · Posted by u/Anon84
enjeyw commented on CDC officials’ resignation emails insidemedicine.substack.c... · Posted by u/Anon84
The good news, at least, is that next week there's a chance we'll finally get to the bottom of the whole autism thing! https://www.pbs.org/newshour/politics/watch-trump-claims-we-...
Seriously. If you voted for this, you owe civilization a debt that you will probably never be wealthy enough or long-lived enough to repay.
I have no reasonable theory as to how Trump/RFK will be able to reveal credible information about Autism that wasn’t already available from public research papers.
enjeyw commented on Beyond Meat headed to Chapter 11 bankruptcy thestreet.com/restaurants... · Posted by u/delichon
About 10 years ago I became more aware that reducing my consumption of meat was good for the world. The was good for Beyond Meat’s prospects.
About 5 years ago I became more aware that reducing my consumption of ultra processed food was good for me. This was very bad for Beyond Meat’s prospects.
I suspect this experience generalizes.
The vast majority of tokens in a sequence will be irrelevant to an attention mechanism outside of a very small window. Right now however we tend to either keep all cache values forever, or dump them all once they hit a certain age.
My theory is that you can train model to look at the key vectors and from that information alone work out how long to keep a the token in the cache for. Results so far look promising and it’s easy to add after the fact without retraining the core model itself.