For ex: I sent a friend a photo of my puppy in the bathtub and her Airpods (via iphone) announced "(name) sent you a photo of a dog in a bathtub". She thought it was really cool and so do I personally. That's a useful feature. IDK how much that requires going off-device though.
For comparison Hunyuan video encodes a shit-ton of videos and rudimentary real world physics understanding, at very high quality in only 13B parameters. LLAMA 3.3 encodes a good chunk of all the knowledge available to humanity in only 70B parameters. And this is only considering open source models, the closed source one may be even more efficient.
I have a job at a place I love and get more people in my direct network and extended contacting me about work than ever before in my 20 year career.
And finally I keep myself sharp by always making sure I challenge myself creatively. I’m not afraid to delve into areas to understand them that might look “solved” to others. For example I have a CPU-only custom 2D pixel blitter engine I wrote to make 2D games in styles practically impossible with modern GPU-based texture rendering engines, and I recently did 3D in it from scratch as well.
All the while re-evaluating all my assumptions and that of others.
If there’s ever a day where there’s an AI that can do these things, then I’ll gladly retire. But I think that’s generations away at best.
Honestly this fear that there will soon be no need for human programmers stems from people who either themselves don’t understand how LLM’s work, or from people who do that have a business interest convincing others that it’s more than it is as a technology. I say that with confidence.
Proponents often say that this drug is harmless but in some people it's use can trigger psychiatric illnesses esp. schizophrenia and related disorders. In others it can actually exacerbate anxiety (its somewhat counter intuitive, just like some antidepressants can cause suicidal thoughts). Some people are genetically more predisposed to the effects.
This is a personal topic for me because cannabis (ab)use triggered psychotic episodes in two of my close family members, they had to be hospitalized multiple times (psych ward is no joke) and put on antipsychotics (which are also very hard on you and drain the life out of you). Their actions during the psychotic/manic phase disrupted their family and work lives. Both people were unwilling to cease cannabis use, citing its public acceptability and reasons like "it's legal", "you literally can't overdose on it", "a(n) (internet) doctor prescribed it to me for anxiety so I can use it", "everyone uses it and is fine", "xyz (popular celebrity) uses it". After multiple stints in the psych ward and the threat of government mandated treatments they were finally able to drop cannabis use, it then took them many months to come back to normal functioning.
1. The key data point seems to be Figure 6a. Where it compares performance on BABILong and claims Titans performance is at ~62%, as compared to GPT-4o-mini at ~42% for 100k sequence length.
However, GPT-4o and Claude are missing in this comparison - maybe because they perform better ?
2. There is no example provided of the Neural Memory Module in action. This is the first question I would ask of this paper.