Meta is removing its Messenger apps for Windows and macOS
Readit Newsjuliangamble commented on Messenger Deprecation for Mac facebook.com/help/messeng... · Posted by u/juliangamble
juliangamble commented on Spatial intelligence is AI’s next frontier drfeifei.substack.com/p/f... · Posted by u/mkirchner
From reading that, I'm not quite sure if they have anything figured out.
I actually agree, but her notes are mostly fluff with no real info in there and I do wonder if they have anything figured out besides "collect spatial data" like imagenet.
There are actually a lot of people trying to figure out spatial intelligence, but those groups are usually in neuroscience or computational neuroscience. Here is a summary paper I wrote discussing how the entorhinal cortex, grid cells, and coordinate transformation may be the key: https://arxiv.org/abs/2210.12068 All animals are able to transform coordinates in real time to navigate their world and humans have the most coordinate representations of any known living animal. I believe human level intelligence is knowing when and how to transform these coordinate systems to extract useful information. I wrote this before the huge LLM explosion and I still personally believe it is the path forward.
Thanks for your article. The references section was interesting.
I'll add to the discussion a 2018 Nature letter: "Vector-based navigation using grid-like representations in artificial agents" https://www.nature.com/articles/s41586-018-0102-6
and a 2024 Nature article "Modeling hippocampal spatial cells in rodents navigating in 3D environments" https://www.nature.com/articles/s41598-024-66755-x
And a simulation in Github from 2018 https://github.com/google-deepmind/grid-cells
People have been looking at spacial awareness in neurology for quite a while. (In terms of the timeframe of recent developments in LLMs).
> Anything more complex than a few lines, you can just copy it from lib\ folder of the CD-ROM. There's a component for everything. You want to left-pad a string?
This got me.
I'm really sad the core argument for the Matrix's existence doesn't hold up (it never did, just for me as a kid is all).
They started with a different, more brilliant idea, of using human brains as a giant neural net, then backed away from that:
https://news.ycombinator.com/item?id=12508832
juliangamble commented on GHz spiking neuromorphic photonic chip with in-situ training arxiv.org/abs/2506.14272... · Posted by u/juanviera23
Maybe try simulating the algorithms in software before building hardware? People have been trying to get spiking networks to work for several decades now, with zero success. If it does not work in software, it's not going to work in hardware.
“Zero success” seems a bit strong. People have been able to get 96% accuracy on MINST digits on their local machine.
https://norse.github.io/notebooks/mnist_classifiers.html
I think it may be more accurate to say “1970s level neural net performance”. The evidence suggests it is a nascent field of research.
Dafny and verification-aware programming, including proof by induction to verify properties of programs (for example, that an optimizer preserves semantics). Dafny Sketcher (https://github.com/namin/dafny-sketcher)
Multi-stage programming, a principled approach to writing programs that write programs, and its incarnation in multi-stage relational programming for faster synthesis of programs with holes—with the theoretical insight that a staged interpreter is a compiler, and a staged relational interpreter for a functional language can turn functions into relations running backwards for synthesis. multi-stage miniKanren (https://github.com/namin/staged-miniKanren)
Monte Carlo Tree Search, specifically the VerMCTS variant, and when this exploration-exploitation sweet spot is a good match for synthesis problems. VerMCTS (https://github.com/namin/llm-verified-with-monte-carlo-tree-...), and Holey (https://github.com/namin/holey).