So whatever fragment of a model it gains through learning to compress that causal chain of events does not mean much when it cannot generate the actual causal chain.
Neither is animal brain. It's processing the signals produced by the sensors. Once the world model is programmed/auto-built in the brain, it doesn't matter if it's sensing real photons, it just has input pins like a transistor or arguments of a function. As long as we provide the arguments, it doesn't matter how those arguments are produced. LLMs are not different in that aspect.
> nor generating thoughts
They do during the chain-of-thought process. Generally there's no incentive to let an LLM keep mulling over a topic as that is not useful to the humans and they make money only when their gears start turning in response to a question sent by a human. But that doesn't mean that LLM doesn't have capability to do that.
> Its "world model" is several degrees removed from the real world.
Just because animal brain has tools called sensors that it can get data from world without external stimuli, it doesn't mean that it's any closer to the world than an LLM. It's still getting ultra processed signals to feed to its own programming. Similarly, LLMs do interact with real world through tools as agent.
> So whatever fragment of a model it gains through learning to compress that causal chain of events does not mean much when it cannot generate the actual causal chain.
Again, a person who has gone blind, still has the world model created by the sight. This person can also no longer generate the chain of events that led to creation of that sight model. It still doesn't mean that this person's world model has become inferior.
Think:
* CNAME pointing to an S3 bucket, and the S3 bucket gets released
* CNAME pointing to Azure Website/WebApp Instance
* A record to an non-elastic IP, and the box gets rebooted
* DNS name using a Route53 name server that no longer part of the org's AWS account
* CNAME pointing to a Heroku/Shopify/GitHub pages account and the account gets deleted/deactivated freely up those names for registration
* MX record pointing to old transaction email provider start up that dies, and someone else registers that domain name...
Why does that happen?
* Decentralization of IT means people spinning up infrastructure not knowing what they are doing
* Great a spinning up infra, but when decomissioning they forget about DNS
* Lots of subsidiaries, lots of brands, different groups, operating in different geographies. All this makes it difficult to discover and enforce proper policies
* Geo-specific websites/apps (Think of all the country-specific websites Coke runs)
* Using some 3rd party vendor and never telling security about it (Marketing spinning up some landing pages on some fly-by-night martech provider or wordpress host, and never turning them off)
I am the Field CTO at a venture backed Israeli cyber security company in this space. I was literally talking to a major computer part company yesterday about the dozen or so Indonesian gambling websites that are "running" on their domain names using their pagerank and links. This is a weekly conversation
DEF CON 32 - Secrets & Shadows: Leveraging Big Data for Vulnerability Discovery - Bill Demirkapi
if you only messed up 5% of your hires you'd be a goddamn genius and every company in the world would want to put you in charge of their hiring process
the "standard" is more like 20% of hires end up being bad hires
What am I missing? What should an old fart who's becoming convinced things were better in the old days put myself infront of?
Monster (Chasing a serial killer)
Ergo Proxy (Can't describe it)
Samurai 7 (Sci-fi variant off 7 samurai)
Last Exile (Post appocapltic world with lots of flying machines)
Kino's Journey
Mushishi
Time of Eve
Gargantia
Baccano
Durarara
Psycho Pass
Arslan Senki
Sunaboju (Desert Punk)
Witch Hunter Robin
Hunter x Hunter (old not new)
Texnolyze
Darker than Black
Black Lagoon
Great Teach Onizuka (One of the old and best)
Gintama (Comedy, It's at the level One Piece and Naruto disgusing as Comedy, you have to get past 30 episodes)
Kabaneri of Iron Fortress (Just for animation quality)
Beck (Music career)
Golden Kamui
Terror in Resonance
Ping Pong Animation (Don't let the animation fool you, it's one of the best stories)
Area 88 (Story ends abruptly, watch at your own risk)
Ashita no Joe (Old anime, boxing genre)
Valkyria Chronicles (War story)
Scissor Seven (Comedy, Chinese, assassin, in a strange world)
Shura no Toki (Martial arts, 3 generations)
A Record of Mortal's Journey to Immortality (Chinese cultivation genre, 3D good animation, faithful adaptation of one of the good novels in this genre)
Swallowed Star (Chinese cultivation genre Sci-fi variant, great 3D animation)