(Incidentally, its clear this book doesnt make this mistake, already identifying that NN is basically kNN).
Rather ML algorithms are just rememberings of data coupled with various degrees of compression, with kNN having zero compression -- just a straight weights=data; and NNs having fairly significant levels, where weights=ensemble(compressions(data)).
We should therefore regard the ML step as incredibly trivial, it is just a clever process of averaging over the data given to it. The whole "magic" of ML, such as it is, is *only* in the data. And this is where the word "data" hamstrings our ability to see properly.
Everything *isnt* data; and "data" isnt some source of information. The world exists, and "data" is just what we call any measurement of any part of it by any means. "Data" is only *relevant* to the probelm we're trying to solve if we do incredible amounts of experimental work to carve-the-world along its joints, ie., to have the right concepts; and incredible amounts of work to measure along its joints, ie., to have the right units. *And then* to eliminate all the coincidences and irrelevances. *And then* to provide that to a machine, which at this point, does basically nothing but automate our effort.
Almost all data it is possible to collect is useless, indeed, an infinite amounts is useless. The magic of ML is a sleight-of-hand trick -- we dont really need to know how its averaging of our data does anything useful -- it almost never does.
Rather, it is our "experimental design" which produces the usefulness of the system. ML algorithms are just interpolations and averages through data prepared to produce useful averages by (literally millenia) of human ingenuity.
It takes actual intelligence to do this because the world isnt data, and almost any measurement one cares to make (with eyes, even) produces endless ambiguities and coincidences that you have to "be in the world" to resolve; and resolution is a dynamic process which you "have to be here for".
Sounds like a magic view of the mind to me.
It's suspicious that this is never said about the function of Liver or Kidneys, only about the function of the Brain.
Maybe the brain is protecting itself, like if you ask a cow about steaks.
The best feature of Remarkable 2 is how quiet it is, it doesn't do anything except for Book reading and note taking.
No notifications, no messaging, no email, quiet tech.
I mean, that's pretty much it and he states it up front. If that's the crux, then why write about this other than to brag?