knotthebest (u/knotthebest)

knotthebest commented on Terence Tao on O1 mathstodon.xyz/@tao/11313... · Posted by u/dselsam

nybsjytm · a year ago

Daniel Litt, an algebraic geometer on twitter, said "Pretty impressed by o1-preview! Still not having much luck asking it to do any interesting math but it seems much more reliable with simple things; I can actually imagine it being a net time-saver at this point with some non-mathematical tasks."

Any other takes by mathematicians out there?

knotthebest · a year ago

Do note that Terry has access to the full o1. o1-preview is, well, a preview.

knotthebest commented on AI solves International Math Olympiad problems at silver medal level deepmind.google/discover/... · Posted by u/ocfnash

sebzim4500 · a year ago

Ok but if you read the actual solutions they aren't a bizarre mess of brute force.

They look like what a human would write if they were trying to come up with a formal proof (albeit it does some steps in a weird order).

knotthebest · a year ago

They are, though. I spoke to an author just yesterday. They did mostly use brute-force.

knotthebest commented on AI solves International Math Olympiad problems at silver medal level deepmind.google/discover/... · Posted by u/ocfnash

lupire · a year ago

Improved parallelization. More cost in less time.

This is Nvidia's main area of research now.

knotthebest · a year ago

Still, very marginal improvements. There is also Amdahl’s Law which limits the speed gains of parallelisation.

knotthebest commented on AI solves International Math Olympiad problems at silver medal level deepmind.google/discover/... · Posted by u/ocfnash

Davidzheng · a year ago

I can tell you that as someone who could have gotten bronze (i was too weak for the team) and is now a math phd--I would not have scored as well as alphaproof in three days most likely. In most problems either you find an idea soon or it can be much much longer. It's just not a matter of working and constant progress.

knotthebest · a year ago

Skill issue tbh

knotthebest commented on Google AI recommends adding Elmer's glue to pizza cheese after scanning Reddit old.reddit.com/r/Pizza/co... · Posted by u/LeoPanthera

rowanG077 · 2 years ago

I'm simply applying "We use this test to measure intelligence in humans what does this AI do.". We have a priori here that it measures intelligence, before the AI existed. Now the AI scores high on this measurement. There is nothing else but t conclude the AI is intelligent.

knotthebest · 2 years ago

You’re not understanding the tests. They were designed for humans. They were also designed to be taken once. LLMs have been trained on these tests numerous times. LLMs are also not humans. We can’t conceivably compare the two

knotthebest commented on Google AI recommends adding Elmer's glue to pizza cheese after scanning Reddit old.reddit.com/r/Pizza/co... · Posted by u/LeoPanthera

rowanG077 · 2 years ago

That's a pretty rich statement considering they perform pretty good at tests which we have designed to measure intelligence. I don't see how you can say there is no intelligence.

knotthebest · 2 years ago

Well, they were trained on those tests. What LLMs literally do is map inputs to outputs. That’s why they can’t do much outside of training data.

knotthebest commented on Scaling will never get us to AGI garymarcus.substack.com/p... · Posted by u/isaacfrond

karmakaze · 2 years ago

My take would be that AGI is inevitable, and it's your choice if you want to be a part of making it (or deadend branches along the way) or not. I take Ray Kurzweil's predicted timeline as being the most sensible.

knotthebest · 2 years ago

I just don’t think Ray Kurzweil understands these systems well enough. His views aren’t of much substance anymore.

knotthebest commented on Symbolica hopes to head off the AI arms race by betting on symbolic models techcrunch.com/2024/04/09... · Posted by u/goldenzun

goldenzun · 2 years ago

Has there been any significant progress on symbolic models in a way thats pushed the needle in any way?

knotthebest · 2 years ago

Nothing particularly interesting to my knowledge. You should read this though, some people at Symbolica AI worked on it too: https://www.google.com/url?q=https://arxiv.org/abs/2402.1533...

knotthebest commented on Is the Sun Conscious? (2021) [pdf] sheldrake.org/files/pdfs/... · Posted by u/bookofjoe

cess11 · 2 years ago

There's still a lot to figure out but we can phenomenologically and cognitively grasp the structures of consciousness by the use of drugs and modern science, which leaves very little room for the remnants of christian dualism, whether as 'the hard problem', 'panpsychism' or the trans-/consubstantiation of the eucharist.

Maybe there is a demon in my head giving me the illusion of reality being perceived as a projection on the cerebral cortex, and it's reliable malleability under caffeine, MDMA, LSD, cannabis and so on. If so, I find this model of better utility than going with vibes and prayer and belief in eternity and so on that comes with the descendants of christian dualism in liberalism, 'panpsychism', analytic philosophy, &c.

Edit: Kierkegaard wrote quite interesting texts about the structures of consciousness, I'd recommend The Sickness unto Death as a start. It has some of his best jokes.

knotthebest · 2 years ago

I’m not sure how this would solve the hard problem. Could you please elaborate on that?

knotthebest commented on GPT-5 might arrive this summer as a "materially better" update to ChatGPT arstechnica.com/informati... · Posted by u/cannibalXxx

nextworddev · 2 years ago

Q* was most likely a distraction device from the board saga

knotthebest · 2 years ago

My guess too