Readit News logoReadit News
acegod commented on François Chollet: The Arc Prize and How We Get to AGI [video]   youtube.com/watch?v=5QcCe... · Posted by u/sandslash
abeppu · 2 months ago
I think you're basically saying that ARC-AGI doesn't achieve a goal that _it didn't set_. The point of ARC-AGI is not to benchmark LLMs specifically. The point is to measure fluid intelligence in a way which supports comparisons between models and between models and humans. It's not the obligation of the test to be tailored to the form of model that's most popular now.
acegod · 2 months ago
Right, that's exactly what I'm saying.

>The point is to measure fluid intelligence in a way which supports comparisons between models and between models and humans. It's not the obligation of the test to be tailored to the form of model that's most popular now.

The problem is that the test may not be giving an accurate comparison because the test is problematic when used to assess LLMs, which are the kind of model that people are most interested in assessing for general capabilities.

Dead Comment

acegod commented on Speed matters (2021)   scattered-thoughts.net/wr... · Posted by u/mefengl
acegod · 6 months ago
I agree with this article, however I think it misses the most valuable aspect of speed: compounded returns on experience.

Experience isn't 1:1 with time spent. It's easy to spend a lot of time on something but learn very little. Conversely, its possible to gain a large amount of experience in a short period of time.

By being able to develop faster, you become able to accumulate more experience in a smaller amount of time. This experience then enables you to develop faster, kicking off a virtuous cycle of growth.

Following this thought provides clarity on what action you should take immediately: do anything as long as its something. Through doing something, you will become more experienced and that experience will enable you to do something else even faster.

This is why you end up with so many aphorism in the industry promoting rapid action over inaction:

- Move fast and break things

- Worse is better

- Fail fast

- Hacker mentality

- "Action oriented"

See also: https://danluu.com/productivity-velocity/ and https://patrickcollison.com/fast

u/acegod

KarmaCake day4February 20, 2025View Original