epups (u/epups) - Readit News

epups commented on OpenAI, Google and Anthropic are struggling to build more advanced AI bloomberg.com/news/articl... · Posted by u/lukebennett

hatefulmoron · 10 months ago

I'm curious, what was the leap after GPT-4? What about the leaps after that, given a leap every 6 months?

epups · 10 months ago

Some important landmarks since GPT4 was first released (not in chronological order):

- Vast cost reduction (>10x)

- Performance parity of several open source models to GPT4, including some with far fewer parameters

- Much better performance, much larger context window in state-of-the-art closed source LLMs (Claude 3.5 Sonnet)

- Multimodality (audio and vision)

- Prototypes for semi-autonomous agents and chain-of-thought architectures showing promising avenues for progress

Dead Comment

epups commented on X says it is closing operations in Brazil due to judge's content orders reuters.com/technology/x-... · Posted by u/hexage1814

vintermann · a year ago

Well, one of the people calling out this insanity is Glenn Greenwald. How can he be "the far right in Brazil", when his reporting on Lava Jato is one of the main reasons Lula is not in jail any longer?

epups · a year ago

Greenwald is an odd one, I'll give you that. He seems to see this issue from a libertarian perspective. He would also say that Germany banning Nazi speech is censorship, for example. It's worth nothing that his last professional occupation was being a stooge in a far right show.

epups commented on X says it is closing operations in Brazil due to judge's content orders reuters.com/technology/x-... · Posted by u/hexage1814

SpicyLemonZest · a year ago

How do you know that they’re similar? As the source article describes, the court has not published the orders they’re asking Twitter to enforce, and they don’t seem to be available at all to the public.

epups · a year ago

A huge chunk of them were made public: https://apnews.com/article/brazil-twitter-elon-musk-x-censor...

To the people disagreeing with my parent statement, could you find one non far right affiliated legal scholar who would say those orders are illegal?

epups commented on X says it is closing operations in Brazil due to judge's content orders reuters.com/technology/x-... · Posted by u/hexage1814

hexage1814 · a year ago

Brazil is essentially living under a judicial dictatorship for the last 5 years or so. The media and press have been looking the other way (as well as actively helping in the persecution) because they didn't like the people being persecuted, so they were fine with the whole thing.

epups · a year ago

This is what the far right in Brazil wants you to believe, but it's not true. It's especially not true in regards to X, as they have repeatedly ignored judicial decisions that are very similar to those by European courts (ie, remove illegal content).

epups commented on RLHF is just barely RL twitter.com/karpathy/stat... · Posted by u/tosh

epups · a year ago

This is partially the reason why we see LLM's "plateauing" in the benchmarks. For the lmsys Arena, for example, LLM's are simply judged on whether the user liked the answer or not. Truth is a secondary part of that process, as are many other things that perhaps humans are not very good at evaluating. There is a limit to the capacity and value of having LLM's chase RLHF as a reward function. As Karpathy says here, we could even argue that it is counter productive to build a system based on human opinion, especially if we want the system to surpass us.

epups commented on The Resurrection of Intel Will Take More Than Three Days nextplatform.com/2024/08/... · Posted by u/rbanffy

epups · a year ago

Intel seems 100% tied to its outcomes as a foundry now. If there is any disruption in chip prodution from Taiwan for example, I can see its stock doubling in price.

epups commented on Large Enough mistral.ai/news/mistral-l... · Posted by u/davidbarker

epups · a year ago

The graphs seem to indicate their model trades blows with Llama 3.1 405B, which has more than 3x the number of tokens and (presumably) a much bigger compute budget. It's kind of baffling if this is confirmed.

Apparently Llama 3.1 relied on artificial data, would be very curious about the type of data that Mistral uses.

epups commented on Is Steve Ballmer the Most Underrated CEO of the 21st Century? blog.jovono.com/p/ballmer... · Posted by u/ejz

epups · a year ago

This article is borderline comical. The thin list of his accomplishments focus on increasing revenue ($15B to $70B) and launching or acquiring successful initiatives (Xbox, Skype, Azure). Then the rest is a recollection of his biggest embarassments, like terrible mobile products, misguided Windows strategy and trailing AWS by 7 years.

Reporting on business issues is always muddled by a lack of proper comparisons, along with cherry picking. For example, this article makes the argument that increasing Microsoft's revenue by 4x was very impressive, even though the stock value stagnated. However, when evaluting his tenure as owner of a basketball club, he is declared successful because its value doubled. The problem is that Microsoft was eclipsed compared to its peers at the time - Google, Amazon, etc. -, and likewise the average basketball club doubled in value as well.

epups commented on I am starting an AI+Education company twitter.com/karpathy/stat... · Posted by u/bilsbie

epups · a year ago

It seems that this would compete with Khan Academy for a similar space. Perhaps Karpathy will aim for adults instead?

u/epups

KarmaCake day1404July 5, 2022View Original