Readit News logoReadit News
castigatio commented on LLM Inevitabilism   tomrenner.com/posts/llm-i... · Posted by u/SwoopsFromAbove
kevindamm · 2 months ago
Slight correction, we have many tools that are demonstrably better and more consistent than LLMs for their intended task; LLMs are just the most generally applicable tool (and the fumes are heady).
castigatio · 2 months ago
I agree about the value of general application. I do think though that we just don't have the tools to do many things LLM's can do - searching information in a nuanced way and getting nuanced responses is one thing.
castigatio commented on LLM Inevitabilism   tomrenner.com/posts/llm-i... · Posted by u/SwoopsFromAbove
lwelyk · 2 months ago
What tasks is it better at doing than other technologies we have available to us? I'm not being sarcastic, I generally want to know in which areas you think it is better.

I can't think of anything off the top of my head that isn't just doing the things that make it a generative AI. (It's better at generating an image that I describe to it, etc, but that's not something that another technology does.)

castigatio · 2 months ago
Google search + LLM based search is far more effective than Google search alone. Google's stated mission has been to organize the world's information. Being able to ask a far more nuanced question about the kind of information you are looking for - and getting mostly useful responses - is more useful. Just one example among many. Simple natural language interaction with computer systems is huge. Just look at what LLM's are doing for robotics.
castigatio commented on LLM Inevitabilism   tomrenner.com/posts/llm-i... · Posted by u/SwoopsFromAbove
castigatio · 2 months ago
The argument doesn't work because whatever you think of where generative AI is taking us or not taking us - it is 100% demonstrably better at doing a wide range of tasks than other technologies we have available to us - even in its current exact form. Once computers started to be connected could we have stopped the development of the world wide web. If there's a way of getting humanity to collectively agree on things - please let's start by using it to stop climate change and create world peace before moving on to getting rid of LLM's.
castigatio commented on The Anthropic Economic Index   anthropic.com/news/the-an... · Posted by u/meetpateltech
brap · 7 months ago
Seems like Anthropic has too much money on their hands and are looking for ways to spend it. It’s surprising to see lean AI startups accumulate fat so quickly. Usually this sort of wheel spinning is reserved for large corporations.

And it’s not just them. To me this trend screams “valuations are too high”, and maybe hints at “progress might start to stagnate soon”.

castigatio · 7 months ago
We live in a world where there's a lot of talk about how AI might impact societies and economies - but little actual data. To me it seems very worthwhile to try to add 'any' data to that discussion and track how things change over time. Are reports of economic or labour trends pointless? Should companies not track how people use their products? I don't think it costs Anthropic much to do this - it's work for a couple of people to analyze their database.
castigatio commented on Personality Basins   near.blog/personality-bas... · Posted by u/qouteall
castigatio · 9 months ago
C'mon folks. So many "expert opinions" and erudite references in these comments. The sciences of cognition, neurology, evolutionary psychology etc are all still muddling around trying to figure out how the human mind works. We're learning a lot about possible ways the mind might work from our observations of processes and outcomes of machine learning. It's a cool new paradigm to add to the mix. I really like the framing offered by the author. They're quite upfront about the fact that there's a lot of genetics involved. That all models are wrong but some are useful.

Why all the defensiveness? Whatever genetic aspects of our personalities and behaviours there are - there's still a pretty big component of just learning patterns. Language acquisition is like that. It's an innate thing but the languages we're exposed to as kids shape what patterns of language use we fall into.

castigatio commented on Two undersea cables in Baltic Sea disrupted   cnn.com/2024/11/18/europe... · Posted by u/mooreds
ajuc · 9 months ago
Yeah and if you shoot someone and they die it might be an unrelated heart attack.
castigatio · 9 months ago
Do you not understand probability? Or are you just suffering from confirmation bias?
castigatio commented on Two undersea cables in Baltic Sea disrupted   cnn.com/2024/11/18/europe... · Posted by u/mooreds
Etheryte · 9 months ago
This is a misleading framing. The two cables last year were not taken out by an anchor as an accident, it was literally a ship putting down its anchor just before the cable and then dragging it over the cable. In other words, sabotage. There's no point in trying to color any of this with rose tinted glasses when it's clear who's done it and why.
castigatio · 9 months ago
But this person is just speaking the truth - I worked for an ISP with cable landing stations. These cables went down several times a year due to physical damage of non nefarious kinds. It's not obvious that this malicious. It certainly might be but it's not a slam dunk.
castigatio commented on LLMs don't do formal reasoning   garymarcus.substack.com/p... · Posted by u/LgLasagnaModel
bartread · a year ago
This trope of proclaiming some critical flaw in the functioning of LLMs with the implication that they therefore should not be used is getting boring.

LLMs are far from perfect but they can be a very useful tool that, used well, can add significant value in spite of their flaws. Large numbers of people and businesses are extracting huge value from the use of LLMs every single day. Some people are building what will become wildly successful businesses around LLM technology.

Yet in the face of this we still see a population of naysayers who appear intent on rubbishing LLMs at any cost. To me that seems like a pretty bad faith dialogue.

I’m aware that a lot of the positive rhetoric, particularly early on after the first public release of ChatGPT was overstated - sometimes heavily so - but taking one set of shitty arguments and rhetoric and responding to it with polar opposite, but equally shitty, arguments and rhetoric for the most part only serves to double the quantity of shitty arguments and rhetoric (and, adding insult to injury, often does so in the name of “balance”).

castigatio · a year ago
Well said.

I can understand the incentive for researchers to make provocative claims about the abilities or disabilities of LLM's at a moment in time when there's a lot of attention, money and froth circling a new technology.

I'm a little more stumped on the incentive for people (especially in tech?) to have strong negative opinions about the capabilities of LLM's. It's as if folks feel the need to hold some imaginary line around the sanctity of "true reasoning".

I'd love to see someone rigorously test human intelligence with the same kinds of approaches. You'd end up finding that humans in fact suck at reasoning, hallucinate frequently and show all kind of erratic behaviour in our processing of information. Yet somehow - we find other humans incredibly useful in our day to day lives.

Deleted Comment

castigatio commented on AGI is far from inevitable   ru.nl/en/research/researc... · Posted by u/mpweiher
BobaFloutist · a year ago
So you don't see the value in differentiating between (valuable) manure, (human) wastewater (which can be tested for public health), stool samples, the concept of bullshit, scatting, guano, pet feces, diarrhea, etc? You think those should be all the same word?

What a narrow worldview.

castigatio · a year ago
It was a silly example - though not intended as serious. I agree - the distinctions you describe are useful. So what about the utility of increasingly granular description of oppression? Can you point me to the utility of these?

The people creating new generative AI models are inventing new words. I think their topic of research and the new words they are creating have high utility.

The authors of this paper on the other hand appear to me to not be applying discipline and rigour to solving hard problems. They are however trying to associate the words they have created in a discipline with little objective utility - with the words of a discipline that has high utility.

This strikes me as annoying and absurd. Why try to make the crossover unless you are trying to catch some shine off of a discipline that is getting a lot of well-justified attention?

I'm still waiting for Ilya to publish his first paper on gender studies..

u/castigatio

KarmaCake day105May 21, 2023View Original