Readit News logoReadit News
czzr commented on Where Is GPT in the Chomsky Hierarchy?   fi-le.net/chomsky/... · Posted by u/fi-le
PaulHoule · 7 days ago
The Chomsky Hierarchy isn't the right way to think about, in fact the Chomsky paradigm probably held back progress in language technology over the past 70 years.

In the Kuhnian sense, Syntactic Structures was the vanguard of a paradigm shift that let linguists do "normal science" in terms of positing a range of problems and writing papers about them. It was also useful in computer science for formally defining computer languages that are close enough to natural languages that people find them usable.

On the other hand, attempts to use the Chomsky theory to develop language technology failed miserably outside of very narrow domains and in the real world Markov models and conditional random fields often outperformed when the function was "understanding", "segmentation", etc.

From an engineering standpoint, the function that tells if a production is in the grammar that is central to the theory is not so interesting for language technology, I mean, if LLMs were -centric then an LLM would go on strike if you got the spelling or grammar wrong or correct you in a schoolmarmish William Safire way but rather it is more useful for LLMs to silently correct for obvious mistakes the same way that real language users do.

The other interesting thing is the mixing of syntax and semantics. For a long time I believed the "Language Instinct" idea of Pinker in which the ability to serialize and deserialize language is a peripheral that is attached to an animal and you need the rest of the animal and even the surrounding world to have "human" competence. Now LLMs come around and manage to show a lot of linguistic competence without the rest of the animal and boy we have egg on our face, and coming out of the shadow of the Chomsky theory, structuralism will rear it's head again. (e.g. "X is structured like a language" got hung up on the unspoken truth that "language is not structured like a language")

czzr · 7 days ago
I don’t think LLMs contradict the Pinker description - it just turns out that the output stream embodies a lot of information, and you can construct a model (of some reasonable fidelity) of the original sources from sufficient examples of the output stream.
czzr commented on Temporary suspension of acceptance of mail to the United States   post.japanpost.jp/int/inf... · Posted by u/Kye
SpicyLemonZest · 4 months ago
It's basic economics in the sense that it's an oversimplified toy model. In the real world, every country I'm aware of gets a substantial amount of its tax revenue from consumption taxes, and indeed the US's lack of VAT means it's currently much more dependent on progressive income taxes than peer countries. (https://www.oecd.org/content/dam/oecd/en/topics/policy-sub-i...)
czzr · 4 months ago
I responded to a comment that called progressive taxation a crazy “far left” idea - I’m not sure the second and third order details of taxation policy are really relevant here…

But ok - yes, sure, in real life it’s a mix and the mix is worth debating. Note also that consumption taxes often have exemptions/reductions to offset the most severe regressive effects.

czzr commented on Temporary suspension of acceptance of mail to the United States   post.japanpost.jp/int/inf... · Posted by u/Kye
georgeplusplus · 4 months ago
It’s disingenuous to consider one’s total income when weighing the fairness of a tax like sales tax. The thought that a sales tax is somehow benefiting one group over the other is ridiculous far left extreme thinking.

You pay for a service and that service has a rate. To think that the only good kind of taxation are those that are progressive is the dumbest thing I ever heard.

czzr · 4 months ago
It’s very, very basic economics - the marginal utility of money decreases, so progressive taxation is better than regressive taxation.
czzr commented on EPA Moves to Cancel $7B in Grants for Solar Energy   nytimes.com/2025/08/05/cl... · Posted by u/Jimmc414
tim333 · 5 months ago
I'm of the view climate change is real but not as big a deal as some people make out. A couple of reasons:

- Solar power has been growing exponentially for years and will continue for a while allowing carbon usage to be phased out and maybe carbon capture done.

- The climate has changed naturally more than most people realise and life goes on. The sea is forecast to rise 60cm or so over this century but has risen ~120m over the last 20k years which was hardly noticed. (graph from wikipedia https://upload.wikimedia.org/wikipedia/commons/1/1d/Post-Gla...)

czzr · 5 months ago
On point 2 - notice how flat your graph is for the last 6k years?

Also, why do you think the impact of past changes on a tiny group of humans living as hunter gatherers is of any relevance to 8 billion people living in the modern world (including, for example, in massive coastal cities?)

czzr commented on EPA Moves to Cancel $7B in Grants for Solar Energy   nytimes.com/2025/08/05/cl... · Posted by u/Jimmc414
toastercat · 5 months ago
Can someone in this thread please give me a good steelman that humans don't have a significant affect on climate change? This seems to be a growing sentiment among friends who I regard as intelligent, but goes against what I've believed to be the scientific consensus for years. I'm willing to admit I've been misled or wrong.
czzr · 5 months ago
Of course humans have a significant effect on climate change - the steelman versions of why that doesn’t matter are: 1) It doesn’t matter because we will figure out some technological solution in the future. Or 2) it doesn’t matter since I personally will be ok (because I am rich and/or live in a rich country that can afford to pay the costs)
czzr commented on Sperm are very different from all other cells   bbc.com/future/article/20... · Posted by u/viewtransform
madaxe_again · 6 months ago
I suppose it’s a question of perspective.

The best sperm will likely result in the next generation of sperm also being good.

We look at the human as the organism, the sperm as the gamete - but perhaps our logic is anthropocentric - perhaps the sperm is the organism, and we are just the ridiculously elaborate reproductive mechanism.

czzr · 6 months ago
We are (for genes, though, not sperm)
czzr commented on Changes since congestion pricing started in New York   nytimes.com/interactive/2... · Posted by u/Vinnl
listenallyall · 7 months ago
When you write it out like that, it seems to make total sense! But then you read grant proposals that get funded - in things like the social sciences and humanities, and even conventional science and health - millions of dollars essentially just throwing darts to see what sticks.
czzr · 7 months ago
Surely you see the difference between working in a development environment and working in production?
czzr commented on The Decline of the U.S. Machine-Tool Industry and Prospects for Recovery (1994)   rand.org/pubs/research_br... · Posted by u/walterbell
NoMoreNicksLeft · 9 months ago
We've been coasting on advances made many decades ago. Most developed, sure. Successful? By nearly any metric you can imagine or make up. Strongest? Our economy is eaten hollow by termites. A stiff wind would make it crumble. Worse, there doesn't appear to be any path to true recovery... we can't create the jobs that people need to prosper, but if we could somehow do that we no longer create the people who would grow up to fill those jobs. What industry is it exactly that you think the United States dominates in 2025? What vital, 21st century technology do we have a monopoly on, or at least some undeniable marketshare of? Do we build boats or planes or cars? Do we make computer chips or garments or appliances? Our only saving grace might be that we're self-sufficient agriculturally, without that we'd probably already have starved.
czzr · 9 months ago
The US is the second largest manufacturer in the world - it's just moved into high end manufacturing. One of the difficult things about the current situation is how confidently wrong people are about the basic facts of the US economy.

https://en.wikipedia.org/wiki/Manufacturing_in_the_United_St...

czzr commented on The Decline of the U.S. Machine-Tool Industry and Prospects for Recovery (1994)   rand.org/pubs/research_br... · Posted by u/walterbell
NoMoreNicksLeft · 9 months ago
Rich in what, exactly? Inflated stock prices? Inflated home prices? Empty processed-food calories? Are we the richest in recently-built public infrastructure or intellectual property (or both!!)? Maybe we're the richest in collateralized debt obligations?

No one in the United States feels rich, when we look around, we don't see wealth or prosperity. We suspect, though we'd feel silly to say it out loud, that if anyone ever busted into Fort Knox and looked in the vaults, those would be empty of the gold that it was once famous for.

>What's the US supposed to look like after this purge?

I imagine we'll look like what we really have been for a long while, instead of this illusion that everyone has of us.

czzr · 9 months ago
America is the richest country in the world. Guess you won’t know how good you have it until you destroy it.
czzr commented on US Administration announces 34% tariffs on China, 20% on EU   bbc.com/news/live/c1dr7vy... · Posted by u/belter
simne · 9 months ago
US formally don't have VAT, when most other developed countries have.

As I know, US states few decades spent on talks about implement VAT, but have not achieved agreement yet.

For equivalent, most US states have trade tax, could be returned with set of rules. So, on some abstract level it could be considered as far equivalent of VAT, which is also could be returned with set of rules.

czzr · 9 months ago
VAT has nothing to do with this.

u/czzr

KarmaCake day1174October 7, 2018View Original