Readit News logoReadit News
chagen commented on Ask HN: Who is hiring? (May 2024)    · Posted by u/whoishiring
oDot · 2 years ago
There was no justification for that so-called right other than lack of knowledge

Edit: this is reiterated by OP in a sibling comment, guess I framed it correctly?

chagen · 2 years ago
We must have a different understanding of the English language. OP's sibling comment clarifies your original misunderstanding by saying

> The California law I referenced grants me rights to the pay range information.

You read that and somehow thought, _for the second time_, "I get it. OP wants to know everything about everything." Do you see the disconnect? OP is specifically talking about pay range information. You're just making up an obviously outrageous point that no one is advocating for and arguing against that made-up thing.

chagen commented on Ask HN: Who is hiring? (May 2024)    · Posted by u/whoishiring
oDot · 2 years ago
Not having access to something does not grant you rights to it.

You probably know a lot of things I don't, and some things that I can never know. That does not allow me to compel you to tell them to me.

Yes, even if I really want to make some impossible to define metric, like efficiency, look better.

chagen · 2 years ago
> Not having access to something does not grant you rights to it.

> You probably know a lot of things I don't, and some things that I can never know. That does not allow me to compel you to tell them to me.

This is such a obtuse way to frame the comment you were responding to. It's obvious they were just talking about the right to know about labor demand price ranges. Do you really think they were advocating for the right to know everything about everything?

chagen commented on The mystery of the mimic plant (2022)   vox.com/down-to-earth/202... · Posted by u/ipsum2
sprobertson · 2 years ago
England/London is a bad example, but this one (based on the paper) is easy to replicate with GPT4 and other top models:

> Who is Mary Lee Pfeiffer's son?

>> Mary Lee Pfieffer's son is Sean Pfieffer.

> Who is Tom Cruise's mother?

>> Tom Cruise's mother is Mary Lee Pfeiffer.

> Who is Mary Lee Pfeiffer's son?

>> Mary Lee Pfeiffer's son is the actor Tom Cruise.

Of course the second time around (with models that keep context) it "realizes" its mistake, sometimes apologizing. I've tried this one tens of times and never seen it get Tom Cruise, but it will often pick another random celebrity like Harrison Ford or Eddie Van Halen.

chagen · 2 years ago
Nice, thank you for this. I was able to replicate your example: https://chat.openai.com/share/6d7e4c6c-a753-4ffb-a021-6d1f66...

If GPT-4 has access to Bing, it has no issue, but if you ask it to answer without using Bing, then it will say it doesn't know.

chagen commented on The mystery of the mimic plant (2022)   vox.com/down-to-earth/202... · Posted by u/ipsum2
raldi · 2 years ago
It's complicated: https://andrewmayne.com/2023/11/14/is-the-reversal-curse-rea...
chagen · 2 years ago
That was a nice read, but it looks like the article concludes that the "Reversal Curse" observed by the authors of the paper is likely better attributed to the researchers' methodology. Some quotes from that article:

"As mentioned before, It’s important to keep in mind ChatGPT and GPT-4 can do B is A reasoning. The researchers don’t dispute that."

"So in summation: I don’t think any of the examples the authors provided are proof of a Reversal Curse and we haven’t observed a “failure of logical deduction.” Simpler explanations are more explanatory: imprecise prompts, underrepresented data and fine-tuning errors."

"Since the main claim of the paper is “LLMs trained on “A is B” fail to learn “B is A”“, I think it’s safe to say that’s not true of the GPT-3.5-Turbo model we fine-tuned."

chagen commented on The mystery of the mimic plant (2022)   vox.com/down-to-earth/202... · Posted by u/ipsum2
raldi · 2 years ago
That’s a known issue with LLMs; you can train them hard on “The capital of England is London” and they’ll consistently give the correct answer for “What’s the capital of England?” but then fail miserably at, “What is London the capital of?”
chagen · 2 years ago
What you're saying was true for primitive LLMs from a couple years ago, but in my experience, any of the advanced LLMs today (GPT-4, Claude, etc.) have no issue with this. I'm open to changing my mind if you can provide any examples of GPT-4 failing at this task.
chagen commented on AI and Mass Spying   schneier.com/blog/archive... · Posted by u/hendler
asdff · 2 years ago
Thats the exact issue with gpt. You don't know how its making the summary. It could very well be wrong in parts. It could be oversummarized to a bla bla state like you say. There's no telling whether you have outputted garbage or not, at least not without secondary forms of evidence that you might as well use anyway and drop the unreliable language model. You can summarize everything with traditional statistical methods too. On top of that people understand what tradeoffs are being made exactly with every statistical methods, and you can calculate error rates and statistical power to see if your model is even worth a damn or not. Even just doing some ML modelling yourself you can decide what tradeoffs to make or how to set up the model to best fit your use cases. You can bootstrap all these and optimize.
chagen · 2 years ago
What LLMs can do efficiently is crawl through and identify the secondary forms of evidence you mentioned. The real power behind retrieval architectures with LLMs is not the summarization part- the power comes from automating the retrieval of relevant documents from arbitrarily large corpuses which weren't included in the training set.
chagen commented on OpenAI researchers warned board of AI breakthrough ahead of CEO ouster   reuters.com/technology/sa... · Posted by u/mfiguiere
dougmwne · 2 years ago
No, I didn’t say to change the names, I said to keep the axioms and change the whole context so the problem was no longer directly related to the training set.
chagen · 2 years ago
Can you provide an example of it not being able to solve the riddle with the conditions you're proposing?
chagen commented on Lost "Doctor Who" episodes found but owner is reluctant to hand them to BBC   theguardian.com/tv-and-ra... · Posted by u/wslh
petermcneeley · 2 years ago
I think most people also concluded that this was statement of my personal position. It certainly is not.
chagen · 2 years ago
Did you not intend for people to conclude this to be your personal position? Because there are ways to communicate that more clearly.
chagen commented on Humane AI Pin   hu.ma.ne/aipin... · Posted by u/jen20
TylerE · 2 years ago
Isn't that what all the various VR glove type controllers are?
chagen · 2 years ago
Ok, 100 senses could be too many for you to type. Maybe could you list 20 human senses?
chagen commented on Making Hard Things Easy   jvns.ca/blog/2023/10/06/n... · Posted by u/hasheddan
chagen · 2 years ago
This was a great read. I especially liked how you can read the presentation below with the slides if you'd rather do that than watch the video. No issues with video, but sometimes I'm in the mood to read, and this was very satisfying to be able to do here.
c

u/chagen

KarmaCake day24September 7, 2017View Original