Readit News logoReadit News
aryamaan commented on Study mode   openai.com/index/chatgpt-... · Posted by u/meetpateltech
aryamaan · 7 months ago
It is surprising that it is prompt based model and not RLHF.

I am not an LLM guy but as far as I understand, RLHF did a good job converting a base model into a chat model (instruct based), a chat/base model into a thinking model.

Both of these examples are about the nature of the response, and the content they use to fill the response. There are so many differnt ways still pending to see how these can be filled.

Generating an answer step by step and letting users dive into those steps is one of the ways, and RLHF (or the similar things which are used) seems a good fit for it.

Prompting feels like a temporary solution for it like how "think step by step" was first seen in prompts.

Also, doing RLHF/ post training to change these structures also make it moat/ and expensive. Only the AI labs can do it

aryamaan commented on Ask HN: Am I old?    · Posted by u/zwilderrr
aryamaan · 9 months ago
It is like hearing about manual cars.
aryamaan commented on Trying to teach in the age of the AI homework machine   solarshades.club/p/dispat... · Posted by u/notarobot123
plantwallshoe · 10 months ago
A mix of feeling I’m “missing” some CS concepts and just general intellectual curiosity.

I am planning on doing a masters but I need some undergrad CS credits to be a qualified candidate. I don’t think I’m going to do the whole undergrad.

Overall my experience has been positive. I’ve really enjoyed Discrete Math and coming to understand how I’ve been using set theory without really understanding it for years. I’m really looking forward to my classes on assembly/computer architecture, operating systems, and networks. They did make me take CS 101-102 as prereqs which was a total waste of time and money, but I think those are the only two mandatory classes with no value to me.

aryamaan · 10 months ago
as I am also thinking mildly about doing masters cause I want to break into ai research, I am curious what your motivations are, if you would be open to share those.
aryamaan commented on Why Cline doesn't index your codebase   cline.bot/blog/why-cline-... · Posted by u/intrepidsoldier
nick-baumann · 10 months ago
Fair point Jeff -- you're right that we're still doing retrieval. The key distinction is how we retrieve.

Traditional RAG for code uses vector embeddings and similarity search. We use filesystem traversal and AST parsing - following imports, tracing dependencies, reading files in logical order. It's retrieval guided by code structure rather than semantic similarity.

I highly recommend checking out what the Claude Code team discovered (48:00 https://youtu.be/zDmW5hJPsvQ?si=wdGyiBGqmo4YHjrn&t=2880). They initially experimented with RAG using embeddings but found that giving the agent filesystem tools to explore code naturally delivered significantly better results.

From our experience, vector similarity often retrieves fragments that mention the right keywords but miss the actual implementation logic. Following code structure retrieves the files a developer would actually need to understand the problem.

So yes -- I should have been clearer about the terminology. It's not "no retrieval" -- it's structured retrieval vs similarity-based retrieval. And with today's frontier models having massive context windows and sophisticated reasoning capabilities, they're perfectly designed to build understanding by exploring code the way developers do, rather than needing pre-digested embeddings.

aryamaan · 10 months ago
Hi, nick, given that this product is opensourced, I have a request/ wish:

It would be wondeful if some of the tools the projects uses are exposed to build on. Like the tools related to AST, finding definitions, and many more

aryamaan commented on Show HN: ReadToMe (iOS) turns paper books into audio   readtome-app.com... · Posted by u/kolchinski
aryamaan · 2 years ago
If you don’t mind me asking what do you use TTS?
aryamaan commented on How I got an O-1 visa as a software engineer   blog.awais.io/o1-visa/... · Posted by u/ahussain
kelnos · 2 years ago
I'm not sure I'd agree it's a fluke. Someone I worked with at a previous company did something very similar to this, and I recall reading an account on HN a couple years back about someone who did it using different criteria than OP, but still in a way that surprised me.
aryamaan · 2 years ago
Can’t find that blogpost or link anymore. I was along the lines of how I hacked usa visa system
aryamaan commented on Three senior researchers have resigned from OpenAI    · Posted by u/convexstrictly
thekoma · 2 years ago
One funny detail is that the OpenAI charter states that, if this happens, they will stop their own work and help the organisation that is closest to achieving OpenAI's stated goal.
aryamaan · 2 years ago
really?
aryamaan commented on Opal Tadpole – A webcam for laptops   opalcamera.com/opal-tadpo... · Posted by u/jnthn
jasonjmcghee · 2 years ago
Anyone with an iPhone + Mac, just get a MagSafe iphone webcam mount https://www.belkin.com/iphone-mount-with-magsafe-for-mac-not...

Your iPhone is crazy powerful with a beautiful picture- if you want to look great during meetings, use it.

No wires- just works

aryamaan · 2 years ago
Nice, I want to use one with my monitor so that my face is facing the screen I am looking at
aryamaan commented on We have decided to pause driverless operations across all of our fleets   twitter.com/Cruise/status... · Posted by u/ra7
lopkeny12ko · 2 years ago
What I find interesting is that this "press release" reads like a response to an exposé of a toxic internal company culture. But as far as I can tell, this was just a technology failure. It's not very clear to me why they need to "examine their processes" and "take a hard look inwards at how they do work" in order to rectify what was basically a software bug.
aryamaan · 2 years ago
what bugs are we talking about?
aryamaan commented on Show HN: Guess The Movie – Discover a secret Movie everyday   guess-the-movie-one.verce... · Posted by u/csamuelssm
aryamaan · 2 years ago
Same feeling. It does not take you towards the answer. So I added the first movie in the today's game (say Spiderman) and the answer was spiderman 2. When I entered Spiderman, it should have told how close I am to the answer
aryamaan · 2 years ago
I liked the part that rather than taking some english phrase, it takes the movie name as the answer. Helps with the prompt injection.

u/aryamaan

KarmaCake day374January 13, 2015View Original