rajansaini (u/rajansaini)

rajansaini commented on RoboCat – A Self-Improving Robotic Agent deepmind.com/blog/robocat... · Posted by u/l1n

itissid · 2 years ago

I mean I am not blind, there are plenty of no code platforms that work on B2B space. But nothing in the B2C for general purpose domain that do this in a privacy safe manner, at least not one that will shake up the tech companies.

rajansaini · 2 years ago

A successor to OpenLLaMA could make this possible. Imagine being able to deploy your own LLM.

rajansaini commented on The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT thesequence.substack.com/... · Posted by u/gardenfelder

EGreg · 2 years ago

I am shocked that it speaks the way it does when it was trained on random stuff it doesn’t have rights to.

They say they trained it on databases they had bought access to etc. And it seems that way.

Because how does ChatGPT:

1. Do what you ask instead of continuing your instructions?

2. Use such nice and helpful language as opposed to just random average of what people say?

3. And most of all — how does it have a structure where it helpfully restates things, summarizes things, warns you against doing dangerous stuff… no way is it just continuing the most probable random Internet text!!

rajansaini · 2 years ago

Read the InstructGPT paper and see alpaca. You just need instruction fine-tuning.

Unlike what the other commenters are saying, RLHF, while powerful, isn't the only way to get an LLM to follow instructions.

rajansaini commented on Show HN: Kuboble.com – Minimalistic sliding pieces puzzle game kuboble.com... · Posted by u/kuboble

MrDrDr · 3 years ago

This is very good - got me spending more time playing than I intended to and I will definitely share - well done. Maybe consider the wordle - one game a day/ share your score with your friends on social media approach - so your users stay hungry and don't waste too much time playing it!

rajansaini · 3 years ago

Seconded! If you make it easy/fun to share I (personally) would totally do so :)

rajansaini commented on Turning nuclear waste into diamond batteries thebrighterside.news/post... · Posted by u/rmason

rajansaini · 3 years ago

Could it be useful to use these to charge long term batteries to be used millennia from now? So that future generations living centuries from now can have easy power when the fossil fuels run out?

rajansaini commented on Ask HN: Which book can attract anyone towards your field of study? · Posted by u/debanjan16

rajansaini · 3 years ago

I am surprised that Algorithms to Live By has not been mentioned. (Disclaimer: I am still reading it.) That book is both accessible and practical for any layman. However, just enough hints at variations of the discussed algorithms are given that even a non-technical reader might be motivated to dive further into theoretical CS and read a paper or two.

rajansaini commented on Fakelish – Fake English word generator fakelish.nwtgck.org/... · Posted by u/lioeters

mrbukkake · 4 years ago

Nice idea, naive implementation which leads to the output being unconvincing as hypothetical English words. I had a brief look and it seems to be proportionally selecting and sticking together sequences of letters sampled from English words (lib/word-probability.ts). This doesn't take into account syllable boundaries, the way the English spelling system maps between phones/phonemes and the phonotactic properties of English which is why the output looks unconvincing.

A better approach would be to use a markov chain built from sampling English text letter-by letter... an even better approach would be to build your stats from some source of English words in IPA transcription with syllable boundaries etc marked, then map from IPA to spelling via some kind of lookup table. We use a similar process in reverse in my research group for building datasets for doing Bayesian phylogenies of language families

rajansaini · 4 years ago

You should check out the VOLT paper, I think it would work well. It's a new technique for splitting up a vocabulary into subwords while minimizing entropy. These subwords could then be mixed and matched, maybe by a neural model, for better results.

rajansaini commented on Ask HN: Looking for a book on algorithms and data structures · Posted by u/OulaX

rajansaini · 4 years ago

I'm only a student, but I personally really liked https://jeffe.cs.illinois.edu/teaching/algorithms/

This is better for more advanced topics, like dynamic programming (well, advanced for me, anyway). I started out taking over an hour to solve the first problem in the problem sets, but they build on each other slowly, so I was soon able to see solutions within minutes. It took me a weekend to go through chapters I was struggling with, and I did really well on my coding interview the next day.