Readit News logoReadit News
8jy89hui commented on Show HN: Finetune LLaMA-7B on commodity GPUs using your own text   github.com/lxe/simple-lla... · Posted by u/lxe
callesgg · 2 years ago
Now, use this library to "bootstrapp the smarts of LLaMA from its own smartness" like this:

1. Ask it things. Let it answer.

2. Ask it to find errors in the answer it outputted and for it to correct the answer.

3. Use the original prompt and the corrected output as training data.

This should, with each iteration make the model less and less likely to output statements that are self contradictions or obviously wrong, until the model can no longer spot its own faults.

8jy89hui · 2 years ago
You should try using a larger model like llama-35b or even GPT-3 for the feedback. That way you might be able to condense knowledge from these really big models into a smaller model
8jy89hui commented on America’s banks are missing hundreds of billions of dollars   economist.com/finance-and... · Posted by u/pseudolus
8jy89hui · 2 years ago
Not a great summary of the article. It just barely touches on reverse repo lending which is the core of the linked article.
8jy89hui commented on $22B project to provide 8% of UK energy via undersea cable from North Africa   e360.yale.edu/features/af... · Posted by u/consumer451
8jy89hui · 2 years ago
This sounds like the output of a LLM. No actual reasoning or thought.
8jy89hui commented on TurboTax is blitzing Congress for the right to tax YOU   pluralistic.net/2023/02/2... · Posted by u/danuker
ramesh31 · 3 years ago
If unicorns were real and rainbows were made by leprechauns, and congress passed a flat tax, I'd be all for dumping TurboTax. But as it stands, they provide a pretty decent value to me. With 1099s, W2s, capital gains, multiple state returns, and god knows what else to account for, I seriously cannot imagine having to fill out my own tax forms. Plus they really do have (and have had consistently for years) some of the best UX of any product I've ever used. I don't mind paying those peoples' salaries.
8jy89hui · 3 years ago
As stated multiple times in the article, making taxes easier for the average person does not stop people with complicated taxes from getting help.

My taxes are simple; my family’s taxes are simple; most of my friends taxes are simple. We don’t need Inutit making our taxes more complicated than they need to be. I’d rather have free simple filing be done with my government. I don’t need Intuit getting between me and my government. And if I ever have really complicated taxes, I’m sure TurboTax will still exist.

8jy89hui commented on AMD CEO Says It's Limiting Supply of CPUs and GPUs to Maintain High Prices   extremetech.com/computing... · Posted by u/chazeon
Qem · 3 years ago
Hope RISC-V is broadly adopted eventually, so we get rid of this lame x86 duopoly.
8jy89hui · 3 years ago
Every time I see AMD in the news I hope to hear that they’ve invested in a RISC-V cpu. I would love a real desktop or professional class RISC-V chip made by an American company.
8jy89hui commented on Datadog's commitment to OpenTelemetry and the open source community   datadoghq.com/blog/datado... · Posted by u/ecliptik
8jy89hui · 3 years ago
This article is most likely in response to “DataDog asked OpenTelemetry contributor to kill pull request” [1]. Though it fails to make a real apology or explain their actions.

[1]: https://news.ycombinator.com/item?id=34540419

8jy89hui commented on Ask HN: What Next After Ubuntu?    · Posted by u/voakbasda
gaganyaan · 3 years ago
I'm liking NixOS thus far. I've got it installed on my personal laptop. It's got some rough edges, but the benefits for me outweigh the downsides. I really like affordances like "nix-shell -p foo" to just run a shell with the "foo" command in it for one-off usages, instead of slowly accumulating installed apt packages that I forgot why I installed them.

Similarly, having any custom configuration inside of "configuration.nix" is way nicer to use than manually editing /etc/whatever.conf. I can have one place to store any custom hacks, with a nice comment as to why + git history.

8jy89hui · 3 years ago
> It's got some rough edges

I've recently been looking really hard at NixOS as a possible next-step. (I use Manjaro and am particularly interested in ways to keep my Laptop and Desktop in sync)

I've heard that the documentation can be pretty lackluster at times. Are there any other rough edges I should know about?

8jy89hui commented on Noise2Music: Generating Music from Text Using Diffusion Models   noise2music.github.io/... · Posted by u/georgehill
8jy89hui · 3 years ago
On my phone (iOS) I can’t seem to get any of the samples to play.
8jy89hui commented on Rust Books Grouped by Level   github.com/sger/RustBooks... · Posted by u/GTP
justaj · 3 years ago
It seems that all of these books assume some prior programming experience.
8jy89hui · 3 years ago
Rust feels like a really hard first-language. I can’t imagine recommending Rust to an excited upcoming programmer.
8jy89hui commented on CamelCase vs. underscores revisited (2013)   whatheco.de/2013/02/16/ca... · Posted by u/aloukissas
stevula · 3 years ago
I do prefer snakecase visually but having to press shift for the underscore is a pain and it’s also quite far from the home row on the keyboard.

I wonder if a lot of people rebind the underscore character to a more convenient key?

8jy89hui · 3 years ago
I bound _ to capslock + u. It is very convenient for both hands.

u/8jy89hui

KarmaCake day287April 15, 2020View Original