Excellent writing style
Readit Newsrawrmaan commented on You're holding your AI wrong cdibona.substack.com/p/yo... · Posted by u/mooreds
rawrmaan commented on Releasing 3B and 7B RedPajama together.xyz/blog/redpaja... · Posted by u/antimatter15
I'd suggest reading the recently leaked Google memo for some context about why open source LLMs are important (and are disruptive from the perspective of a large company). It gives a good insight into why closed source models like GPT-4 might be overtaken by open source even if they can't directly compete at the moment.
Typical reasons are highly specialised models that are cheap and fast to train, lack of censorship, lack of API and usage restrictions, lightweight variants and so on. The reason there's a lot of excitement right now is indeed how fast the space is moving.
https://www.semianalysis.com/p/google-we-have-no-moat-and-ne...
This was great. The timeline was the perfect catch-up I needed. Thank you!
rawrmaan commented on Releasing 3B and 7B RedPajama together.xyz/blog/redpaja... · Posted by u/antimatter15
The bit I liked best was the response examples. Look at those. Clearly not as good as GPT-4 but good enough I feel that for say a scenario where you care about privacy or data provenance this would be a contender.
For example a therapist, a search bot for you diary, a company intranet help bot. Anything where the prompt contains something you don’t want to send to a third party.
That's a great point, I definitely overlooked these. They look pretty good, too, and I agree with your use cases.
Thanks!
rawrmaan commented on Releasing 3B and 7B RedPajama together.xyz/blog/redpaja... · Posted by u/antimatter15
Oh I definitely agree that there are multiple levels of AI research that are valuable. Huge supporter of open source, and not meaning to talk down to anyone working on AI projects.
It's just that at the moment I'm finding the open source LLM community hard to contextualize from an outside perspective. Maybe it's because things are moving so fast (probably a good thing).
I just know that personally, I'm not going to be exploring any projects until I know they're near or exceeding GPT-4 performance level. And it's hard to develop an interest in anything else other than GPT-4 when comparison is so tough to begin with.
rawrmaan commented on Releasing 3B and 7B RedPajama together.xyz/blog/redpaja... · Posted by u/antimatter15
There was a lot of detail and data in here, but it's not very useful to me because all of the comparisons are to things I have no experience with.
There's really only one thing I care about: How does this compare to GPT-4?
I have no use for models that aren't at that level. Even though this almost definitely isn't at that level, it's hard to know how close or far it is from the data presented.
I confess deep ignorance, here, but: Why would miners go along with this switch, given it's going to eliminate their profits? Why wouldn't they just fork the chain and continue to run a PoW version? What would force people to switch to the new PoS version?
There will be forks, but only the PoS one will have stablecoins with actual backing (e.g. any value at all): https://decrypt.co/107094/circle-will-not-support-ethereum-p...
rawrmaan commented on Apple announces 27-inch 5K Studio Display apple.com/studio-display/... · Posted by u/sparshgupta
No 12Hz is so unfortunate. Hopefully the next Pro Display XDR will have ProMotion, at the very least.
I may get accused of UI nostalgia, but I'm always shocked that the simple UX of winamp is not found on any modern media player (at least none I've found in 2021, on MacOS).
I just want to:
* Go to desktop and select one of more folders full of music.
* Right-click -> Play, or drag into the player. Either add or replace to existing file set.
* Select or de-select shuffle
That's it. Why is this so hard??
Doesn't VLC do this?
https://bsky.app/profile/rawrmaan.com