Thanks for sharing. Have you prodded the model with various inputs and written an article that show various output examples? I'd love to get an idea of what sort of "end product" 4x4090s is capable of producing.
Readit Newsanonytrary commented on All You Need Is 4x 4090 GPUs to Train Your Own Model sabareesh.com/posts/llm-r... · Posted by u/sabareesh
anonytrary commented on That's not an abstraction, that's a layer of indirection fhur.me/posts/2024/thats-... · Posted by u/fagnerbrack
I'm not sure what it's called (abstraction vs. indirection) but I dislike when everything needs a class/object with some odd combination of curried functions. Some programming languages force this on you more than others I think? As a contrived example "StringManager.SlicingManager.sliceStringMaker(0)(24)(myStr)", I've seen code that reminds me of this and wonder why anyone uses a language where this not only an acceptable idiom, but a preferred one.
Surprised the author didn't coin "fauxltruism".
anonytrary commented on BrainGPT turns thoughts into text iflscience.com/new-mind-r... · Posted by u/11thEarlOfMar
Using EEG to predict thought is like looking at the clouds in Mumbai to predict the clouds in Austin. The electrical signal from individual neurons are lost in a sea of large-scale oscillations, which are further blurred by the layers of bone, muscle, and tissue that separate the device from the brain. Bitrate is like 1 bit per second, completely insufficient for most use-cases.
anonytrary commented on OpenAI's board has fired Sam Altman openai.com/blog/openai-an... · Posted by u/davidbarker
Very excited to see what Sam & Greg are up to in the coming months! Guys like this don't just run away with their tails between their legs. They will be back.
anonytrary commented on Computationally optimal arrangements of barbell plates jacobbrazeal.wordpress.co... · Posted by u/tibbar
As a some-time lifter, the idea of totally optimizing plate changes begins to feel a bit like taking the escalators up to the gym entrance where there are stairs right there[1]. After a couple of years of attempting what the author does here, it finally occurred to me that moving around heavy weights was the whole point of the exercise, and plate-switching was just a different move. Efficiency didn't matter, I was using my body and building strength. Shout out to people who are pressed for time and want to get their workout done in a small window: You do you, just don't hog all the weights and not put them back on the racks.
1 https://medium.com/@nessasaurus/only-in-america-fe7d2d5d461e also, I understand there are legitimately people going to gyms to exercise who may not have full use of their legs.
Agree, moving the weights inefficiently will end up working the muscles you don't necessarily target in your main workout. It's less efficient, but probably gives a (very slightly) more well-rounded workout. If you're pressed for time, it could make sense to have a basic understanding of how to avoid dilly-dallying during your workout. If you go to a public gym, there will be other factors that affect your total time much more, like having to share equipment, which introduces a lot of uncertainty. Maybe these micro-optimizations are worthwhile if you have a private gym.
From a well-being/philosophical standpoint, maybe it's better to live life relaxed, and not one where you have to micro-manage every minute of your day to squeeze out every inch and penny of efficiency you can. That sounds like a horrible lifestyle, but I guess to each their own :)
Deep fakes were always a huge concern for me in AI. That's just one way AI can be weaponized, and this example is very clear on the damage caused. Thankfully Twitter quickly corrects the issue, but sadly only because it became viral. Sadly, Twitter won't be able to correct all of the little cases of AI misuse that don't go viral.
Neat and probably works on most dishwasher models, but not enough temperature precision for my comfort level. I wouldn't trust it. Rather just pan fry or bake myself a salmon. I don't have a sous vide, but I imagine this is not a replacement for one since the whole point is precision cooking.
> Ask your team to perform tasks that resemble work. Common examples include presentations, diagrams, and ticket management.
I'm as salty as the next guy, but in my experience it has been the sub-par employees who are the ones that don't do this. Ticket management is not busy work, it's a necessity for everyone to keep updated. Presentations and diagrams are tools to communicate. I can safely say that by far the most waste I've ever seen has always come down to poor communication rather than anything actually business or technical related.
Engineer who implements correct, comprehensible code but doesn't manage ticket statuses is more valuable than one who manages ticket statuses but scatters the codebase with technical debt and confusing abstractions/code. If "better communication" means spending an extra 10 hours with the latter dev to correct/re-teach them, then yes, communication is the problem. The most time I've lost at work is correcting/teaching engineers who eventually got let go due to low performance.
I feel vindicated reading this. Yesterday in a separate thread I claimed that it was wrong on 80% of the coding problems I gave it, and received the response from multiple readers that I was probably phrasing my questions poorly.
I started to believe them, too. Unfortunately, my brain is structured in such a way that a unanimous verdict from a few strangers is enough to make me think I’m probably the one who’s wrong. I need to make note of these events as a way to remind myself that this isn’t always the case.
Vindicated and excited. Gradient descent is likely not enough. I love it when we get closer to something but are still missing the answer. I would be very happy if "add more parameters and compute" isn't enough to get us to AGI. It means you need talent to get there, and money alone will not suffice. Bad news for OpenAI and other big firms, good news for science and the curious.
I imagine physicists got very excited with things like the ultraviolet catastrophe, and the irreconcilable nature of quantum mechanics and general relativity. It's these mysteries that keep the world exciting.