I am recently studying hpc configs and the docs I follow most (amd,suse) recommends blocking thp by default which I was able to replicate performance impact myself as well, on the otherside standard hugepages brings lot of advantage, I do setup during kernel boot but didnt test properly, currently using 4GB. If you really wanna bypass page latency I recommend buying a cheap persistence memory, not all filesystems support yet , (ext4 and xfs ?) but with -o dax mount option you dont use pages, if data is temporary tmpfs with hugepages as far as I can see quite common usage but I also found kernel memblock argument by simulating non-existent persistent memory and mounting a filesystem with dax brings similar performance or even faster most of my cases yet still you wanna script each time boot mkfs/mount
Readit Newshrgiger commented on I've had bad luck with transparent hugepages on my Linux machines utcc.utoronto.ca/~cks/spa... · Posted by u/ingve
hrgiger commented on C++ Neural Network in a Weekend (2020) jeremyong.com/cpp/machine... · Posted by u/cpp_frog
For anybody looking to understand/implement Neural Networks in C++, the books by Timothy Masters are indispensable - http://www.timothymasters.info/
There are plenty of resources on search engine results , what did you find in particular those books stays top of the others?
hrgiger commented on C++ Neural Network in a Weekend (2020) jeremyong.com/cpp/machine... · Posted by u/cpp_frog
You might wanna validate your back propogation *or the final cost against a hand written very small network to see what went wrong
hrgiger commented on Train CIFAR10 to 94% in under 10 seconds on a single A100 github.com/tysam-code/hlb... · Posted by u/tysam_and
Thank you! I don't know for sure if we will get there, but it has been going _muuuch_ more quick than expected already. I do suspect that it might slow down as life gets going, and the required changes are more and more involved. Remember, this is a freaking super tightly integrated system, so complex components may take a long time to get it to work.
But, we can hope! Now that we're below the lovely advertising-friendly bar of 10 seconds, I can use it as a living resume as I look to pick up some research/architecture-related stuff part-time.
Cheers and thanks again for your comment, much love and have a good/great week! :D
Can you add some details about what are the most complex components in your system? Also what parts you implemented from scratch? I see you still use torch
hrgiger commented on Ask HN: What true thing do you believe that few people agree with you on? · Posted by u/schappim
unconditional worldwide true peace (not brought by weapons)
We already have a stable fusion going. It's 8 light minutes away. All you have to do is to point a solar panel at it to harvest the energy.
Korean reactor reached 7 times hotter than sun, when I was reading it made me laugh that humans said fuck the dyson sphere and skipped a step on Kardashev scale yet still I find it ironic that this one built with military support.
https://www.sciencealert.com/koreas-fusion-reactor-ran-7-tim...
I don't think people truly understand the gap from "net-positive fusion is technically possible" to "fusion plants are real and have an ROI competitive with fossil fuels".
Seems like we're getting close to step 1 (exciting) but that's really just the beginning if fusion is actually going to live up to the hype as the savior energy source. We need to make it politically and economically viable, solve the mineral supply chain and construction cost issues, mobilize existing industrial resources towards rapidly build out fusion plants, concurrently with improvements to the grid and battery systems, while electrify everything. And it has to happen tomorrow.
But consider that we already have several viable non-fossil-fuel energy technologies that _could_ power our civilization but don't. It's worth reflecting on why. Solar, wind, hydro, geothermal and nuclear fission are already established energy sources at a certain scale. Yet physical limits, politics, and economic realities prevent us from fully deploying them at the scale required. To wit, none of them have made a dent in the still-increasing global fossil fuel consumption. "Renewables" are just added on top in the pursuit of additional growth, with fossil carbon still the core engine.
It's not enough to make fusion work technically. It has to out-compete oil, gas and coal in the market to such an extent that it incentivizes rapid electrification - we have plenty of examples of once-promising energy technology that have failed to deliver at this scale. Honest question for the nuclear fusion hopefuls - why do you think fusion will be different?
Well quick google search tells me there is about 50 to 100 year fossil resources left, thats about a lifetime for a currently newborn or more optimistic next 2 generation
Deleted Comment
hrgiger commented on Ask HN: Again: The “I want to do everything but end up doing nothing” dilemma · Posted by u/sidcool
Human nature doesn’t change all that much. That thread is still relevant. The secret ingredient is “No”.
I think it was Warren Buffett who said, “Really successful people say no to almost everything.”
That seems to have been true of successful people from every time period that I’ve read about.
Certainly he is an exceptional programmer