I've been trying my hand at RL envs for various sparse matrix algorithms in CUDA. It's easy to generate code that "looks good", "novel" and "fast". Escaping the distribution and actually creating novel sequences of instructions or even patterns (has any model come with something as useful as fan-in/fan-out or double buffering patterns that's now ubiquituous?) seems difficult to say the least.
Readit Newskonradha commented on CUDA-l2: Surpassing cuBLAS performance for matrix multiplication through RL github.com/deepreinforce-... · Posted by u/dzign
80kms for the longest day, amazing. The most I achieved in the north of Berlin was about 30kms/day. Also, is "Shengan" a british spelling quirk?
Next article: What's SASS?
Japanese corporate | Zurich, Switzerland | FULL-TIME | ONSITE (preferred) or REMOTE | EU/EFTA
We are a global manufacturing leader in optical fiber communication systems and electronic components that supplies telecom and carmakers worldwide. Our current activities relate to upcoming wireless technologies and sensors based on mmWave for the automotive and mobility industries.
I am looking for a (Senior) Software Engineer with strong expertise in HPC to join our R&D team. Your main role is as an expert in the development and implementation of high-performance routines from our state-of-the-art algorithms.
We look for someone with a liking for software craftmanship, experience with developing compilers and eating vfmsubadd231ps and vbroadcastf32x8 for breakfast. You are proficient in modern C and experienced with SIMD, hardware offloading and safety.
Please contact me if you're interested or have further questions.
I'd be interested as well!
From what I see helping some friends not well versed with programming doing their PhDs, FORTRAN still has a lot of penetration with scientists. Lots of climate models are FORTRAN code.
Also, through helping them I can see the dire state of scientific code, it's a mess, if departments had the budget to employ 1-2 professional programmers to help them mentor staff it could be extremely helpful for science code to be more easily shared and reasoned about, some of the code I've seen is basically throw away code after the contributors aren't around anymore...
There is project bringing Fortran to the browser, though (_using WebAssembly_)
Read some of the performance-related work here: https://acl.inf.ethz.ch/publications/
And all of the information collected by the Stasi, we now voluntarily give to social media companies.
But that's different, right? I mean, it's not the government so its okay.
I know some people who took a look at their StaSi files. Today's really different compared to what happened then: There wasn't someone from inside your inner circle transmitting every joke and every utterance to "law enforcement" for them to build kompromat. Sure, nowadays your every move is sold to god-knows-who but this will not impact your ability to choose a course of study (which may or may not suit you academically). You can get a job anywhere provided you have clearance and education needed. You will not look at pictures from your childhood and realize that three out of five people sold you out to get ahead in the queue to acquire a car. Your most intimate thoughts and acts aren't recorded for random bureaucrats to get a laugh out of. Please think again before equivocating "den Realen" with modern democracy. Neoliberal, consumerism societies definitely have their flaws but you're definitely better off on the freedom scale.
konradha commented on JAX – NumPy on the CPU, GPU, and TPU jax.readthedocs.io/en/lat... · Posted by u/peter_d_sherman
It took me a while to realize it, but Jax is actually a huge opportunity for a lot of scientific computing. Jax was originally developed as a more flexible platform for doing machine learning research. But Jax's real superpower is that it bundles XLA and makes it really easy to run computations on GPU or TPU. And huge swathes of scientific computation basically run large scale vectorized computations.
When I was in astronomy (about a decade ago) I did large scale simulations of gravitational interactions. But at the time all these simulations were done on CPU. Some of the really big efforts used more specialized chips, but it was a huge effort to write the code for it.
But today with Jax, if you want to write an N-body simulation of a globular cluster, you can just code it up in numpy and it'll run on a GPU for free and be about 1000x faster. From what I can tell though, very few people in the sciences have caught on yet.
Would you happen to have sources on the three orders of magnitude speedup coming at no cost? I'd assume porting + data movement considerations making this task non-trivial.
konradha commented on Lfortran: Modern interactive LLVM-based Fortran compiler lfortran.org/... · Posted by u/zaikunzhang
This is probably fantastic from a maintainability perspective, but I'm curious if some performance is left on the table by using LLVM IR instead of compiling directly to machine code. I know there are a number of optimizations that can be made for Fortran that can't be made for C-like languages and I wonder if some of those C-like assumptions are implicitly encoded in the IR.
LFortran is not necessarily using LLVM IR to compile. It's building up an ASR [1] structure that's already being used in the LFortran-specific backends. Potentially it can make full use of Fortran semantics!
konradha commented on Ask HN: What are the best papers you read in your life? · Posted by u/toombowoombo
Nice!
Related: You might find the book Matters Computational - https://www.jjj.de/fxt/#fxtbook and the FXT library it describes - https://www.jjj.de/fxt/ useful.
Oh absolutely. That work is a gem, I've used it for quite some research. Good idea to refer to this, too!