> Please be like them instead.
Be an arrogant martinet? No thanks. But I'll stop posting so congrats on keeping your community homogeneously obnoxious (and ignorant).
Deleted Comment
> Please be like them instead.
Be an arrogant martinet? No thanks. But I'll stop posting so congrats on keeping your community homogeneously obnoxious (and ignorant).
Most MPI-programs are SPMD, and really, the only conceptual difference between MPI and CUDA is that a thread's id is a point in a grid space that's relevant for scheduling and memory locality. Oh wait, that's true for MPI as well, only the scheduling and memory locality relates to CPU cores and nodes, instead of CUDAs SMPs and blocks.
The only real justification for a different programming model is that SIMT creates opportunities for implicit SIMD on a thread scheduling level if you've written your program in a way that the warps don't diverge.
Yes I have read it enough times that I knew exactly where it was in the book.
> That compares SIMD to SIMT.
Yes and so does the op I responded to.
> SIMD, not SPMD. SIMD is a more restrictive hardware paradigm,
Thanks but I was already aware. The op was the one that conflated SPMD and SIMD, not me.
> SPMD is just a mutiple copies of a single program running on multiple processes/threads, i.e., exactly what CUDA does.
CUDA is a C language extension that enables you to write host and device code in the same source. That's it. SIMT is the model of compute on NVIDIA SMs.
> The only real justification for a different programming model is that SIMT creates opportunities for implicit SIMD on a thread scheduling level if you've written your program in a way that the warps don't diverge.
No that's incorrect. SIMT is implemented using predicated execution and instruction replay exactly so that warps can diverge.
Again, it's amazing you guys are so sure that NVIDIA pulled a fast one on just the whole community/industry and didn't actually innovate but it turns out you're actually missing some pieces of the puzzle.
Dead Comment
If you are white or Asian and do not submit SAT/ACT, your application goes to trash right away - there are enough candidates with stellar SAT/ACT to pick from. So SAT/ACT is still very relevant but only for part of population.
Do you have literally any proof of this?
Also you're perpetual quoting of the rule book under the guise of "here's our credo" doesn't accomplish anything because it doesn't clarify what rule was broken (and just serves to obscure the censure under "we don't like your kind around here"). At minimum you should cite exactly what rule was broken.
Dead Comment
Dead Comment
This isn't a response to just one comment, let alone one word, but to the pattern of your comments in general: they stand out as nasty, abusive towards other commenters, and not in the intended spirit of the site; not just by a little, but a lot. It's not a borderline call.