Readit News logoReadit News
almostgotcaught commented on Writing Speed-of-Light Flash Attention for 5090 in CUDA C++   gau-nernst.github.io/fa-5... · Posted by u/dsr12
doctorpangloss · 2 hours ago
By all means, the guy could have written the triton fixes he needs and NOT sent it up stream. It would still make more sense to do that! He’s obviously an expert, and I was sincerely wondering, why bother with the C++ stuff if he already knew the better way, and also has the chops to implement it?
almostgotcaught · 2 hours ago
There's an enormous difference between writing kernels and writing compiler infra.
almostgotcaught commented on Writing Speed-of-Light Flash Attention for 5090 in CUDA C++   gau-nernst.github.io/fa-5... · Posted by u/dsr12
saagarjha · 3 hours ago
I mean, you can look at the most recent commit and see that the infrastructure is being built out for this right now (of course OpenAI doesn't care about sm_120, though).
almostgotcaught · 3 hours ago
i don't know what this comment has to do with my point that OAI doesn't take commits from randoms, especially for infra code.
almostgotcaught commented on Writing Speed-of-Light Flash Attention for 5090 in CUDA C++   gau-nernst.github.io/fa-5... · Posted by u/dsr12
doctorpangloss · 6 hours ago
Yes… I read it. If the feature is missing, why not contribute it instead?
almostgotcaught · 6 hours ago
How many PRs do you have landed in Triton that you can just blithely say "contribute it"?
almostgotcaught commented on Crimes with Python's Pattern Matching (2022)   hillelwayne.com/post/pyth... · Posted by u/agluszak
tialaramex · 2 days ago
"We've made this mistake before so for consistency we need to repeat it" is such a bad idea. Ideally you want a way to go back and fix things you got wrong, but, even if you can't do that (which is itself a defect and you should figure out how you can improve) you should improve as you move forward.

C++ has struggled with this, so that paper authors sometimes plead with the committee not to make their proposal needlessly worse in the name of "consistency" with existing bad features. This famously failed for std::span, which thus managed to be not only a real world footgun in a language which already has plenty of footguns but also a PR footgun - because for "consistency" the committee removed the safety from the safety feature and I believe in C++ 26 they will repair this so it's just pointless rather than actively worse...

almostgotcaught · 2 days ago
> "We've made this mistake before so for consistency we need to repeat it" is such a bad idea.

no it's not. you literally have no other choice. you cannot add scopes after the fact - it is a breaking change. you cannot have some parts of the language have scopes and others not - it's so much worse for the user. think about human languages and which ones get quoted as being the hardest to learn (those with many exceptions). you're just wrong.

almostgotcaught commented on Crimes with Python's Pattern Matching (2022)   hillelwayne.com/post/pyth... · Posted by u/agluszak
tialaramex · 2 days ago
Which x? There are two in your code, one for each time you introduce a pattern Some(x) and each x has scope which of course ends when that pattern is done with

Notice that the Python doesn't work this way, we didn't make a new variable but instead changed the existing one.

Also, the intent in the Python was a constant, in Rust we'd give this constant an uppercase name by convention, but regardless it's a constant and so of course matching against a constant does what you expect, it can't re-bind a constant, 404 is a constant and so is `const NOT_FOUND: u16 = 404;`

almostgotcaught · 2 days ago
> Which x? There are two in your code, one for each time you introduce a pattern Some(x) and each x has scope which of course ends when that pattern is done with

if each x's scope ends at the end of each case doesn't that mean there's only one x?

> we didn't make a new variable but instead changed the existing one.

so because python doesn't have scopes except for function scopes it shouldn't ever have any new features that intersect with scope?

almostgotcaught commented on Crimes with Python's Pattern Matching (2022)   hillelwayne.com/post/pyth... · Posted by u/agluszak
pansa2 · 2 days ago
> you simply don't understand what a match statement is

It's "a DSL contrived to look like Python, and to be used inside of Python, but with very different semantics":

https://discuss.python.org/t/gauging-sentiment-on-pattern-ma...

almostgotcaught · 2 days ago
you linked to a random detractors rant. i don't see what that has to do with whether a match statement binds a match?
almostgotcaught commented on Crimes with Python's Pattern Matching (2022)   hillelwayne.com/post/pyth... · Posted by u/agluszak
pansa2 · 2 days ago
Doesn't matter what it is, it shouldn't break fundamental rules of the language.

Ruby's `case`/`in` has the same problem.

almostgotcaught · 2 days ago
> it shouldn't break fundamental rules of the language

it doesn't? you simply don't understand what a match statement is.

https://doc.rust-lang.org/book/ch19-03-pattern-syntax.html

    let num = Some(4);

    match num {
        Some(x) if x % 2 == 0 => println!("The number {x} is even"),
        Some(x) => println!("The number {x} is odd"),
        None => (),
    }
notice that x is bound to 4.

almostgotcaught commented on Crimes with Python's Pattern Matching (2022)   hillelwayne.com/post/pyth... · Posted by u/agluszak
pansa2 · 2 days ago
The real crime is the design of Python's pattern matching in the first place:

    match status:
        case 404:
            return "Not found"

    not_found = 404
    match status:
        case not_found:
            return "Not found"
Everywhere else in the language, you can give a constant a name without changing the code's behaviour. But in this case, the two snippets are very different: the first checks for equality (`status == 404`) and the second performs an assignment (`not_found = status`).

https://x.com/brandon_rhodes/status/1360226108399099909

almostgotcaught · 2 days ago
because it's not a `switch` it's a `match` ie pattern matching...
almostgotcaught commented on The contrarian physics podcast subculture   timothynguyen.org/2025/08... · Posted by u/Emerson1
padjo · 2 days ago
> Weinstein released his Geometric Unity paper on April 1, debuting it on Joe Rogan’s podcast

We live in deeply unserious times.

almostgotcaught · 2 days ago
i mean he's not a physicist of any sort so i don't think there's anything amiss about this? the "deeply unserious" part is that people can't (refuse to?) recognize that he's not a physicist.
almostgotcaught commented on Mark Zuckerberg freezes AI hiring amid bubble fears   telegraph.co.uk/business/... · Posted by u/pera
Hilift · 3 days ago
META has only made $78.7 billion operating income in the past 12 months of returns. Time to buckle up!

https://finance.yahoo.com/quote/META/financials/

almostgotcaught · 3 days ago
385 comments based on a clickbait headline from telegraph (you know that sophisticated tech focused newspaper...)

u/almostgotcaught

KarmaCake day640May 1, 2024View Original