Readit News logoReadit News
oasisaimlessly commented on Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation   arxiv.org/abs/2602.00294... · Posted by u/fheinsen
logicchains · 5 days ago
It can't be successful at that any more than 1+1 can equal 3. Fundamentally, if every token wants to be able to look at every previous token without loss of information, it must be O(n^2); N tokens looking at N tokens is quadratic. Any sub-quadratic attention must hence necessarily lose some information and be unable to support perfect recall on longer sequences.
oasisaimlessly · 5 days ago
That argument could also be used to say that the FFT's time complexity of O(n log n) should be impossible.
oasisaimlessly commented on Guix System First Impressions as a Nix User   nemin.hu/guix.html... · Posted by u/todsacerdoti
gurjeet · 9 days ago
TLDR: ... I'm getting a comparable experience to NixOS, with all the usual pros a declarative environment brings and without having to put up with Nixlang.
oasisaimlessly · 9 days ago
Instead, put up with a flavor of Scheme that looks suspiciously like Nix with some extra parentheses...
oasisaimlessly commented on Case study: Creative math – How AI fakes proofs   tomaszmachnik.pl/case-stu... · Posted by u/musculus
mlpoknbji · 15 days ago
My favorite early chatgpt math problem was "prove there exists infinitely many even primes" . Easy! Take a finite set of even primes, multiply them and add one to get a number with a new even prime factor.

Of course, it's gotten a bit better than this.

oasisaimlessly · 14 days ago
IIRC, that is actually the standard proof that there are infinitely many primes[1] or maybe this variation on it[2].

[1]: https://en.wikipedia.org/wiki/Euclid%27s_theorem#Euclid's_pr...

[2]: https://en.wikipedia.org/wiki/Euclid%27s_theorem#Proof_using...

oasisaimlessly commented on Postmortem: Our first VLEO satellite mission (with imagery and flight data)   albedo.com/post/clarity-1... · Posted by u/topherhaddad
bsder · 16 days ago
So, a set of standard software RPCs (remote procedure calls) and APIs (application programming interfaces) and not another electrical signalling standard. Got it.

Thanks for the correction.

So, I guess the next question is what are you folks actually using at the electrical signalling level to talk? (If you are not allowed to say, I understand.)

oasisaimlessly · 16 days ago
No, not RPCs/APIs either. A satellite bus is a physical object[1], which defines the mechanical standards for mounting payload modules.

[1]: https://en.wikipedia.org/wiki/Satellite_bus

oasisaimlessly commented on Nvidia-smi hangs indefinitely after ~66 days   github.com/NVIDIA/open-gp... · Posted by u/tosh
loeg · 16 days ago
It's 32 bits of milliseconds, right? Hm, no, that would overflow much sooner (49.7 days).
oasisaimlessly · 16 days ago
It's a uint32_t of 750 Hz "jiffies", which does overflow at ~66 days.
oasisaimlessly commented on Satellites reveal heat leaking from largest US cryptocurrency mining center   space.com/space-explorati... · Posted by u/troglo-byte
thegrim000 · 2 months ago
I read it as the inefficient part isn't the compute efficiency, the inefficient part is dumping all the resulting heat into the environment without capturing it and using it in some way to generate electricity or do work.

On a related/side note, when there's talk about seti and dyson spheres, and detecting them via infrared waste heat, I also don't understand that. Such an alien civilization is seemingly capable of building massive space structures/projects, but then lets the waste heat just pour out into the universe in such insane quantities that we could see it tens/hundreds of light years away? What a waste. Why wouldn't they recover that heat and make use of it instead? And repeat the recovering until the final waste output is too small to bother recovering, at which point we would no longer be able to detect it.

oasisaimlessly · 2 months ago
All energy inevitably changes into heat eventually, and in the steady state, power in = power out.

There is no way to get rid of heat. It has to go somewhere; otherwise, the temperature of the system will increase without bound.

oasisaimlessly commented on More on whether useful quantum computing is “imminent”   scottaaronson.blog/?p=942... · Posted by u/A_D_E_P_T
GrilledChips · 2 months ago
More recently it's turned out that quantum computers are less useful for molecular simulation than previously thought. See: https://www.youtube.com/watch?v=pDj1QhPOVBo

The video is essentially an argument from the software side (ironically she thinks the hardware side is going pretty well). Even if the hardware wasn't so hard to build or scale, there are surprisingly few problems where quantum algorithms have turned out to be useful.

oasisaimlessly · 2 months ago
At 15:00, she says "quantum computers are surprisingly good at [...] quantum simulations [of electron behavior]", which would seem to contradict you.
oasisaimlessly commented on Show HN: Shittp – Volatile Dotfiles over SSH   github.com/FOBshippingpoi... · Posted by u/sdovan1
goku12 · 2 months ago
Could you elaborate?
oasisaimlessly · 2 months ago
Now anybody with root/sudo/physical access to the remote machine has full R/W access to your entire home directory.
oasisaimlessly commented on AI helps ship faster but it produces 1.7× more bugs   coderabbit.ai/blog/state-... · Posted by u/birdculture
naasking · 2 months ago
It's totally plausible that AI codegen produces more bugs. It still seems important to familiarize yourself with these tools now though, because that bug count is only ever going to go down. These tools are here to stay.
oasisaimlessly · 2 months ago
Are you trying to assure others or reassure yourself?

u/oasisaimlessly

KarmaCake day386July 25, 2023View Original