Readit News logoReadit News
julius commented on Neural networks that learn non-linearity without activation functions [pdf]   tahabouhsine.com/nmn/asse... · Posted by u/mlnomadpy
rytill · 5 months ago
Why would one have motivation to not use activation functions?

To my knowledge they’re a negligible portion of the total compute during training or inference and work well to provide non-linearity.

Very open to learning more.

julius · 5 months ago
Less information loss -> Less params? Please correct me if I got this wrong. The Intro claims:

"The dot product itself is a geometrically impoverished measure, primarily capturing alignment while conflating magnitude with direction and often obscuring more complex structural and spatial relationships [10, 11, 4, 61, 17]. Furthermore, the way current activation functions achieve non-linearity can exacerbate this issue. For instance, ReLU (f (x) = max(0, x)) maps all negative pre-activations, which can signify a spectrum of relationships from weak dissimilarity to strong anti-alignment, to a single zero output. This thresholding, while promoting sparsity, means the network treats diverse inputs as uniformly orthogonal or linearly independent for onward signal propagation. Such a coarse-graining of geometric relationships leads to a tangible loss of information regarding the degree and nature of anti-alignment or other neg- ative linear dependencies. This information loss, coupled with the inherent limitations of the dot product, highlights a fundamental challenge."

julius commented on Moneybadger and Peach Payments partner to enable Bitcoin payments   bitcoinke.io/2025/07/mone... · Posted by u/DistantCl3ric
benmoneybadger · 5 months ago
happy to answer any questions!
julius · 5 months ago
Lots of people who have relatively stable currencies (EUR, USD..) do not want to use bitcoin. What if bitcoin price goes down? How many extra steps is it to convert my USD to bitcoin and then back to USD? Do I only convert the 19.99 USD for my current purchase into bitcoin or do I put in more?

Do you solve these issues for customers? Or are you only targeting people who already are happy bitcoin wallet users? Are stablecoins part of your strategy?

Given how Visa,Mastercard,Paypal are seen as bad actors. Do you think you can capitalize on that, possibly partnering with Valve or something of that sort?

julius commented on XSLT – Native, zero-config build system for the Web   github.com/pacocoursey/xs... · Posted by u/_kush
julius · 6 months ago
Anyone with recent real-world experience?

From talking to AI, it seems the main issues would be:

- SEO (googlebot)

- Social Media Sharing

- CSP heavy envs could be trouble

Is this right?

Deleted Comment

julius commented on Airhull lets electric boats glide on a layer of air   heise.de/en/news/Pascal-T... · Posted by u/doener
igor47 · 7 months ago
Could not get through the drm and tracking click through agreements on this site. Seems like there's no way to view this article without agreeing to be survieled for marketing purposes
julius · 7 months ago
Video of the ship and visualization of the technology: https://www.youtube.com/watch?v=wOK4TGd_l_Q

Deleted Comment

julius commented on Oasis AI   oasis.decart.ai/starting-... · Posted by u/rbaudibert
julius · a year ago
Thanks for making this playable. I have seen videos of it, but thought I had to wait for years until I can experience it.

The future will be wild. "Hey ChatGPT, lets play Counterstrike on the Enterprise-D. Counter-Terrorists agains Spongebobs"

julius commented on Ask HN: What are you working on? (October 2024)    · Posted by u/david927
ejs · a year ago
Every application that I've worked on has had blind spots, or forgotten lands of code. Things like “how often do people actually use this feature?” …or… “does this code still run every night?”.

I made something to track those things easily.

https://flexlogs.com

And since it's Monday…

I've been working on a little project to be less overwhelmed and get more done each week. It's a super simple productivity idea that starts each week with a new (markdown) file.

https://carpeweekem.com

julius · a year ago
At first I thought you made a website that gives me an empty Markdown file. But I am glad I downloaded it its actually a pretty nice template.

What are you personally doing with the yearly goals in that file. Are you copy and pasting them from last week, or are you typing them down everytime to re-iterate them (and possibly even modify) ?

julius commented on Against all odds, an asteroid mining company appears to be making headway   arstechnica.com/space/202... · Posted by u/bookofjoe
cletus · a year ago
I'm not sure what substance you could mine on an asteroid that could possibly be economical.

The first obvious assumption is would have to be launched from space and return to space because the cost of getting a payload from Earth to LEO is a huge extra expense.

Then you have to consider the delta-V of getting to the asteroid, doing a rendezvous and getting back. If that's so significant that the Earth launch cost is trivial then the delta-V budget is so huge, it must make the endeavour even more uneconomical.

I believe humanity's future is in a Dyson Swarm. There are simply too many advantages. This is a deep topic. The question is how do you bootstrap that? Where do you get raw materials?

I don't think it's from asteroids. I very much suspect it's from a larger body and my money is on Mercury. Why? On pretty much any body in the Solar System you're living underground so Mercury is at no disadvantage here. It has no atmosphere. That's an advantage. Mars's super thin atmosphere is the worst of both worlds. Additionally, Mercury is metal rich and due to its proximity to the Sun, energy is abundant (ie solar power). Interestingly, it has a higher orbital speed than Earth (47km/s vs 30km/s). That's really interesting because it's free velocity to leave the Solar System.

Resources on EArth are so ridiculously cheap. You can mine iron ore for a few dollars a ton at scale. You can convert it into steel really cheaply too (again, at scale). Doing anything in space requires having truly stupendous amounts of cheap energy available.

julius · a year ago
Mercury sounds interesting. Requires a certain scale though (gravity is a bitch).

Considering just the initial mining and construction, bodies with low gravity and proximity to the earth feel like an efficient starting point, right? I always thought the moon would be a good place to bootstrap the first few thousand space habitats.

Your point about energy will probably be the biggest deal. Wondering how complicated it would be to ship a bunch of nuclear reactors to the moon. There seems to be quite a few companies working on small, "mass produced" reactors currently.

u/julius

KarmaCake day406September 29, 2008View Original