Readit Newsfewsats commented on I fear for the unauthenticated web sethmlarson.dev/i-fear-fo... · Posted by u/SethMLarson
Aren't you paying for me to use the site, too? Or Google? Isn't the point of paying for a web hosting service to distribute information?
Yes, but there is a "free lunch" problem. I can run a script that hits your page costing you X at a fraction of the cost for me (the user)
*Edit: typo
fewsats commented on I fear for the unauthenticated web sethmlarson.dev/i-fear-fo... · Posted by u/SethMLarson
There's a real economic problem here: when someone scrapes your site, you're literally paying for them to use your stuff. That's messed up (and not sustainable)
It seems like a good fit for micropayments. They never took off with people but machines may be better suited for them.
L402 can help here.
The other obvious solution is a "web of trust" where Cloudflare just tells you "this request goes in, this one goes out".
I think the paying approach is superior (after all you make money out of people using your service) but Cloudflare is a straight forward/simpler one.
fewsats commented on I fear for the unauthenticated web sethmlarson.dev/i-fear-fo... · Posted by u/SethMLarson
this is basically what they are doing, but instead of charging actual money they are making visitors spin the CPU ideally in a proof of work problem, which has the same outcome from the crawlers perspective.
I've talked with tons of publishers and all say the same thing:
"Hey, we'd happily give these companies clean data if they just paid us instead of building these scrapers."
I think there is a psychological aspect that made micropayments never work for humans but machines may be better suited for it.
fewsats commented on I fear for the unauthenticated web sethmlarson.dev/i-fear-fo... · Posted by u/SethMLarson
There's a real economic problem here: when someone scrapes your site, you're literally paying for them to use your stuff. That's messed up (and not sustainable)
It seems like a good fit for micropayments. They never took off with people but machines may be better suited for them.
L402 can help here.
Deleted Comment
What is the countdown for the missions?