I wish there was an alternative (possibly European) to Cloudflare, because it’s so scary to put all eggs in one basket.
To that end the company is developing a “Pay Per Crawl” system, which would give content creators the option to request payment from AI companies for utilising their original content.
So Cloudflare is not as much “saving the Internet”, as just becoming a middleman between LLM training companies and content creators. Which I believe has a potential of being a true goldmine in the future.
Can you DRM a crawl ?
Oh yes DRM whole internet and wire it to Personal ID. Wet dream.
Until the AI companies find a way around it. Love the idea so hopefully it causes at least 3 days of struggle for the AI crawlers.
Having said that… Can someone else put this in place so we do not have Cloudflare hosting everything where we would just be one intern away from a global outage. Please? Pretty please?
The problem is that the biggest service Cloudflare provides is DDoS protection, and doing that requires that you have more bandwidth available than your attacker. Having enough bandwidth to withstand modern botnet powered DDoS attacks is ridiculously expensive (and it’s also a finite resource, there’s only so much backbone infrastructure). Basically it’s economically infeasible to have multiple companies providing the service Cloudflare does. You might be able to get away with two companies doing so, but it’s unlikely you could manage more than that without some of them starting to go bankrupt.
when a critical service is not economical for more than one business to do (natural monopoly), that’s when govt should be stepping in.
This is not about stopping bot-scrapers, it’s about charging them.
Hopefully people will price their content out of reach of the bot-scrapers, effectively stopping them.
I can’t wait to be denied access to websites because of it. Even more than I already am, that is.
I didnt read “bot blocker” wrong, thats for sure…