WelcomeUser Guide
ToSPrivacyCanary
DonateBugsLicense

©2025 Poal.co

887

Yeah, that's a interesting prospect. Force them to pay you for your content to be scraped?

Archive: https://archive.today/PTfnV

From the post:

>Many publishers, content creators and website owners currently feel like they have a binary choice — either leave the front door wide open for AI to consume everything they create, or create their own walled garden. But what if there was another way? At Cloudflare, we started from a simple principle: we wanted content creators to have control over who accesses their work. If a creator wants to block all AI crawlers from their content, they should be able to do so. If a creator wants to allow some or all AI crawlers full access to their content for free, they should be able to do that, too. Creators should be in the driver’s seat.

Yeah, that's a interesting prospect. Force them to pay you for your content to be scraped? Archive: https://archive.today/PTfnV From the post: >>Many publishers, content creators and website owners currently feel like they have a binary choice — either leave the front door wide open for AI to consume everything they create, or create their own walled garden. But what if there was another way? At Cloudflare, we started from a simple principle: we wanted content creators to have control over who accesses their work. If a creator wants to block all AI crawlers from their content, they should be able to do so. If a creator wants to allow some or all AI crawlers full access to their content for free, they should be able to do that, too. Creators should be in the driver’s seat.

(post is archived)

[–] 2 pts

Use AI to craft slop pages that you then charge the big AI companies to crawl - infinite profits?

[–] 1 pt

Better yet, train your LLM with content scraped from and . You’ll be making easy money and improving the big commercial LLMs at the same time.