Cloudflare, a leading connectivity cloud service provider, has just announced that it has become the first Internet infrastructure provider to block AI crawlers from accessing content by default without permission or payment.
Cloudflare empowers leading publishers and AI companies to prevent unauthorized exploitation and use of original content. (Illustration photo)
Website owners can now choose whether to allow AI crawlers to access their content and decide how AI companies can use that content. AI companies can also now explicitly state their purpose – whether their crawlers are used for training, inference, or search – which helps website owners decide which crawlers to allow.
Cloudflare's new default setting is seen as the first step toward a more sustainable future for both content creators and AI innovators.
For decades, the internet has operated on a simple exchange: Search engines index content and direct users back to the original websites, generating traffic and advertising revenue for websites of all sizes.
This cycle brings money and followers to quality content creators, while helping users discover new and relevant information. That model has collapsed. AI crawlers collect content like text, articles, and images to create answers without taking visitors to the original data source, depriving content creators of revenue and the satisfaction of knowing someone is watching their content.
If the incentive to create original and quality content disappears, society will lose out and the future of the Internet will be threatened.
“If the internet is going to survive the age of AI, we need to give publishers the control they deserve and build a new economic model that works for everyone – creators, consumers, future AI innovators, and the future of the web itself,” said Matthew Prince, co-founder and CEO of Cloudflare.
According to Cloudflare CEO, this is about protecting the future of a free and vibrant internet, with a new model that works for everyone.
“ Cloudflare’s innovative approach to blocking AI crawlers is a game changer for publishers and sets a new standard for how content is protected online. When AI companies can no longer take whatever they want for free, it opens the door for sustainable innovation built on permission and collaboration, ” said Roger Lynch, CEO of Condé Nast, adding that this is an incredibly important step toward creating a fair exchange of value on the internet that protects creators, supports quality journalism, and holds AI companies accountable.
Cloudflare owns one of the world's largest networks, managing and protecting traffic for 20% of the web. The company handles trillions of requests every day and therefore has the world's most advanced bot management solutions, accurately distinguishing between real users and AI crawlers. In September 2024, Cloudflare introduced the option to block AI crawlers with a single click.
Source: https://vtcnews.vn/cloudflare-ngan-chan-ai-an-cap-ban-quyen-website-ar952660.html
Comment (0)