{"id":30856,"date":"2025-07-01T10:00:12","date_gmt":"2025-07-01T10:00:12","guid":{"rendered":"https:\/\/medexperts.pro\/?p=30856"},"modified":"2025-07-01T10:24:07","modified_gmt":"2025-07-01T10:24:07","slug":"cloudflare-introduces-blocking-of-a-i-scrapers-by-default","status":"publish","type":"post","link":"https:\/\/medexperts.pro\/?p=30856","title":{"rendered":"Cloudflare Introduces Blocking of A.I. Scrapers By Default"},"content":{"rendered":"
<\/div>\n

The tech company\u2019s customers can automatically block A.I. companies from exploiting their websites, it said, as it moves to protect original content online.<\/p>\n

\n
\n
\n

Cloudflare, a tech company that helps websites secure and manage their internet traffic, said on Tuesday that it had rolled out a new permission-based setting that allows customers to automatically block artificial intelligence companies from collecting their digital data, a move that has implications for publishers and the race to build A.I.<\/p>\n

With Cloudflare\u2019s new setting, websites can block \u2014 by default \u2014 online bots that scrape their data, requiring the website owner to grant access for a bot to collect the content, the company said. In the past, those whom Cloudflare did not flag as a hacker or malicious actor could get through to a website to gather its information.<\/p>\n

\u201cWe\u2019re changing the rules of the internet across all of Cloudflare,\u201d said Matthew Prince, the chief executive of the company, which provides tools that protect websites from cyberattacks and helps them load content more efficiently. \u201cIf you\u2019re a robot, now you have to go on the toll road in order to get the content of all of these publishers.\u201d<\/p>\n

Cloudflare is making the change to protect original content on the internet, Mr. Prince said. If A.I. companies freely use data from various websites without permission or payment, people will be discouraged from creating new digital content, he said. The company, which says its network of servers handles about 20 percent of internet traffic, has seen a sharp increase in A.I. data crawlers on the web.<\/p>\n<\/div>\n<\/div>\n

<\/div>\n
\n
\n

Data for A.I. systems has become an increasingly contentious issue. OpenAI, Anthropic, Google and other companies building A.I. systems have amassed reams of information from across the internet to train their A.I. models. High-quality data is particularly prized because it helps A.I. models become more proficient in generating accurate answers, videos and images.<\/p>\n

But website publishers, authors, news organizations and other content creators have accused A.I. companies of using their material without permission and payment. Last month, Reddit sued Anthropic<\/a>, saying the start-up had unlawfully used the data of its more than 100 million daily users to train its A.I. systems. In 2023, The New York Times sued<\/a> OpenAI and its partner, Microsoft, accusing them of copyright infringement of news content related to A.I. systems. OpenAI and Microsoft have denied those claims.<\/p>\n

\n
\n
<\/div>\n
\n
\n
\n

We are having trouble retrieving the article content.<\/p>\n

Please enable JavaScript in your browser settings.<\/p>\n<\/div>\n<\/div>\n

\n
\n

Thank you for your patience while we verify access. If you are in Reader mode please exit and\u00a0log into<\/a>\u00a0your Times account, or\u00a0subscribe<\/a>\u00a0for all of The Times.<\/p>\n

\n<\/div>\n
\n
\n

Thank you for your patience while we verify access.<\/p>\n

Already a subscriber?\u00a0Log in<\/a>.<\/p>\n

Want all of The Times?\u00a0Subscribe<\/a>.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/section>\n","protected":false},"excerpt":{"rendered":"

The tech company\u2019s customers can automatically block A.I. companies from exploiting their websites, it said, as it moves to protect original content online.Cloudflare, a tech company that helps websites secure and manage their internet traffic, said on Tuesday that it had rolled out a new permission-based setting that allows customers to automatically block artificial intelligence companies from collecting their digital data, a move that has implications for publishers and the race to build A.I.With Cloudflare\u2019s new setting, websites can block \u2014 by default \u2014 online bots that scrape their data, requiring the website owner to grant access for a bot to collect the content, the company said. In the past, those whom Cloudflare did not flag as a hacker or malicious actor could get through to a website to gather its information.\u201cWe\u2019re changing the rules of the internet across all of Cloudflare,\u201d said Matthew Prince, the chief executive of the company, which provides tools that protect websites from cyberattacks and helps them load content more efficiently. \u201cIf you\u2019re a robot, now you have to go on the toll road in order to get the content of all of these publishers.\u201dCloudflare is making the change to protect original content on the internet, Mr. Prince said. If A.I. companies freely use data from various websites without permission or payment, people will be discouraged from creating new digital content, he said. The company, which says its network of servers handles about 20 percent of internet traffic, has seen a sharp increase in A.I. data crawlers on the web.Data for A.I. systems has become an increasingly contentious issue. OpenAI, Anthropic, Google and other companies building A.I. systems have amassed reams of information from across the internet to train their A.I. models. High-quality data is particularly prized because it helps A.I. models become more proficient in generating accurate answers, videos and images.But website publishers, authors, news organizations and other content creators have accused A.I. companies of using their material without permission and payment. Last month, Reddit sued Anthropic, saying the start-up had unlawfully used the data of its more than 100 million daily users to train its A.I. systems. In 2023, The New York Times sued OpenAI and its partner, Microsoft, accusing them of copyright infringement of news content related to A.I. systems. OpenAI and Microsoft have denied those claims.We are having trouble retrieving the article content.Please enable JavaScript in your browser settings.Thank you for your patience while we verify access. If you are in Reader mode please exit and\u00a0log into\u00a0your Times account, or\u00a0subscribe\u00a0for all of The Times.Thank you for your patience while we verify access.Already a subscriber?\u00a0Log in.Want all of The Times?\u00a0Subscribe.<\/p>\n","protected":false},"author":1,"featured_media":30858,"comment_status":"close","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-30856","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/medexperts.pro\/index.php?rest_route=\/wp\/v2\/posts\/30856","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/medexperts.pro\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/medexperts.pro\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/medexperts.pro\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/medexperts.pro\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=30856"}],"version-history":[{"count":2,"href":"https:\/\/medexperts.pro\/index.php?rest_route=\/wp\/v2\/posts\/30856\/revisions"}],"predecessor-version":[{"id":30859,"href":"https:\/\/medexperts.pro\/index.php?rest_route=\/wp\/v2\/posts\/30856\/revisions\/30859"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/medexperts.pro\/index.php?rest_route=\/wp\/v2\/media\/30858"}],"wp:attachment":[{"href":"https:\/\/medexperts.pro\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=30856"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/medexperts.pro\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=30856"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/medexperts.pro\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=30856"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}