Cloudflare rolls out a way for sites to charge AI crawlers for access
Today, Cloudflare unveiled “pay per crawl,” a way for websites to charge AI crawlers for access. Currently in private beta, the program provides more control over AI bots and lets each site set a price. The company also announced it will block AI crawlers from accessing web pages by default. “If the Internet is going […]
Cloudflare rolls out a way for sites to charge AI crawlers for access Read More »