If you run a website for your business — whether it’s a letting agency page, a plumbing service site, or your trade shop — something is changing on September 15 that could affect how AI finds you.
Cloudflare, the internet infrastructure company that sits in front of roughly one in five websites globally, is flipping a switch. From that date, AI training crawlers and agent bots will be blocked by default on any of its hosted sites that display ads. That includes the free tier, which covers millions of small business owners who never gave it a second thought.
What’s Actually Changing?
Cloudflare has split web crawlers into three categories. Search bots are the familiar ones — Googlebot indexing pages so someone can find you later. Those stay allowed. Training bots crawl your content to build or improve an AI model. Agent bots read your pages in real time to answer someone’s question right now, like when ChatGPT fetches a product page to tell a user what you charge.
From mid-September, training and agent bots get blocked on ad-supported pages by default. Googlebot is a special case because it does both search indexing and training, and blocking training means blocking Googlebot entirely. That’s a trade-off most small businesses won’t want to make.
Why Should a Tradesman or Landlord Care?
Right now, when a potential tenant searches “best property management in Cork” and an AI assistant surfaces your name, an agent bot has just read your site to compile that answer. Same when someone asks a chatbot which plumber covers their area. If that bot gets blocked, you don’t get the referral. You don’t even know you missed it.
For businesses that rely on local visibility, this is a new layer of search behaviour you need to understand. People are already using AI assistants to find services, and that habit is only growing. If your website blocks the bots that feed these assistants, you become invisible in a channel you didn’t know existed.
What You Should Do Before September 15
First, check if your site is on Cloudflare. Most Irish small business sites are — it’s bundled with many hosting packages. If you’re on the free tier, the new defaults apply automatically. Log into your Cloudflare dashboard, go to Security, and look for the AI Bots section. You can override the defaults before they take effect.
Second, understand the trade-off. Letting agent bots through means your content gets read by AI assistants, which can drive referral traffic. Blocking training bots might feel good (“no one’s using my content to train AI for free”), but remember that Googlebot is in the same bucket. Block training, and your Google rankings take a hit.
Third, watch the payment models that are emerging. Companies like Ceramic.ai and You.com are starting to pay publishers when their content appears in AI search results. This is early days, but it’s the direction of travel. The open web’s free lunch is ending, and the question is whether you’re getting paid or getting locked out.
The Bottom Line
Cloudflare’s change is not a catastrophe, but it’s not nothing either. The default settings will quietly reduce your visibility to AI assistants unless you opt out. Spend ten minutes in your dashboard before September 15. If you’re not sure how, ask your web host or your IT person. This is one of those rare tech changes where a small amount of attention upfront saves a bigger problem later.