Skip to content
MackayGrowth

Robots.txt

In plain English

A file that tells search engine bots which pages of your site they're allowed to crawl. Most of your site should be open to crawlers. The exception is admin pages or private content you don't want appearing in search results.

Why it matters for your broker business

A misconfigured robots.txt left over from a site migration can silently block Google from your entire site - worth checking any time rankings mysteriously vanish.