BrainGuruAudit
About our website audit crawler
If you've seen BrainGuruAudit/1.0 in your logs, someone ran our free website check on your site. Here's exactly what it does.
- When it visits
- Only when someone runs the free Business Check on brainguru.ai and enters a website address. It doesn't crawl the web on its own.
- What it fetches
- The homepage, robots.txt, sitemap.xml and llms.txt if they exist, and up to 30 links found on the homepage, which it checks are working. To draw design concepts it opens the homepage in a browser and takes screenshots. Google's PageSpeed service may also load the page to measure speed.
- How it behaves
- It obeys robots.txt for the user agent BrainGuruAudit, checks same-site links at no more than one per second, caps how much it downloads, and never submits forms or signs in.
- What it keeps
- A summary of the audit and the screenshots, so the person who ran the check can see their results: 30 days for most checks, longer only if they ask us to follow up. Our privacy notice has the details.
How to block it
Add this to your robots.txt and the check will stop at your homepage:
User-agent: BrainGuruAudit Disallow: /
Questions or problems: hello@brainguru.ai.