FurokiAuditBot

FurokiAuditBot reads public web pages when someone asks Furoki Marco for a free audit of a website. It only runs when an audit is requested, and the result is reused for the same site for 7 days. It never logs in and never submits forms.

How it identifies itself

User agent:

Mozilla/5.0 (compatible; FurokiAuditBot/1.0; +https://marco.furoki.com/bot)

It runs on Cloudflare, so it has no fixed IP address: requests come from Cloudflare's shared addresses. Match on the user agent, not the IP.

What it fetches

  • The address it was asked to audit (usually your home page), plus the http:// and www / non-www versions of it, to check redirects.
  • /robots.txt, and the sitemaps listed there (or /sitemap.xml and /sitemap_index.xml), up to 6 sitemap files.
  • Up to 50 HTML pages, found from your home page links and sitemap. A small sample of sitemap addresses it didn't open (at most 10) is checked with a light HEAD request.
  • One address that shouldn't exist, /marco-404-check- followed by random letters, to see that missing pages return a 404.
  • A few well-known files: /llms.txt, /.well-known/mcp.json, /.well-known/ai-plugin.json and /openapi.json. For shops and travel sites that promote a mobile app, also /.well-known/assetlinks.json and /.well-known/apple-app-site-association.

It does not fetch images, scripts, stylesheets, PDFs or downloads, and it does not run JavaScript. It reads at most 2 MB per page and waits up to 10 seconds for an answer.

How it behaves

  • It follows robots.txt, using the rules for FurokiAuditBot or, if there are none, for *.
  • It reads up to 4 pages at a time. If your robots.txt sets a Crawl-delay, it reads one page at a time and waits that long between pages, up to a maximum of 2 seconds.
  • It follows at most 5 redirects per address, and only to public websites.

Blocking or slowing it

To block it, add this to your robots.txt:

User-agent: FurokiAuditBot
Disallow: /

To slow it down instead:

User-agent: FurokiAuditBot
Crawl-delay: 2

You can also block the user agent FurokiAuditBot in your firewall or CDN.

Contact

Questions or problems: hello@furoki.com or Telegram.