Test WebStatBot on your URL

What this does

Reads robots.txt first and follows it. A URL it forbids is never requested.
Then sends a single header-only request (HTTP HEAD) with the User-Agent WebStatBot/1.0 (+https://www.webstatbot.com/bot) and follows up to three redirects.
Reports whether the address resolves and the server responds, with the HTTP status and robots.txt result. No page content is downloaded or shown, and nothing you enter is stored.
To keep it from being abused, tests are limited per address and per domain, and a short proof-of-work puzzle is solved in your browser before each run.

The test runs from Cloudflare’s network, so it shows how your site treats the WebStatBot User-Agent and robots.txt. The real crawler may use different IP addresses of our nodes, so firewall rules based on IP address are not reflected here. WebStatBot respects robots.txt wherever it runs.

Notice. Because of a high share of abuse requests, this tool now only reports whether a URL resolves and responds. We do not download any content, it is just a ping (after checking robots.txt).