AllIDLinkChecker

User-Agent

AllIDLinkChecker/1.0 (+https://allid.me/bot)

How it behaves

• Sends a HEAD request first, then a capped GET if needed — single fetch per check.
• 5-second timeout per request.
• Response body capped at 64 KB.
• No JavaScript, no cookies, no form submissions.
• We store only the HTTP status code.

Cadence

We keep things polite and don't hammer hosts.

What we respect

• robots.txt rules targeting the AllIDLinkChecker user-agent.
• The Crawl-delay directive.
• HTTP redirects and standard cache headers.

How to block us

Block specific paths (e.g. your admin area) while allowing the rest of the site:

User-agent: AllIDLinkChecker
Disallow: /admin
Disallow: /wp-admin
Disallow: /private

Or block the entire site:

User-agent: AllIDLinkChecker
Disallow: /

Changes take effect within 24 hours (our cache lifetime).

Contact

Reach us through our about page.