← All toolsFree tool. No sign-up needed.

AI Crawler Access Test for WordPress

Test a public WordPress page for crawler user-agent blocking. Compare HTTP responses and review security plugins, server rules, and robots.txt.

Paste a published WordPress post URL that visitors can read while logged out. The test uses crawler user-agents from SiteSeed servers.

How to use the results

  1. Test the public article URL rather than wp-admin, a preview URL, or a password-protected draft.
  2. If a browser succeeds but a crawler request fails, review bot restrictions in your security plugin and hosting settings.
  3. Check robots.txt separately from HTTP access. Use host logs to confirm actual crawler visits before changing security rules.

Example review

A security plugin challenges an automated request even though robots.txt allows the URL. Review the matching plugin rule; the result alone does not establish whether a verified crawler is blocked.

For general instructions and FAQs, visit the AI Crawler Access Test.

Crawler access checks for your setup