robots.txt for WordPress

What to let crawlers see, without blocking what matters.

Genuinely free. No sign-up, no email, no limits, no cookies. We don't store the URL you analyse.

Sitemap URL

Block /wp-admin/ (allowing admin-ajax)Block internal search pages (?s=)

Code

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /?s=

Sitemap: https://esempio.it/sitemap.xml

What it's for

robots.txt guides crawlers: a wrong block can make the site vanish from Google, an over-permissive one exposes useless pages. This base blocks what should be blocked while letting admin-ajax through, which the site needs to work.

← All WordPress tools

Frequently asked questions

›Why not block all of /wp-admin/?

Because admin-ajax.php lives in there and is used by the frontend too. Blocking the whole folder but allowing admin-ajax.php is the correct rule, and it's the one this tool generates.