Robots.txt editor

Edit the site's robots.txt in a code editor; it is served at /robots.txt.

SEO Manager > Robots.txt has a plain-text code editor for the site's robots.txt. Whatever is saved is served as text/plain at /robots.txt. When nothing is saved, the editor pre-fills a suggested file (allow all plus a Sitemap line), but the live /robots.txt only returns 'User-agent: *' until you click Save.

How it works

  • Empty setting: output is the single line 'User-agent: *'.

When to use it

  • Block crawling of a staging section
  • Point crawlers to the sitemap

Limitations

  • No validation of robots.txt syntax
  • The default shown in the editor is not live until saved

Availability

  • Works in Designer and MCP.
  • Included in every plan.
  • Limits: MCP: 20,000 characters

How to use it.

  1. Open SEO Manager > Robots.txt
  2. Edit the text
  3. Click Save

Related features.

No card needed

Build it today.Pay when it goes live.

Every feature is unmetered while you build. Checkout opens the first time you publish.