Robots.txt Generator

Build robots.txt with visual editor for crawl rules and sitemap.

9/10 uses left today

Rule 1

User-agent

Allow

Disallow

Sitemap URL

robots.txt

User-agent: *
Allow: /
Disallow: /api/
Disallow: /admin/
Disallow: /dashboard/

Sitemap: https://example.com/sitemap.xml

Related Tools

Searchable reference for all HTTP status codes with descriptions.

Send HTTP requests (GET, POST, PUT, DELETE) and inspect responses. Like Postman in your browser.

Run SQL queries in your browser with in-memory SQLite. Practice joins, aggregations, and more.