Crawling & Indexing

Robots.txt Generator

← Back to All SEO Tools
Tool Controls & Inputs
Output / Live Preview

Features & Highlights

  • Supports User-Agent rules for Googlebot, Bingbot, Yandex, DuckDuckBot, and ALL (*)
  • Custom Allow and Disallow directory paths
  • Crawl-Delay specification (seconds)
  • Sitemap XML path inclusion
  • 1-click Copy or Download robots.txt file

How to Use

Configure user agents, specify directory paths to allow or block from crawlers, enter your sitemap URL, then click 'Download robots.txt'.