Free Robots.txt Generator: Control Crawlers and Block AI Scrapers
Your robots.txt controls which crawlers can access your site. Our free generator helps you allow search engines, block AI training scrapers like GPTBot and CCBot, and protect private paths.