lang: vi slug: robots-txt-generator title: ‘robots.txt Generator — With AI Crawler Controls (GPTBot, ClaudeBot, PerplexityBot)’ description: ‘Generate a clean robots.txt with one click — set sitemap, disallow paths, and block AI crawlers like GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, CCBot, and Google-Extended. Copy-paste ready for your site root.’ date: 2026-05-18 lastmod: 2026-05-19 layout: “tool-robots-txt-generator” tool_id: “robots-txt-generator” #

featureImage: /images/articles/robotstxt-생성기-ai-크롤러-제어-gptbot-claudebot.jpg #