Build a clean robots.txt file: pick user agents, add Allow/Disallow rules, set a sitemap URL — with live preview and copy.
It blocks the selected user agent from crawling the whole site. Most sites use selective rules instead.
