Free Robots.txt Generator for Blogger & WordPress
Build a clean, valid robots.txt file for your Blogger or WordPress site in seconds. Pick your platform, add your sitemap URL, and the tool writes the User-agent, Disallow, Allow and Sitemap directives for you — no coding needed.
Quick answer: This robots.txt generator creates a ready-to-upload robots.txt file for Blogger/Blogspot or WordPress. Choose your platform, paste your sitemap URL, click Generate Robots.txt, then copy or download the result and upload it to your site root. Everything runs in your browser — nothing is sent to a server.
Robots.txt Generator
Each platform gets its own recommended rules.
Optional. If you leave it empty, no Sitemap: line is added.
Blogger only. Adds a second Sitemap: line.
Ready. Choose your platform, add a sitemap URL if you have one, then click Generate Robots.txt.
What This Robots.txt Generator Does
It turns your platform choice and sitemap URLs into a plain-text robots.txt file that follows the Robots Exclusion Protocol (RFC 9309) and Google's crawling guidelines.
Blogger & WordPress presets
One dropdown switches the entire rule set, so you get the directives that actually matter for your platform instead of a generic block.
Blogger search blocking
The Blogger preset adds Disallow: /search so duplicate search and archive pages stop eating crawl budget.
WordPress admin protection
The WordPress preset disallows /wp-admin/ while allowing /wp-admin/admin-ajax.php, which front-end AJAX still needs.
Sitemap directives
Every sitemap URL you enter is written as a proper Sitemap: line, helping crawlers find your content faster.
URL checking
Malformed sitemap URLs are reported before you generate, and a missing https:// prefix is added automatically.
Copy or download
Copy the file to your clipboard in one click, or download it as robots.txt and upload it to your site root.
How to Use the Robots.txt Generator
Four steps, about 30 seconds.
1. Choose your platform
Select Blogger / Blogspot or WordPress. The available fields and the generated rules change with your choice.
2. Add your sitemap URL
Paste your main sitemap address, for example https://yourblog.com/sitemap.xml. On Blogger you can also add a separate pages sitemap.
3. Generate the file
Click Generate Robots.txt. The tool validates your URLs and writes the finished file into the output box.
4. Copy, download and upload
Copy the code or download robots.txt, then publish it as described in the upload steps below.
Where to Upload Your robots.txt
The file must be reachable at https://yourdomain.com/robots.txt — the root of your domain, not a subfolder.
Blogger / Blogspot
Open Settings → Crawling and indexing → Custom robots.txt, turn the custom option on, paste the generated code and save. Blogger serves it at your blog URL automatically.
WordPress (plugin)
In Yoast SEO or Rank Math, open the Tools → File editor section for robots.txt, paste the code and save. The plugin writes the file for you.
WordPress (manual)
Download the file and upload it to your site's root folder using cPanel File Manager, FTP, or your host's file tools. Set permissions to 644.
Check it worked
Visit yourdomain.com/robots.txt in a browser and confirm the text matches. Then test the file with Google Search Console's robots.txt report.
Blogger vs WordPress: What the Generator Outputs
The exact directives this tool writes for each platform.
| Directive | Blogger / Blogspot | WordPress |
|---|---|---|
User-agent |
* (all crawlers) |
* (all crawlers) |
Disallow |
/search |
/wp-admin/ |
Allow |
/ |
/wp-admin/admin-ajax.php |
Sitemap |
Each sitemap URL you enter | Each sitemap URL you enter |
Robots.txt Best Practices
Short rules that keep your file useful instead of harmful.
Never block CSS, JS or images
If crawlers cannot load the files your pages depend on, they may render and understand your content poorly. Keep stylesheets, scripts and images crawlable.
robots.txt controls crawling, not indexing
A Disallow rule asks crawlers not to fetch a URL. To keep a page out of search results entirely, use a noindex meta tag or HTTP header instead.
Keep it short
A handful of clear rules is easier to maintain and less likely to block something you wanted indexed. Add rules only when you have a reason.
Test after every change
After uploading, check the live file and run it through Google Search Console's robots.txt report before assuming it works.
Robots.txt Generator FAQ
Answers to the questions people ask most about robots.txt files.
What is a robots.txt file?
A robots.txt file is a plain text file that lives in your site's root directory — for example https://example.com/robots.txt — and tells crawlers which URLs they may request. It uses simple directives such as User-agent, Disallow, Allow and Sitemap, and is defined by the Robots Exclusion Protocol (RFC 9309).
Is this robots.txt generator free?
Yes. The tool is free to use, requires no sign-up and has no usage limits. It runs entirely in your browser, so you can generate as many robots.txt files as you need for your own or your clients' sites.
How do I add robots.txt to my Blogger site?
In Blogger, open Settings → Crawling and indexing → Custom robots.txt, enable the custom robots.txt option, paste the generated code and save. Blogger then serves it at your blog address. The Blogger preset in this tool disallows /search so duplicate search and archive pages are not crawled.
How do I add robots.txt to WordPress?
Either paste the code into the robots.txt editor of an SEO plugin such as Yoast SEO or Rank Math, or download the file and upload it to your site's root folder with cPanel File Manager, FTP or your host's file tools. The WordPress preset blocks /wp-admin/ but allows /wp-admin/admin-ajax.php so front-end AJAX requests keep working.
What is the difference between the Blogger and WordPress output?
The Blogger preset adds Disallow: /search to keep duplicate search and archive pages out of the crawl queue. The WordPress preset adds Disallow: /wp-admin/ plus Allow: /wp-admin/admin-ajax.php. Both presets start with User-agent: * and add one Sitemap: line for every sitemap URL you provide.
Does robots.txt affect AI search engines like ChatGPT, Perplexity and Gemini?
Crawlers used by AI search and assistant products generally respect robots.txt, so the file can affect whether those systems fetch your pages. If you want a page to be available for AI answers and citations, do not disallow it. Remember that robots.txt controls crawling rather than indexing — a disallowed page can still appear in results if it is linked from elsewhere.
What if I don't have a sitemap URL?
Leave the sitemap field empty. The tool will still generate a valid robots.txt file — it simply omits the Sitemap: directive and tells you so in the status message. You can regenerate the file with your sitemap URL at any time.
Do I need a robots.txt file for SEO?
It is not strictly required — search engines can crawl a site that has no robots.txt file at all — but it helps you manage crawl budget and keep low-value URLs such as Blogger search pages or WordPress admin paths out of the crawl queue. Only disallow URLs you genuinely do not want crawled, and test the file after every change.