URL Encoder
Encode text for safe use inside URLs.
Web utilitiesRobots.txt Builder
Build a small robots.txt file with your chosen crawl directives.
In-browser processing No account needed Review before using
Loading your workspace...
About Robots.txt Builder
Build a small robots.txt file with your chosen crawl directives. This workspace gives you an immediate, inspectable result without creating an account. Inputs are not uploaded by the tool, and original files on your device are not overwritten.
Before you use the result
Generated links and snippets are drafts for you to review. Parsing a URL does not visit or verify the destination. A robots.txt instruction does not secure a private page.
Do I need to install software?
No desktop application is required. Open this page in a current browser with JavaScript enabled. PDF, OCR and Markdown features load an additional engine on demand; an internet connection may be needed the first time.
Are my files saved on the website?
The application does not upload or store your file contents. Results stay in this browser until you download or copy them. The server still receives normal page requests; see our privacy page for the distinction.
What should I do if a result looks wrong?
Check your input, units and options, then try a smaller example. Keep the original file and review important results manually. Browser format support and memory limits can affect file tools.
Keep your momentum.
Related tools for the next step.