Search AnyKit Tools

Type a tool name, tag, or category to quickly open any tool instantly.

Robots.txt Generator

Define crawling policies and control search engine access to your website

Sitemap Integration

Helps crawlers find your content structure faster

Blocked Paths
Custom Rules
robots.txt Preview
# Configure settings to generate robots.txt
Default Policy
Actions
Common Templates
Crawler Settings
SEC