← All tasks
What you'll do
Before an SEO audit, fetch the site's robots.txt file to review its crawl rules.
Scenario
Before an SEO audit, fetch the site's robots.txt file to review its crawl rules.
Ready to try it?
Create a free account and try "Check robots.txt Rules" free for 7 days, no card required. Earn 100 XP and track your internship progress.
Already have an account? Sign in