# www.robotstxt.org/ # Allow crawling of all content except for admin page User-agent: * Disallow: /admin/