User-agent: * Disallow: /administrator/ Disallow: /cache/ Disallow: /components/ Disallow: /images/ Disallow: /includes/ Disallow: /installation/ Disallow: /language/ Disallow: /libraries/ Disallow: /media/ Disallow: /modules/ Disallow: /plugins/ Disallow: /templates/ Disallow: /tmp/ Disallow: /xmlrpc/ # prevent googlebot and other snake programs User-agent: * Disallow: / # slow down Yahoo, if it get through the above attempt to stop snakes User-agent: Slurp Crawl-delay: 10