User-agent: * Disallow: /adminforce/ Disallow: /adscan/ Disallow: /ajax/ Disallow: /backups/ Disallow: /cache/ Disallow: /crons/ Disallow: /lib/ Disallow: /spider/