# This file will tell all robots to avoid URLs User-agent: * Disallow: /admin* Disallow: /js* Disallow: /_* Disallow: /bin Disallow: /app* Disallow: /aspnet* Disallow: /log* Disallow: /temp*