User-agent: * Disallow: /merchant/ Disallow: /ssl/ Disallow: /xtras/ Disallow: /js/ Disallow: /javascripts/ Disallow: /assets/