User-agent: * Disallow: /customer/ Disallow: /Action/ Disallow: /Admin/ Disallow: /provider/