User-agent: * Disallow: /registration Disallow: /login Disallow: /locale Disallow: /agentbob/querySearch Disallow: /agentbob/documentBasket Disallow: /agentbob/Unpublished Disallow: /agentbob/PublishedPrivate