User-agent: * Allow: / User-agent: Googlebot Allow: / User-agent: BingBot Crawl-delay: 10 Allow: / User-agent: Adsbot-Google Allow: / User-agent: AdsBot-Google-Mobile Allow: / User-agent: Googlebot-image Allow: / User-agent: facebookexternalhit Allow: / User-agent: Facebot Allow: / Sitemap: https://www.dawnthrive.co.uk/robots.txt