User-agent: * Disallow: /searching/* Disallow: /results/* User-agent: Googlebot User-agent: Googlebot-Image Allow: / User-agent: Baiduspider Disallow: / User-agent: BLEXBot Disallow: / User-agent: Cliqzbot Disallow: / User-agent: CCBot Disallow: / User-agent: Exabot Disallow: / User-agent: GarlikCrawler/1.1 (http://garlik.com/, crawler@garlik.com) Disallow: / User-agent: grapeshot Disallow: / User-agent: Linguee Disallow: / User-agent: MJ12bot Disallow: / User-agent: proximic Disallow: / User-agent: SemrushBot Disallow: / User-agent: Slurp Crawl-delay: 20 User-Agent: The Knowledge AI Disallow: / User-agent: YandexBot Disallow: / Sitemap: https://freepeoplesearch.com/sitemap.xml