User-agent: Googlebot-Image Disallow: / User-agent: * Disallow: *.vcf$ Disallow: /family/wp-* Disallow: /family/feed/* Disallow: /family/trackback/* Disallow: /family/rss/* Disallow: /family/comments/feed/* Disallow: /family/page/* Disallow: /family/date/* Disallow: /family/comments/* Disallow: /family/cgi-bin/* Disallow: /family/archives/tag/* Disallow: /family/category/* Disallow: /family/wp-content/plugins/* Disallow: /bolivia/wp-* Disallow: /bolivia/feed/* Disallow: /bolivia/trackback/* Disallow: /bolivia/rss/* Disallow: /bolivia/comments/feed/* Disallow: /bolivia/page/* Disallow: /bolivia/date/* Disallow: /bolivia/comments/* Disallow: /bolivia/cgi-bin/* Disallow: /bolivia/archives/tag/* Disallow: /bolivia/category/* Disallow: /bolivia/wp-content/plugins/* User-agent: Googlebot Disallow: /*.vcf$ Disallow: /*.gif$ Disallow: /*.pdf$ # I'm allowing these because they are AI Search Crawlers # and I want my website to appear in AI-assisted search. # User-agent: Applebot # User-agent: CCBot # User-agent: ChatGPT-User # User-agent: DuckAssistBot # User-agent: Google-Extended # User-agent: ICC-Crawler # User-agent: Meta-ExternalFetcher # User-agent: OAI-SearchBot # I'm blocking AI data scrapers, though. User-agent: AI2Bot User-agent: Ai2Bot-Dolma User-agent: Amazonbot User-agent: anthropic-ai User-agent: Applebot-Extended User-agent: Bytespider User-agent: Claude-Web User-agent: ClaudeBot User-agent: cohere-ai User-agent: cohere-training-data-crawler User-agent: Crawlspace User-agent: Diffbot User-agent: FacebookBot User-agent: FriendlyCrawler User-agent: GoogleOther User-agent: GoogleOther-Image User-agent: GoogleOther-Video User-agent: GPTBot User-agent: iaskspider/2.0 User-agent: ImagesiftBot User-agent: img2dataset User-agent: ISSCyberRiskCrawler User-agent: Kangaroo Bot User-agent: Meta-ExternalAgent User-agent: omgili User-agent: omgilibot User-agent: PanguBot User-agent: PerplexityBot User-agent: PetalBot User-agent: Scrapy User-agent: SemrushBot-OCOB User-agent: SemrushBot-SWA User-agent: Sidetrade indexer bot User-agent: Timpibot User-agent: VelenPublicWebCrawler User-agent: Webzio-Extended User-agent: YouBot Disallow: / Sitemap: http://www.joshrenaud.com/sitemap.xml Sitemap: http://www.joshrenaud.com/family/sitemap.xml Sitemap: http://www.joshrenaud.com/bolivia/sitemap.xml