User-Agent: * Allow: / Disallow: /api/ User-Agent: Amazonbot User-Agent: anthropic-ai User-Agent: Applebot-Extended User-Agent: AwarioRssBot User-Agent: AwarioSmartBot User-Agent: Bytespider User-Agent: CCBot User-Agent: ChatGPT-User User-Agent: ClaudeBot User-Agent: Claude-Web User-Agent: cohere-ai User-Agent: DataForSeoBot User-Agent: Diffbot User-Agent: FacebookBot User-Agent: FriendlyCrawler User-Agent: Google-CloudVertexBot User-Agent: Google-Extended User-Agent: GPTBot User-Agent: ImagesiftBot User-Agent: magpie-crawler User-Agent: Meta-ExternalAgent User-Agent: meta-externalagent User-Agent: NewsNow User-Agent: news-please User-Agent: OAI-SearchBot User-Agent: omgili User-Agent: omgilibot User-Agent: peer39_crawler User-Agent: peer39_crawler/1.0 User-Agent: PerplexityBot User-Agent: Quora-Bot User-Agent: Scrapy User-Agent: TurnitinBot Disallow: / Sitemap: https://bettertrail.com/sitemap.xml