User-Agent: * Allow: / Disallow: /api/ Disallow: /account Disallow: /login User-Agent: OAI-SearchBot User-Agent: ChatGPT-User User-Agent: PerplexityBot User-Agent: Claude-SearchBot User-Agent: Claude-User User-Agent: Bingbot Allow: / Disallow: /api/ Disallow: /account Disallow: /login Sitemap: https://newsiteradar.com/sitemap.xml