# Replykar — robots.txt # https://replykar.online # # One group on purpose: a crawler that matches its own group ignores the # `*` group, so separate per-bot groups used to drop the private-path rules # for AI crawlers. Search and AI crawlers all get the same access to the # public site and the same Disallow list for private pages. Disallow lines # come first so parsers that stop at the first match behave like Google. User-agent: * User-agent: Googlebot User-agent: Google-Extended User-agent: Bingbot User-agent: DuckDuckBot User-agent: Applebot User-agent: Applebot-Extended User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: Claude-Web User-agent: Claude-User User-agent: Claude-SearchBot User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: CCBot User-agent: Amazonbot User-agent: Meta-ExternalAgent User-agent: Bytespider User-agent: cohere-ai User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: Meta-ExternalFetcher Disallow: /pages/dashboard.html Disallow: /pages/login.html Disallow: /pages/signup.html Disallow: /pages/global-login.html Disallow: /pages/global-signup.html Disallow: /pages/admin-preview.html Disallow: /pages/admin-kit-orders.html Disallow: /pages/admin-managed.html Disallow: /pages/admin-affiliates.html Disallow: /pages/admin-acquisition.html Disallow: /pages/affiliate-login.html Disallow: /pages/affiliate-dashboard.html Disallow: /pages/affiliate-apply.html Disallow: /pages/kit-purchase.html Disallow: /pages/kit-connect.html Disallow: /pages/kit-intake.html Disallow: /pages/kit-status.html Disallow: /pages/thank-you.html Disallow: /pages/no-business.html Disallow: /api/ Disallow: /admin/ Disallow: /review/ Disallow: /preview/ Allow: / Allow: /index.html Allow: /pages/about.html Allow: /pages/contact.html Allow: /pages/privacy.html Allow: /pages/terms.html Allow: /pages/refund.html Allow: /blog/ Sitemap: https://replykar.online/sitemap.xml Sitemap: https://replykar.online/sitemap-businesses.xml