######################################################################################################################## ### AI crawler reference ### ### The link below provides instructions to what kind of content can be used to train AI models on this website ### ### https://finanswatch.dk/ai.txt ######################################################################################################################## # Common crawl User-agent: CCBot Disallow: / # OpenAI (ChatGPT) User-agent: GPTBot Disallow: / # OpenAI (ChatGPT realtime search) User-agent: ChatGPT-User Disallow: / # Anthropic User-agent: anthropic-ai Disallow: / User-agent: * Disallow: /archive/ Disallow: /auth Disallow: /user/addTrial Disallow: /metrics Disallow: /health Disallow: /cache Disallow: /esi Disallow: /mark-variant-won Disallow: /article/5253094 Disallow: /Sygdom___Sundhed/article5253094.ece Disallow: /service/cbp Sitemap: https://finanswatch.dk/sitemapindex.xml