# =================================== # Erstellt am: 2025-05-29T15:01:01+01:00 # Webseite: https://kulturist.ch # =================================== Sitemap: https://kulturist.ch/sitemap.xml User-agent: Googlebot Allow: / User-agent: googlebot-mobile Allow: / User-agent: googlebot-image Allow: / User-agent: Googlebot-Video Allow: / User-agent: AdsBot-Google Allow: / User-agent: AdsBot-Google-Mobile Allow: / User-agent: Googlebot-news Allow: / User-agent: APIs-Google Allow: / User-agent: Mediapartners-Google Allow: / User-agent: Google-Site-Verification Allow: / User-agent: bingbot Allow: / User-agent: yahoo-slurp Allow: / User-agent: DuckDuckBot Allow: / # =================================== # Schließe folgende Spider komplett aus: # =================================== User-agent: yahoo-mmcrawler Disallow: / User-agent: psbot Disallow: / User-agent: teoma Disallow: / User-agent: yandex Disallow: / User-agent: YandexBot Disallow: / User-agent: exabot Disallow: / User-agent: gigabot Disallow: / User-agent: ia_archiver Disallow: / User-agent: baiduspider Disallow: / User-agent: nutch User-agent: cityreview Disallow: / User-agent: WebReaper Disallow: / User-agent: WebCopier Disallow: / User-agent: Offline Explorer Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: EmailCollector Disallow: / User-agent: penthesilea Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / # =================================== # Crawling eines Verzeichnisses und seines Inhalts verhindern: # =================================== Allow: /event/ Disallow: /download/ Disallow: /notizen/ Disallow: /atoll/ Disallow: /AddEvent.com/ Disallow: /templates/ Disallow: /Templates/ Disallow: /jubilaeum/ Disallow: /rebekka_lindauer.html Disallow: /stefan_heuss.html Disallow: /download/ Disallow: /notizen/ Disallow: /atoll/ Disallow: /AddEvent.com/ Disallow: /templates/ Disallow: /Templates/ Disallow: /jubilaeum/ Disallow: /main/