User-Agent: * Disallow: */checkout/ Disallow: */order/ Disallow: */loggedin/ Disallow: *?filter* Disallow: *?s=* Disallow: *?_gl=* Disallow: *?getFormHtmlOnly* Disallow: *?formId=* Disallow: *?country_id= Disallow: *?cat_id= Disallow: /search/ Disallow: /upload/scripts/ Disallow: /specifications-pdf/ Disallow: /food-checkpostalcode Disallow: *utm_medium=tradetracker User-agent: PetalBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: newspaper/0.2.8 Disallow: / User-agent: InfoTigerBot Disallow: / User-agent:BLEXBot/1.0 Disallow: / User-agent:IsraBot Disallow: / User-agent:Python/3.9 aiohttp/3.8.1 Disallow: / User-agent:Qwantify/2.4w Disallow: / User-agent:proximic Disallow: / User-agent:Orthogaffe Disallow: / User-agent:Scrapy/2.5.0 Disallow: / User-agent:UbiCrawler Disallow: / User-agent:DOC Disallow: / User-agent:Zao Disallow: / User-agent:sitecheck.internetseer.com Disallow: / User-agent:Zealbot Disallow: / User-agent:MSIECrawler Disallow: / User-agent:SiteSnagger Disallow: / User-agent:WebStripper Disallow: / User-agent:WebCopier Disallow: / User-agent:Fetch Disallow: / User-agent:Offline Explorer Disallow: / User-agent:Teleport Disallow: / User-agent:TeleportPro Disallow: / User-agent:WebZIP Disallow: / User-agent:linko Disallow: / User-agent:HTTrack Disallow: / User-agent:Microsoft.URL.Control Disallow: / User-agent:Xenu Disallow: / User-agent:larbin Disallow: / User-agent:libwww Disallow: / User-agent:ZyBORG Disallow: / User-agent:Download Ninja Disallow: / User-Agent: Baiduspider Disallow: / User-Agent: CazoodleBot Disallow: / User-Agent: Fasterfox Disallow: / User-Agent: Ingrid Crawl-delay: 20 User-Agent: Jyxobot Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: ShopWiki Disallow: / User-Agent: msnbot Crawl-Delay: 20 User-Agent: Slurp Crawl-delay: 20 User-Agent: Yahoo! Slurp Crawl-delay: 20 User-agent: rogerbot Crawl-delay: 2 User-agent: SemrushBot Crawl-delay: 5 User-agent: SiteAuditBot Crawl-delay: 5 User-agent: AhrefsBot Crawl-Delay: 5 User-agent: Bytedance Crawl-Delay: 5 User-agent: Bytespider Crawl-Delay: 5 User-agent: Mediapartners-Google Disallow: *utm User-agent: AdsBot-Google Disallow: *utm User-agent: AdsBot-Google-Mobile Disallow: *utm User-agent: Screaming Frog SEO Spider Disallow: / User-Agent: * Sitemap: https://rijschoolmaraya.nl/sitemap-index.xml