# Block leaky Cloudflare endpoints # -------------------------------- User-agent: * User-agent: AdsBot-Google Disallow: /cdn-cgi/bm/cv/ Disallow: /cdn-cgi/challenge-platform/ Disallow: /cdn-cgi/images/trace/ Disallow: /cdn-cgi/rum Disallow: /cdn-cgi/scripts/ Disallow: /cdn-cgi/styles/ Disallow: /cdn-fpw/sxg/ # Ban noisy bots # -------------- User-agent: Nuclei User-agent: WikiDo User-agent: Riddler User-agent: PetalBot User-agent: Zoominfobot User-agent: Go-http-client User-agent: Node/simplecrawler User-agent: CazoodleBot User-agent: DotBot User-agent: dotbot/1.0 User-agent: Gigabot User-agent: Barkrowler User-agent: BLEXBot User-agent: magpie-crawler User-agent: MJ12bot User-agent: 008 User-agent: Yandex User-agent: Baiduspider User-agent: AhrefsBot User-agent: Synthesio User-agent: SemrushBot User-agent: MauiBot Disallow: / # Adsbot doesn't ever need to crawl fonts # --------------------------------------- User-agent: AdsBot-Google Disallow: /*.woff2 # Block workers # ------------- User-agent: * User-agent: AdsBot-Google Disallow: /workers/ # Block partytown # --------------- User-agent: * User-agent: AdsBot-Google Disallow: /~partytown # Block some general OC endpoints # ------------------------------- User-agent: * User-agent: AdsBot-Google Disallow /nmcadmin/ Disallow /systemc/ Disallow /catalog/ Disallow: /private/ Disallow: /hidden/ Disallow: /temp/ Disallow: /download Disallow: /mods Disallow: /system Disallow: /system_ Disallow: /vendor Disallow: /vqmod Disallow: /*&limit Disallow: /*?limit Disallow: /*?sort Disallow: /*&sort Disallow: /*?tag Disallow: /*&tag Disallow: /*?manufacturer_id Disallow: /*?route=checkout/ Disallow: /*?route=account/ Disallow: /*?route=product/search Disallow: /*journal_blog_tag* Disallow: /*getfile&product_attach_file_id* Disallow: /fisiere/ Sitemap: https://www.nmcromania.ro/sitemap.xml