NZRetailDiscovery is a retail market research crawler. It reads publicly available product pages and product data on New Zealand online stores, about once a night and one request at a time, to follow product ranges, prices and stock availability.
Requests carry the user agent NZRetailDiscovery/1.0 and are signed
with Web Bot Auth.
Our public keys are at /.well-known/http-message-signatures-directory.
We read each store's robots.txt before every crawl and follow it, including rules for all bots and any Crawl-delay. To stop NZRetailDiscovery visiting your store, add this to your robots.txt:
User-agent: NZRetailDiscovery
Disallow: /Or email bot@nzretaildiscovery.com and we will remove your store.
Contact: bot@nzretaildiscovery.com