About our crawler

Requests from GreatWorkStoreScanner come from Listvane. Someone asked us to check a store's website for the issues Merchant Center reviews look at, usually the store owner or their agency.

  • We read at most 25 pages per scan, one at a time, with a pause between requests.
  • We follow robots.txt. To block us, add:
    User-agent: GreatWorkStoreScanner
    Disallow: /
  • One exception: on Shopify stores we read the standard policy pages under /policies/ (refund, shipping, terms, privacy, contact information) even though Shopify's default robots.txt disallows that folder. A scan is requested for a specific store, and those pages are what Merchant Center reviews check. If your robots.txt has rules for our crawler by name (like the one above), we follow them exactly, with no exception.
  • We only read public pages. We never log in, submit forms, add to cart or place orders.
  • Monitored stores are re-scanned once a week.

Questions or problems: hello@greatwork.company.