Home / Merchant Center issues / Mobile page not crawlable due to robots.txt

"Mobile page not crawlable due to robots.txt" in Merchant Center: what it means and how to fix it

"Mobile page not crawlable due to robots.txt" is an item-level issue: it affects the specific products it's attached to.

Checks 2 things on your site related to this issue. Score and issue count in about a minute.

Not quite the wording you see? Compare the look-alike landing page messages.

What it usually looks like on a store

A robots.txt rule meant for one crawler or one folder ends up blocking Google's mobile crawler from product pages.

What Google says

robots.txt forbids Google's crawler from downloading the landing page when crawling with a mobile user agent, which stops Google's automated quality and policy checks. Affected products stop showing on desktop and mobile until the page can be crawled.

robots.txt forbids Google's crawler to download the landing page when crawling with a mobile user-agent.Google, How to fix: Mobile page not crawlable due to robots.txt
Affected products will stop showing in Shopping ads and free product listings for desktop and mobile devices until we are able to crawl the landing page.Google, How to fix: Mobile page not crawlable due to robots.txt
The landing page cannot be crawled by Google because robots.txt forbids Google's crawler to download the landing page when crawling with a mobile user-agent.Google, How to fix: Unable to do quality & policy checks on mobile product pages

Also seen as: "Mobile page not crawlable due to robots.txt (for desktop)", "Unable to do quality & policy checks on mobile product pages".

How to fix it

Based on Google's help pages, in plain language:

  1. Allow Googlebot and Googlebot-image in robots.txt.
  2. Test with the URL Inspection tool using the Smartphone fetch type.
  3. Update items with a new data source upload or the Merchant API.

What to check on your website

These are the checks we run that relate to this issue. A problem in any of them can be enough on its own.

  • Google's crawlers are allowed: Your robots.txt doesn't block Googlebot, Storebot-Google or AdsBot-Google from your homepage or product pages.
  • Mobile-friendly pages: Pages declare a mobile viewport so they render properly on phones, where most shopping clicks happen.

Requesting a review

Google says errors should disappear within a couple of days after fixing and updating items.

Questions

Can a website scan fix "Mobile page not crawlable due to robots.txt"?

A scan finds the website problems behind it (google's crawlers are allowed, mobile-friendly pages) and tells you how to fix each one. You still fix them on your store and then ask Google for a review where Merchant Center offers one.

Sources

Checked against Google's help pages on 2026-10-08. Listvane is an independent tool made by Great Work LLC. It isn't affiliated with, endorsed by or sponsored by Google. Google and Google Merchant Center are trademarks of Google LLC.

Find what's behind "Mobile page not crawlable due to robots.txt" on your store

Enter your address. You'll see a score and issue count before you decide on the full report.