Home / Merchant Center issues / Mobile page not crawlable due to robots.txt

Why does Merchant Center say "Mobile page not crawlable due to robots.txt", and how do you fix it?

robots.txt forbids Google's crawler from downloading the landing page when crawling with a mobile user agent, which stops Google's automated quality and policy checks. Affected products stop showing on desktop and mobile until the page can be crawled. Google applies it to the specific products it's attached to.

Checks 2 things on your site related to this issue. Score and issue count in about a minute.

Not quite the wording you see? Compare the look-alike landing page messages.

What it usually looks like on a store

A robots.txt rule meant for one crawler or one folder ends up blocking Google's mobile crawler from product pages.

What Google says

robots.txt forbids Google's crawler from downloading the landing page when crawling with a mobile user agent, which stops Google's automated quality and policy checks. Affected products stop showing on desktop and mobile until the page can be crawled.

robots.txt forbids Google's crawler to download the landing page when crawling with a mobile user-agent.Google, How to fix: Mobile page not crawlable due to robots.txt
Affected products will stop showing in Shopping ads and free product listings for desktop and mobile devices until we are able to crawl the landing page.Google, How to fix: Mobile page not crawlable due to robots.txt
The landing page cannot be crawled by Google because robots.txt forbids Google's crawler to download the landing page when crawling with a mobile user-agent.Google, How to fix: Unable to do quality & policy checks on mobile product pages

Also seen as: "Mobile page not crawlable due to robots.txt (for desktop)", "Unable to do quality & policy checks on mobile product pages".

How to fix it

Based on Google's help pages, in plain language:

  1. Allow Googlebot and Googlebot-image in robots.txt.
  2. Test with the URL Inspection tool using the Smartphone fetch type.
  3. Update items with a new data source upload or the Merchant API.

Reviews look at the whole website, not one message, so go through the Merchant Center website checklist before you request one. To see how a scan reports problems like this, open the sample report.

What to check on your website

2 of our checks relate to mobile page not crawlable due to robots.txt, and a problem in any one of them can be enough:

  • Google's crawlers are allowed: Your robots.txt doesn't block Googlebot, Storebot-Google or AdsBot-Google from your homepage or product pages.
  • Mobile-friendly pages: Pages declare a mobile viewport so they render properly on phones, where most shopping clicks happen.

Requesting a review

Google says errors should disappear within a couple of days after fixing and updating items.

Questions

Can a website scan fix "Mobile page not crawlable due to robots.txt"?

A scan finds the website problems behind it (google's crawlers are allowed, mobile-friendly pages) and tells you how to fix each one. You still make the changes on your store, then ask Google for a review where Merchant Center offers one, after a re-scan shows the list is clear.

Sources

Quotes checked against Google's pages on 2026-11-05. Terms like account-level issue and cool-down period are defined in the glossary. Listvane is an independent tool made by Great Work LLC. It isn't affiliated with, endorsed by or sponsored by Google. Google and Google Merchant Center are trademarks of Google LLC.

Find what's behind "Mobile page not crawlable due to robots.txt" on your store

Enter your address. You'll see a score and issue count before you decide on the full report.