Google: Noindexed Pages Do Not Effect Crawl Budget

Posted by

Google’s Search Relations group verifies that noindexed pages don’t adversely impact a site’s crawl budget, no matter how many a website has.

This topic is attended to not once but thrice during the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Search Advocates John Mueller and Gary Illyes take turns responding to three similar concerns from individuals worried they have too many noindexed pages on their sites.

From Mueller’s and Illyes’ reactions, we learn there’s no such thing as “too many” indexed pages. Further, unless your site has more than a million pages, there’s no requirement to fret about crawl budget.

Here’s a quick recap of each concern and response.

Question 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a concern asking if an “extreme” variety of indexed pages is a concern for discovery or indexed.

Illyes says noindex is a tool to help websites keep content out of online search engine. Google motivates utilizing the noindex tag when needed, and for that reason, there are no negative effects associated with it.

“Noindex is an extremely powerful tool that online search engine support to assist you, this website owner, keep content out of their indexes. For this factor, it does not bring any unexpected impacts when it concerns crawling and indexing. For instance, having lots of pages with noindex will not affect how Google crawls and indexes your site.”

Question 2: Ratio Of Indexed/Noindexed Pages

The following concern comes up at the 10:22 mark:

“Should we keep an eye on the ratio between indexed and non-indexed pages in Search Console in order to much better acknowledge perhaps squandered crawl budget on non-indexed pages?”

Mueller debunks that sites need to try to balance their indexed and nonindexed pages.

To that end, crawl spending plan is an element that couple of sites require to consider; Mueller states:

“No, there is no magic ratio to watch out for. Also, for a website that’s not massive, with less than a million pages, maybe, you actually do not need to fret about the crawl spending plan of your website. It’s great to get rid of unneeded internal links, but for little to medium-sized sites, that’s more of a website health topic than an SEO one.”

Concern 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a question turns up about no indexed pages that’s somewhat different from the previous two.

The concern reads:

“A great deal of SEOs are grumbling about having millions of URLs flagged as left out by noindex in Google Search Console. All to rubbish internal search pages linked from spammy sites. Is this an issue for crawl budget?”

Ilyes repeats the earlier point about noindex being a tool for websites to utilize as needed.

Assuming the pages are deliberately noindexed, there’s no need to fret about Search Console flagging them. It does not imply you’re doing anything wrong.

Illyes states:

“Noindex is there to help you keep things out of the index, and it doesn’t featured unexpected negative effects, as we said previously. If you wish to make sure that those pages or their URLs, more specifically, do not end up in Google’s index, continue utilizing noindex and don’t worry about crawl budget.”

Source: Google