Google: Noindexed Pages Do Not Effect Crawl Budget

Posted by

Google’s Search Relations team verifies that noindexed pages do not negatively affect a website’s crawl budget plan, no matter how many a website has.

This topic is attended to not when but thrice during the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Browse Supporters John Mueller and Gary Illyes take turns addressing three similar concerns from people concerned they have too many noindexed pages on their websites.

From Mueller’s and Illyes’ actions, we learn there’s no such thing as “a lot of” indexed pages. Even more, unless your site has over a million pages, there’s no need to fret about crawl budget.

Here’s a quick recap of each concern and answer.

Concern 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a question asking if an “extreme” variety of indexed pages is a concern for discovery or indexed.

Illyes says noindex is a tool to assist sites keep material out of search engines. Google motivates using the noindex tag when needed, and because of that, there are no negative effects connected with it.

“Noindex is a very effective tool that online search engine support to assist you, this website owner, keep content out of their indexes. For this reason, it doesn’t bring any unintentional impacts when it pertains to crawling and indexing. For example, having lots of pages with noindex will not influence how Google crawls and indexes your website.”

Concern 2: Ratio Of Indexed/Noindexed Pages

The following concern turns up at the 10:22 mark:

“Should we watch on the ratio in between indexed and non-indexed pages in Browse Console in order to better recognize perhaps squandered crawl budget plan on non-indexed pages?”

Mueller debunks that websites need to try to balance their indexed and nonindexed pages.

To that end, crawl budget plan is an element that few sites need to think of; Mueller states:

“No, there is no magic ratio to watch out for. Likewise, for a site that’s not enormous, with less than a million pages, perhaps, you actually do not require to worry about the crawl budget plan of your site. It’s fine to remove unneeded internal links, but for little to medium-sized sites, that’s more of a site hygiene topic than an SEO one.”

Question 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a concern turns up about no indexed pages that’s somewhat different from the previous 2.

The concern checks out:

“A great deal of SEOs are grumbling about having countless URLs flagged as excluded by noindex in Google Browse Console. All to rubbish internal search pages connected from spammy websites. Is this a problem for crawl budget?”

Ilyes reiterates the earlier point about noindex being a tool for sites to use as required.

Assuming the pages are purposefully noindexed, there’s no requirement to worry about Browse Console flagging them. It doesn’t suggest you’re doing anything incorrect.

Illyes states:

“Noindex exists to assist you keep things out of the index, and it does not featured unintentional negative impacts, as we said formerly. If you wish to ensure that those pages or their URLs, more specifically, don’t wind up in Google’s index, continue utilizing noindex and do not stress over crawl budget plan.”

Source: Google