What is crawl budget?
Crawling (English crawling) in SEO terminology is scanning of website pages by a search robot, their indexing to form search results.
Crawl budget is a limit that is allocated
To each site for this scanning. That is, it is a limitation on the number of pages that a search robot can index in a given time period.
This term europe cell phone number list was introduce by Google, so it is primarily associate with the activities of Googlebot.
The crawling budget is calculate for each site separately, bason its user demand and server availability.
Who needs to know how to manage it and why?
Vladimir Sumatokhin, SEO expert technologist at SEO.RUVladimir Sumatokhin, SEO expert technologist at SEO.RU:
“Crawl budget is often overlooke. If you have a small site or are optimizing it, there is no reason to worry. But if you have a large project, optimizing the crawl budget is vital, as it will affect the ranking of the site in search engines. Otherwise, it may turn out that part of your site is not indexe and does not participate in search.”
Why optimize the indexation budget? To avoid wasting it.
Look: Google sets a budget for indexing your site — let’s say 200 pages per day. It may seem like a lot, but if your web resource is a huge online store with a constantly update assortment, then តើហត្ថលេខាអេឡិចត្រូនិត្រូវបានបន្តជាថ្មីញឹកញាប់ប៉ុណ្ណា? 200 new pages on your site alone can appear in 1 day. And there are other pages that also nee to be displaye in search results. The robot may not be able to crawl everything at once.
Another common problem: pages for low-frequency queries get into the index, but fly by for high-frequency ones. For example, a page with a pink toy crocodile keychain will get to the top, but a section bank email list with the entire assortment of keychains will not.
Therefore, without optimizing the
crawling budget, problems with indexing the entire site will begin: if the search robot runs out of budget on a certain page, then the rest will simply cease to exist for it.
Where can I see my site’s crawl budget?
The whole story about the indexing limit is tieto Google, so the most convenient way is to look at crawl statistics in Google Search Console.
To do this, open the “Previous Tools and Reports” menu, and then click on “Scan Statistics”:
Previous tools and reports
The graphs with statistics will open in a new window. The first one is important to us – “Number of pages scanne per day”. The number of pages that Googlebot scans on average per day is the crawling budget of the site:
Scan statistics
This is not an absolute and constant value – this figure can increase and decrease, but it works as an approximate indicator.
How to optimize crawl budget?
Crawling is indexing, so the entire limit is quickly spent precisely because of indexing errors. As part of SEO website promotion, they nee to be correcte.
