Crawl Rate: How Quickly Googlebot Requests Your Site
Crawl rate is the pace at which Googlebot requests pages from your site, balancing thorough crawling with server capacity.
Crawl Rate is the pace at which Googlebot requests pages.
What It Is
Crawl rate is the number of requests Googlebot makes to your site, usually measured per second.
Google sets the rate based on the health and responsiveness of your server.
How Google Sets It
- Fast, healthy servers get crawled faster.
- Server errors or slow responses make Google slow down.
- Google raises the rate when your site proves it can handle it.
Why It Matters
- A rate too high can overload your server.
- A rate too low means changes are discovered slowly.
- Hosting migrations and traffic spikes can trigger rate changes.
How to Manage
- Use the crawl rate setting in Search Console when needed.
- Keep server response times low to avoid throttling.
- Fix server errors quickly so Google does not back off.
- Watch crawl stats to spot unusual rate changes.
Before: a site starts returning slow responses during a spike.
After: Google lowers the crawl rate to protect the server.
The result: the site stabilizes and Google gradually speeds back up.
The lesson: Google crawls as fast as your server allows.
Quick Tip
Most sites never need to touch crawl rate, but know where the setting lives in Search Console.
Frequently Asked Questions
Crawl Rate, in Short
Google matches its crawling pace to your server.
Serve fast and Google will crawl faster.