22
Jan

Faster Google Crawl Rate

If you're new here, you may want to subscribe to my RSS feed or get your blog updates by email. Thanks for visiting!

Let me start off saying that if you do not use Google Webmaster Tools, you should start trying it out. It is a great tool that shows you near-instant updates of backlinks to your posts, how often Google views your blog, as well as any errors that the Google bot finds.

Utilizing the tools will help you keep your blog search engine friendly and clean. Now for the point of this article, Google normally has a “normal” and a “slower” option for how often it will crawl your page. If you write at least a few times a week you should keep this at “normal,” but if you have a slow webhost or another reason that you do not want Google visiting a lot you can set it to slow.

crawlrates1.jpg

Just in the last few days, Google has deemed my blog worthy of a “Faster” crawl rate. I enabled the option yesterday and Google viewed my blog 270 times when the daily average is 70. With this new faster crawling, my blog posts are getting spidered, indexed, and cached in a matter of hours… sometimes even within minutes.

crawl1.jpg

If you have been blogging for awhile, I recommend checking out the crawl rate in your webmaster tools to see if you can enable the option. Since Google barely uses any bandwidth at all, I highly recommend using the Faster rate if your hosting can support it. In my opinion, the more times Google browses my blog the better!

Do any of you have a faster crawl rate option?

Share This: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Reddit
  • StumbleUpon
  • Mixx

RSS feed | Trackback URI

20 Comments »

Comment by SEO Meter
2008-01-22 16:19:10

“Since Google barely uses any bandwidth at all, I highly recommend using the Faster rate if your hosting can support it.”

That’s because the number of Google-indexed pages for your blog is small. For larger sites, it will make much difference in terms of bandwidth consumption. So care needs to be taken before turning its switch.

Comment by Collin LaHay
2008-01-22 16:57:12

While this is true, bandwidth is cheap and is only getting cheaper. If you have a site that is fifty times as big as my blog then you should be getting crawled well already. Most hosting companies provide terabyte(s) of bandwidth now, so a few hundred kilobytes, or even a few megabytes do little damage to the bill. =)

 
 
Comment by Sudarshan
2008-01-22 18:55:28

I am going to use this option to my celebrity blog an let u know on how it goes

 
Comment by Eric
2008-01-23 02:27:21

My blog got the option available in August 2007, just a month after I’ve started my blog.

If your site updates a lot (like a blog should do) you definately need to activate this option. It helps getting your pages indexed faster. Which could result in high rankings in Google search.

 
Comment by Ethan Christ
2008-01-23 03:00:22

Thanks for the tip. Going to implement a faster crawl rate for Slam Blogger as we speak.

 
Comment by Binh Nguyen
2008-01-23 06:58:27

I have faster crawl rate. ;)

 
Comment by Tyler
2008-01-23 09:45:39

I have seen firsthand what raising that option can do to your web server. Sometimes Google will turn that option off so you cant select it.

 
Comment by James Pong
2008-01-23 11:23:14

I have seen Google indexes my page within 40 minutes after posting it. Does the crawl rate goes “Faster” by default? Thanks for the tip. I’ll try to check the webmaster tools more often.

 
Comment by Steve
2008-01-23 12:31:07

Fastest I’m now getting is inclusion within 5 minutes as a Google News Source. It is both a blessing and a curse. Sucks when you find the type just a minute too late.

 
Comment by Leandro
2008-01-23 13:04:37

thanks for the tip. I use the google sitemap for a long time and never saw this tool.

 
Comment by rhyan
2008-01-23 14:50:25

thanks for this tip. I will take a look at this one :D

 
Comment by Sunglasses Auctions
2008-01-24 19:34:55

Collin,

When i was browsing around the google webmaster tools, i noticed in the Tools section something called ‘Enable enhanced image search’ .

Do you know if this is a good or bad thing to activate? i did a search but found mixed results

Cheers

Comment by Collin LaHay
2008-01-24 23:01:47

I saw this too. I enabled it weeks ago, but I cannot give you an answer. I have not received any traffic from Google images so I have no idea how well it works.

I would assume enabling it is better than not enabling it. =)

 
 
Comment by Catherine Lawson
2008-01-24 20:03:21

Thanks for the great tip. There’s certainly no harm in trying it to see what happens.

 
Comment by arlene
2008-01-25 00:42:31

thanks for this information. Am playing on it now but my baby is still a baby. has not started crawling yet. hehehe

good day!

 
2008-01-27 14:17:35

[…] it myself. I wish I would have joined a month ago to see an accurate growth after switching to the faster google crawl option in my webmaster […]

 
Comment by Karel Geenen Subscribed to comments via email
2008-01-30 16:54:30

My Dutch blog doesn’t have the faster crawl option. However my posts get indexed within 10 minutes, always.

My advice is to check first how long it takes before a post get’s indexed. If it takes to long, activate the faster crawl. If it gets indexed within the hour, leave it as it is.

 
Comment by paulette Subscribed to comments via email
2008-01-31 11:19:28

Thanks for the info. Google really is a fast tool for searching

 
Comment by Bolkie
2008-02-07 06:48:06

Does this option work for established blogs only, or also for newer/fresh blogs?

Comment by Collin LaHay
2008-02-07 07:40:39

Blogs that Google thinks should be crawled more often. The only way to find out is to check Webmaster Tools.

 
 
Name (required)
E-mail (required - never shown publicly)
URI
Subscribe to comments via email
Your Comment (smaller size | larger size)
You may use <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong> in your comment.
New Poker Affiliate



Recent Posts

Recent Viewers

Tag Cloud


  Website Marketing Strategies by Collin LaHay © 2008, Mixed Market Arts