On Demand Google Crawling

Have you ever needed to get Googlebot to crawl a page that was not getting indexed?

Here’s a quick dirty trick: Use the Fetch as Google function in your Google Webmaster Tools account.

Fetching as Googlebot In Google Webmaster Tools.

Once you hit the Fetch button, Googlebot will crawl the page:

logfile screenshot

Googlebot fetched the page seconds after hitting the Fetch button in GWT.

 

If the page is worthy, it will also be indexed.

To increase the chances of getting those reluctant pages indexed by Google also backlink from a couple of trusted sources.

VN:F [1.9.22_1171]
Rating: 7.0/10 (2 votes cast)
VN:F [1.9.22_1171]
Rating: +2 (from 2 votes)
On Demand Google Crawling, 7.0 out of 10 based on 2 ratings

About

Traian is the founder and Director of Search Marketing at Pitstop Media Inc. He has more than 10 years experience in helping small and medium businesses generate and convert organic traffic from search engines. Most of his time is dedicated to growing the company and spending time with the family. Connect with Traian on Google+

 

4 Responses to “On Demand Google Crawling”

  1. Dan said:

    May 28, 12 at 3:03 pm

    Such an awesome trick… I’m so tired of constantly pinging my pages. Thanks.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  2. TraiaN said:

    May 28, 12 at 3:09 pm

    :) keep in mind that there’s a limit for that, I think about 500 per day or so. Probably others were abusing it.

    VN:F [1.9.22_1171]
    Rating: 5.0/5 (1 vote cast)
    VN:F [1.9.22_1171]
    Rating: +1 (from 1 vote)
  3. Jasmine said:

    Jun 19, 12 at 9:22 pm

    This is a good method to get Google to crawl a page quickly. Thanks for this tips!

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  4. Google SEO tools for bloggers and how to use them said:

    Nov 28, 12 at 4:17 pm

    [...] tip: One of the most useful webmaster tools for newbie travel bloggers is the Fetch Google. If some posts are not indexed, you may use the Fetch Google tool to make the Google spider crawl [...]