Ask Google to Crawl a Page or Site

Many times you don’t need to ask Google to index you’re page because it’s an automated process built into what are known as “spiders” or “bots” which find pages and add them to the Google index. However, there are a few instances that you would like to notify Google about some changes on your site asking them for a quick re-crawl of your page. For example, if you’ve just added a URL or page to your site, since the last time it was crawl, and would like it included within the SERP’s.

So, here’s how to get Google to crawl my site…

First, you need to have an account on Google Webmaster Tools, known as GWT, and if you do then simply log in. Next, you need to add your site by clicking the “Add Site” link. If you’ve already added your site then skip the next step.

You need to verify the site you’ve just added which can be done using four ways:

 

  • Through domain provider like GoDaddy, HostGator, etc
  • Add Meta Tag to your home page
  • Add Google Analytics code to your site
  • Upload an HTML file through FTP to your server

GWT_2The option you choose is totally up to you but your site will need to be updated before you can submit a crawl request. Once everything is done, your site will appear within login page. Simply click “Manage Site” under the dashboard or the URL of the site to proceed.

GWT_4

 

To request Google to crawl my site you’ll need to click “Fetch as Google” located under the “Crawl” menu option. In the text box field, enter the URL to the site or page. Remember if you’re asking Google to crawl a page enter the full URL to the page.

GWT_6

Google only accepts submissions to the web so select “Web” from the dropdown list. After, hit “Fetch” and Google will fetch the URL you indicated within the box. The process may take anywhere from 10-15 minutes for the status to be updated. Keep a close eye on the fetch status for errors…for example,

A fetch status of “Successful” is awesome so all you need to do is click “Submit to Index”. You can click one of the following to enhance the submission:

  • To submit the individual URL to Google’s index, select URL and click Submit. You can submit up to 500 URLs a week in this way.
  • To submit the URL and all pages linked from it, click URL and all linked pages. You can submit up to 10 of these requests a month.

Here are some external resources to help you get started…

Fetch As Google – Google Support