Blog > Content Marketing > How Long Does It Take for Google to Index My Blog
How Long Does It Take for Google to Index My BlogPublished by Kenny Novak • Category: Content Marketing

Every single aspect of SEO, from link building to keyword optimization, is geared towards putting your site on the Google results pages and ranking it as highly as possible. None of that can happen without your site being indexed by Google. When you make a new site, it can be a frustrating wait for the search engine to find your content. How long does it take, and what can you do to speed up the process?

The Process of Indexing

Indexing the Internet is a massive task. Google has robots working on it around the clock. These robots are software search crawlers known as web spiders. The spiders are let loose throughout the Internet, and from their starting points they go about their business.

The first thing a Google bot does when it reaches a page is compare that page to the main search index. If that page has changed, it records the changes. If that page has been removed, it flags it as removed. The same goes for domains that have been parked or hacked. Hacked domains in particular are flagged with warnings about malicious content, to warn away unwary users.

Once the page content is indexed, the web crawler begins to follow links. Links are the joints between websites. They are the only way Google’s crawlers can find a page naturally. The crawler will follow links until it runs out of them.

Index Submission

Index-Submission

With this description, it seems as though linking is the only way for Google to find your page. Indeed, having an incoming link to your new page is one of the best ways for that content to be found. Google will, eventually, find that link and follow it to your content. The problem is that this process can take a while.

Google also monitors a few other sources of page submission. Its RSS feed service, Feedburner, is one such service. If your content is new, and you submit it through RSS, Google will find that content and set a crawler loose.

Likewise, Google monitors shares on Google+. When you post a piece of content on their social media platform, if that content has not been recently indexed, it can become the target of a crawler in short order. This is one way that Google is subtly pushing the power of Google+ as a platform.

Google also has a manual submission form. This form allows you to submit a URL directly for consideration. This option is best used sparingly, for new websites as a whole, rather than new pages on an existing website. Google will, again, process the new content for indexing and set a crawler loose.

Google Analytics submission is another route. When you create a site profile for a new site, Google generates tracking code for you to place on that site. The code also tells Google that this site is new, not something in its index, and that it should release a crawler.

Speeding the Process

Speeding-the-Process

So, how do you speed up the indexing process? After all, the sooner you’re indexed, the sooner you can build your traffic by putting your SEO skills to work. There are a few different techniques you can try, depending on your situation.

For a new website on a new domain:

  • Submit your site to Google using the submit URL tool.
  • Set up a Google Analytics account and tie it into your new site.
  • Create an XML sitemap for Google to crawl. This ensures that, when one page on your new site is discovered, the crawler has an easy way to reach all of your subpages and content.
  • Submit your new sitemap to Google Webmaster Tools, under Optimization > Sitemaps.
  • If you plan to utilize RSS for active syndication, use Feedburner to manage the feed. You don’t need to do anything with Feedburner beyond setting it up for a new site; publishing new content will automatically add it to he feed.
  • Carefully use blog directories. Sites such as Alltop and Technorati allow submission of blogs in a way that is distanced from old black hat article directories. Avoid submitting your blog to unrelated directories or spamming your link everywhere.

For both new websites and new pages on existing websites:

  • Share your new site on Google+ and other social media profiles, including Facebook and Twitter. Remember, social media is powerful for SEO, regardless of the age of your site.
  • Link to the page from an existing page on your site, whether it’s your homepage or another subpage.
  • Add the new page to your sitemap, or ensure that your sitemap updates automatically.
  • Share your new link on social bookmarking sites, such as Reddit, Delicious and StumbleUpon. These sites don’t do much unless your content goes viral, but they are a good location to establish a presence just in case.
  • Create guest posts on other blogs in your industry and link back to your site.

Common Errors

Common-Errors

There are a few errors that typically cause the Google bot to fail to index your site properly. Make sure your new site avoids these errors.

  • Server or web hosting issues. If the connection times out or is excessively slow, the crawler will back away. Your site will also be penalized if your link is redirected more than once.
  • Malformed code issues. If your basic web code is poor, it will cause the crawler to fail to parse your site. This shouldn’t be an issue if you hired a quality development team, but occasionally small errors slip in that a browser parses but a crawler is hung up on.
  • Robots.txt issues. The robots.txt file is a text file that tells search crawlers such as the Google bot what to do. A broken, missing or faulty robots.txt file will drive away the crawler. Additionally, make sure you aren’t simply telling the crawler not to index your site.

Guest Blogging for Fun and Profit

Guest blogging is one of the most powerful search indexing tools you have available. It’s great for SEO and great for indexing. It also helps you pull in an audience from your industry partners.

First, search out blogs in your industry that are not direct competitors. Often times a direct competitor will refuse to publish an article with links. You’re looking for blogs with which you can establish an ongoing relationship.

Approach these blogs with offers for guest blogs. Explain that you’re trying to get a new site off the ground and that you would like to collaborate with them for a guest post. You may need a pitch for an article, or you may be able to pitch one after they agree.

Write your post. Make sure it’s valuable content that relates to both their niche and yours. Avoid overly-optimized keyword-stuffed content. Make sure your guest post is valuable to users. Try to naturally include a link to your site in the main content; it’s more valuable than a link in an author bio. Some sites won’t let you include a link in the content itself. That’s fine, so long as a link is present somewhere in the post or author bio in the finished post.

Dont-worry-Nofollowed-links

Don’t worry too much if the site tells you that it will only allow nofollowed links. Nofollowed links simply mean that the site does not want to pass SEO link equity to your site. This is fairly common with guest posts and with new sites in general. The nofollowed link will still tell the crawler there is a site at your URL, it just won’t pass link authority.

The final, and hardest, step of the entire indexing process is to wait for results. No matter how many ways you submit your site, you’re going to have to wait. It may take a few hours for indexing, or it may take a few days or weeks. If you use as many methods as possible, you’re more likely to be found and indexed. Additionally, all of these methods are in some way or another beneficial to your SEO, if used correctly. There’s no harm in putting them to use and moving on to build more content.

Written by Kenny Novak

Kenny Novak

Kenny is an SEM and SEO professional. He uses blogging and content marketing as a launchpad for small businesses looking to grow their online presence.

Comments

Questions for us? Comments? Thoughts? Leave a reply!

Leave a reply

Share64
Tweet
Pin
Buffer
64 Shares