Every single aspect of SEO, from link building to keyword optimization, is geared towards putting your site on the Google results pages and ranking it as highly as possible. None of that can happen without your site being indexed by Google. When you make a new site, it can be a frustrating wait for the search engine to find your content. How long does it take, and what can you do to speed up the process?
Indexing the Internet is a massive task. Google has robots working on it around the clock. These robots are software search crawlers known as web spiders. The spiders are let loose throughout the Internet, and from their starting points they go about their business.
The first thing a Google bot does when it reaches a page is compare that page to the main search index. If that page has changed, it records the changes. If that page has been removed, it flags it as removed. The same goes for domains that have been parked or hacked. Hacked domains in particular are flagged with warnings about malicious content, to warn away unwary users.
Once the page content is indexed, the web crawler begins to follow links. Links are the joints between websites. They are the only way Google’s crawlers can find a page naturally. The crawler will follow links until it runs out of them.
With this description, it seems as though linking is the only way for Google to find your page. Indeed, having an incoming link to your new page is one of the best ways for that content to be found. Google will, eventually, find that link and follow it to your content. The problem is that this process can take a while.
Google also monitors a few other sources of page submission. Its RSS feed service, Feedburner, is one such service. If your content is new, and you submit it through RSS, Google will find that content and set a crawler loose.
Likewise, Google monitors shares on Google+. When you post a piece of content on their social media platform, if that content has not been recently indexed, it can become the target of a crawler in short order. This is one way that Google is subtly pushing the power of Google+ as a platform.
Google also has a manual submission form. This form allows you to submit a URL directly for consideration. This option is best used sparingly, for new websites as a whole, rather than new pages on an existing website. Google will, again, process the new content for indexing and set a crawler loose.
Google Analytics submission is another route. When you create a site profile for a new site, Google generates tracking code for you to place on that site. The code also tells Google that this site is new, not something in its index, and that it should release a crawler.
So, how do you speed up the indexing process? After all, the sooner you’re indexed, the sooner you can build your traffic by putting your SEO skills to work. There are a few different techniques you can try, depending on your situation.
For a new website on a new domain:
For both new websites and new pages on existing websites:
There are a few errors that typically cause the Google bot to fail to index your site properly. Make sure your new site avoids these errors.
Guest blogging is one of the most powerful search indexing tools you have available. It’s great for SEO and great for indexing. It also helps you pull in an audience from your industry partners.
First, search out blogs in your industry that are not direct competitors. Often times a direct competitor will refuse to publish an article with links. You’re looking for blogs with which you can establish an ongoing relationship.
Approach these blogs with offers for guest blogs. Explain that you’re trying to get a new site off the ground and that you would like to collaborate with them for a guest post. You may need a pitch for an article, or you may be able to pitch one after they agree.
Write your post. Make sure it’s valuable content that relates to both their niche and yours. Avoid overly-optimized keyword-stuffed content. Make sure your guest post is valuable to users. Try to naturally include a link to your site in the main content; it’s more valuable than a link in an author bio. Some sites won’t let you include a link in the content itself. That’s fine, so long as a link is present somewhere in the post or author bio in the finished post.
Don’t worry too much if the site tells you that it will only allow nofollowed links. Nofollowed links simply mean that the site does not want to pass SEO link equity to your site. This is fairly common with guest posts and with new sites in general. The nofollowed link will still tell the crawler there is a site at your URL, it just won’t pass link authority.
The final, and hardest, step of the entire indexing process is to wait for results. No matter how many ways you submit your site, you’re going to have to wait. It may take a few hours for indexing, or it may take a few days or weeks. If you use as many methods as possible, you’re more likely to be found and indexed. Additionally, all of these methods are in some way or another beneficial to your SEO, if used correctly. There’s no harm in putting them to use and moving on to build more content.