Everyone wants to figure out how to get Google’s spider or crawler to come find new content on their site as soon as that content is added.
One of my readers is Sean and asked:
how [do] I get the search engine spiders to return on a regular basis?
Sites that have a lot of content added on a regular basis get their sites re-crawled more frequently. Sites like cnn.com are crawled by Google multiple times a day.
While no one knows the exact algorithm Google’s spider uses it appears the more often you add content to your site the more often Google’s spider will come and re-crawl your website.
One way that content is added to websites is by the comments that your visitors add. If you put something new up on your blog and then a day later you have 10 comments then you have your content on your website and I believe that Google is more likely to come and re-crawl.
Leverage social bookmarking websites
Since we have very little control about how often Google comes and crawls our websites we should look for other ways to get crawled.
Because we know that many social bookmarking websites have a ton of new content added every day we can be fairly certain that Google is crawling them at least once a day if not more often.
So use this to your advantage.
Whenever you have something new at your website be sure to submit it to social bookmarking websites. This way Google will pick up on your new content very quickly.
But submitting to many of these websites can be a pain so I recommend using a free service called onlywire. You can learn about onlywire here:
http://nickstraffictricks.com/1570_video-social-bookmarking-made-easy/
What do you think?
I would love to hear your thoughts so leave a comment below!Cool Free Stuff from Nick
- Free Backlinks - Get a free one way back link from this blog here.
- Free Stumbles - I will stumble your site here.
- Free Answers - I will answer any traffic question you have here.
- Free 68 Page Traffic Guide - Download a free 68 page traffic guide here.
Get Updates Subscribe To My RSS
 Follow Me On Twitter
 Receive Updates Via Email
|
Related Posts |
Loading ...
{ 4 comments… read them below or add one }
They don’t crawl your website more often, just come more often to check if there’s something new, that’s it, no big deal
They check the same content for change once in a few weeks.
Anyways, if you run Wordpress, they’ll come right after you make a new post, I’m sure of that
Hey Nick,
I agree that the more you post fresh content on a regular basis will increase your chances of getting Googlebot to visit your site. I don’t do much with the social bookmarking websites but I know it’s a strategy I need to start using more. Maybe now that you’ve put it back in my head I will start implementing it instead of thinking about it.
Later,
Jeff Sargent
Great idea! I always wondered how you got the spiders to crawl back to your website. Is it true that if you website is new than Google will ensure that it doesn’t come up in rankings at least for the first 6 months?
Not true at all. But it can a little while. Really depends on your content, backlinks, etc.