- This topic is empty.
-
Posts
-
I have nearly a 2 month old site, msn crawled 103 pages, google only 41.
It is normal for new sites to get into the index slow. This is a patience game
Yep, patience is the key. Don’t expect too much right away. It could take weeks or even months for all your pages to be spidered and indexed by the search engines.
Make sure your linking structure is easy enough to follow. From what I have read, Google can have trouble after a couple levels deep into a site. Also, you may want to check the bottom of the search results in Google. If it says the following, you have more pages indexed, but they don’t show them to you right away if they look like duplicate page (based on titles and meta descriptions I think).
In order to show you the most relevant results, we have omitted some entries very similar to the 20 already displayed.
Also, to see how many pages are indexed use the search “site:www.domain.com”
And finally, yes it takes time. We have been waiting for a week for additional pages to be indexed.
Thanks for the info guys, patience is not one of my virtues
I do have buttons with mouseovers on the main page, would this stop google? Is it weird that google would just see the main page but nothing further?
This morning I did realize that all my “home” links throughout the site pointed to http://www.mysite.com/index.htm. I took out the index.htm. Could that have contributed to only having a few pages indexed?
Thanks!
It takes a while… The quickest way to get indexed is to have a link from a PR9 page. Those sites get indexed frequently and the spider will follow.
My site has been up for a couple of months and the home page is the only one indexed as well. This is not uncommon.
Also, in addition, create a Google sitemap. This will ensure that all the pages you want indexed get crawled.
kw
My website went live August 1 and here’s my stats
Googlebot 26+5 74.84 KB 18 Aug 2005 – 22:37
LinkWalker 23+1 193.73 KB 18 Aug 2005 – 11:39
Unknown robot (identified by ‘crawl’) 19+1 189.79 KB 17 Aug 2005 – 05:28
Unknown robot (identified by hit on ‘robots.txt’) 0+8 2.23 KB 09 Aug 2005 – 12:46
Alexa (IA Archiver) 4+2 42.44 KB 07 Aug 2005 – 20:23
MSNBot 1+1 14.17 KB 11 Aug 2005 – 12:40
Unknown robot (identified by ‘robot’) 1+1 4.08 KB 09 Aug 2005 – 05:21Mine is very similar to this.. With a couple of different bots. Same for Google, though.
Still only home page indexed, but sometimes Google takes a while… It is mentioned as such on all the major SEO sites.
Thanks guys, I feel better now. I was a little worried that I’d made some mistake and the google bots had run away from my site in horror, never to return :p
Now if I could just get a pr9 site to list me right across the front of their main page. It’s not even possible to get linked to a pr9 site is it?
Maybe I should have explained it better…..
A PR9 page will get you indexed quickly…
A PR8 page will get you indexed quickly…
.
.
.
A PR5 page maybe days.. maybe a week.
It really all depends on how quickly Google indexes the page you are linking to (from what I understand of everything).
So, don’t just go looking for a PR9 page to link to. It might not be that easy to find. Just get quality links. That ‘should’ get you indexed quicker.
Just my 2 cents, though. I have only SEO’d 10’s of sites, not 100’s of sites. This is just how I see things and what I have read….
Like it was said earlier by Sipka and Engineer… ‘Patience is the key’
How do I find out if my site has been indexed yet?
cbruhn42
Thanks Kwblue. Appreciate the help.
cbruhn42 wrote:How do I find out if my site has been indexed yet?cbruhn42
Simply type in your url to the search field. Or you can try site:http://www.mydomain.com it will list all your indexed pages.
Hope this helps.
Update….
I submitted a sitemap to Google
http://www.google.com/webmasters/sitemaps/docs/en/protocol.html
3 days later, the entire website was indexed! It isn’t always that quick (although I have seen it happen more quickly).
Maybe that will help you as well.
PS – I created the sitemap using Notepad instead of their sitemap generator.
kw
There are free sotwares to create Google Sitemaps:
Web based: http://www.blocklayer.com/googlesitemap/ (it is a little bit hard to update the sitemap manually as you add more pages to your site)
Program: http://www.vigos.com/products/gsitemap/ You can download it and it crawls your pages, makes the sitemap and upload it to your server. And you only have to resubmit the sitemap to Google (but in my experience, you don’t have to do it, G makes it periodically).
Thanks so much for the links Sipka! Those were lifesavers!!! I was dreading submitting a sitemap because I thought I’d have to do it manually. Took me all of 15 minutes.
One more question if you don’t mind. Is it important to keep updating the sitemap as you add content? Having the sitemap there won’t confine google to only visiting those pages right? Or will google visit your site and automatically add new content to it’s index? If I never updated my map would google still find my new pages?
Thanks!
