PDA


View Full Version : Spiders & Indexing

BRC2
06-15-2005, 12:25 AM
I just opened my new site, after importing from phpBB on sunday, June 12th. As part of the upgrade I also changed my domain and used a 301 redirect for all traffic going to the old domain. I realize that it can take a little while for the major SEs to spider your site. However, within the last 3 days Yahoo, Google and MSN have all been to the new site multiple times. Unfortunately, the vast majority of these visits do not go past the home page (CMPS). My original thinking was that these visits were spiders looking for the old domain links and mabye were leaving immediately since they were redirected and did not find the old domain content.

I noticed today that MSN is showing 72 links to my new domain/site. See HERE (http://search.msn.com/results.aspx?q=cyphos.com&first=1&count=10&FORM=PERE). Great...except 29 of the 72 are to the home page and show paths like .com/?p=9052, .com/?t=744&view=previous, .com/?t=929&view=next, and .com/?g=221. Why is this? Is this because spiders are looking for the old pages? If MSN is showing these links, could this becausing problems with say google and yahoo?

Thanks,
Brian
corriewf
06-15-2005, 01:01 AM
The same thing on my page also however the site is indexed just fine.
Brian
06-15-2005, 10:04 AM
Just give them some time.
BRC2
06-15-2005, 06:44 PM
Just give them some time.
Thanks. I have no problem giving them some time, but I was curious about the part of the URL after .com for the root URL....com/?p=9052, .com/?t=744&view=previous, .com/?t=929&view=next, and .com/?g=221. What do these mean? And how do they always point to the same page?
corriewf
06-15-2005, 07:00 PM
If we could figure out how the spiders work then we wouldnt have them.
BRC2
06-16-2005, 12:53 AM
Ok...after some further investigaton it appears that the characters appended to my new domain's home URL is part of a search link to a forum, thread or post on my old phpBB and domain. It appears only MSN is indexing the redirects in this manner.
LEAD_WEIGHT
06-16-2005, 12:59 AM
In some forums it could take spiders upto 17weeks to come back or even longer. If u want spiders to work for u fast, Affilate with other forums.