2004-09-30
The New Googlebot Follows Redirects?
Well, only days after I came upon the realization that most crawlers don't follow standard HTTP redirects, I think I have evidence that Google's mysterious new crawler does.
I originally had the public files on the Nanobox hosted at http://mwinds.chipx86.com/nanobox/nsnd/public. I decided to get rid of the old Mystical Winds Prime site that was hosted at http://mwinds.chipx86.com/ and moved the public folder down. At the time, I intended the public files to be sort of a section of Nano See, Nano Do, so the public files were at http://mwinds.chipx86.com/nsnd/public. Shortly afterward, I decided to move it down again to http://mwinds.chipx86.com/public/. Because of the number of links that I already had to the old locations, I set up some HTTP redirects at both of the old paths.
I just looked at my logs from yesterday, and the new Googlebot requested http://mwinds.chipx86.com/nsnd/public/Gallery, then immediately http://mwinds.chipx86.com/public/Gallery, and then http://mwinds.chipx86.com/public/Gallery/. That looks like it's following redirects to me.
Comment moderation policy: Your comment will be reviewed before it is added to the site. This is in response to spam and other forms of abuse. I gladly accept comments containing criticism as long as the language is clean.
This weblog is powered by Blogger.