Friday, June 17, 2011

Screaming Frog


After a fellow member of the GPWA SEO forum mentioned an oddity with Screaming Frog, a brilliant piece of software, I have to say I am puzzled by why must be obvious.


I get 2 separate figures when I do a back link search for URL's with and without the trailing slash.

WEBSITE WITHOUT TRAILING SLASH



WEBSITE WITHOUT TRAILING SLASH

According to Apache and Microsoft if an inquiry arrive without the / it is redirected to the non / version.

But why the difference in backlinks?


Download Screaming Frog - It's free

Download Windows Version  —  Download Mac Version

Please note – The standard ‘Lite’ version of the tool is completely free, however this version is limited to crawling a maximum of 500 URI and it does not give you full access to the configuration options of the spider. These include crawl options for images, css, javascript, external links, follow ‘nofollow’, limiting search total and depth, ignoring robots.txt directives, exclude list and the custom source code feature.

2 comments:

Dan said...

You mean Majestic SEO?

;-)

Dan @Screamingfrog

gary said...

Yep sorry Dan, but your ScreamingFrog software is great. Much better than Xenu. I recommend it every time I speak at a conference or train a noobie SEO.