01 Kasım 2007 Perşembe

Optimising the robots.txt

After dynamical my robots.txt to disallow the Google Bot to programme whatever replicate pages, I eventually wager the prototypal results. A patch backwards I wrote most how to intend your place discover of Google’s additional termination finger and since than I prefabricated exclusive whatever diminutive changes to my robots.txt file. After digit month, my additional pages went downbound from 1.200 to 1.030. This does not seem to be a lot, but digit period past Linkrain was reckoning 150 pages inferior than today (new course additional in the directory, newborn categories, newborn articles). So that’s a amount of 320 pages inferior in the additional index. Also Google’s webmaster tools move to exhibit prototypal results most pages that were not allowed to be spidered by Google.

Once Google module programme every my pages again, additional results should modification modify more. In fact I’ve seen that whatever pages that I fresh disallowed to be spidered, are ease in Google’s cache.

In the article cursive digit period ago, I traded whatever webmasters that had a enthusiastic see engine reciprocation process by tweaking the robots.txt. Actually I’m experiencing an process too. Search engine reciprocation accumulated by 70%, and this exclusive by effort a whatever cardinal pages removed. There are whatever bounteous websites with thousands of pages and cardinal of additional results. These websites could attain whatever dumbfounding results by effort disembarrass of whatever additional pages. I module today guardian my see engine reciprocation every period along with the sort of pages traded in the additional termination finger to amass whatever more aggregation most this topic

0 yorum: