M.Efe Ozer’s Weblog

February 27, 2009

GateKeeper on BlogEngineNet

Filed under: Asp.Net, BlogEngineNet — Tags: , , — Mehmet Efe Ozer @ 5:37 am

I was complaining about spiders and crawler entries on my visitor map. It is not only matter of visitor accuracy but also they using traffic. I wrote a http module for blocking some ip numbers which tried my registration page also. But all my works about unwanted visitors were lack of management.

Now I am using GateKeeper of Chris Blankenship and it is working good for me. Has easy implementation and very good admin panel. When i checked honeypot violation’s ip numbers, i found diffrent spider locations than i’ve already know before.

I allowed some known user agents. They are storing in a xml file, so i still could prevent their entires from my visitor map. I added a little extra check to my codes like this :

Add a function to my visitor tracking class that returns ip number is known spider or not:

Public Shared Function IsAllowedSpider(ByVal ip As String) As Boolean

        Return XDocument.Load(AllowedSpiderListDataFilePath) _
        .Descendants.Elements("ipaddress").Elements("entry") _
        .Where(Function(f) f.Attribute("ipaddress").Value = ip).Count > 0

        Return False
End Function

I still suspicious about visitors from some cities but i eliminated a lot.  By the way map is here (little patience for loading map :) ).

No Comments Yet »

No comments yet.

RSS feed for comments on this post. TrackBack URI

Leave a comment

Blog at WordPress.com.