|
|
|
|
![]() ![]() |
Feb 13 2006, 09:53 PM
Post
#1
|
|
|
Super Member ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Group: Members Posts: 258 Joined: 13-November 05 Member No.: 14,234 |
Hey...
On my stats page of website , i see often this bot visits my website... Unknown robot (identified by 'crawl') I see it almost every second day .Can some one please tell me which companys bot it is and what is its purpose. Note: I have submitted my website to good and other search engines , a month ago , it is on Yahoo and msn already but its not on dmoz and google.Is it related to that bot etc ?? |
|
|
|
Feb 13 2006, 11:51 PM
Post
#2
|
|
|
Administrator ![]() Group: Admin Posts: 1,479 Joined: 11-June 04 From: Somewhere in Time & Space. Member No.: 1 |
There are many Search engines other than Google and Yahoo. The programmer who created your software added general Crawler recognisation code for major companies. For all other search engines whose crawling bots are not identified, it will show up as Unknown or Unidentified Bot.
|
|
|
|
![]() ![]() |
Similar Topics
|
Lo-Fi Version | Time is now: 11th October 2008 - 10:29 PM |