Jul 26, 2008

What Is "unknown Robot (identified By 'crawl') "
Free Web Hosting, No Ads > General > Hosted Members Area

free web hosting

What Is "unknown Robot (identified By 'crawl') "

itssami
Feb 13 2006, 09:53 PM
Hey...
On my stats page of website , i see often this bot visits my website...
Unknown robot (identified by 'crawl')
I see it almost every second day .Can some one please tell me which companys bot it is and what is its purpose.
Note: I have submitted my website to good and other search engines , a month ago , it is on Yahoo and msn already but its not on dmoz and google.Is it related to that bot etc ??

Reply

OpaQue
Feb 13 2006, 11:51 PM
There are many Search engines other than Google and Yahoo. The programmer who created your software added general Crawler recognisation code for major companies. For all other search engines whose crawling bots are not identified, it will show up as Unknown or Unidentified Bot.

Reply


Got an Opinion! Express your Views! (no registration):-
Add your Reply/ Opinion/ Views/ Comments/ Suggestion/ Questions/ Queries etc.
Posts with decent grammar & English will be accepted and please refrain from profanities.
For asking a Question, We recommend you to sign-up (for free) so that you can track the topic easily.

Nature of your Post*: Opinion/ Reply/ Comments
Question/Query
Feedback to us.
       
Name   Email
Title/Question*

(Maximum characters: 10,000)
You have characters left.
Confirm Code:

Similar Topics

Keywords : unknown robot identified crawl

  1. Unknown Cpanel Password - help with title (2)



Looking for unknown, robot, identified, crawl

Searching Video's for unknown, robot, identified, crawl
advertisement



What Is "unknown Robot (identified By 'crawl') "



 

 

 

 

ADD REPLY / Got an Opinion! Remove these ADs! RAPID SEARCH! Free Web Hosting [X]
Express your Opinions, Thoughts or Contribute more info. to help others.
Ask your Doubts & Queries to get answers, So that "Together We can help others!" 		Register FREE for AD-FREE forum, Create your own topics, Ask Questions, track topics, setup subscriptions & notifications and Get a Free Website w/ Email and FTP.
500MB Space *No Ads*, CPanel, FTP, PHP, MySQL, EMails - 100% FREE