What Is "unknown Robot (identified By 'crawl') "
free web hosting
Open Discussion > General > Hosted Members Area

What Is "unknown Robot (identified By 'crawl') "

itssami
Feb 13 2006, 09:53 PM
Hey...
On my stats page of website , i see often this bot visits my website...
Unknown robot (identified by 'crawl')
I see it almost every second day .Can some one please tell me which companys bot it is and what is its purpose.
Note: I have submitted my website to good and other search engines , a month ago , it is on Yahoo and msn already but its not on dmoz and google.Is it related to that bot etc ??

Reply

OpaQue
Feb 13 2006, 11:51 PM
There are many Search engines other than Google and Yahoo. The programmer who created your software added general Crawler recognisation code for major companies. For all other search engines whose crawling bots are not identified, it will show up as Unknown or Unidentified Bot.

Reply


Got an Opinion! Express your Views! (no registration):-
Add your Reply/ Opinion/ Views/ Comments/ Suggestion/ Questions/ Queries etc.
Posts with decent grammar & English will be accepted and please refrain from profanities.
For asking a Question, We recommend you to sign-up (for free) so that you can track the topic easily.

Nature of your Post*: Opinion/ Reply/ Comments
Question/Query
Feedback to us.
       
Name   Email
Title/Question*

(Maximum characters: 10,000)
You have characters left.

Similar Topics

Keywords : unknown robot identified crawl

  1. Unknown Cpanel Password - help with title (2)



Looking for unknown, robot, identified, crawl

*RANDOM STUFF*





*SIMILAR VIDEOS*
Searching Video's for unknown, robot, identified, crawl
Watch the latest videos on YouTube.com

*MORE FROM TRAP17.COM*
advertisement



What Is "unknown Robot (identified By 'crawl') "



 

 

 

 

ADD REPLY / Got an Opinion! a humble request :-) RAPID SEARCH! Free Hosting [X]
Express your Opinions, Thoughts or Contribute your information that might help someone here.
Ask your Doubts & Queries to get answers.. "Together, We enlight each other!" 		Register FREE for AD-FREE forum, Create your own topics, Ask Questions, track topics, setup subscriptions & notifications and Get a Free Website w/ Email and FTP.
500MB Space *No Ads*, CPanel, FTP, PHP, MySQL, EMails - 100% FREE