Welcome Guest ( Log In | Register)



 
Reply to this topicStart new topic
> What Is "unknown Robot (identified By 'crawl') "
itssami
post Feb 13 2006, 09:53 PM
Post #1


Super Member
*********

Group: Members
Posts: 258
Joined: 13-November 05
Member No.: 14,234



Hey...
On my stats page of website , i see often this bot visits my website...
Unknown robot (identified by 'crawl')
I see it almost every second day .Can some one please tell me which companys bot it is and what is its purpose.
Note: I have submitted my website to good and other search engines , a month ago , it is on Yahoo and msn already but its not on dmoz and google.Is it related to that bot etc ??
Go to the top of the page
 
+Quote Post
OpaQue
post Feb 13 2006, 11:51 PM
Post #2


Administrator
Group Icon

Group: Admin
Posts: 1,479
Joined: 11-June 04
From: Somewhere in Time & Space.
Member No.: 1



There are many Search engines other than Google and Yahoo. The programmer who created your software added general Crawler recognisation code for major companies. For all other search engines whose crawling bots are not identified, it will show up as Unknown or Unidentified Bot.
Go to the top of the page
 
+Quote Post

Reply to this topicStart new topic

Collapse

> Similar Topics

Topics Topics
  1. How Can I Build Yahoo Robot With Vb(11)
  2. Robot Rage(11)
  3. Unknown Cpanel Password(2)
  4. Robot Racing Gets Under Way(3)
  5. Unknown Device On Re-installof W98se(1)
  6. Robot & Angel(8)
  7. Trouble Removing Account(1)
  8. Probably My Best Sig :)(4)
  9. Unknown History Of Words.....interesting(0)
  10. Vulnerability Identified Within Internet Explorer(2)
  11. Land Walker -Japanese Robot Suit-(2)
  12. File Format Unknown! (wap)(6)
  13. Unknown Pain - Song Lyrics(2)
  14. Making The Unknown Less So(1)
  15. Robot Slaves(15)
  1. Robot Rights : Right Or Wrong(30)
  2. Unknown Title Of A Book(0)
  3. Unknown Virus Problem [resolved](8)
  4. Free Web Hosting: (unknown_99) [screened] [approved](2)
  5. Need Help Picking Stocks(4)
  6. How Do I Crawl Out Of This Shell?(3)
  7. Hitman(4)
  8. Open Any Unknown File Type With Notepad(1)
  9. Does Google Adsense Crawl Your Website Automatically?(5)
  10. Robby The Robot(5)
  11. U.s Military Uses Wii Remote(7)
  12. Using Unknown Fonts For Text In Webpage(5)
  13. Honda Creates A Human Like Robot(0)


 



- Lo-Fi Version Time is now: 11th October 2008 - 10:29 PM