Google Crawling System

khan11

Jul 13 2006, 12:11 PM

hello guys,

i dont know much about seo system,but i heard google crawls any website after 1 week,is it true or its google's choice to crawl any site?

i know its kiddy question but i cant solve this in my mind.

T100

Jul 13 2006, 12:41 PM

You can summit your site to google for crawling and google will index your page shortly. If you do not publicize your website, google will not know your existence until someone who likes your site put a hyperlink pointing to your site. Google will then follow the link and crawling onto your website. Google bot is a very diligent bot, you have to expect a high bandwidth use if you intend to have google index your page. You can preserve your bandwidth by editing a robots.txt file. You may either prohibit google from crawling your site, or prevent it from indexing some of your pages. (images take up the most bandwidth.)

khan11

Jul 13 2006, 06:23 PM

i dont know how to create robots.txt file so you will be laughing to read that i created robots.txt and written nothing in it and then uploaded on my webserver coz i dont know what to write in it.

Sinari

Jul 15 2006, 10:46 PM

I think that Google crawls them in a week- but I have yet to be listed in the Google search anywhere. I've been in the "crawling" list for a few weeks, but still nothing. Not sure how it works yet, but any advice would definently help.

Florisjuh

Jul 18 2006, 08:14 AM

Google Crawl bot is one of the smartest bots ever, if your site has usefull information on it the bot will find it

kbsp

Jul 27 2006, 07:47 PM

so these bots use up a lot of bandwidth how much are we talking im saying like for a forums like this...and i hear they even crawl peoples pm is that true

so they download files off the site too?

Malexos

Jul 28 2006, 12:15 AM

I don't think they search peoples PM's, otherwise, my whole dirty conversation with my girlfriend would've been public . . . Aww, crap!

(No, they can't crawl PM's, without your password, and username, just public pages with no special privalages needed)

Dooga

Jul 28 2006, 07:59 AM

Google usually crawls every site that people submit, with an exception of sites that were previously banned from their system (usually because you used some "under the table" method to increase your rank, which includes stuff like redirecting other sites, having too many irrelevant keywords, etc.)

khan11

Jul 30 2006, 11:25 AM

i think or im sure that google dont needs any user or pass to login to crawl the pages coz alot of times i check from my admin panel that someone is crawling many pages without getting logged in.This means its the google bot.Its up to webmaster that if he put google ads in Private Messaging page then google will surely crawl that area.

Guys i heard that we can put some code to not allow google to crawl the page we dont want to.So if some of you know please share here.

Thanks in advance.

arnz

Aug 1 2006, 01:14 PM

I've noticed that on some boards, that Google comes up under the "users" browsing bars when it comes to viewing some Invision powered forums.

Latest Entries

keego

Jan 9 2008, 04:04 PM

actually at first i thought my site was never gona be indexed by google.. then out of no where i rememberd to check and it was on i was so shocked. but then i thought hey i got links of my site on myspace, youtube, facebook .. alot of the popular networking sites.. i guess thats why.

im quite happy seeing how when you search my nick Keego Nguyen.. it actually comes up probably 5th on the page.. or higher

richierich1m

Feb 1 2007, 06:39 AM

There isn't a definate period for google to crwal the site ,i see sometimes it index my site once in two days and sometimes not even in a month ,i think it scans the site everytime it somes to your site through a link ,so the more links you have to your site the more it comes to your site for indexing , so get as much link as u can get ,its really worth it

zamaliphe

Feb 1 2007, 03:41 AM

QUOTE(brandice @ Aug 1 2006, 02:31 PM)

I'm sure that submitting your site to google might help, but I have never submitted the site that I have now. I've just added links to the site in all of my BBS profiles and on my Myspace page. I got spidered and put on google much faster that way, for some reason.

i did submit my site to google and 4 Weeks so far nothing happens i think i have to add meny liks to my web site every wear
to be added fast to google
i'm gona try your way and see

richierich1m

Dec 28 2006, 08:14 AM

No its not fixed like this some sites get crwaled even after a mont and some sites may get crawled in plain two days like one of my site did

trace-uk

Aug 2 2006, 02:09 PM

providing you've got linsk to your site out there on well-used and well-crawled websites and submitted your new url to google, it usually is done very qucikly. Though, expect google to only crawlt he idnex page of the new site. expect a 8 wekk wait for ti to have all the website's pages. you'd then need to wait utnilt he next google update to even think about getting it in the serps. usually it takes 2 updates, as by the first google update the search engines doesn't know about all the links to your site and rates it poorly.

ADD REPLY / Got an Opinion!	a humble request :-)	RAPID SEARCH!	Free Hosting	[X]
Express your Opinions, Thoughts or Contribute your information that might help someone here. Ask your Doubts & Queries to get answers.. "Together, We enlight each other!"	Register FREE for AD-FREE forum, Create your own topics, Ask Questions, track topics, setup subscriptions & notifications and Get a Free Website w/ Email and FTP.		500MB Space No Ads, CPanel, FTP, PHP, MySQL, EMails - 100% FREE