May 12, 2008

Google Crawling System

Free Web Hosting, No Ads > CONTRIBUTE > The Internet > Google Services > THE MIGHTY GOOGLE SEARCH!
Pages: 1, 2

free web hosting

Google Crawling System

khan11
hello guys,

i dont know much about seo system,but i heard google crawls any website after 1 week,is it true or its google's choice to crawl any site?



i know its kiddy question but i cant solve this in my mind.

Reply

T100
You can summit your site to google for crawling and google will index your page shortly. If you do not publicize your website, google will not know your existence until someone who likes your site put a hyperlink pointing to your site. Google will then follow the link and crawling onto your website. Google bot is a very diligent bot, you have to expect a high bandwidth use if you intend to have google index your page. You can preserve your bandwidth by editing a robots.txt file. You may either prohibit google from crawling your site, or prevent it from indexing some of your pages. (images take up the most bandwidth.)

Reply

khan11
i dont know how to create robots.txt file so you will be laughing to read that i created robots.txt and written nothing in it and then uploaded on my webserver coz i dont know what to write in it.

Reply

Sinari
I think that Google crawls them in a week- but I have yet to be listed in the Google search anywhere. I've been in the "crawling" list for a few weeks, but still nothing. Not sure how it works yet, but any advice would definently help.

Reply

Florisjuh
Google Crawl bot is one of the smartest bots ever, if your site has usefull information on it the bot will find it wink.gif

Reply

kbsp
so these bots use up a lot of bandwidth how much are we talking im saying like for a forums like this...and i hear they even crawl peoples pm is that true

so they download files off the site too?


Reply

Malexos
I don't think they search peoples PM's, otherwise, my whole dirty conversation with my girlfriend would've been public . . . Aww, crap!

(No, they can't crawl PM's, without your password, and username, just public pages with no special privalages needed)

Reply

Dooga
Google usually crawls every site that people submit, with an exception of sites that were previously banned from their system (usually because you used some "under the table" method to increase your rank, which includes stuff like redirecting other sites, having too many irrelevant keywords, etc.)

Reply

khan11
i think or im sure that google dont needs any user or pass to login to crawl the pages coz alot of times i check from my admin panel that someone is crawling many pages without getting logged in.This means its the google bot.Its up to webmaster that if he put google ads in Private Messaging page then google will surely crawl that area.

Guys i heard that we can put some code to not allow google to crawl the page we dont want to.So if some of you know please share here.

Thanks in advance.

Reply

arnz
I've noticed that on some boards, that Google comes up under the "users" browsing bars when it comes to viewing some Invision powered forums.

Reply

Latest Entries

keego
actually at first i thought my site was never gona be indexed by google.. then out of no where i rememberd to check and it was on i was so shocked. but then i thought hey i got links of my site on myspace, youtube, facebook .. alot of the popular networking sites.. i guess thats why. smile.gif im quite happy seeing how when you search my nick Keego Nguyen.. it actually comes up probably 5th on the page.. or higher

Reply

richierich1m
There isn't a definate period for google to crwal the site ,i see sometimes it index my site once in two days and sometimes not even in a month ,i think it scans the site everytime it somes to your site through a link ,so the more links you have to your site the more it comes to your site for indexing , so get as much link as u can get ,its really worth it

Reply

zamaliphe
QUOTE(brandice @ Aug 1 2006, 02:31 PM) *
I'm sure that submitting your site to google might help, but I have never submitted the site that I have now. I've just added links to the site in all of my BBS profiles and on my Myspace page. I got spidered and put on google much faster that way, for some reason.

i did submit my site to google and 4 Weeks so far nothing happens i think i have to add meny liks to my web site every wear
to be added fast to google
i'm gona try your way and see

Reply

richierich1m
No its not fixed like this some sites get crwaled even after a mont and some sites may get crawled in plain two days like one of my site did

Reply

trace-uk
providing you've got linsk to your site out there on well-used and well-crawled websites and submitted your new url to google, it usually is done very qucikly. Though, expect google to only crawlt he idnex page of the new site. expect a 8 wekk wait for ti to have all the website's pages. you'd then need to wait utnilt he next google update to even think about getting it in the serps. usually it takes 2 updates, as by the first google update the search engines doesn't know about all the links to your site and rates it poorly.

Reply



Got an Opinion! Express your Views! (no registration):-
Add your Reply/ Opinion/ Views/ Comments/ Suggestion/ Questions/ Queries etc.
Posts with decent grammar & English will be accepted and please refrain from profanities.
For asking a Question, We recommend you to sign-up (for free) so that you can track the topic easily.

Nature of your Post*: Opinion/ Reply/ Comments
Question/Query
Feedback to us.
       
Name   Email
Title/Question*

(Maximum characters: 10,000)
You have characters left.
Confirm Code:

Pages: 1, 2
Recent Queries:-
  1. google crawling rule - 347.71 hr back.
  2. how long does it take for search engines to crwal a site - 355.30 hr back.
  3. google crawling - 519.59 hr back.
  4. google - 494.08 hr back.
Similar Topics

Keywords : google crawling

  1. How Long Does It Take To Get Listed In Search Engines - Time to get listed on Google, Yahoo etc. (3)
  2. Google A Number? - (35)
    when i was in 5th grade, which was 5 years ago, this was right when google first came out i think...
    anyways, i remember my 5th grade teacher telling me that the word google was the biggest number
    possible and that it was bigger than infinity. Back then i believed it but then you really think
    about it, how is a number even possibly bigger than infinity if infinity goes on FOREVER? and is
    googe EVEN a number????? anybody know?...
  3. Google Rolling Image Trick - (11)
    You might already know this but it doesn't really matter.... OK this isnt a useful trick or
    something, its just something thats fun to see. 1. Goto Google 2. Click "images" 3. Type "jesus"
    or any other word 4. You will get a page which is full of images 5. Then delete the item from the
    address bar and paste the below script: CODE java script:R=0; x1=.1; y1=.05; x2=.25; y2=.24;
    x3=1.6; y3=.24; x4=300; y4=200; x5=300; y5=200; DI=document.images; DIL=DI.length; function
    A(){for(i=0; i<DIL; i++){DIS=DI[ i ].style; DIS.position=&#...
  4. Google Tricks - (31)
    I found out these from some other site, but if you type in QUOTE worst band in the world
    scrool down abit and look who you see. Typing in QUOTE the answer to life the universe and
    everything and see what the google calculator Another good one is when you type in QUOTE
    French Miltary Victories And press i'm feeling lucky it comes up with, QUOTE Do you
    mean French Miltary Defeats And the best of them all, is when you type in Failure and the
    first option is george bush. That one made me laugh for weeks....
  5. What Kinda Stuff Do You Search For On Google? - (9)
    What do you all search for on google? Some of those I search for. others I don't....
  6. Google On An Acquisition Spree - (7)
    Google is on an acquisition spree. Over the last few days, it has acquired Panoromio and feed
    burner. What does this mean? Well Panoromio mainly was used in Google Earth to show pics anywhere in
    the world at the location taken while feedburner is aRSS feeds utility. But did Google make the
    right choice. How long is it gonna continue making such aquisitions? It has gotten into a huge legal
    turmoil with youtube. And it paid Doubleclick a ridiculously huge amount. Is Google gonna benefit
    from these takeovers. Share your thoughts....
  7. Google Vs *other Search Engine* - Which is the best?!!?!? (37)
    Now, do you think that there is a better search engine out there? Or do you think it's GOOGLE?
    And do you think Google is against yahoo and all the other search engines? To me, I kinda like the
    search engine dogpile... It may not have a lot of search results, but that's ok. It has the best
    search engines all piled up into one! ( visit Dogpile.com )...
  8. Submit Your Site To Google - How to make google find your site (14)
    How to submit website to google? Is there any fast and guaranteed way to do it?...
  9. Will Google Be The New Microsoft? - (35)
    Google has become a huge success through these past years. They have grown from a simple company on
    the corner of the market to a leader in its industry. It keeps comming with new ideas that blows
    their competetion out of the water. This growth from Google is makeing Microsoft a little affraid.
    Though Microsoft is the leader of the computer world, it has not reached out to become a leader on
    the internet, like Google has. Now Google is the leader of the internet world, and also adapts
    itself to its users with programs and services that ignore what operating system its sy...
  10. Google Earth Day Logo - (5)
    Have you guys seen Google's logo today. As a part of Earth Day they have given an entirely new
    colour to google. It is sooooo coooooooooool literally. Showing a frozen Google Ice berg. Wonder
    where they come up with these ideas. I simply love them...
  11. A Google Mirror - the strangest mirror site of google (14)
    go to google.com and type elgoog, which is google revesed, then hit the "I'm feeling lucky"
    button....
  12. I Like Google - (8)
    Personally, I use google for most things over yahoo and all those. Maybe it's just a habit or
    maybe I just think it's good...(which it is) but with image search and all the other links,
    It's good....
  13. Google Celebrates Halloween - (7)
    Google is celebrating the Halloween by putting up a new doodle in its site, the 2007 Halloween
    doodle is, you can see the previous google Halloween doodles here ...
  14. Life Before Google - (40)
    Google has been the leading search engine for many years now, it makes me wonder how one out of what
    seems like a million different search engines could stand out so much to the point where very few of
    us would consider using something else. What I am curious about, is what search engines did people
    use before the invasion of Google? I remember using a site called Metacrawler and that it
    wasn't the most effective thing ever for what I was looking for, but it worked nonetheless. I
    remember using yahoo too but again, it wasn't that refined back then either. Pos...
  15. Google Celebrates 50th Aniversary Of Sputnik - (1)
    Sputnik 1, launched on Oct.4, 1957, became the first artificial satellite to successfully orbit the
    Earth. Image of Sputnik According to NASA, QUOTE History changed on October 4, 1957, when
    the Soviet Union successfully launched Sputnik I. The world's first artificial satellite was
    about the size of a basketball, weighed only 183 pounds, and took about 98 minutes to orbit the
    Earth on its elliptical path. That launch ushered in new political, military, technological, and
    scientific developments. While the Sputnik launch was a single event, it marked the star...
  16. Google Celebrates 9th B'day - (11)
    Google that revolutioned the way we search the web has turned 9 today. Google is celebrating its
    9th B'day today. On this occasion Google has released its new logo ...
  17. Britney Spears On Google - (26)
    we have always known google to be the pioneers in cutting edge tech, et al... but its a well known
    fact that these guys are funny... here is an example http://www.google.com/jobs/britney.html ...
  18. Google Acquires Grandcentral - (0)
    Google has acquired GrandCentral , a company that provides services for managing voice
    communications. GrandCentral is an innovative service that lets users integrate all of their
    existing phone numbers and voice mailboxes into one account, which can be accessed from the web.
    QUOTE GrandCentral offers many features that complement the phone services you already use. If you
    have multiple phone numbers (e.g., home, work, cell), you get one phone number that you can set to
    ring all, some, or none of your phones, based on who's calling. This way, your phone numbe...
  19. Google To Acquire Postini - (0)
    Google has signed an agreement to acquire Postini , a global leader in security solutions serving
    more than 35,000 businesses and 10 million users worldwide. Postini's services include message
    security, archiving, encryption, and policy enforcement are used to protect a company's email,
    instant messaging, and other web-based communications. Google will acquire Postini for $625
    million in cash and Postini will become a wholly-owned subsidiary of Google. The agreement is
    expected to close by the end of the third quarter 2007. Read the Google's Press ...
  20. Google, The Traitor - How Google betrayed me, in a search engine way (12)
    "Yes! I'm listed" was my initial response when searching google for: computer.trap17.com :
    And there it was, my link in the Google Search Engine. What was remarkable was how my site was
    indexed in one day when my site had no posts and a disgusting template. I was ecstatic and hoping
    this was a beginning of something good to come. So I started making my site better. I got a
    template, some members, and one month later there is my site. With 2100 posts and 5 members. I felt
    proud of the job I had done and thought to myself. If I can get indexed in google in one da...
  21. Will Google All Ways Be Number 1 Search? - (63)
    i have used google for as long as i can remeber but i have try use msn search but i still find my
    self useing google. i think it will be the best forever /smile.gif' border='0'
    style='vertical-align:middle' alt='smile.gif' /> do you have google set as homepage? do you use
    google?...
  22. Newfangled Languages From Google - (3)
    Newfangled languages from Google! /huh.gif" style="vertical-align:middle" emoid=":huh:"
    border="0" alt="huh.gif" /> as you know, Google brings search results in your language here are
    some new languages from Google! check these out! http://www.google.com/intl/xx-bork/
    http://www.google.com/intl/xx-elmer/ http://www.google.com/intl/xx-piglatin/ ...
  23. Google Search Engine Gets An Update - (14)
    Well it seems google search engine will get a big update when people begin using the search engine.
    When a person checks the results of what they entered, they now have the option to check if
    video's exsist but instead the video will be within the search query. So basically instead of
    clicking all over the place everything will be intertwined within each other, they also plan to
    include a gmail link up on top of the search results. Which means new people can sign up for a
    gmail account that is now open to the public. They also provided a link to new idea's go...
  24. Crawled By Google! - (4)
    Well I signed up to be on googles search engine it has been 2 months and I havn't got crawled
    yet I am mad is it because I didn't get accepted in the search engine or something please post
    your comments or feedback on this post!...
  25. What Does Wikipeadia Think About Google - mmm?? (11)
    QUOTE Google Inc. (NASDAQ: GOOG and LSE: GGEA) is an American multinational software
    corporation, first incorporated as a privately held corporation in September, 1998, that specializes
    in search engine, information retrieval technology and online advertising. With a market
    capitalization of US$118.32 billion as of June 2006, Google is the largest internet search
    company in the world, almost twice as large as rival Yahoo! The company employs approximately
    6,800 employees and is based in Mountain View, California. Eric Schmidt, formerly chief executive
    offi...
  26. Google Tricks Dieing :( - (3)
    Most of you probably read my thread about google tricks. Well google has changed some of it, can you
    belive it! Not all of them but the one where you type: QUOTE Failure The press "I'm
    feeling Lucky" button, it no longer works. They have replaced that with this:
    http://news.bbc.co.uk/1/hi/world/americas/3298443.stm What has this world come to? ...
  27. What Is Your Favourite Google Feature? - (17)
    What is your favourite feature on Google? I like the way it always offers different spellings of a
    word, becuase without that, i would never get anything done! i also like the way it ranks the
    most 'popular' sites first, if it's a good site, people will want to go to it,
    therefore, you should not waste your time looking at less interesting sites....
  28. I Like Google - (25)
    Google is the only web search I use though on od days i would use yahoo i dont no y though lol and i
    would just like to say that I love trap17 even though I havent been here very long and I cant wait
    to get my hosting and if you wana be my frein please please pleas pm me and have a we chat with me
    because i get board all the time ! /biggrin.gif" style="vertical-align:middle" emoid=":D"
    border="0" alt="biggrin.gif" />...
  29. Google-wack - (0)
    The almighty google-wack The Rules: Enter 2 words used in the english dictionary into google No
    hyphens or any punctuation Has to be spelt correctly Aim: Have 1 page returned into your search.
    EXAMPLE- 'correlations defibulating' typed into google returns 1 page result
    "http://tuesdaypillow.journalspace.com/?cat=humor" ...
  30. Great Site Ranking In Google - The Secrets Out (20)
    worth reading if you desire a great site ranking in google. covers a good deal of hard facts on how
    google indexing works. some "common" techniques and notions dispelled as well, to avoid getting your
    site "sandboxed" by google. QUOTE Google have recently filed a US patent which reveals a great
    deal of how they rank your web site. Some of it you could never of guessed at...
    http://www.buzzle.com/editorials/text6-10-2005-71368.asp ...



Looking for google, crawling, system

Searching Video's for google, crawling, system
advertisement



Google Crawling System



 

 

 

 

ADD REPLY / Got an Opinion! Remove these ADs! RAPID SEARCH! Free Web Hosting [X]
Express your Opinions, Thoughts or Contribute more info. to help others.
Ask your Doubts & Queries to get answers, So that "Together We can help others!"
Register FREE for AD-FREE forum, Create your own topics, Ask Questions, track topics, setup subscriptions & notifications and Get a Free Website w/ Email and FTP.
500MB Space *No Ads*, CPanel, FTP, PHP, MySQL, EMails - 100% FREE