jlhaslip
Jan 30 2006, 11:41 AM
I guess I have had a site up for a few months now and the Googlebots and others are beginning to find the site, according to the Web Stats at least. My question is: when the Bots travel through and spider a site, do they actually see the sub-domains associated with the main domain? And do the contents of the sub-domains affect the schedule for the return of the Bots in the same way as good Content would affect the return? For instance, if you regularly update a sub-domain and keep adding or changing the content, will the Bots be back quicker or more regularly? Are the domain and the sub-domain inter-related with respect to the Bots? Another question, if I may: similarly, should the Meta-tags for pages other than the Index page by different than the Meta-tags for the Index page? I would think that the Meta-tags for the inside pages could be more specific to the particular page, and if the Meta-tags for the secondary pages are different, will the Bots pick these up and handle the secondary any differently? (assume the robots.txt file does not exclude bots from sub-domains, of course.) 
Reply
Amezis
Jan 30 2006, 01:53 PM
robots.txt will not do anything to the subdomains. From what I've heard, some bots sees the subdomains as external sites. But after what I've experienced, that's partially wrong. My site is not indexed, and none of the subdomains are. Seems like the domain is banned for some reasons, and that the subdomains are banned too. But bots follows external links too, so if you have links to the subdomains from your main page, I'm sure the subdomains will be crawled too.
Reply
spy_charly
Jan 31 2006, 04:35 AM
well yep... i think the robots are supposed to search into your subdomains as soon as you register your domain with the search engines. But another way to do it is to have a refferece in your main page or either in some of your pages registered into your search engines
Reply
Similar Topics
Keywords : robots, domains, bots, domains
- Addon Domains
What exactly are they? (2)
Free Domains For Bloggers
My Website Idea (3) Note: I tried to post this in the Internet Section but cudn't so i'm posting it here I have
this idea to build this website that will provide free domains to bloggers. The idea is simple. I
will take donations from people and applications from bloggers and will provide domains to bloggers
who have the potential to be successful. This is because despite the fact that domains are cheap,
many people cant afford to buy them or cant because of other constraints. And any one knows that to
have a successful blog you need a top-level domain. What do you think? Is this....
Donate Domains To Bloggers.
My Site (0) I'm planning on starting a site soon that will allow visitors to donate money, which will be
used to purchase domains for bloggers. Bloggers who have a decent existing blog with moderate
traffic can apply for free domains. This is to promote good blogging, expose great bloggers/writers
to a greater audience and is intended for those who are not able to afford a domain. What do you
think? Is this a good idea? Would you apply for a domain? Would you donate for this cause?....
What Is Network Marketing And How Does It Work?
Global Domains International (0) Start A LUCRATIVE Online Business That Generates a Passive, Residual Income Every Month on
Autopilot From The Job You Do Just ONCE ! That is the catchline... Network marketing is
basically where if you recruit someone, they recruit tons more people virally in a
endless-spiralling loop of recruiting more and more people. For example, I recruited 10 people for
this GDI thing (http://www.viralurl.com/Gnarfard/GDI), and the system costs $10/month. This
means as long as all the people I signed up stay signed up I never lose or gain money. EXCEPT that
the peo....
Us War Robots Go Bad
(6) Apparently, somebody made a mistake. Or perhaps a lot of them.
http://www.theregister.co.uk/2008/04/11/us...rebellion_iraq/ ....
Sub Domain Problem : Urgent
Cannot access my sub domains (10) Hi, I am having some serious problems with my sub domains. I registered a site with trap17 named
http://zoebelkin.co.cc . Then I made 2 sub domains for the site. One is for the forums section
and the other is for the gallery section. 1> forums.zoebelkin.co.cc 2> gallery.zoebelkin.co.cc
Whenever I type these in the browser adress bar the browser gives an output that it cannot find the
web sites. But they are complete and should show something. Also using www. in front of the sub
domains didn't help. Is www. needed in front of the sub domains. Could you just....
Addon Domains/ Domain Help.
I have no idea what im doing so I need a little help. (12) Ok I just bought a domain name from yahoo.com (www.ageofilluminati.com) Right now my website is
www.childrenofconan.trap17.com/index.html I want to be able to change my domain so when I visit
www.ageofilluminati.com it will direct everything. Forsay when I hit downloads it will direct to
www.ageofilluminati.com/downloads.html not www.childrenofconan.trap17.com/downloads.html. I havent
set it up yet and I just want to be able to change this information so it works. I know that the
re-direction thing is much easier to do but I want the site to be more professional looki....
Need Help In Addon Domains
(4) i need some help in addon domains My domain registor uses A record hence in the DNS setting i have
to put the ip address of my trap17 hosting account. The main domain works out perfectly after
changing the DNS to trap17 ip in my domain registor. Now the problem is when i tried adding a
another domain from the same registor to my Addon domains. I changed the DNS setting as like before
in my domain registor, same ip of trap17 hosting account, waiting it the Dns setting updateds as it
takes time only after it started pointed towards trap17 ip hosting account, i tried to a....
Giving Away A Couple Domains
(6) Well, I'm trying to concentrate more of my time on school work, and baseball, so I'm giving
out three domains. They are established websites, and have content included with them. You will
have full control over the domains, all I ask is you change the whois information to your own. Here
are they are pspsource.info Given to alex7h3pr0gr4m3r An established PSP website with 276 posts
in 85 threads, and 33 registered members and counting. It is using Mybb software, and has a
co-admin, and a moderator who will come up every once and awhile to keep the site act....
Are There Any Free Domains Up For Grabs
(1) are there any free domains still up for grabs if so please let me know.. email me at
rickster090@hotmail.co.uk....
The Reason Why .info Domains Aren't Liked- *scam Site*
http://www.msnliststatus.com/ is a scam! People get sent to it via (2) Hello all! IMPORTANT! If someone on ur MSN logs in, posts:
http://www.yildiztasi.info/list /wink.gif" style="vertical-align:middle" emoid=";)" border="0"
alt="wink.gif" /> Then logs out, be wary. The domain "http://www.yildiztasi.info/list" is a
redirect to http://www.msnliststatus.com/ which is a major scam site, it asks you to login, so you
can see who has blocked you. DO NOT ENTER IN YOUR MSN INFO. If you do, they will be able to
login to your account and take it over! So tell everyone you know NOT to click it and NOT to
enter in your in....
Email Address Protection From Spam Bots
(15) I've developed a nifty small javascript file that will protect the email address in the webpages
from spam bots. all you need to do is to download safeMail from
http://blog.delivi.info/get/safeMail include the javascript file in between the & tags in the
following format. CODE <script type="text/javascript"
src="PATH/safeMail.js"></script> here PATH is the location where you've
uploaded the safeMail.js file then include the email address in your web page in the following
format, CODE <span class="safe....
Cheap & Reliable Domains?
(2) Any recommendations for cheap and reliable Top-level domains? By cheap I mean less than the usual
8, 9 bucks usually charged by most well-known domain companies like godaddy, with no additional
purchase. And the renewal fee should not cost much higher. i was with domainsarefree.com for a time.
The $3.99 first year order looks good but renewal is more than twice the amount, which kind of
put me off after that. And of course, it's got to be reliable.....
Addon Domains?
(5) It appears to tell me that I can request more spaces for addon domains? What must I do/what are the
criteria for more? Thanks.....
Encode Your Email Address
Confuse the Spam Bots, but not your viewing clients (5) Spam bots often 'scrape' pages to glean information and collect email addresses. I don't
like that. To combat the Bots from collecting my address off of my site, I wrote a script that
includes 'obscures' the address in several ways. It adds 'AT' where the '@'
sign is and then replaces the '.' with 'DOT' so it is humanly readable, but not by
the Bots. Also, it encodes the 'mailto' and the address used in the 'mailto' so it
shows okay on the web page and on:hover, but it is actually encode into hex value....
People Will Marry Robots In Future, Says Scientist!
(21) QUOTE Get ready to say 'I do' to R2-D2, because robots are going to be the perfect
marriage material. A British scientist claims humans and cyborgs will tie the knot in the not too
distant future. Artificial intelligence researcher David Levy was awarded a PhD today by a Dutch
university for his thesis, Intimate Relationships With Artificial Partners. He believes marriages
to robots will become common. The thesis examines changing attitudes towards the meaning of
marriage and the development of robotics. He says in the past that people only showed affect....
Godaddy Or Yahoo Domains
Help me to Choose... (9) Hi people... I am in great need. Looking forward for your help. I am in the process of getting a
domain name...but got into the mess of selecting an domain name provider. From suggestions i have
short listed the list to 2. It will be either godaddy.com or from Yahoo Domains . But from the
reviews, i can see that both the providers have pros and cons... But i want to be with the better
provider. Also my concern is with 1. Ease of use 2. Easy configuration 3. Easy to manage 4. Full
Control 5. Feature rich 6. No issues -- like selling your domains to others.... ....
Question About Domains And Introduction
(3) Hello everyone Im new here, Im from Mexico Im starting my own new business (Insurance) And Im
building the website for my future business... I bougth 1 month ago my domain @ godaddy.com, and i
can tell you that is pretty good. The only problem is that if u want to upload your website with
them, u have to deal with ads!!!! Thats the main reason im here.... Can anbody tell
me how can I get free hosting here (Exactly how does this works?, and how long does it takes
usually?) Thanks!!! This is my website http://www.villarrealavalos.com /smile.....
Your Own Domain's Email Address...free
Get your own email with your own domain for free (7) Yes, it's true You get your own domain's email address. Example, if you want email not like
name@yahoo.com but name@surname.com you can get it free. And this Free service is from AOL, so no
fraud Here is the link: http://free.aol.com/thenewaol/domain_email.adp Get your own personal
mail address for free.......
Domains Cheap
(8) do anyone know, where to get free TopLevelDomain name?........
Free .info Domains
Get free .info domain instantly | Your own Control Panel | No Advt. | (22) Hi all, I am going to offer .info domains for free of cost with the following T&C.
LIMITED TIME OFFER T&C 1. Only one domain /user 2. This free offer applicable for
one year only (You can continue next year by paying $8.9/year or u can transer it some other
Registrar from your control panel 3. The Index page of your site should have backlink to our site
(Sigle line text link like "Our Featured Linkpartner http://www.Pcprice.info" | Must be placed at
bottom of the index page | ) FEATURES 1. Your own control panel t....
Domains Registered To Google
(26) QUOTE Google has over 1000's of registered domains. Take a look at the list. Domains
Registered to Google Inc. Last Updated: October 12, 2005 466453.com Adsbygoogle.com Adsense.net
Adwords.com Adwords.net Adwords.org Adwordsexample.com Adwordsgoogle.com Adwords-select.com
Adwordselect.com Adwordsselect.com Adwordsselect.net Adwordsselect.org Akwan.com (still not
registered as a Google domain) Android.com (still not registered as a Google domain)
Answergoogle.com Answer-google.com Answersgoogle.com Answers-google.com AppliedSemantics.com
Appsem.com Arabgoogle.....
Robots : Our Future Or Our End
(75) Though right now only industrial robots are used except a very nominal percentage of population who
have robotic pets etc. , it will take just about 20 or so odd years before they will become part of
our daily lives. The one thing that comes to the mind as soon as hearing the word robot is that ,
how safe will they be . Thanx to the sci-fi flicks of hollywood most of us have created a negative
image about robots. I m a very great fan of science and i dont like it when people speak in
negative sense about science. But in this field i have a different opinion. As i m a....
Help With Subdomains And Dns
are Sub-Domains possible with threw the (16) well, i searched for the forum for an answer specificly for me and didn't find one, so i was
wodnering if anyone could help me out with sub-domains. I have a .com domain at 1&1.co.uk, as i saw
it advertised/suggested in OpaQue's Signature. so. . .first of all, what is DNS? and is that
relelvent to me at all for this? secondly, i can only forward with my domain using the 1&1 control
panel, BUT is there a way to edit all that in trap17's control panel? because at the moment all
the pages of the website go under the same domain and if refreshed is hit then it go....
Free Tld Domains
(15) Hi, Just dropped in to inform you about the free domain offer launched at SingX i can assure that
the offer will be for at least a hundred domain names, rest depends upon your response, read the
guidelines carefully, there can be some bugs in the new system, so whenever you encounter a
problem, PM me, /dry.gif' border='0' style='vertical-align:middle' alt='dry.gif' /> lest i dont
turn out to be a scammer /smile.gif' border='0' style='vertical-align:middle' alt='smile.gif' /> ....
Bot's Cs Source ! Need Help !
(5) I have counter strike source , when a create server i haven't , under choosing maps , add bot .
if any one know how can i fix this problem or if i have to download somthing that add bot , just
tell me any suggestion plz !....
Ezyrewards, Free Domains
No jip, no rip, all real. (41) I've been with www.ezyrewards.com now for almost eight months, and nothing has ever gone wrong
that I've seen in this service. Let me explain what this service exactly is. You sign up at
www.ezyrewards.com, and to earn points, you can do two things: 1. Sign up at advertisments, and earn
a set amount of points for each one. 2. Refer people, and you get points for each advertisment that
the other person signs up at. Once you get to 1000 points, you can register your free domain. I
earned my 1000 points within four months, and it required almost none of my time....
Can two domains share hosting
(4) say i have two different domains can they share the same hosting? so can i have two websites on one
hosting? /biggrin.gif' border='0' style='vertical-align:middle' alt='biggrin.gif' /> ....
Dotworlds Free Domain Problem!
Dotworlds offers dot[anything] domains but I need help! (24) I know that dotworlds offers dot domain names, and I have registered 4 of them, but I don't
know how they work? It says that you have to have a plugin to view the domains registered from
dotworlds, but I'm trying to figure out how to redirect the domain to the one I own. I've
registered http://jesus.christ from dotworlds, and I want it to redirect to
http://theheavenlyfather.com . What do I do?....
Free Dot Com Domains
(22) Is there anyone that knows where I can get a free dot com domain. Is there anyplace where I can get
one? If their is one I would be very appreciative if you could tell me where I can get one. Thanks
again Seņor Maniac ....
Looking for robots, domains, bots, domains
|
|
Searching Video's for robots, domains, bots, domains
|
advertisement
|
|
