«Home

How Long Does It Normally Take Search Engines To Crawl A Site?

i submitted a site to google days ago and it hasnt been listed yet. and i heard something about a robots.txt file, can someone please explain to me??

Avatar
Newbie
13 answers

@Dual. funny right?

@Ade. I no fit reach you for phone ohhh

0
Avatar
Newbie

@Sam. i don't see the reason why you are trying to raise a beef,

Ok. is it a matter of connection speed? So i dismissed that point,

Ok, you just spoke on submitting site to google webmaster, is that not what i spoke about,

Whats ur point, the whole sitemap poo sucks, as long as a page meta tags are well written, a search engine can index it, either it is submitted, or automatically crawed, , Search Donpuzo, and you will see my site search Imonitie Nosa Mark and you will see my site, cause they were written in the meta tag, if any of this key word ai'nt there i bet it wont find the site upon search,

Men quite the thinking that i am claiming seo guru, just trying to make people understand simple facts

0
Avatar
Newbie

@DonPuzo,

You have been making a lot of noise here like you are SEO expert.

If you want to show off your site here, just do it as many times as you wish and then do other things.

[by the way, nice site. good job.]

What did you search on google ?

If you develop a site and publish it , you can see it the next day on google index if you search for the site.

eg.  yoursite.com as search keyword. How about search for the contents of your site and see how many of them google have indexed ?

try    site:yoursite.com  and check how many urls you have there.

Meanwhile You need a site map. Thats the first thing you should create and add to your site. create a file for it in your root directory. Name it sitemap.xml.

generate xml links from http://www.xml-sitemaps.com/  and add the contents in the file you created. Use google webmasters tools to submit your site to google and check how many urls u have indexed in google. I run custom sites too apart from my forum.

0
Avatar
Newbie

For me I'd say instantaneously! I developed a site, never sought a link from any site, never submitted it to Google or any other SE but found its way into their index after 48 hours. Amazing, huh! I'd say just do the right stuff and the SEs will be chasing your site. No need to buy links, you can do it on your own.

0
Avatar
Newbie

@Mama gee. You are wrong, internet speed has absolutely nuffin to do with google indexing ur site

0
Avatar
Newbie

It depends if you're using a highspeed internet.

0
Avatar
Newbie

Thanks bro,

Doing more work, to make it great site and far more a great web application, for subscribers to get what they want,

Hope you have gotten the search engine thing done, a look at my source code could help u with the meta tag issues!!!

0
Avatar
Newbie

wow, mehn your site is fresh. i am definitely going to subscribe.

0
Avatar
Newbie

Yes na, the description, and all those complete meta tags and keyword meta tag, with somethig that can easily be indexed as in you will fill it with a well placed tag.

Check www.marknollis.com for an example

0
Avatar
Newbie

its been days now and the site hasnt been indexed. is there any special meta tag that i need to put??

0
Avatar
Newbie

In seconds nomally and some cases 24 hours, submited mine to google when next i checked it was there as in that same moment,

Try checking your meta tag and also if it ain't good, work on it, that should work it out!!!

0
Avatar
Newbie

robots.txt are those places you do not want robots to crawl.

Its a file you can create in your root directory and include the urls you do not want robots to index.

0
Avatar
Newbie
Your answer
Add image

By posting your answer, you agree to the privacy policy and terms of service.