how to crawl a website?
i have a website i want to be listed on google, its a small non profit. how do i get google to post it on their search results?
niel, thanks for the fast answer, but i dont really know what im doing as far as adding XML site maps and stuff like registering to google. im not really a tech guy
sorry, meant Neil*
Have you registered your site with Google Webmaster Tools & Bing Webmaster Tools. You will also need to add an xml sitemap file to your site.
On top of that, have you added good keywords to your site.
PS. I'm not a tech guy also but all these processes have good instructions on how to do things and its all free. If you have a Google account go into Google Webmaster Tools and follow the instructions for adding your website. Go to www.xml-sitemaps.com/ to create an xml site map, download the file to your My Documents folder on your computer and then upload it to the root folder of your website using a FTP program such as FileZilla.
Source(s):12 months ago
Typically, if you get a few links from other sites already indexed, the search spiders will 'discover' your site by traversing those links. Comments on relevant blogs or forum signature links may do.
This helps find appropriate sites.
To see what pages are indexed try this definitive test:
search for: site:yoursite.com (no spaces)
A big issue is being found for useful, relevant phrase searches, coming up for a search of the name is not very valuable.