SBS web site not appearing in google (and other search engines)

Discussion in 'Windows Small Business Server' started by Xavier, Sep 11, 2005.

  1. Xavier

    Xavier Guest

    Hi,

    I recently installed a "business card" like web site on top of a SBS 2003. I
    replaced the default robots.txt by the following one:

    User-agent: *
    Disallow: /_vti_bin/
    Disallow: /clienthelp/
    Disallow: /exchweb/
    Disallow: /remote/
    Disallow: /tsweb/
    Disallow: /aspnet_client/
    Disallow: /images/
    Disallow: /_private/
    Disallow: /_vti_cnf/
    Disallow: /_vti_log/
    Disallow: /_vti_pvt/
    Disallow: /_vti_script/
    Disallow: /_vti_txt/

    However, after a few days, my site is still absent from search engines like
    Google or MSN Search. I must add that the server has been up and running
    several weeks with a "under construction" default web page and a robots.txt
    file containing

    User-agent: *
    Disallow: /

    I also checked my IIS log file and could not find any trace of a search
    engine crawler.

    Does anyone have a hint about what could be done for my site to be
    referenced in search engines ?


    Thanks for your suggestions.

    Xavier
     
    Xavier, Sep 11, 2005
    #1
    1. Advertisements

  2. Xavier

    Russ Grover Guest

    It can take MONTHS for your website to appear in Search Engines...

    I think Yahoo Wants $500 now for a business listing (@#$)
    And there's no Guarantee of listing.

    Google should spider your site within 24hrs after you submit it.

    But I don't think it indexes it right away.
    I'm not sure but I think they have to get a Couple of Positive Hits before
    it gets indexed.

    --
    Russ Grover
    Small Business IT Support
    Portland\Beaverton OR USA
    Email: Sales at SmallBusinessITSupport.com
    Website: www.SmallBusinessITSupport.com
     
    Russ Grover, Sep 11, 2005
    #2
    1. Advertisements

  3. Xavier

    Dale Guest

    Concerning GOOGLE...

    You might want to check out the new sitemap (in beta) for google. You can
    see my sitemap at: www.daleallen.com/sitemap.xml

    After I made a sitemap, I got indexed right away on Google's site. You can
    make a sitemap file by using this Sitemap Generator... (Download it from my
    site)

    http://www.daleallen.com/downloads/webcrawler.zip

    You can also download third party Sitemap generators. See... Sitemaps Third
    Party Programs & Websites
    http://code.google.com/sm_thirdparty.html

    See: http://www.daleallen.com/website_developers_links.htm Especially the
    part about: "Some Traffic Numbers: Here are some search engine traffic
    results listed by popularity and where people search. Gathered by
    useit.net."...

    Also See:
    https://www.google.com/webmasters/sitemaps/docs/en/protocol.html#faq_sitemap_location



    I hope all this helps...

    Dale Allen
     
    Dale, Sep 12, 2005
    #3
    1. Advertisements

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments (here). After that, you can post your question and our members will help you out.