Правильно ли составлен robots.txt

Discussion in 'PHP' started by Naydav, 6 Nov 2007.

  1. Naydav

    Naydav Elder - Старейшина

    Joined:
    30 Dec 2006
    Messages:
    439
    Likes Received:
    63
    Reputations:
    4
    Правильно ли составлен robots.txt если необходимо запретить индексацию сайта всем поисковикам кроме - Yandex, Google, Rambler, Meta, Bigmir


    User-agent: Yandex
    User-agent: Googlebot
    User-agent: BigmirSpider
    User-agent: MetaSpider
    User-agent: StackRambler
    Disallow:
    Host: www.site.com

    User-agent: *
    Disallow: /

    ---
     
    #1 Naydav, 6 Nov 2007
    Last edited: 7 Jul 2008
  2. halkfild

    halkfild Members of Antichat

    Joined:
    11 Nov 2005
    Messages:
    365
    Likes Received:
    578
    Reputations:
    313
    вроде правильно

    некоторое потверждение
    /thread51728.html
    http://www.fdmua.com/articles/5/32.html
     
    _________________________
    #2 halkfild, 6 Nov 2007
(You must log in or sign up to post here.)