Удалить дубликаты

Discussion in 'Болталка' started by PomaH9991, 11 Jul 2009.

  1. PomaH9991

    PomaH9991 Member

    Joined:
    10 Nov 2007
    Messages:
    14
    Likes Received:
    21
    Reputations:
    5
    Помогите плиз есть список в нём много дублей но написаных в разном регистре, с помощю чего можно удалить такие дубликаты?
     
  2. eLWAux

    eLWAux Elder - Старейшина

    Joined:
    15 Jun 2008
    Messages:
    860
    Likes Received:
    616
    Reputations:
    211
    PHP:
    #!/usr/bin/perl  -w -elw
    #use: anti-dubl.pl input.txt

    $inputF shift;
    $ouputF 'out_'.$inputF;

    open ("<$inputF");
    @
    input = <F>;
    chomp (@input);
    close F;
    %
    out = ();
    @
    input grep(!$out{$_}++, @input);

    open (">>$ouputF");
    print 
    F join("\n",@input);
    close F;
     
  3. Barsik

    Barsik Блoxacтый

    Joined:
    16 Jan 2005
    Messages:
    267
    Likes Received:
    235
    Reputations:
    182
    http://www.google.com/search?hl=ru&client=opera&hs=XHb&q=Text+Duplicates+Killer&btnG=%D0%9F%D0%BE%D0%B8%D1%81%D0%BA&lr=
    Text Duplicates Killer
     
  4. br3k

    br3k Elder - Старейшина

    Joined:
    19 Sep 2007
    Messages:
    130
    Likes Received:
    107
    Reputations:
    17
    Raptor
     
  5. Nelzone

    Nelzone Banned

    Joined:
    12 Apr 2008
    Messages:
    172
    Likes Received:
    134
    Reputations:
    6
    dubkill
     
    #5 Nelzone, 11 Jul 2009
    Last edited: 11 Jul 2009