Skip to content

Commit

Permalink
sort/uniq after lines are cleaned up.
Browse files Browse the repository at this point in the history
  • Loading branch information
willwhite committed Feb 8, 2015
1 parent 83a52fa commit d189388
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions update
Original file line number Diff line number Diff line change
Expand Up @@ -9,11 +9,11 @@ for source in $sources; do
done;

cat data/free.txt tmp \
| sort \
| uniq \
| sed '/./,$!d' \
| sed -e 's/^ *//' -e 's/ *$//' \
| awk '{print tolower($0)}' \
| sort \
| uniq \
| comm -23 - ./data/blacklist.txt \
| comm -23 - ./data/disposable.txt > ./data/free.txt

Expand Down

0 comments on commit d189388

Please sign in to comment.