simple wget spider get urls from a page using wget dependencies wget jq grep awk sort uniq usage ./wgetSpider.sh <url>