Python Web Crawler for testing URLs

checkurl.py

• Create a text file with list of URLs to test, one per line
• Any leading/trailing spaces will be trimmed
• empty lines and those starting with # will be ignored
• default input file name is urls.txt
• a different source file name may be entered as the last parameter
• full and error logs are saved as log-.txt and errorlog-.txt respectively

Usage:

python checkurl.py [source_file_name]

Note

Created for and tested under Python 2.7