Skip to content

Issues: buren/wayback_archiver

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
5 Open 22 Closed
5 Open 22 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

cannot load such file -- robots (LoadError) with ruby verison 2.5
#51 by bartman081523 was closed Nov 22, 2024
1
10
Error in running the script
#46 by xplosionmind was closed Jan 24, 2022
8
error while collecting URLs during crawl
#7 by milliken was closed Feb 5, 2017
6
`check_path': path conflicts with opaque (URI::InvalidURIError)
#25 by bartman081523 was closed Jan 22, 2019
4
Jekyll integration
#39 by xplosionmind was closed Jan 27, 2021
3
most URLs sent to Wayback have 502 Bad Gateway status bug
#10 by milliken was closed Jul 1, 2017
3
cannot load such file -- rexml/document
#44 by shoeper was closed Oct 7, 2021
1
2
Invalid gemspec in [wayback_archiver.gemspec]
#47 by bartman081523 was closed Nov 16, 2021
1
Consider *not* respecting robots.txt by default
#37 by buren was closed Oct 8, 2021
1
Figure out what to do when a domain redirects to a subdomain when starting to crawl
#15 by buren was closed Jun 24, 2022
1
Allow URL with path as the start URL for the crawler enhancement
#6 by buren was closed Aug 3, 2017
1
Use spidr as the crawler enhancement
#5 by buren was closed Jul 1, 2017
1
Make crawler threaded feature
#3 by buren was closed Oct 22, 2014
1
Road to v2
#67 by buren was closed Jun 24, 2022
9 tasks
@buren
WARNING: open-ended dependency on byebug
#49 by bartman081523 was closed Nov 16, 2021
1
Fix hosts argument regression bug
#28 by buren was closed Jun 24, 2022
Brakes when crawling hemnet.se sitemap
#20 by buren was closed Sep 23, 2017
Update the Travis CI config to run on Ruby 2.0
#18 by buren was closed Aug 6, 2017
Replace usage of String#match? in HttpCode
#17 by buren was closed Aug 6, 2017
Configure crawler to send more page types than just html
#16 by buren was closed Jan 22, 2019
Use the concurrent-ruby gem
#11 by buren was closed Jul 1, 2017
Follow redirects enhancement
#1 by buren was closed Oct 21, 2014
ProTip! no:milestone will show everything without a milestone.