Skip to content
This repository has been archived by the owner on Dec 18, 2024. It is now read-only.

Only allowed to download max 1000 posts? #3

Closed
pangjac opened this issue Oct 8, 2015 · 2 comments
Closed

Only allowed to download max 1000 posts? #3

pangjac opened this issue Oct 8, 2015 · 2 comments

Comments

@pangjac
Copy link

pangjac commented Oct 8, 2015

In settings there is "Max Posts Retrieved in Subreddit Content Download[1-1000]", so if I want to download posts more than 1000? 1000 posts is far from enough to get data analysis.

Which setting will allow me to extract next 1001-2000, 2001-3000 etc posts? Is there an automatically mechansim to download ALL posts for one reddit topic?

Thanks!

@pangjac pangjac changed the title Only allowed to download max 100 posts? Only allowed to download max 1000 posts? Oct 9, 2015
@NSchrading
Copy link
Owner

Sorry, currently the Reddit API restricts downloads to the most recent 1000 submissions. If you want to download past the 1000 limit, you have to write your own scraper that can pass in time values to Reddit. Currently this isn't something available in my tool, and I haven't seen anything that does this for you, but if you look around you might be able to find something.

@pangjac
Copy link
Author

pangjac commented Oct 15, 2015

Dear J, thanks for the information. I think another way is just scrape the website directly, bypassed an reddit API?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants