Skip to content
This repository has been archived by the owner on May 15, 2023. It is now read-only.
/ TwitterScraper Public archive

For scraping reply data from tweets.

Notifications You must be signed in to change notification settings

stlxiii/TwitterScraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

How to install
    1. Install the latest Python version at https://www.python.org/downloads/
        Make sure to check the option to add Python to the path.

    2. Download and extract the project
        https://github.com/stlxiii/TwitterScraper/archive/master.zip

    3. Open a command line / terminal at the extracted "TwitterScraper-master" folder

    4. Run the following commands to install a virtual environement
        python -m venv .venv
        .venv\Scripts\activate.bat       (or .venv\Scripts\activate if not on PC)
        pip install --upgrade pip
        pip install -r requirements.txt

    5. Install Firefox and the Firefox webdriver
        https://github.com/mozilla/geckodriver/releases
        You can place the webdriver file in ".venv/bin"
        or anywhere else in the system path

How to use:
    1. Enter URLs of tweets in config.ini
    
    2. Run download.py
       It may be necessary to run it several times until no
       new tweets are found.

    3. Run export.py
       Tweet information will be saved under /export/{tweet id}.csv

Releases

No releases published

Packages

No packages published

Languages