- Grab the data from the cloud bucket here: https://storage.cloud.google.com/quartic-newyork/raw-data`
gsutil rsync gs://quartic-newyork/raw-data <repository root>/data/raw
- Unzip it in
<repository root>/data
(so you should haverepository root/data/raw
) sudo docker-compose up -d
- Build the data integration docker image:
cd transform-raw && docker build -t data-integration .
- Run the the data integrations:
cd integration && ./run.sh
cd weyl_imports
pip install -r requirements.txt
python import.py -p jdbc:postgresql://postgis/postgres yml_configs/*
This project is made available under BSD License 2.0.