Creating our analysis data sets

Forecasting Crime in Portland

Required packages: rvest, data.table, foreign, zoo, sp, rgeos, maptools, rgdal

Run data_download.R to scrape the NIJ website for links to all .zip files and download them into ./data.
Run crimes_to_csv.R to convert these shapefiles' .dbf databases into our analysis .csv files: crimes_all.csv, crimes_bur.csv, crimes_str.csv and crimes_veh.csv.
Make sure you have the provided Portland_Police_Districts.shp shapefile of police districts in Portland in ./data, then run extract_portland_boundary_to_csv.R to create a text file containing all x-y coordinates of the (500-ft-buffered) vertices of the outer boundary of Portland into ./data/portland_coords.csv.

Converting chosen parameters into output shapefiles

competition_output.R takes all the parameters as input and outputs one shapefile (.shp, .dbf, .prj, and .shx) in the appropriate place in the submissions folder (one crime type/horizon combination per run of competition_output.R).

Name		Name	Last commit message	Last commit date
Latest commit History 480 Commits
alternative_models		alternative_models
bo_scripts_in_r		bo_scripts_in_r
data		data
delete_me		delete_me
kde_baselines		kde_baselines
rss_data		rss_data
scores		scores
smint_template		smint_template
submission		submission
timings		timings
.gitignore		.gitignore
README.md		README.md
ar_ws.py		ar_ws.py
ar_ws_evaluate_params.R		ar_ws_evaluate_params.R
ar_ws_grid.R		ar_ws_grid.R
ar_ws_random_search.R		ar_ws_random_search.R
competition_output.R		competition_output.R
crimes_all.csv		crimes_all.csv
crimes_bur.csv		crimes_bur.csv
crimes_str.csv		crimes_str.csv
crimes_to_csv.R		crimes_to_csv.R
crimes_veh.csv		crimes_veh.csv
data_download.R		data_download.R
extract_portland_boundary_to_csv.R		extract_portland_boundary_to_csv.R
feb28_calls_geocode.R		feb28_calls_geocode.R
final_parameters.rtf		final_parameters.rtf
local_setup.R		local_setup.R
paramsearch_arws.R		paramsearch_arws.R
parse_spearmint_output.ipynb		parse_spearmint_output.ipynb
run_smint_experiment.bash		run_smint_experiment.bash
smint_getout.py		smint_getout.py