Skip to content
This repository has been archived by the owner on Jul 5, 2019. It is now read-only.

TODO

Jump to bottom
Fábio Madeira edited this page May 16, 2018 · 4 revisions

This page lists the future development plans.

TODO - General

  • Form an org with multiple repos (importer, web node)
  • Support for swappable DB adapters (Dynamo, MongoDB, Redis)
  • Continuous Integration set up

TODO - App infrastructure

  • Use environment variables for app configuration
  • Set up Cloudflare DNS
  • Fully scripted deployment with Terraform
  • Manage deployed app process with PM2 / Keymetrics

TODO - Data importer

  • Rewrite DynamoDB ingestion process in Python
  • CrossRef data dump + import as a reproducible processes
  • Throttle the ingest process and allow multi-threading
  • Contain the date range in initial/seed data dump script (should stop at a fixed date with complete data, i.e. yesterday to prevent snapshotting a moving target and after that's finished use daily snapshots going forward)

Notes:

Currently the project uses DynamoDB because of the free tier (up to 25GB) which is sufficient at the moment and will allow for free hosting of the DB in the near future.

Clone this wiki locally