AminoStore

This repository includes code implementing AminoStore -- A fault-tolerant, transactional data store. This code is based on the research described in the SOSP 2015 paper, "Building Consistent Transactions with Inconsistent Replication."

AminoStore incorporates TAPIR, a new protocol for linearizable distributed transactions built using replication with no consistency guarantees. By enforcing consistency only at the transaction layer, coordination at the replication layer is eliminated, enabling the same transaction model and consistency guarantees as existing systems, like Spanner, with better latency and throughput.

In addition to TAPIR, this repo includes several other useful implementations of distributed systems, including:

1. An implementation of a lock server designed to work with inconsistent replication (IR), our high-performance, unordered replication protocol.

2. An implementation of Viewstamped Replication (VR), detailed in this older paper and this more recent paper.

3. An implementation of a scalable, distributed storage system designed to work with VR that uses two-phase commit to support distributed transactions and supports both optimistic concurrency control and strict two-phase locking.

The repo is structured as follows:

• /lib - the transport library for communication between nodes. This includes UDP based network communcation as well as the ability to simulate network conditions on a local machine, including packet delays and reorderings.

• /replication - replication library for the distributed stores

  • /vr - implementation of viewstamped replication protocol
  • /ir - implementation of inconsistent replication protocol

• /store - partitioned/sharded distributed store

  • /common - common data structures, backing stores and interfaces for all of stores
  • /tapirstore - implementation of TAPIR designed to work with IR
  • /strongstore - implementation of both an OCC-based and locking-based 2PC transactional storage system, designed to work with VR
  • /weakstore - implementation of an eventually consistent storage system, using quorum writes for replication

• /lockserver - a lock server designed to be used with IR

Compiling & Running

You can compile all of the executables by running make in the root directory

AminoStore depends on protobufs and libevent, so you will need those development libraries installed on your machine. On Linux, this can be done through apt.

Contact and Questions

Please email Quinton at [email protected], Irene at [email protected], Dan at [email protected]