parquet-rs

An Apache Parquet implementation in Rust (work in progress)

Development

Requirements

• Rust nightly
• Thrift (with Rust support)

To install Rust nightly build, run this (assuming you have Rust installed already):

rustup update nightly
rustup default nightly

Building project requires Thrift with Rust support, which is in master branch. Build from source:

git clone --depth=1 https://github.com/apache/thrift
cd thrift

# export env vars for openssl (this might not be needed depending on packages installation)
LD_LIBRARY_PATH=/usr/local/opt/openssl/lib:"${LD_LIBRARY_PATH}"
CPATH=/usr/local/opt/openssl/include:"${CPATH}"
PKG_CONFIG_PATH=/usr/local/opt/openssl/lib/pkgconfig:"${PKG_CONFIG_PATH}"
export LD_LIBRARY_PATH CPATH PKG_CONFIG_PATH

./bootstrap.sh

# no need to include 'with-rs' flag, 'cargo build' will build this dependency
./configure --enable-libs=no

make install

On OS X you might need to pre-install following packages (if not installed already):

brew install boost libevent openssl libtool automake pkg-config

For more information on setup and build refer to .travis.yml file.

Build and test

To build project run:

cd parquet-rs

make

# clean generated files
make clean

# run tests
make test

# install 'rust-clippy' for this ('cargo install clippy')
make clippy