Pterradactyl is a library developed to abstract TF configuration from the TF environment setup. Pterradactyl allows to create a hierarchy of TF environments/stacks, hallows an unconstrained number of cloud accounts and stacks to share inherited configuration.
Currently, multiple TF stacks are managed through different TF environments and var files. But this becomes especially tricky to manage when the stacks are vastly different from one another, or even in the case of slightly different stacks, one could question the DRY principal looking at all the repeat vars in the var file! When stacks deviate from one another, by using just the var files, the TF code quickly becomes unreadable with all the conditionals. Using just environments based TF, there is always room of accidental apply of one stack to the other. You can use bash files to safegaurd against that but then there is always the old faithful way of doing by just completely skipping the bash file ! (#fun-stuff)
Pterradactyl takes care of all the pain points described above.
Table of content
- Some of the Pterradactyl features
- Installation
- Usage
- Unit Tests
- Examples of creating new projects/prodcuts
- Pterradactyl Directory Structure
- Comparison of other well-known Terraform wrappers:
- Programatically generated Terraform code using hierarchical YAML files structure. Override only what you have to in your stack file and keep the rest in common YAML.
- Because Pterradactyl uses hierarchy, it becomes simple to provide standard structure to common attributes like
tags
in a uniform manner. - Secrets support using sops and AWS KMS.
- Keeps Terraform versions consistent between stacks.
- As the Terraform file is generated through Pterradactyl, there is no room for the fun
override
:)
Pterradactyl uses Phiera, to manage the YAML hierarchy configuration for a terraform code base.
Integration of terraform with Phiera is achieved through Pterradactyl.
A primer on Hiera.
pip install pterradactyl
pip install git+https://github.com/Nike-Inc/pterradactyl#egg=pterradactyl
You can always install it from wheel, by running the following commands:
Build package and wheel.
poetry install
poetry build
Install
python3 -m pip install dist/*.whl
Of course, you can always deploy the package to your corporate Artifactory.
Pterradyctal supports all of the terraform commands.
apply `pt apply <stack-name>`
plan `pt plan <stack-name>`
destroy `pt destroy <stack-name>`
graph `pt graph <stack-name>`
show `pt show <stack-name>`
Pterradyctal supports all state commands and they follow the same argument patter as in TF, here are some examples
state list `pt state list <stack-name>`
state show `pt state show <stack-name> -state <target>`
state rm `pt state rm <stack-name> -state <statefile>`
Run unit tests
poetry run pytest
Run unit tests with coverage report in HTML format.
poetry run pytest --cov-report=html --cov=pterradactyl --cov-fail-under=80 tests/
Basic Example here
- Module setup
- Attribute overriding
Advanced Example here
- Create infrastructure for a new AWS account
- Common tag setup
- KMS encryption
- Remote backend
- Module setup
- Attribute overriding
After running pt apply
pterradactyl will create below directory structure,
containing downloaded given Terraform version with all required plugins, and workspace containing all metadata for your stack, e.g.:
.pterradactyl
├── terraform
│ └── 0.13.1
│ ├── terraform
│ └── terraform-provider-kubectl_v1.13.1
└── workspace
└── bt-projectc0-na-useast1
├── facts.json
└── main.tf.json
- terraform - directory containing downloaded Terraform given version with downloaded plugins defined in pterra.yaml file.
- workspace - directory containing metadata information for you stack. Each stack has a separate workspace.
- facts.json - JSON file with facts generated by Pterradactyl (e.g. deploy_user, state_prefix, aws_account_alias)
- main.tf.json - metadata information file regarding providers (e.g. aws, kubernetes, helm), moduls (e.g. vpc, kms, eks)and terraform backend information.
Some of the key Terragrunt features:
- Execute Terraform commands on multiple modules at once
- Keep your Terraform configuration DRY
- Inputs set as env variables.
- Call custom actions using Before and After Hooks
- Work with multiple AWS accounts
- Lock File Handling
- AWS Auth support
- Caching folder where commands are being executed.
- Auto-retry e.g. when installing provider failed due to connection error.
More info here
Some of the key Terraspace features:
- Build-in generators
- Multiple environments
- Deploy Multiple Stacks with a single command
- Build-in secrets support for AWS Secret Manager, AWS SSM Parameter Store, Azure Key
- Configurable CLI Hooks and CLI Args.
- Allows you to create test harness.
- Terraform Cloud and Terraform Enterprise support.
More info here
Feature | Pterradactyl | Terragrunt | Terraspace | Comment |
---|---|---|---|---|
Organized Structure | ✓ | ✓ | ✓ | |
Multiple environments | ✓ | ✓ | ✓ | |
Execute Terraform commands on multiple modules at once | ✓ | ✓ | ✓ | |
Secrets support | ✓ | ✓ | ✓ | |
CLI Hooks | ✓ | ✓ | ✓ | More details |
Automated Backend Creation | ✓ | ✓ | ✓ | |
Built-in Test Framework | ✗ | ✗ | ✓ | More details |
Native Terraform HCL | ✗ | ✗ | ✓ | More details |
It's hard to compare Pterradactyl, Terragrunt and Terraspace on the same level.
Overall all those tools have some major differences. However above gives you a gist of what you can expect in each tool.
If you are thinking what is more proper for you, simply deep into the details of each tool.
Terragrut and Pterradactyl are rather thin wrappers for Terraform, whereas Terraspace is rather a huge framework.