Skip to content

Commit

Permalink
Merge branch 'master' of github.com:cloudera/cloudera-playbook
Browse files Browse the repository at this point in the history
  • Loading branch information
roczei committed Nov 21, 2019
2 parents ec960e5 + c7b66e2 commit b12d99c
Show file tree
Hide file tree
Showing 2 changed files with 20 additions and 16 deletions.
31 changes: 17 additions & 14 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,12 @@

An Ansible Playbook that installs the Cloudera stack on RHEL/CentOS

# Running the playbook
## Running the playbook

* Setup an [Ansible Control Machine](http://docs.ansible.com/ansible/intro_installation.html).

**Please do not use Ansible 2.9.0**. This version has an [issue with templating](https://github.com/ansible/ansible/issues/64745) which causes the playbook execution to fail. Instead, use any 2.8.x version or a later 2.9.x version as these are not affected.

* Setup an [Ansible Control Machine](http://docs.ansible.com/ansible/intro_installation.html)
* Create Ansible configuration (optional):

```ini
Expand Down Expand Up @@ -38,8 +41,8 @@ scm_server
db_server
krb5_server

[gateway_servers]
host4.example.com host_template=HostTemplate-Gateway role_ref_names=HDFS-HTTPFS-1
[edge_servers]
host4.example.com host_template=HostTemplate-Edge role_ref_names=HDFS-HTTPFS-1

[master_servers]
host5.example.com host_template=HostTemplate-Master1
Expand All @@ -56,7 +59,7 @@ host_template=HostTemplate-Workers

[cdh_servers:children]
utility_servers
gateway_servers
edge_servers
master_servers
worker_servers
```
Expand All @@ -83,14 +86,14 @@ ansible_user=ec2-user

AWS users can use Ansible’s ``--private-key`` option to authenticate using a PEM file instead of SSH keys.

# Enabling Kerberos
## Enabling Kerberos

The playbook can install a local MIT KDC and configure Hadoop Security. To enable Hadoop Security:

* Specify the '[krb5_server]' host in the inventory (see above)
* Set 'krb5_kdc_type' to 'MIT KDC' in ``group_vars/krb5_server.yml``

# Overriding CDH service/role configuration
## Overriding CDH service/role configuration

The playbook uses [Cloudera Manager Templates](https://www.cloudera.com/documentation/enterprise/latest/topics/install_cluster_template.html) to provision a cluster.
As part of the template import process Cloudera Manager applies [Autoconfiguration](https://www.cloudera.com/documentation/enterprise/latest/topics/cm_mc_autoconfig.html)
Expand All @@ -116,7 +119,7 @@ For example ``roles/cdh/templates/hdfs.j2``:
}
```

# Dynamic Inventory Script for Cloudera Manager
## Dynamic Inventory Script for Cloudera Manager

To make integration easier, Gabor Roczei created a dynamic inventory [script](https://github.com/cloudera/cloudera-playbook/blob/master/dynamic_inventory_cm_py2) that allows Ansible to gather data from Cloudera Manager. Its main advantages are:

Expand All @@ -130,7 +133,7 @@ To make integration easier, Gabor Roczei created a dynamic inventory [script](ht
High level architecture of Ansible dynamic inventory vs. Cloudera Managers
</p>

## Configuration
### Configuration

**Step 1**: Configuration of the related Cloudera Manager(s)

Expand Down Expand Up @@ -282,7 +285,7 @@ Further information about dynamic inventory and ad-hoc commands can be found in
* [Developing Dynamic Inventory](http://docs.ansible.com/ansible/latest/dev_guide/developing_inventory.html)
* [Documentation of Ansible Ad-Hoc commands](http://docs.ansible.com/ansible/latest/intro_adhoc.html)

## SSSD setup with Ansible (applicable for RHEL 7 / CentOS 7)
### SSSD setup with Ansible (applicable for RHEL 7 / CentOS 7)

**Step 1**: Edit the default variables in group_vars/all:

Expand Down Expand Up @@ -349,25 +352,25 @@ Remove the Balaton hosts from the realm with this command (See the Ansible [Best
$ ansible-playbook --limit Balaton -u root realm_leave.yaml
```

# How do I contribute code?
## How do I contribute code?
You need to first sign and return an
[ICLA](https://github.com/cloudera/cloudera-playbook/blob/master/icla/Cloudera_ICLA_25APR2018.pdf)
and
[CCLA](https://github.com/cloudera/cloudera-playbook/blob/master/icla/Cloudera_CCLA_25APR2018.pdf)
before we can accept and redistribute your contribution. Once these are submitted you are
free to start contributing to cloudera-playbook. Submit these to [email protected].

# Main steps
### Main steps
* Fork the repo and create a topic branch
* Push commits to your repo
* Create a pull request!

## Find
### Find
We use Github issues to track bugs for this project. Find an issue that you would like to
work on (or file one if you have discovered a new issue!). If no-one is working on it,
assign it to yourself only if you intend to work on it shortly.

## Fix
### Fix

Please write a good, clear commit message, with a short, descriptive title and
a message that is exactly long enough to explain what the problem was, and how it was
Expand Down
5 changes: 3 additions & 2 deletions group_vars/all
Original file line number Diff line number Diff line change
Expand Up @@ -38,11 +38,12 @@ ad_site: Default-First-Site-Name
## ------------------------------------------------------------------------------------------------------------

# Version of CDH to install
cluster_version_cdh: 6.3.0
cluster_version_cdh: 6.3.2
#cluster_version_cdh: 7.x

# Version of Cloudera Manager to install
cluster_version_cm: "{{ cluster_version_cdh }}"
cluster_version_cm: 6.3.1
#cluster_version_cm: "{{ cluster_version_cdh }}"
#cluster_version_cm: 7.x.0

# Version of CDS Powered by Apache Spark (note: not installed if CDH6/7 is also selected)
Expand Down

0 comments on commit b12d99c

Please sign in to comment.