Introduction to CI/CD

STEPS FOR CI/CD PIPELINE USING JENKINS

1) jenkins set up

Run jekins setup script

1.1) get password for login

cat /var/lib/jenkins/secrets/initialAdminPassword

1.2) Create a user

2) RUN FIRST JOB

Click new item > Name: Hello world > select freestyle project > Build Steps > Select Execute on shell > echo "Hello World!" && uptime > Save.

2.1) RUN YOUR FIRST JOB

Click on Build now > Check build history > See output.

2.2) SSH into the Machine to check the jobs directory all jobs are listed in the dirctory.

cat /var/lib/jenkins/workspace/

3) Integrate Git with Jenkins

3.1) Rename hostname to jenkins-server

echo "jenkins-server" > /etc/hostname

3.2) Install git

yum install git -y & git -v

3.3) Install github plugin on jenkins GUI

Click Dashboard > manage jenkins > manage pulgins > Avaliable > Search for github > check and click on install without restart.

3.4) configure git

Click Dashboard > manage jenkins > click tools > go for git > name git > Path to Git executable: /usr/bin/git (Exceute cmd whereis git to get path)> save

4) Run Jenkins Job to Pull Code from GitHub

Click Dashboard > new item > Name: PUllcodefromgitRepo > source code management > select git > Enter git url name > credential none > click save.

4.1) RUN THE JOB & check the pulled repositoy.

Click on build now > check the build history successfull.

cd /var/lib/jenkins/workspace/PullcodefromGitRepo

5) Integrate Maven with Jenkins

5.1) INSTALL MAVEN

Search maven install & maven download > copy link from the maven download Binary tar.gz archive.

Go to terminal

cd /opt

download the maven

wget https://dlcdn.apache.org/maven/maven-3/3.9.1/binaries/apache-maven-3.9.1-bin.tar.gz

unzip downloaded file

tar xzvf apache-maven-3.9.1-bin.tar.gz

Rename dir to maven

mv apache-maven-3.9.1 maven

check the version of maven

/opt/maven/bin/mvn -v

JAVA HOME PATH TO SET IT AS ENVIRONMENT VARIABLE

M2_HOME=/opt/maven
M2=/opt/maven/bin
JAVA_HOME=/usr/lib/jvm/java-11-openjdk-11.0.18.0.10-3.el9.x86_64

TO find java home path

find / -name java-11*  

OUTPUT= /usr/lib/jvm/java-11-openjdk-11.0.18.0.10-3.el9.x86_64

Export the variable to .bash_profile (check before executing file there should not be any path entry)

echo -e "M2_HOME=/opt/maven\nM2=/opt/maven/bin\nJAVA_HOME=/usr/lib/jvm/java-11-openjdk-11.0.18.0.10-3.el9.x86_64\nPATH=b\$PATH:b\$HOME:bin:b\$JAVA_HOME:b\$M2_HOME:b\$M2\nexport PATH" >> .bash_profile && source .bash_profile

validate path

echo $PATH

check maven version

mvn -v

5.2) ADD MAVEN PLUGIN

Click Dashboard > manage jenkins> plugins > Available > search maven > check maven integration > install withour restart

5.3) CONFIGURE MAVEN

Click Dashboard > manage jenkins> TOOLS >

1. jdk > Name: Java-11 > JAVA_HOME: /usr/lib/jvm/java-11-openjdk-11.0.18.0.10-3.el9.x86_64 > MAVEN ADD > Name: Maven-3.9.1 MAVEN_HOME: /opt/maven > apply & save.

6) Build a Java Project Using Jenkins

need to create Build job to build the source code pulled form the git repo.

1. Click Dashboard > new item > Name:Build_Maven_Artifact > select maven project > Source_code_management:check Git,
2. repo url:https://github.com/Pruthvi360/ci-cd-hello-world.git
3. Build > Root POM: pom.xml> Goals and options: clean install (Check maven lifecycle)
4. Apply & save

6.1) Run the job & Click build history output

6.2) Click Build_Maven_Artifact JOB and navigate workspace > webapp > target > webapp.war

7) Set Up a Tomcat Server

7.1) Refer to tomcatinstall.md

follow the steps in the tomcatinstall.md to complete the installation. Run the tomcat-setup.sh

8) Intergrate with Tomcat

8.1) Install plugin Deploy-to-container

Click Dashboard > manage jenkins > plugins > available > Search: Deploy to continer > check and click install withour restart.

8.2) Configure Tomacat credentials

1. Click Dashboard > manage jenkins > manage credentials > system > global > select usernam & password > specify username & password >
2. name: tomacat-deployer > description:tomcat-deployer.

8.3) Create new job

1. Click Dashboard > new item > Name:Deploy-to-container > Source_code_management: check git and git url > Build > Root POM: pom.xml > Goals and options: clean install
2. Post build action > select deploy to continer > specify war file path webapp/target/webapp.war or **/*.war
3. Containers > Select Tomatcat 9 > Give credentials select from previously created > Tomcat URL: http://35.231.215.116:8080/ > click Apply and save

8.4) Build Now

8.5) Check the webapp directory in tomcat server

9) Automate Deploy When any changes in the git repo for every 1 minute

Modify the existing job and Select

git clone https://github.com/Pruthvi360/ci-cd-hello-world.git

Edit index.jsp

git status                           > It should be **modified** state
git add .                            > In the current directory state should be **staging**
git commit -m "Auto Tigger to CI/CD" > In the state **commited** ready to push
git remote -v                        > used to show the remotes mapped to git remote repository
git branch                           > Check the branch
git push origin master               > push the commited changes to the repository

9.1) build will trigger automatically after a change within a minute

Watch the Build history in jenkins and validate the changes in the tomcat server.

10) Setup Docker

10.1) Read into Docker installation Setup

Refer the Docker-install.md file

11) Docker file

11.1) Write a docker file

FROM tomcat:latest
RUN cp -R  /usr/local/tomcat/webapps.dist/*  /usr/local/tomcat/webapps
COPY ./*.war /usr/local/tomcat/webapps

11.2) Docker build

docker build -t mytomcat .

11.3) Docker run

docker run -d --name tomcat -p 8082:8080 mytomcat

12) Integrate Docker with Jenkins

12.1) Create Dockeradmin in Docker server

useradd dockeradmin
passwd
usermod -aG docker dockeradmin

12.2) Change ssh_config file in docker server

nano /etc/ssh/sshd_config

passwordAuthentication yes

12.3) Install Publish over SSH plugin in jenkins

Click Dashboard > manage jenkins > plugins > available > Search Publish over SSH > install without restart

12.4) Configure jenkins system setting

Click Dashboard > manage jenkins > click system > scroll down > publish over ssh > add > enter ip (public/private) > dockeradmin: password apply and save

12.5) set up the docker host

passwd root

echo -e "FROM tomcat:latest
RUN cp -R  /usr/local/tomcat/webapps.dist/*  /usr/local/tomcat/webapps
COPY ./*.war /usr/local/tomcat/webapps" > Dockerfile

docker build -t app:v1 .
docker run -d --name myfirstapp -p 8087:8080 app:v1

12.4) Configure jenkins system setting

Click Dashboard > manage jenkins > click system > scroll down > publish over ssh > add > enter hostname (public/private) > username: root: password apply and save

12.5) open ports in VPC firewall in gcp

gcloud compute --project=qwiklabs-gcp-00-88cd768cca2a firewall-rules create docker-ports --direction=INGRESS --priority=999 --network=default --action=ALLOW --rules=tcp:8080,tcp:8087 --source-ranges=0.0.0.0

13) Deploy container

1. Click Dashboard > New Item > Name: Build_and_deploy_container > Description: Build code with help of maven and deploy it on tomcat docker container.
2. Source code manangement > Check Git > git url: > Check it is master > Build Triggers: Poll SCM : * * * * * >
3. Build > Root POM: pom.xml > Goal and Options: clean install
4. Post Build Action: Name: root > Transfers: webapp/target/*.war > Remove prefix: webapp/target > Remote Directory: //opt//docker
5. Exec command : echo -e "FROM tomcat:latest RUN cp -R /usr/local/tomcat/webapps.dist/* /usr/local/tomcat/webapps COPY ./*.war /usr/local/tomcat/webapps" > Dockerfile

docker build -t app:v2 . docker run -d --name myfirstapp -p 8087:8080 app:v2

13.1) Delete unused container and images

docker container prune 
docker images prune -a 

13.2) Fix docker issues in automation

Edit Exec commads in the Post Build Actions:
echo -e "FROM tomcat:latest
RUN cp -R  /usr/local/tomcat/webapps.dist/*  /usr/local/tomcat/webapps
COPY ./*.war /usr/local/tomcat/webapps" > Dockerfile

CONTAINER=myfirstapp
docker build -t app:v1 .
docker stop $CONTAINER
docker rm $CONTAINER
docker run -d --name $CONTAINER -p 8087:8080 app:v1

14) Ansible Installation

15) Manange Dockerhost with ansible

15.1) Use the ansible.tf to create the ansible contol host

Refer to ansible/ansible.tf file

15.2) Post creation of the Ansible Control host

ansible --version
python3 --version

ansible -m ping localhost

tree /etc/ansible/

cat /etc/ansible/hosts

15.3) Setup ansible user in docker server

useradd ansibleadmin
passwd ansibleadmin
sed -i '/%wheel/a ansibleadmin       ALL=(ALL)     NOPASSWD: ALL' /etc/sudoers
sed -i 's/PasswordAuthentication no/PasswordAuthentication yes/g' /etc/ssh/sshd_config
sed -i 's/PermitRootLogin no/PermitRootLogin yes/g' /etc/ssh/sshd_config
sed -i 's/PubkeyAuthentication no/PubkeyAuthentication yes/g' /etc/ssh/sshd_config

15.4) Generate SSH-KEY IN THE ANSIBLE SERVER

su - root
ssh-keygen
ssh-copy-id <docker-host-ip private or public ip if both are in same VPC>

15.5) Edit Ansible hosts file

echo -e "docker-host-ip" > /etc/ansible/hosts
ansible all -m ping
ansible all -m command -a uptime

deveops-course