notes.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Draft WIKI \n",
    "==================================================="
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the official repository, you find an [exemple of full deployment of the OpenAirInterface System](https://github.com/OPENAIRINTERFACE/openair-cn/wiki/Full-Deployment-of-OAI-system). Here you are going to find another one.\n",
    "\n",
    "All the following text is based on the openAirInterface official documentation available in\n",
    "* [openair-cn](https://github.com/OPENAIRINTERFACE/openair-cn/wiki/)\n",
    "* [openair-cn-cups](https://github.com/OPENAIRINTERFACE/openair-cn-cups/wiki/)\n",
    "* [openairinterface5g](https://gitlab.eurecom.fr/oai/openairinterface5g/wikis/)\n",
    "\n",
    "# Table Of Content\n",
    "\n",
    "<small><i><a href='http://ecotrust-canada.github.io/markdown-toc/'>Table of contents generated with markdown-toc</a></i></small>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the official repository, you find an [exemple of full deployment of the OpenAirInterface System](https://github.com/OPENAIRINTERFACE/openair-cn/wiki/Full-Deployment-of-OAI-system). Here you are going to find another one.\n",
    "\n",
    "All the following text is based on the openAirInterface official documentation available in\n",
    "* [openair-cn](https://github.com/OPENAIRINTERFACE/openair-cn/wiki/)\n",
    "* [openair-cn-cups](https://github.com/OPENAIRINTERFACE/openair-cn-cups/wiki/)\n",
    "* [openairinterface5g](https://gitlab.eurecom.fr/oai/openairinterface5g/wikis/)\n",
    "\n",
    "# LTE Test Environment\n",
    "\n",
    "<a name=\"fig-experimental-env\"></a>![Experimental-environment](https://media.githubusercontent.com/media/navarrothiago/masters/master/imgs/experimental-environment.png)\n",
    "\n",
    "## Hardware\n",
    "\n",
    "For more information about hardware requirements for eNBs and UE, see [here](https://gitlab.eurecom.fr/oai/openairinterface5g/wikis/OpenAirSystemRequirements#hardware-requirements-readme).\n",
    "For more information about hardware requirements for EPC, see (**I have not found it!!**).\n",
    "\n",
    "**Host1**\n",
    "* CPU: Intel(R) Core(TM) i5-10210U CPU\n",
    "* Memory: 8GB\n",
    "* Network Device-1: Intel Wireless-AC 9462  \n",
    "* Network Device-2: ICS Advent DM9601 Fast Ethernet Adapter\n",
    "* USB: v3.0 Host Controller\n",
    "* VM1 - EPC: CPU: 2 core\n",
    "* VM1 - EPC: Memory: 2GB\n",
    "* VM1 - EPC: Virtual Network Device-1\n",
    "* VM1 - EPC: Virtual Network Device-2\n",
    "\n",
    "**Host2**\n",
    "* CPU: Intel(R) Core(TM) i7-2637M CPU **(NOT RECOMEND BY OAI)**\n",
    "* Memory: 4GB\n",
    "* Network Device-1: Intel Wireless Centrino Advanced-N 6230\n",
    "* USB: v3.0 Host Controller\n",
    "\n",
    "##  Other Devices\n",
    "\n",
    "* USRP B210\n",
    "* Wireless AP Router\n",
    "* UE COTS - Motorola MotoG7\n",
    "\n",
    "## Software\n",
    "\n",
    "For more informataion about operating system, see [here](https://gitlab.eurecom.fr/oai/openairinterface5g/wikis/OpenAirKernelMainSetup#recommended-operating-system-versions) for eNB and [here](https://github.com/OPENAIRINTERFACE/openair-cn/wiki/OpenAirSoftwareSupport) for the core network.\n",
    "\n",
    "<a name=\"hwHost1\"></a> **Host1** \n",
    "* OS: Manjaro v18.0\n",
    "* Kernel: 5.4.30-1\n",
    "* VM1 - EPC: QEMU/KVM \n",
    "* VM1 - EPC: OS: Ubuntu Server v18.04\n",
    "* VM1 - EPC: Repo: openair-cn: v2020.w13\n",
    "* VM1 - EPC: Repo: openair-cn-cups: v1.0.0\n",
    "\n",
    "<a name=\"hwHost2\"></a>**Host2**\n",
    "* OS: Xubuntu v18.04\n",
    "* Kernel: 5.3.0-45-lowlatency\n",
    "* Repo: openairinterface5g: v1.2.1\n",
    "\n",
    "\n",
    "## Host1 - Create Virtual Machine on Manjaro \n",
    "\n",
    "1. [Install KVM/QEMU on Manjaro](https://www.fosslinux.com/2484/how-to-install-virtual-machine-manager-kvm-in-manjaro-and-arch-linux.htm)\n",
    "1. [Download Ubuntu Server v18.04](http://releases.ubuntu.com/18.04.4/ubuntu-18.04.4-live-server-amd64.iso)\n",
    "\n",
    "Now, it is possible to create the virtual machine using KVM. You can use a GUI like Virtual Machine Manager or CLI with QEMU API, for instance. See [here](https://help.ubuntu.com/community/KVM/VirtManager) how to create a virtual machine with ubuntu operating system. Guest hardware information (e.g. number of core, memory) see [here](#hwHost1).\n",
    "\n",
    "Check if the there is a connection configuratation as described below.\n",
    "![vmm-connection](https://github.com/navarrothiago/masters/blob/master/imgs/vmm-connection-details.png)\n",
    "\n",
    "Besides, check if the you there is an adicional NIC and configured correctly, as described below.\n",
    "![nic1](https://github.com/navarrothiago/masters/blob/master/imgs/vmm-nic1.png)\n",
    "![nic2](https://github.com/navarrothiago/masters/blob/master/imgs/vmm-nic2.png)\n",
    "\n",
    "## Host1 - Install Packages\n",
    "\n",
    "```\n",
    "sudo pacman -S tmux wine\n",
    "```\n",
    "\n",
    "The wine is used with Text Analysis Tool. This tool is very useful to log analysis. It is possible to create filters with colours and enabled them easily. For more information, see the [official website](https://textanalysistool.github.io/). \n",
    "\n",
    "## Host2 - Install Kernel Low-Latency\n",
    "\n",
    "```\n",
    "sudo apt install linux-image-lowlatency linux-headers-lowlatency\n",
    "```\n",
    "For more information, see [here](https://gitlab.eurecom.fr/oai/openairinterface5g/wikis/OpenAirKernelMainSetup#ubuntu-1604-ltslinux-kernel-version-48-or-higher)\n",
    "\n",
    "### Host2 - Power Management\n",
    "\n",
    "```\n",
    "sudo vim /etc/default/grub\n",
    "```\n",
    "\n",
    "```\n",
    "GRUB_CMDLINE_LINUX_DEFAULT=\"quiet intel_pstate=disable processor.max_cstate=1 intel_idle.max_cstate=0 idle=poll\"\n",
    "```\n",
    "\n",
    "For more information, see [here](https://gitlab.eurecom.fr/oai/openairinterface5g/wikis/OpenAirKernelMainSetup#power-management)\n",
    "\n",
    "### Host2 - Disable  CPU Frenquency scaling\n",
    "\n",
    "For more information, see [here](https://gitlab.eurecom.fr/oai/openairinterface5g/wikis/OpenAirKernelMainSetup#disable-cpu-frequency-scaling)\n",
    "\n",
    "## VM1 - Install Packages  \n",
    "\n",
    "In guest, open terminal.\n",
    "\n",
    "```\n",
    "sudo apt update\n",
    "sudo apt upgrade -y\n",
    "sudo apt install openssh-server git curl vim tmux\n",
    "```\n",
    "\n",
    "\n",
    "## VM1 - Network Setup\n",
    "\n",
    "### Netplan configuration\n",
    "\n",
    "Before configure the network, check your interfaces available\n",
    "\n",
    "```\n",
    "ip link\n",
    "```\n",
    "\n",
    "The output is something like this\n",
    "```\n",
    "2: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000\n",
    "    link/ether 52:54:00:ec:8d:3d brd ff:ff:ff:ff:ff:ff\n",
    "    inet 192.168.15.14/24 brd 192.168.15.255 scope global enp1s0\n",
    "       valid_lft forever preferred_lft forever\n",
    "    inet6 2804:7f1:2080:4d2b:5054:ff:feec:8d3d/64 scope global dynamic mngtmpaddr noprefixroute \n",
    "       valid_lft 86381sec preferred_lft 43181sec\n",
    "    inet6 fe80::5054:ff:feec:8d3d/64 scope link \n",
    "       valid_lft forever preferred_lft forever\n",
    "3: enp6s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000\n",
    "    link/ether 52:54:00:22:65:9a brd ff:ff:ff:ff:ff:ff\n",
    "    inet 10.50.11.227/24 brd 10.50.11.255 scope global dynamic enp6s0\n",
    "       valid_lft 2163sec preferred_lft 2163sec\n",
    "    inet6 fe80::5054:ff:fe22:659a/64 scope link \n",
    "       valid_lft forever preferred_lft forever\n",
    "\n",
    "```\n",
    "Open _/etc/netplan/50-cloud-init.yaml_ in _VM1 - EPC_ and check with this configuration\n",
    "\n",
    "```\n",
    "network:\n",
    "    ethernets:\n",
    "        enp6s0:\n",
    "            addresses: [192.168.15.14/24]\n",
    "            gateway4: 192.168.15.1\n",
    "            dhcp4: false\n",
    "            nameservers:\n",
    "                addresses: [8.8.8.8,8.8.4.4]\n",
    "        enp1s0:\n",
    "             addresses: [10.50.11.133/24]\n",
    "             gateway4: 10.50.11.1\n",
    "             dhcp4: false\n",
    "             nameservers:\n",
    "                addresses: [8.8.8.8,8.8.4.4]\n",
    "    version: 2\n",
    "\n",
    "```\n",
    "\n",
    "\n",
    "\n",
    "## VM1 - Host2 - Enable SSH\n",
    "\n",
    "Generate ssh keys\n",
    "```\n",
    "ssh-keygen -t dsa\n",
    "```\n",
    "Enable password authentication\n",
    "\n",
    "In /etc/ssh/sshd_config set\n",
    "```\n",
    "PasswordAuthentication yes \n",
    "```\n",
    "\n",
    "# VM1 - Install HSS\n",
    "\n",
    "Then you can also copy your ssh public key in the VM...\n",
    "\n",
    "## VM1 - Clone EPC Repository\n",
    "\n",
    "\n",
    "```\n",
    "cd ~\n",
    "git clone https://github.com/OPENAIRINTERFACE/openair-cn.git\n",
    "git clone https://github.com/OPENAIRINTERFACE/openair-cn-cups.git\n",
    "...\n",
    "```\n",
    "\n",
    "## VM1 - Checkout Realeases\n",
    "\n",
    "```\n",
    "cd ~/openair-cn\n",
    "# HotFix in 2020.w13\n",
    "git checkout 2020.w13 \n",
    "\n",
    "cd ~/openair-cn-cups\n",
    "git checkout v1.0.0\n",
    "\n",
    "```\n",
    "\n",
    "## VM1 -  Add Key\n",
    "\n",
    "You must trust the key below in order to have success.\n",
    "\n",
    "```\n",
    "sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys A278B781FE4B2BDA\n",
    "```\n",
    "\n",
    "## VM1 -  Build Cassandra\n",
    "\n",
    "**Fix cassandra repository (bug fix - 2020.w13)**\n",
    "```\n",
    "cd ~/openair-cn/scripts/\n",
    "sed -i 's+https://www.apache.org/dist/cassandra/KEYS+https://downloads.apache.org/cassandra/KEYS+g' ~/openair-cn/build/tools/build_helper.cassandra \n",
    "```\n",
    "\n",
    "**BGN - This part of the wiki is not working due to the java's and cassandra url.**\n",
    "\n",
    "```\n",
    "cd ~/openair-cn/scripts/; \\\n",
    "./build_cassandra --check-installed-software --force\n",
    "...\n",
    "Processing triggers for libgdk-pixbuf2.0-0:amd64 (2.36.11-2) ...\n",
    "Cassandra installation successful\n",
    "'/home/ubuntu/openair-cn/etc/cassandra.conf' -> '/usr/local/etc/oai/cassandra.conf'\n",
    "Cassandra has been installed successfully.\n",
    "ubuntu@test-install-openair-cn:~/openair-cn/scripts$ \n",
    "```\n",
    "\n",
    "~~Set the JRE version 8 as default~~\n",
    "```\n",
    "sudo service cassandra stop\n",
    "sudo update-alternatives --config java\n",
    "# select jre version 8\n",
    "... \n",
    "sudo service cassandra start\n",
    "```\n",
    "The message below is shown during the execution of https://github.com/OPENAIRINTERFACE/openair-cn/wiki/OpenAirSoftwareSupport#install-hss, it seems to be missing oracle-java8-installer and there is no valid OpenPGP data and a invalid url (http://www.apache.org/dist/cassandra/debian) was provided.\n",
    "\n",
    "```\n",
    "Package oracle-java8-installer is not available, but is referred to by another package.\n",
    "This may mean that the package is missing, has been obsoleted, or\n",
    "is only available from another source\n",
    "\n",
    "E: Package 'oracle-java8-installer' has no installation candidate\n",
    "deb http://www.apache.org/dist/cassandra/debian 21x main\n",
    "  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current\n",
    "                                 Dload  Upload   Total   Spent    Left  Speed\n",
    "100   227  100   227    0     0    378      0 --:--:-- --:--:-- --:--:--   377\n",
    "gpg: no valid OpenPGP data found.\n",
    "```\n",
    "\n",
    "**END - This part of the wiki is not working due to the java's and cassandra url.**\n",
    "\n",
    "Verify that Cassandra is installed and running with\n",
    "```\n",
    "nodetool status\n",
    "```\n",
    "The output\n",
    "```\n",
    "Datacenter: datacenter1\n",
    "=======================\n",
    "Status=Up/Down\n",
    "|/ State=Normal/Leaving/Joining/Moving\n",
    "--  Address    Load       Tokens  Owns (effective)  Host ID                               Rack\n",
    "UN  127.0.0.1  87.6 KB   256     100.0%            8103ad97-42a5-4f52-8de9-33945a2f9110  rack1\n",
    "\n",
    "```\n",
    "\n",
    "**TODO: put in Troubleshoot**\n",
    "\n",
    "## VM1 -  Configure Cassandra\n",
    "Stop Cassandra and cleanup the log files before modifying the configuration\n",
    "\n",
    "```\n",
    "sudo service cassandra stop\n",
    "sudo rm -rf /var/lib/cassandra/data/system/*\n",
    "sudo rm -rf /var/lib/cassandra/commitlog/*\n",
    "sudo rm -rf /var/lib/cassandra/data/system_traces/*\n",
    "sudo rm -rf /var/lib/cassandra/saved_caches/*\n",
    "```\n",
    "\n",
    "Update the Cassandra configuration **if needed** (default configuration set **1 cassandra node listening on localhost**)\n",
    "Update **/etc/cassandra/cassandra.yaml** as indicated below. The <Cassandra_Server_IP> address should be the IP\n",
    "address of the Cassandra server that the HSS will use to connect to Cassandra. The \"...\" below indicate configuration lines between values that need to be modified.\n",
    "```\n",
    "...\n",
    "cluster_name: \"HSS Cluster\"\n",
    "...\n",
    "# OAI Note: no to change Cassandra_Server_IP that is already 127.0.0.1\n",
    "seed_provider:\n",
    "- class_name: org.apache.cassandra.locator.SimpleSeedProvider\n",
    "- seeds: \"<Cassandra_Server_IP>\"\n",
    "...\n",
    "listen_address: <Cassandra_Server_IP>\n",
    "...\n",
    "rpc_address: <Cassandra_Server_IP>\n",
    "...\n",
    "# OAI Note: seems to be this option that is working ()\n",
    "# endpoint_snitch: SimpleSnitch\n",
    "endpoint_snitch: GossipingPropertyFileSnitch\n",
    "```\n",
    "**Start Cassandra service**\n",
    "\n",
    "```\n",
    "sudo service cassandra start\n",
    "```\n",
    "**Check cassandra service status**\n",
    "```\n",
    "sudo systemctl status cassandra\n",
    "```\n",
    "\n",
    "```\n",
    "● cassandra.service - LSB: distributed storage system for structured data\n",
    "   Loaded: loaded (/etc/init.d/cassandra; generated)\n",
    "   Active: active (running) since Thu 2019-05-23 10:26:51 UTC; 1h 54min ago\n",
    "     Docs: man:systemd-sysv-generator(8)\n",
    "    Tasks: 61 (limit: 4704)\n",
    "   CGroup: /system.slice/cassandra.service\n",
    "           └─23863 java -ea -javaagent:/usr/share/cassandra/lib/jamm-0.3.0.jar -XX:+CMSClassUnloadingEnabled -XX:+UseThreadPri\n",
    "\n",
    "May 23 10:26:51 test-install-openair-cn systemd[1]: Starting LSB: distributed storage system for structured data...\n",
    "May 23 10:26:51 test-install-openair-cn systemd[1]: Started LSB: distributed storage system for structured data.\n",
    "```\n",
    "\n",
    "## VM1 - Install HSS Software Dependancies\n",
    "\n",
    "```\n",
    "cd ~/openair-cn/scripts; \\\n",
    "./build_hss_rel14 --check-installed-software --force\n",
    "...\n",
    "# OAI Note: Takes some time...\n",
    "```\n",
    "Output is:\n",
    "```\n",
    "...\n",
    "-- Installing: /usr/local/lib/cmake/pistache/PistacheConfig.cmake\n",
    "~/openair-cn/scripts\n",
    "HSS software installation successful\n",
    "HSS not compiled, to compile it, re-run build_hss without -i option \n",
    "```\n",
    "\n",
    "## VM1 - Build HSS\n",
    "\n",
    "```\n",
    "cd ~/openair-cn/scripts; \\\n",
    "./build_hss_rel14 --clean\n",
    "```\n",
    "\n",
    "Output is:\n",
    "\n",
    "```\n",
    "mkdir: created directory '/home/ubuntu/openair-cn/scripts/../build/hss_rel14/build'\n",
    "~/openair-cn/build/hss_rel14/util ~/openair-cn/scripts\n",
    "...\n",
    " g++  -g -pthread -std=c++11  -I ../../src/hss_rel14/include -I ../../src/hss_rel14/util/include -I ../../build/hss_rel14/../git_submodules/rapidjson/include -I /usr/local/include/freeDiameter -I ../../src/hss_rel14/hsssec/include -I /usr/local/include -MMD -c -o ../../build/hss_rel14/build/s6t_impl.o ../../src/hss_rel14/src/s6t_impl.cpp\n",
    " Linking...\n",
    " g++  -g -pthread -lpthread -Wl,-rpath,/usr/local/lib/x86_64-linux-gnu:/usr/local/lib ../../build/hss_rel14/build/s6t.o ../../build/hss_rel14/build/s6as6d_impl.o ../../build/hss_rel14/build/dataaccess.o ../../build/hss_rel14/build/s6as6d.o ../../build/hss_rel14/build/options.o ../../build/hss_rel14/build/s6c_impl.o ../../build/hss_rel14/build/fdhss.o ../../build/hss_rel14/build/s6c.o ../../build/hss_rel14/build/main.o ../../build/hss_rel14/build/util.o ../../build/hss_rel14/build/resthandler.o ../../build/hss_rel14/build/s6t_impl.o -o ../../build/hss_rel14/bin/hss ../../build/hss_rel14/util/lib/libc3po.a ../../build/hss_rel14/hsssec/lib/libhsssec.a /usr/local/lib/libpistache.a /usr/local/lib/libfdcore.so /usr/local/lib/libfdproto.so -L/usr/local/lib/x86_64-linux-gnu -lcassandra -lrt -lnettle -lgmp \n",
    "'/home/ubuntu/openair-cn/build/hss_rel14/bin/hss' -> '/usr/local/bin/oai_hss'\n",
    "oai_hss installed\n",
    "\n",
    "```\n",
    "\n",
    "## VM1 - Create HSS configuration files\n",
    "See again the test environment configuration [here](#fig-experimental-env)\n",
    "\n",
    "```\n",
    "cd ~/openair-cn/scripts\n",
    "\n",
    "MY_REALM='openairinterface.org'\n",
    "# prompt has been removed for easier Ctrl+C Ctrl+V\n",
    "# cd $OPENAIRCN_DIR/scripts\n",
    "\n",
    "openssl rand -out $HOME/.rnd 128\n",
    "\n",
    "PREFIX='/usr/local/etc/oai'\n",
    "sudo mkdir -p $PREFIX\n",
    "sudo chmod 777 $PREFIX\n",
    "sudo mkdir  $PREFIX/freeDiameter\n",
    "sudo chmod 777 $PREFIX/freeDiameter\n",
    "\n",
    "# freeDiameter configuration files\n",
    "sudo cp ../etc/acl.conf ../etc/hss_rel14_fd.conf $PREFIX/freeDiameter\n",
    "sudo chmod 666 $PREFIX/freeDiameter/acl.conf $PREFIX/freeDiameter/hss_rel14_fd.conf\n",
    "\n",
    "# HSS configuration files\n",
    "sudo cp ../etc/hss_rel14.conf ../etc/hss_rel14.json $PREFIX\n",
    "sudo chmod 666 $PREFIX/hss_rel14.conf $PREFIX/hss_rel14.json\n",
    "\n",
    "declare -A HSS_CONF\n",
    "HSS_CONF[@PREFIX@]=$PREFIX\n",
    "HSS_CONF[@REALM@]=$MY_REALM\n",
    "HSS_CONF[@HSS_FQDN@]=\"hss.${HSS_CONF[@REALM@]}\"\n",
    "HSS_CONF[@cassandra_Server_IP@]='127.0.0.1' \n",
    "HSS_CONF[@cassandra_IP@]='127.0.0.1' # TODO harmonize these 2\n",
    "HSS_CONF[@OP_KEY@]='07AF65295F9419D7CB45FDDE716AAD26'\n",
    "HSS_CONF[@ROAMING_ALLOWED@]='true'\n",
    "\n",
    "for K in \"${!HSS_CONF[@]}\"; do \n",
    "  egrep -lRZ \"$K\" $PREFIX | xargs -0 -l sed -i -e \"s|$K|${HSS_CONF[$K]}|g\"\n",
    "done\n",
    "\n",
    "### freeDiameter certificate\n",
    "../src/hss_rel14/bin/make_certs.sh hss ${HSS_CONF[@REALM@]} $PREFIX\n",
    "\n",
    "# Finally customize the listen address of FD server (if necessary because FD binds by default on available interfaces)\n",
    "# set in $PREFIX/freeDiameter/hss_rel14_fd.conf and uncomment the following line\n",
    "sudo sed -i -e 's/#ListenOn/ListenOn/g' $PREFIX/freeDiameter/hss_rel14_fd.conf \n",
    "```\n",
    "You can ignore the erros for while on the execution of _make_certs.sh_\n",
    "\n",
    "```\n",
    "Can't open ./demoCA/index.txt.attr for reading, No such file or directory\n",
    "140137160171968:error:02001002:system library:fopen:No such file or directory:../crypto/bio/bss_file.c:72:fopen('./demoCA/index.txt.attr','r')\n",
    "140137160171968:error:2006D080:BIO routines:BIO_new_file:no such file:../crypto/bio/bss_file.c:79:\n",
    "```\n",
    "# VM1 - Install MME\n",
    "\n",
    "## VM1 - Install MME software dependencies\n",
    "\n",
    "```\n",
    "cd ~/openair-cn/scripts; \\\n",
    "./build_mme --check-installed-software --force\n",
    "```\n",
    "\n",
    "Output is\n",
    "```\n",
    "...\n",
    "Processing triggers for mime-support (3.60ubuntu1) ...\n",
    "Setting up unzip (6.0-21ubuntu1) ...\n",
    "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...\n",
    "sh: 0: getcwd() failed: No such file or directory\n",
    "MME software installation successful\n",
    "MME not compiled, to compile it, re-run build_mme without -i option\n",
    "```\n",
    "\n",
    "## VM1 - Build MME \n",
    "\n",
    "```\n",
    "cd ~/openair-cn/scripts; \\\n",
    "./build_mme --clean\n",
    "```\n",
    "Ouput is\n",
    "```\n",
    "Clean the build generated files (build from scratch)\n",
    "mkdir: created directory 'build'\n",
    "Build type is Debug\n",
    "Architecture is x86_64\n",
    "git found: /usr/bin/git\n",
    "NETTLE VERSION_INSTALLED  = 3.4\n",
    "NETTLE_VERSION_MAJOR = 3\n",
    "NETTLE_VERSION_MINOR = 4\n",
    "Compilation log for /home/ubuntu/openair-cn/build/mme/build/mme is here: /home/ubuntu/openair-cn/build/log/mme.txt\n",
    "mme compiled\n",
    "'/home/ubuntu/openair-cn/build/mme/build/mme' -> '/usr/local/bin/mme'\n",
    "mme installed\n",
    "```\n",
    "\n",
    "## VM1 - Create MME configuration files\n",
    "\n",
    "See again the test environment configuration [here](#fig-experimental-env)\n",
    "\n",
    "```\n",
    "PREFIX='/usr/local/etc/oai'\n",
    "IFACE_LOCAL='enp1s0'\n",
    "MY_REALM='openairinterface.org'\n",
    "IP_LOCAL='192.168.15.14/24'\n",
    "IP_S10='192.168.15.19/24'\n",
    "cd ~/openair-cn/scripts\n",
    "\n",
    "O script pode ser executado, gerando os arquivos de configuração do MME.\n",
    "sudo ifconfig $IFACE_LOCAL:m11 172.16.1.102 up\n",
    "sudo ifconfig $IFACE_LOCAL:m10 192.168.15.19 up\n",
    " \n",
    "INSTANCE=1\n",
    "cp ../etc/mme_fd.sprint.conf  $PREFIX/freeDiameter/mme_fd.conf\n",
    "cp ../etc/mme.conf  $PREFIX\n",
    "declare -A MME_CONF\n",
    " \n",
    "MME_CONF[@MME_S6A_IP_ADDR@]=\"127.0.0.11\"\n",
    "MME_CONF[@INSTANCE@]=$INSTANCE\n",
    "MME_CONF[@PREFIX@]=$PREFIX\n",
    "MME_CONF[@REALM@]=$MY_REALM\n",
    "MME_CONF[@PID_DIRECTORY@]='/var/run'\n",
    "MME_CONF[@MME_FQDN@]=\"mme.${MME_CONF[@REALM@]}\"\n",
    "MME_CONF[@HSS_HOSTNAME@]='hss'\n",
    "MME_CONF[@HSS_FQDN@]=\"${MME_CONF[@HSS_HOSTNAME@]}.${MME_CONF[@REALM@]}\"\n",
    "MME_CONF[@HSS_IP_ADDR@]=127.0.0.1\n",
    " \n",
    "MME_CONF[@MCC@]='724'\n",
    "MME_CONF[@MNC@]='99'\n",
    "MME_CONF[@MME_GID@]='32768'\n",
    "MME_CONF[@MME_CODE@]='3'\n",
    "MME_CONF[@TAC_0@]='1'\n",
    "MME_CONF[@TAC_1@]='1'\n",
    "MME_CONF[@TAC_2@]='1'\n",
    " \n",
    "MME_CONF[@MME_INTERFACE_NAME_FOR_S1_MME@]=\"$IFACE_LOCAL\"\n",
    "MME_CONF[@MME_IPV4_ADDRESS_FOR_S1_MME@]=\"$IP_LOCAL\"\n",
    "MME_CONF[@MME_INTERFACE_NAME_FOR_S11@]=\"${IFACE_LOCAL}:m11\"\n",
    "MME_CONF[@MME_IPV4_ADDRESS_FOR_S11@]='172.16.1.102/24'\n",
    "MME_CONF[@MME_INTERFACE_NAME_FOR_S10@]=\"${IFACE_LOCAL}:m10\"\n",
    "MME_CONF[@MME_IPV4_ADDRESS_FOR_S10@]=\"$IP_S10\"\n",
    "MME_CONF[@OUTPUT@]='CONSOLE'\n",
    "MME_CONF[@SGW_IPV4_ADDRESS_FOR_S11_TEST_0@]='172.16.1.104/24'\n",
    "MME_CONF[@SGW_IPV4_ADDRESS_FOR_S11_0@]='172.16.1.104/24'\n",
    "MME_CONF[@PEER_MME_IPV4_ADDRESS_FOR_S10_0@]='0.0.0.0/24'\n",
    "MME_CONF[@PEER_MME_IPV4_ADDRESS_FOR_S10_1@]='0.0.0.0/24'\n",
    "\n",
    "TAC_SGW_TEST='7'\n",
    "tmph=`echo \"$TAC_SGW_TEST / 256\" | bc`\n",
    "tmpl=`echo \"$TAC_SGW_TEST % 256\" | bc`\n",
    "MME_CONF[@TAC-LB_SGW_TEST_0@]=`printf \"%02x\\n\" $tmpl`\n",
    "MME_CONF[@TAC-HB_SGW_TEST_0@]=`printf \"%02x\\n\" $tmph`\n",
    "MME_CONF[@MCC_SGW_0@]=${MME_CONF[@MCC@]}\n",
    "MME_CONF[@MNC3_SGW_0@]=`printf \"%03d\\n\" $(echo ${MME_CONF[@MNC@]} | sed 's/^0*//')`\n",
    "TAC_SGW_0='1'\n",
    "tmph=`echo \"$TAC_SGW_0 / 256\" | bc`\n",
    "tmpl=`echo \"$TAC_SGW_0 % 256\" | bc`\n",
    "MME_CONF[@TAC-LB_SGW_0@]=`printf \"%02x\\n\" $tmpl`\n",
    "MME_CONF[@TAC-HB_SGW_0@]=`printf \"%02x\\n\" $tmph`\n",
    "MME_CONF[@MCC_MME_0@]=${MME_CONF[@MCC@]}\n",
    "MME_CONF[@MNC3_MME_0@]=`printf \"%03d\\n\" $(echo ${MME_CONF[@MNC@]} | sed 's/^0*//')`\n",
    "TAC_MME_0='1'\n",
    "tmph=`echo \"$TAC_MME_0 / 256\" | bc`\n",
    "tmpl=`echo \"$TAC_MME_0 % 256\" | bc`\n",
    "MME_CONF[@TAC-LB_MME_0@]=`printf \"%02x\\n\" $tmpl`\n",
    "MME_CONF[@TAC-HB_MME_0@]=`printf \"%02x\\n\" $tmph`\n",
    "MME_CONF[@MCC_MME_1@]=${MME_CONF[@MCC@]}\n",
    "MME_CONF[@MNC3_MME_1@]=`printf \"%03d\\n\" $(echo ${MME_CONF[@MNC@]} | sed 's/^0*//')`\n",
    "TAC_MME_1='1'\n",
    "tmph=`echo \"$TAC_MME_1 / 256\" | bc`\n",
    "tmpl=`echo \"$TAC_MME_1 % 256\" | bc`\n",
    "MME_CONF[@TAC-LB_MME_1@]=`printf \"%02x\\n\" $tmpl`\n",
    "MME_CONF[@TAC-HB_MME_1@]=`printf \"%02x\\n\" $tmph`\n",
    "for K in \"${!MME_CONF[@]}\"; do    egrep -lRZ \"$K\" $PREFIX | xargs -0 -l sed -i -e \"s|$K|${MME_CONF[$K]}|g\";   ret=$?;[[ ret -ne 0 ]] && echo \"Tried to replace $K with ${MME_CONF[$K]}\"; done\n",
    "sudo ./check_mme_s6a_certificate $PREFIX/freeDiameter mme.${MME_CONF[@REALM@]}\n",
    "```\n",
    "**Configure with the correct parameters in /usr/local/etc/oai/mme.conf**\n",
    "```\n",
    "NETWORK_INTERFACES :\n",
    "    {\n",
    "        MME_INTERFACE_NAME_FOR_S1_MME   = \"enp6s0\";    \n",
    "        MME_IPV4_ADDRESS_FOR_S1_MME     = \"192.168.15.14/24\";\n",
    "…\n",
    "    }\n",
    "```\n",
    "\n",
    "# VM1 - Install SPGW-U\n",
    "\n",
    "## VM1 - Install SPGW-U software dependencies\n",
    "\n",
    "**The fmt must be dowloaded, otherwise you will find a error during build_spgwu!**\n",
    "\n",
    "```\n",
    "cd ~\n",
    "git clone https://github.com/fmtlib/fmt.git && cd fmt\n",
    "mkdir _build && cd _build\n",
    "cmake ..\n",
    "make -j$(nproc)\n",
    "sudo make install\n",
    "```\n",
    "\n",
    "```\n",
    "cd ~/openair-cn-cups/build/scripts; \\\n",
    "./build_spgwu -I -f\n",
    "```\n",
    "\n",
    "## Build SPGW-U\n",
    "\n",
    "As a starting point, you can start with a Debug build, then you can change the build type\n",
    "Check build types with './build_spgwu -h'\n",
    "\n",
    "```\n",
    "cd ~/openair-cn-cups/build/scripts; \\\n",
    "./build_spgwu -c -V -b Debug -j\n",
    "```\n",
    "\n",
    "Output is \n",
    "\n",
    "```\n",
    "Clean the build generated files (build from scratch)\n",
    "CMake build process verbose\n",
    "Cleaning S/P-GW-U: generated configuration files, obj files, executable\n",
    "mkdir: created directory 'build'\n",
    "Build type is Debug\n",
    "Architecture is x86_64\n",
    "git found: /usr/bin/git\n",
    "Compilation log for /home/ubuntu/openair-cn-cups/build/spgw_u/build/spgwu is here: /home/ubuntu/openair-cn-cups/build/log/spgwu.txt\n",
    "Scanning dependencies of target 3GPP_COMMON_TYPES\n",
    "[  2%] Building CXX object common/CMakeFiles/3GPP_COMMON_TYPES.dir/logger.cpp.o\n",
    "...\n",
    "[ 97%] Building CXX object CMakeFiles/spgwu.dir/home/ubuntu/openair-cn-cups/src/itti/itti_msg.cpp.o\n",
    "[100%] Linking CXX executable spgwu\n",
    "[100%] Built target spgwu\n",
    "spgwu compiled\n",
    "'/home/ubuntu/openair-cn-cups/build/spgw_u/build/spgwu' -> '/usr/local/bin/spgwu'\n",
    "spgwu installed\n",
    "```\n",
    "\n",
    "## VM1 - Create SPGW-U configuration files\n",
    "\n",
    "See again the test environment configuration [here](#fig-experimental-env)\n",
    "```\n",
    "IFACE_LOCAL=enp1s0\n",
    "IFACE_NET=enp6s0\n",
    "\n",
    "IP_S1U=192.168.15.18/24\n",
    "\n",
    "cd ~/openair-cn-cups/build/scripts\n",
    "\n",
    "# prompt has been removed for easier Ctrl+C Ctrl+V\n",
    "sudo ip addr add 172.55.55.102/24 dev $IFACE_LOCAL label $IFACE_LOCAL:sxu # SPGW-U SXab interface\n",
    "sudo ip addr add $IP_S1U dev $IFACE_LOCAL label $IFACE_LOCAL:s1u # SPGW-U S1U interface\n",
    "\n",
    "INSTANCE=1\n",
    "PREFIX='/usr/local/etc/oai'\n",
    "sudo mkdir -m 0777 -p $PREFIX\n",
    "cd ~/openair-cn-cups/build/scripts\n",
    "cp ../../etc/spgw_u.conf  $PREFIX\n",
    "\n",
    "declare -A SPGWU_CONF\n",
    "\n",
    "SPGWU_CONF[@INSTANCE@]=$INSTANCE\n",
    "SPGWU_CONF[@PREFIX@]=$PREFIX\n",
    "SPGWU_CONF[@PID_DIRECTORY@]='/var/run'\n",
    "SPGWU_CONF[@SGW_INTERFACE_NAME_FOR_S1U_S12_S4_UP@]=\"$IFACE_LOCAL\"\n",
    "SPGWU_CONF[@SGW_INTERFACE_NAME_FOR_SX@]=\"$IFACE_LOCAL:sxu\"\n",
    "SPGWU_CONF[@SGW_INTERFACE_NAME_FOR_SGI@]=\"$IFACE_NET\"\n",
    "\n",
    "for K in \"${!SPGWU_CONF[@]}\"; do \n",
    "  egrep -lRZ \"$K\" $PREFIX | xargs -0 -l sed -i -e \"s|$K|${SPGWU_CONF[$K]}|g\"\n",
    "  ret=$?;[[ ret -ne 0 ]] && echo \"Tried to replace $K with ${SPGWU_CONF[$K]}\"\n",
    "done\n",
    "```\n",
    "\n",
    "**Important:**\n",
    "\n",
    "**Customize in $PREFIX/spgw_u.conf file the \"SPGW-C_LIST\" and \"PDN_NETWORK_LIST\" sections.**\n",
    "```\n",
    "SPGW-C_LIST = (\n",
    "\t {IPV4_ADDRESS=\"172.55.55.101\";}\n",
    ");\n",
    "```\n",
    "\n",
    "# VM1 - Install SPGW-C\n",
    "\n",
    "As a starting point, you can start with a Debug build, then you can change the build type\n",
    "Check build types with './build_spgwc -h'\n",
    "\n",
    "```\n",
    "cd ~/openair-cn-cups/build/scripts; \\\n",
    "./build_spgwc -c -V -b Debug -j\n",
    "```\n",
    "\n",
    "Output is \n",
    "\n",
    "```\n",
    "Clean the build generated files (build from scratch)\n",
    "CMake build process verbose\n",
    "Cleaning S/P-GW-C: generated configuration files, obj files, executable\n",
    "mkdir: created directory 'build'\n",
    "Build type is Debug\n",
    "Architecture is x86_64\n",
    "git found: /usr/bin/git\n",
    "Compilation log for /home/ubuntu/openair-cn-cups/build/spgw_c/build/spgwc is here: /home/ubuntu/openair-cn-cups/build/log/spgwc.txt\n",
    "Scanning dependencies of target 3GPP_COMMON_TYPES\n",
    "[  2%] Building CXX object common/CMakeFiles/3GPP_COMMON_TYPES.dir/logger.cpp.o\n",
    "Scanning dependencies of target PGWC\n",
    "...\n",
    "Scanning dependencies of target spgwc\n",
    "[ 92%] Building CXX object CMakeFiles/spgwc.dir/home/ubuntu/openair-cn-cups/src/oai_spgwc/options.cpp.o\n",
    "[ 92%] Building CXX object CMakeFiles/spgwc.dir/home/ubuntu/openair-cn-cups/src/oai_spgwc/main.cpp.o\n",
    "[ 95%] Building CXX object CMakeFiles/spgwc.dir/home/ubuntu/openair-cn-cups/src/itti/itti.cpp.o\n",
    "[ 97%] Building CXX object CMakeFiles/spgwc.dir/home/ubuntu/openair-cn-cups/src/itti/itti_msg.cpp.o\n",
    "[100%] Linking CXX executable spgwc\n",
    "[100%] Built target spgwc\n",
    "spgwc compiled\n",
    "'/home/ubuntu/openair-cn-cups/build/spgw_c/build/spgwc' -> '/usr/local/bin/spgwc'\n",
    "spgwc installed\n",
    "```\n",
    "\n",
    "## VM1 - Create SPGW-C configuration files\n",
    "\n",
    "See again the test environment configuration [here](#fig-experimental-env)\n",
    "\n",
    "```\n",
    "IFACE_LOCAL=enp1s0\n",
    "\n",
    "cd ~/openair-cn-cups/build/scripts\n",
    "\n",
    "# prompt has been removed for easier Ctrl+C Ctrl+V\n",
    "sudo ip addr add 172.55.55.101 dev ens3 label $IFACE_LOCAL:sxc # SPGW-C SXab interface\n",
    "sudo ip addr add 172.58.58.102 dev ens3 label $IFACE_LOCAL:s5c # SGW-C S5S8 interface\n",
    "sudo ip addr add 172.58.58.101 dev ens3 label $IFACE_LOCAL:p5c # PGW-C S5S8 interface\n",
    "sudo ip addr add 172.16.1.104 dev ens3 label $IFACE_LOCAL:s11 # SGW-C S11 interface\n",
    "\n",
    "INSTANCE=1\n",
    "PREFIX='/usr/local/etc/oai'\n",
    "sudo mkdir -m 0777 -p $PREFIX\n",
    "cp ../../etc/spgw_c.conf  $PREFIX\n",
    "\n",
    "declare -A SPGWC_CONF\n",
    "\n",
    "SPGWC_CONF[@INSTANCE@]=$INSTANCE\n",
    "SPGWC_CONF[@PREFIX@]=$PREFIX\n",
    "SPGWC_CONF[@PID_DIRECTORY@]='/var/run'\n",
    "SPGWC_CONF[@SGW_INTERFACE_NAME_FOR_S11@]=\"$IFACE_LOCAL:s11\"\n",
    "SPGWC_CONF[@SGW_INTERFACE_NAME_FOR_S5_S8_CP@]=\"$IFACE_LOCAL:s5c\"\n",
    "SPGWC_CONF[@PGW_INTERFACE_NAME_FOR_S5_S8_CP@]=\"$IFACE_LOCAL:p5c\"\n",
    "SPGWC_CONF[@PGW_INTERFACE_NAME_FOR_SX@]=\"$IFACE_LOCAL:sxc\"\n",
    "SPGWC_CONF[@DEFAULT_DNS_IPV4_ADDRESS@]='8.8.8.8'\n",
    "SPGWC_CONF[@DEFAULT_DNS_SEC_IPV4_ADDRESS@]='4.4.4.4'\n",
    "\n",
    "for K in \"${!SPGWC_CONF[@]}\"; do \n",
    "  egrep -lRZ \"$K\" $PREFIX | xargs -0 -l sed -i -e \"s|$K|${SPGWC_CONF[$K]}|g\"\n",
    "  ret=$?;[[ ret -ne 0 ]] && echo \"Tried to replace $K with ${SPGWC_CONF[$K]}\"\n",
    "done\n",
    "```\n",
    "\n",
    "**IMPORTANT:**\n",
    "\n",
    "**Customize in $PREFIX/spgw_c.conf file the \"IP_ADDRESS_POOL\" and \"APN_LIST\" sections.**\n",
    "\n",
    "```\n",
    "APN_LIST = (\n",
    "      {APN_NI = \"default.ng4T.com\"; PDN_TYPE = \"IPv4\"; IPV4_POOL  = 0; IPV6_POOL = -1},\n",
    "      {APN_NI = \"apn1\"; PDN_TYPE = \"IPv4\"; IPV4_POOL = 1; IPV6_POOL = ...\n",
    "    );\n",
    "```\n",
    "\n",
    "# Host2 - Install eNB\n",
    "\n",
    "## Host2 - Checkout Realase\n",
    "\n",
    "```\n",
    "sudo apt install git\n",
    "git clone https://gitlab.eurecom.fr/oai/openairinterface5g.git\n",
    "git checkout v1.2.1\n",
    "```\n",
    "\n",
    "## Host2 - Build eNB\n",
    "\n",
    "```\n",
    "cd openairinterface5g\n",
    "source oaienv\n",
    "cd cmake_targets\n",
    "./build_oai -I -w USRP\n",
    "\n",
    "```\n",
    "```\n",
    "./build_oai --eNB -c -w USRP\n",
    "```\n",
    "\n",
    "## Host2 - Create configuration file for eNB\n",
    "\n",
    "Go to _~/openairinterface5g/ci-scripts/conf_files/enb.band25.conf_ and set the following parameters\n",
    "```\n",
    "eutra_band 28\n",
    "downlink_frequency 763000000L\n",
    "uplink_frequency_offset -55000000\n",
    "mcc 724\n",
    "mnc 99\n",
    "mme_ip_address 192.168.15.14\n",
    "ENB_IPV4_ADDRESS_FOR_S1_MME 192.168.15.7\n",
    "ENB_IPV4_ADDRESS_FOR_S1U 192.168.15.7\n",
    "```\n",
    "After that, rename it \n",
    "```\n",
    "mv ~/openairinterface5g/ci-scripts/conf_files/enb.band25.conf ~/openairinterface5g/ci-scripts/conf_files/enb.band28.conf\n",
    "```\n",
    "\n",
    "# Execution Of OAI System\n",
    "\n",
    "The test environment was presented [here](#fig-experimental-env). The following steps will show how to run all EPC components and eNB.\n",
    "\n",
    "## Tmux scripts\n",
    "In order to run all the components that were installed and built in the previous steps, it was created two script in bash and tmux. The idea is to avoid wasting time in the process of starting up, running and copying the log to host1 for analyses. To sum up, these are the scripts features:\n",
    "\n",
    "**Script _work-session.sh_**   \n",
    "* Create a tmux session in local (Host1) machine \n",
    "    * Window0 pane0 - Start up de virtual environment\n",
    "    * Window0 pane1 - Log in remote machine (Host2) \n",
    "    * Window1 pane0 - Open jupyter notebook server\n",
    "    * Window2 pane0 - Open Text Analysis Tool window2 pane0\n",
    "\n",
    "**Script _oai-session.sh_**\n",
    "* Create a tmux session in remote machine  \n",
    "    * Window0 pane0 - Insert user and mme data an in HSS database\n",
    "    * Window0 pane0 - Create all virtual interface in VM1\n",
    "* Run EPC components in window\n",
    "     * Window0 pane0 - Run HSS \n",
    "     * Window0 pane1 - Run MME\n",
    "     * Window0 pane2 - Run SPGW-C \n",
    "     * Window0 pane3 - Run SPGW-U\n",
    "* Copy HSS, MME, SPGW-U and SPGW-C logs with timestamp when dettach tmux session\n",
    "\n",
    "The scritps are availabe in https://github.com/navarrothiago/masters/scripts.\n",
    "\n",
    "### Running Process Step-by-Step\n",
    "\n",
    "Download the scripts above, open the Host1 terminal and run \n",
    "\n",
    "```\n",
    "work-session.sh ubuntu18.04 192.168.15.14 navarro 192.168.15.7\n",
    "```\n",
    "\n",
    "where:\n",
    "* ubuntu18.04 - virtual machine name\n",
    "* 192.168.15.14 - VM1 IP \n",
    "* navarro - Host2 username\n",
    "* 192.168.15.7 - Host2 IP \n",
    "\n",
    "## Run EPC Components\n",
    "\n",
    "Create a new window in the tmux session that was opened (prefix + c)\n",
    "```\n",
    "oai-session.sh epc 192.168.15.14 22 epc enp1s0 enp6s0\n",
    "```\n",
    "\n",
    "where:\n",
    "* epc - VM1 username\n",
    "* 192.168.15.14 - VM1 IP\n",
    "* 22 - ssh port\n",
    "* enp1s0 - S1c interface\n",
    "* enp6s0 - SGi interface\n",
    "\n",
    "The figure below shows the _oai-session.sh_ script during its execution.\n",
    "\n",
    "![oai-session-png](https://media.githubusercontent.com/media/navarrothiago/masters/master/imgs/oai-session.png)\n",
    "\n",
    "## Run eNB Component\n",
    "\n",
    "In local tmux session (Host1), execute in window0, pane1\n",
    "\n",
    "```\n",
    "cd ~/openairinterface5g/cmake_targets/lte_build_oai/build/\n",
    "sudo -E ./lte-softmodem -O /work/openairinterface5g/ci-scripts/conf_files/enb.band28.tm1.25PRB.usrpb210.conf\n",
    "\n",
    "```\n",
    "The figure below shows the _work-session.sh_ script during its execution.\n",
    "![work-session-png](https://media.githubusercontent.com/media/navarrothiago/masters/master/imgs/work-session.png)\n",
    "\n",
    "## Check UE Attach\n",
    "\n",
    "Open the epc tmux session and check if the UE is connected and attached.\n",
    "\n",
    "```\n",
    "002134 00580:818697 7FD656FFD700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0045      ======================================= STATISTICS ============================================\n",
    "\n",
    "002135 00580:818738 7FD656FFD700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0046                     |   Current Status| Added since last display|  Removed since last display |\n",
    "002136 00580:818749 7FD656FFD700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0048      Connected eNBs |          1      |              0              |             0               |\n",
    "002137 00580:818758 7FD656FFD700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0050      Attached UEs   |          1      |              0              |             0               |\n",
    "002138 00580:818767 7FD656FFD700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0052      Connected UEs  |          1      |              0              |             0               |\n",
    "002139 00580:818775 7FD656FFD700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0054      Default Bearers|          0      |              0              |             0               |\n",
    "002140 00580:818783 7FD656FFD700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0056      S1-U Bearers   |          0      |              0              |             0               |\n",
    "\n",
    "\n",
    "```\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Install HSS  \n",
    "\n",
    "## Checkout Realeases\n",
    "```\n",
    "cd ~/openair-cn\n",
    "# HotFix in 2020.w13\n",
    "git checkout 2020.w13 \n",
    "\n",
    "```\n",
    "\n",
    "## Add key\n",
    "You must trust the key below in order to have success.\n",
    "\n",
    "```\n",
    "sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys A278B781FE4B2BDA\n",
    "```\n",
    "\n",
    "Fix cassandra repository (bug fix - 2020.w13) \n",
    "```\n",
    "sed -i 's+https://www.apache.org/dist/cassandra/KEYS+https://downloads.apache.org/cassandra/KEYS+g' ~/openair-cn/build/tools/build_helper.cassandra \n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Setup Environment\n",
    "\n",
    "## Install KVM on Kernel 5.4.24-1-MANJARO x86_64\n",
    "https://www.fosslinux.com/2484/how-to-install-virtual-machine-manager-kvm-in-manjaro-and-arch-linux.htm   \n",
    "https://computingforgeeks.com/complete-installation-of-kvmqemu-and-virt-manager-on-arch-linux-and-manjaro/\n",
    "\n",
    "## Download Ubuntu ISO Bionic\n",
    "http://releases.ubuntu.com/18.04.4/ubuntu-18.04.4-desktop-amd64.iso\n",
    "\n",
    "TODO: \n",
    "* Install with some light distro (ubuntu-server? xubuntu? lubuntu?).\n",
    "* [Strip version](https://askubuntu.com/questions/33/what-is-the-easiest-way-to-strip-a-desktop-edition-to-a-server-edition)\n",
    "\n",
    "\n",
    "## [QEMU](https://www.qemu.org/)\n",
    "Documentation:\n",
    "* https://wiki.archlinux.org/index.php/QEMU \n",
    "* https://wiki.gentoo.org/wiki/QEMU/Options\n",
    "\n",
    "Networking\n",
    "* https://wiki.qemu.org/Documentation/Networking\n",
    "* http://bsdwiki.reedmedia.net/wiki/networking_qemu_virtual_bsd_systems.html\n",
    "* https://www.qemu.org/2018/05/31/nic-parameter/\n",
    "* https://www.redhat.com/en/blog/introduction-virtio-networking-and-vhost-net\n",
    "* https://wiki.gentoo.org/wiki/QEMU_with_Open_vSwitch_network\n",
    "* https://en.wikipedia.org/wiki/Slirp\n",
    "* http://events17.linuxfoundation.org/sites/events/files/slides/KVM17%27-vDPA.pdf\n",
    "* https://www.linux-kvm.org/page/UsingVhost\n",
    "\n",
    "Resize disk\n",
    "* https://maunium.net/blog/resizing-qcow2-images/\n",
    "* https://www.jamescoyle.net/how-to/1818-access-a-qcow2-virtual-disk-image-from-the-host\n",
    "* http://blogs.perl.org/users/rurban/2013/11/how-to-resize-a-ntfs-qemu-qcow2-image-the-easy-way.html\n",
    "* https://medium.com/@aysadx/linux-nbd-introduction-to-linux-network-block-devices-143365f1901b\n",
    "* https://www.suse.com/c/ljdt-kvm-snapshots-disk-resizing/\n",
    "\n",
    "Create snapshot\n",
    "* https://wiki.qemu.org/Documentation/CreateSnapshot\n",
    "\n",
    "Research\n",
    "* https://pdfs.semanticscholar.org/afb2/e44fba74484ddb9cd8bfaa432831c2056e04.pdf"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Create a Disk Image\n",
    "```\n",
    "sudo qemu-img create -f qcow2 /var/lib/libvirt/images/pool/openair-cn 10G\n",
    "```\n",
    "\n",
    "### Launch QEMU with Ubuntu ISO attached\n",
    "Run the following command to launch a QEMU virtual machine with the Ubuntu ISO and hard disk we created in the previous step attached.\n",
    "\n",
    "```\n",
    "sudo qemu-system-x86_64 \\\n",
    "  -m 4096 \\\n",
    "  -smp 2 \\\n",
    "  -vga virtio \\\n",
    "  -show-cursor \\\n",
    "  -usb \\\n",
    "  -device usb-tablet \\\n",
    "  -enable-kvm \\\n",
    "  -cdrom ubuntu-18.04.4-desktop-amd64.iso \\\n",
    "  -drive file=/var/lib/libvirt/images/pool/openair-cn,format=qcow2,if=virtio \\\n",
    "  -cpu host\n",
    "\n",
    "```\n",
    "\n",
    "or ẁith Ubuntu-Server\n",
    "```\n",
    "sudo qemu-system-x86_64 \\\n",
    "  -m 4096 \\\n",
    "  -smp 2 \\\n",
    "  -vga virtio \\\n",
    "  -show-cursor \\\n",
    "  -usb \\\n",
    "  -device usb-tablet \\\n",
    "  -enable-kvm \\\n",
    "  -cdrom /work/unicamp/iso/ubuntu-18.04.4-live-server-amd64.iso \\\n",
    "  -drive file=/var/lib/libvirt/images/pool/openair-cn,format=qcow2,if=virtio \\\n",
    "  -cpu host\n",
    "```\n",
    "**The iso must be located in the same place where the command is executed.**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Reboot without Ubuntu ISO attached\n",
    "Once the machine is powered off. Run the command below to power it back on without the CD-ROM attached.\n",
    "\n",
    "```\n",
    "sudo qemu-system-x86_64 \\\n",
    "  -m 4096 \\\n",
    "  -smp 2 \\\n",
    "  -vga virtio \\\n",
    "  -show-cursor \\\n",
    "  -usb \\\n",
    "  -device usb-tablet \\\n",
    "  -enable-kvm \\\n",
    "  -drive file=/var/lib/libvirt/images/pool/openair-cn,format=qcow2,if=virtio \\\n",
    "  -cpu host \\\n",
    "  -net nic,model=virtio \\\n",
    "  -net user,hostfwd=tcp::2222-:22 \\\n",
    "  -display none\n",
    "  \n",
    "```\n",
    "and connect to the VM with ssh\n",
    "```\n",
    "ssh <user>@localhost -p 2222\n",
    "```\n",
    "\n",
    "Note the port is the same that was configured in _hostfwd_\n",
    "\n",
    "Use _-monitor stdio_ to open monitor.\n",
    "Ref: https://graspingtech.com/ubuntu-desktop-18.04-virtual-machine-macos-qemu/\n",
    "\n",
    "TODO: Start ubuntu in console mode (sometimes works)\n",
    "```\n",
    "sudo qemu-system-x86_64   -m 2G   -smp 2  -enable-kvm   -drive file=/var/lib/libvirt/images/pool/enodeb,format=qcow2,if=virtio   -cpu host   -net nic,model=virtio   -net user,hostfwd=tcp::2223-:22 -curses\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Virt-Manager [WIP]\n",
    "* https://www.youtube.com/watch?v=FuPofbt1MXU\n",
    "\n",
    "\n",
    "### Configure IP Address in Guest\n",
    "Check if there is an IP assigne on your link device with\n",
    "```\n",
    "sudo ip link\n",
    "```\n",
    "\n",
    "If not, modify the configuration file \n",
    "```\n",
    "sudo vim /etc/netplan/50-cloud-init.yaml\n",
    "```\n",
    "```\n",
    "network:\n",
    "    ethernets:\n",
    "        <iface>:\n",
    "            dhcp4: true\n",
    "    version: 2\n",
    "\n",
    "```\n",
    "where _iface_ is the interface name.\n",
    "\n",
    "Reboot the system and check again if there is an IP address assgined\n",
    "\n",
    "### Setup Virtual Networking\n",
    "See https://wiki.libvirt.org/page/VirtualNetworking\n",
    "\n",
    "### Access virtual machines using their hostnames\n",
    "* https://libvirt.org/nss.html\n",
    "* https://wiki.archlinux.org/index.php/libvirt"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Bridge mode\n",
    "* https://wiki.archlinux.org/index.php/Network_bridge\n",
    "* https://wiki.debian.org/BridgeNetworkConnections\n",
    "* https://libvirt.org/formatdomain.html#elementsNICSBridge\n",
    "* https://wiki.libvirt.org/page/Networking\n",
    "* [brigde linux vs macvtap](https://www.youtube.com/watch?v=jHrJvKzu-vk)\n",
    "* [rules on bridge](https://www.tldp.org/HOWTO/BRIDGE-STP-HOWTO/rules-on-bridging.html)\n",
    "\n",
    "Follow the link below in order to setup bridge in manjaro\n",
    "* [create bridge archlinux](https://wiki.archlinux.org/index.php/Systemd-networkd#Bridge_interface)\n",
    "\n",
    "\n",
    "Note that if you want to take advantage of automatic DNS configuration from DHCP, you need to enable systemd-resolved and symlink /run/systemd/resolve/resolv.conf to /etc/resolv.conf. See systemd-resolved.service(8) for more details.\n",
    "\n",
    "\n",
    "### Static IP \n",
    "* https://www.cyberciti.biz/faq/linux-kvm-libvirt-dnsmasq-dhcp-static-ip-address-configuration-for-guest-os/\n",
    "\n",
    "### iproute2\n",
    "* [route interpretation](http://linux-ip.net/html/tools-ip-route.html)\n",
    "\n",
    "## Internet Sharing\n",
    "* https://wiki.archlinux.org/index.php/Internet_sharing"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Install Packages in Guest \n",
    "In guest, open terminal.\n",
    "\n",
    "```\n",
    "sudo apt update\n",
    "sudo apt upgrade -y\n",
    "sudo apt install openssh-server git curl vim tmux\n",
    "```\n",
    "\n",
    "## Access Guest from Host\n",
    "Open terminal and you copy public key and then loggin on guest.\n",
    "\n",
    "```\n",
    "ssh-copy-id openair-cn@localhost -p 2222\n",
    "ssh openair-cn@localhost -p 2222\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Open Air Interface Core Network ( OAI-CN )\n",
    "\n",
    "## Overview\n",
    "See\n",
    "* https://www.openairinterface.org/?page_id=864\n",
    "* https://github.com/OPENAIRINTERFACE/openair-cn/wiki/Full-Deployment-of-OAI-system\n",
    "\n",
    "\n",
    "## Block Diagram\n",
    "\n",
    "![Block Diagram](https://gitlab.eurecom.fr/oai/openairinterface5g/raw/master/doc/images/oai_enb_block_diagram.png)\n",
    "![EPC](https://upload.wikimedia.org/wikipedia/commons/thumb/d/d7/Evolved_Packet_Core.svg/1920px-Evolved_Packet_Core.svg.png)\n",
    "\n",
    "## Deps\n",
    "Cool tool:\n",
    "https://www.gitmemory.com/openairinterface-GH\n",
    "\n",
    "Tutorial Cassandra: \n",
    "https://www.tutorialspoint.com/cassandra/cassandra_architecture.htm\n",
    "\n",
    "**The next steps were based on the following links:**\n",
    "* https://github.com/OPENAIRINTERFACE/openair-cn/wiki/OpenAirSoftwareSupport\n",
    "* https://github.com/OPENAIRINTERFACE/openair-cn-cups/wiki/OpenAirSoftwareSupport"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Network overview\n",
    "\n",
    "![Network Overview](https://github.com/OPENAIRINTERFACE/openair-cn-cups/wiki/pictures/oai_epc_all_in_one_cups_spgw.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "### Setup Networking VMs \n",
    "[WIP] Put xml VMs configuration file and netplan condiguration (.yaml)\n",
    "\n",
    "\n",
    "##### Netplan configuration\n",
    "Open _/etc/netplan/50-cloud-init.yaml_ in epc guest and fill with these parameters\n",
    "```\n",
    "network:\n",
    "    ethernets:\n",
    "        ens3:\n",
    "            dhcp4: true\n",
    "        enp6s0:\n",
    "            addresses: [192.168.15.14/24]\n",
    "            gateway4: 192.168.15.1\n",
    "            dhcp4: false\n",
    "            nameservers:\n",
    "                addresses: [8.8.8.8,8.8.4.4]\n",
    "        enp1s0:\n",
    "             addresses: [10.50.11.133/24]\n",
    "             gateway4: 10.50.11.1\n",
    "             dhcp4: false\n",
    "             nameservers:\n",
    "                addresses: [8.8.8.8,8.8.4.4]\n",
    "    version: 2\n",
    "\n",
    "```\n",
    "\n",
    "**TODO: How to configure using dhcp client.**\n",
    "\n",
    "**Referências**\n",
    "* http://csortu.blogspot.com/2009/12/building-virtual-network-with-qemu.html\n",
    "* https://wiki.archlinux.org/index.php/Network_bridge\n",
    "* https://www.linux-kvm.org/page/Networking"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "## Enable ssh\n",
    "Generate ssh keys\n",
    "```\n",
    "ssh-keygen -t dsa\n",
    "```\n",
    "Enable password authentication\n",
    "\n",
    "In /etc/ssh/sshd_config set\n",
    "```\n",
    "PasswordAuthentication yes \n",
    "```\n",
    "\n",
    "Then you can also copy your ssh public key in the VM...\n",
    "\n",
    "## Download EPC source code\n",
    "\n",
    "\n",
    "```\n",
    "cd ~\n",
    "git clone https://github.com/OPENAIRINTERFACE/openair-cn.git\n",
    "git clone https://github.com/OPENAIRINTERFACE/openair-cn-cups.git\n",
    "...\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## EPC\n",
    "https://gitlab.eurecom.fr/oai/openair-cn/blob/develop/docs/EPC_User_Guide.pdf\n",
    "\n",
    "## Install HSS  \n",
    "\n",
    "### Checkout Realeases\n",
    "```\n",
    "cd ~/openair-cn\n",
    "# HotFix in 2020.w13\n",
    "git checkout 2020.w13 \n",
    "\n",
    "```\n",
    "\n",
    "## Add key\n",
    "You must trust the key below in order to have success.\n",
    "\n",
    "```\n",
    "sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys A278B781FE4B2BDA\n",
    "```\n",
    "\n",
    "**BGN - This part of the wiki is not working due to the java's ppa. Oracle stopped to support it.**\n",
    "\n",
    "```\n",
    "cd ~/openair-cn/scripts/; \\\n",
    "./build_cassandra --check-installed-software --force\n",
    "...\n",
    "Processing triggers for libgdk-pixbuf2.0-0:amd64 (2.36.11-2) ...\n",
    "Cassandra installation successful\n",
    "'/home/ubuntu/openair-cn/etc/cassandra.conf' -> '/usr/local/etc/oai/cassandra.conf'\n",
    "Cassandra has been installed successfully.\n",
    "ubuntu@test-install-openair-cn:~/openair-cn/scripts$ \n",
    "```\n",
    "\n",
    "~~Set the JRE version 8 as default~~\n",
    "```\n",
    "ubuntu@test-install-openair-cn:~/openair-cn/scripts$ sudo service cassandra stop\n",
    "ubuntu@test-install-openair-cn:~/openair-cn/scripts$ sudo update-alternatives --config java\n",
    "# select jre version 8\n",
    "... \n",
    "ubuntu@test-install-openair-cn:~/openair-cn/scripts$ sudo service cassandra start\n",
    "```\n",
    "Verify that Cassandra is installed and running\n",
    "\n",
    "**END - This part of the wiki is not working due to the java's ppa. Oracle stopped to support it.**\n",
    "\n",
    "The message below is shown during the execution of https://github.com/OPENAIRINTERFACE/openair-cn/wiki/OpenAirSoftwareSupport#install-hss, it seems to be missing oracle-java8-installer and there is no valid OpenPGP data.\n",
    "\n",
    "```\n",
    "Package oracle-java8-installer is not available, but is referred to by another package.\n",
    "This may mean that the package is missing, has been obsoleted, or\n",
    "is only available from another source\n",
    "\n",
    "E: Package 'oracle-java8-installer' has no installation candidate\n",
    "deb http://www.apache.org/dist/cassandra/debian 21x main\n",
    "  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current\n",
    "                                 Dload  Upload   Total   Spent    Left  Speed\n",
    "100   227  100   227    0     0    378      0 --:--:-- --:--:-- --:--:--   377\n",
    "gpg: no valid OpenPGP data found.\n",
    "```\n",
    "\n",
    "\n",
    "**See Troubleshoot to fix it**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Stop Cassandra and cleanup the log files before modifying the configuration\n",
    "\n",
    "```\n",
    "sudo service cassandra stop\n",
    "sudo rm -rf /var/lib/cassandra/data/system/*\n",
    "sudo rm -rf /var/lib/cassandra/commitlog/*\n",
    "sudo rm -rf /var/lib/cassandra/data/system_traces/*\n",
    "sudo rm -rf /var/lib/cassandra/saved_caches/*\n",
    "```\n",
    "\n",
    "Update the Cassandra configuration **if needed** (default configuration set **1 cassandra node listening on localhost**)\n",
    "Update **/etc/cassandra/cassandra.yaml** as indicated below. The <Cassandra_Server_IP> address should be the IP\n",
    "address of the Cassandra server that the HSS will use to connect to Cassandra. The \"...\" below indicate configuration lines between values that need to be modified.\n",
    "```\n",
    "...\n",
    "cluster_name: \"HSS Cluster\"\n",
    "...\n",
    "# OAI Note: no to change Cassandra_Server_IP that is already 127.0.0.1\n",
    "seed_provider:\n",
    "- class_name: org.apache.cassandra.locator.SimpleSeedProvider\n",
    "- seeds: \"<Cassandra_Server_IP>\"\n",
    "...\n",
    "listen_address: <Cassandra_Server_IP>\n",
    "...\n",
    "rpc_address: <Cassandra_Server_IP>\n",
    "...\n",
    "# OAI Note: seems to be this option that is working ()\n",
    "# endpoint_snitch: SimpleSnitch\n",
    "endpoint_snitch: GossipingPropertyFileSnitch\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Start Cassandra service**\n",
    "\n",
    "```\n",
    "sudo service cassandra start\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Check cassandra service status**\n",
    "```\n",
    "sudo systemctl status cassandra\n",
    "```\n",
    "\n",
    "```\n",
    "● cassandra.service - LSB: distributed storage system for structured data\n",
    "   Loaded: loaded (/etc/init.d/cassandra; generated)\n",
    "   Active: active (running) since Thu 2019-05-23 10:26:51 UTC; 1h 54min ago\n",
    "     Docs: man:systemd-sysv-generator(8)\n",
    "    Tasks: 61 (limit: 4704)\n",
    "   CGroup: /system.slice/cassandra.service\n",
    "           └─23863 java -ea -javaagent:/usr/share/cassandra/lib/jamm-0.3.0.jar -XX:+CMSClassUnloadingEnabled -XX:+UseThreadPri\n",
    "\n",
    "May 23 10:26:51 test-install-openair-cn systemd[1]: Starting LSB: distributed storage system for structured data...\n",
    "May 23 10:26:51 test-install-openair-cn systemd[1]: Started LSB: distributed storage system for structured data.\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Install HSS software dependancies**\n",
    "\n",
    "```\n",
    "cd ~/openair-cn/scripts; \\\n",
    "./build_hss_rel14 --check-installed-software --force\n",
    "...\n",
    "# OAI Note: Takes some time...\n",
    "```\n",
    "Output is:\n",
    "```\n",
    "...\n",
    "-- Installing: /usr/local/lib/cmake/pistache/PistacheConfig.cmake\n",
    "~/openair-cn/scripts\n",
    "HSS software installation successful\n",
    "HSS not compiled, to compile it, re-run build_hss without -i option \n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Build HSS**\n",
    "\n",
    "```\n",
    "cd ~/openair-cn/scripts; \\\n",
    "./build_hss_rel14 --clean\n",
    "```\n",
    "\n",
    "Output is:\n",
    "\n",
    "```\n",
    "mkdir: created directory '/home/ubuntu/openair-cn/scripts/../build/hss_rel14/build'\n",
    "~/openair-cn/build/hss_rel14/util ~/openair-cn/scripts\n",
    "...\n",
    " g++  -g -pthread -std=c++11  -I ../../src/hss_rel14/include -I ../../src/hss_rel14/util/include -I ../../build/hss_rel14/../git_submodules/rapidjson/include -I /usr/local/include/freeDiameter -I ../../src/hss_rel14/hsssec/include -I /usr/local/include -MMD -c -o ../../build/hss_rel14/build/s6t_impl.o ../../src/hss_rel14/src/s6t_impl.cpp\n",
    " Linking...\n",
    " g++  -g -pthread -lpthread -Wl,-rpath,/usr/local/lib/x86_64-linux-gnu:/usr/local/lib ../../build/hss_rel14/build/s6t.o ../../build/hss_rel14/build/s6as6d_impl.o ../../build/hss_rel14/build/dataaccess.o ../../build/hss_rel14/build/s6as6d.o ../../build/hss_rel14/build/options.o ../../build/hss_rel14/build/s6c_impl.o ../../build/hss_rel14/build/fdhss.o ../../build/hss_rel14/build/s6c.o ../../build/hss_rel14/build/main.o ../../build/hss_rel14/build/util.o ../../build/hss_rel14/build/resthandler.o ../../build/hss_rel14/build/s6t_impl.o -o ../../build/hss_rel14/bin/hss ../../build/hss_rel14/util/lib/libc3po.a ../../build/hss_rel14/hsssec/lib/libhsssec.a /usr/local/lib/libpistache.a /usr/local/lib/libfdcore.so /usr/local/lib/libfdproto.so -L/usr/local/lib/x86_64-linux-gnu -lcassandra -lrt -lnettle -lgmp \n",
    "'/home/ubuntu/openair-cn/build/hss_rel14/bin/hss' -> '/usr/local/bin/oai_hss'\n",
    "oai_hss installed\n",
    "\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "###  Populate users table\n",
    "Here you will have to feed scripts with your parameters:\n",
    "\n",
    "!!! IMPORTANT NOTICE !!! It is highly recommended that your APN contains a realm, else you will have to enter in the SPGW config file ...gprs\n",
    "APN (Access Point Name): --apn value # value is \"default.ng4T.com\" here.\n",
    "\n",
    "LTE K:                   --key value # value is \"fec86ba6eb707ed08905757b1bb44b8f\" here.\n",
    "\n",
    "IMSI:                    --imsi value # value of IMSI of first subscriber is \"208931234561000\" here, the IMSI of next subscribers will be incremented by one, if --no-of-users value is > 1.\n",
    "\n",
    "REALM:                   --realm value # value of realm here is ng4T.com.\n",
    "\n",
    "MME FQDN:                --mme-identity value # value of MME FQDN is mme.ng4T.com here (end with realm).\n",
    "\n",
    "\n",
    "```\n",
    "./data_provisioning_users --apn oai.ipv4 --apn2 internet --key BA6C4204C5F5F77726C0B43431C92EEF --imsi-first 724990000001046 --msisdn-first 15126389698 --mme-identity mme.o\n",
    "penairinterface.org --no-of-users 1 --realm openairinterface.org --truncate False --verbose True --cassandra-cluster 127.0.0.1                                                                                                                \n",
    "INFO:root:724990000001046 15126389698 41 BA6C4204C5F5F77726C0B43431C92EEF mme.openairinterface.org 3 openairinterface.org 2683b376d1056746de3b254012908e0e 96 {\"Subscription-Data\":{\"Access-Restriction-Data\":41,\"Subscriber-Status\":0,\"Network-Access-Mode\":2,\"Regional-Subscription-Zone-Code\":[\"0x0123\",\"0x4567\",\"0x89AB\",\"0xCDEF\",\"0x1234\",\"0x5678\",\"0x9ABC\",\"0xDEF0\",\"0x2345\",\"0x6789\"],\"MSISDN\":\"0x15126389698\",\"AMBR\":{\"Max-Requested-Bandwidth-UL\":50000000,\"Max-Requested-Bandwidth-DL\":100000000},\"APN-Configuration-Profile\":{\"Context-Identifier\":0,\"All-APN-Configurations-Included-Indicator\":0,\"APN-Configuration\":{\"Context-Identifier\":0,\"PDN-Type\":0,\"Service-Selection\":\"oai.ipv4\",\"EPS-Subscribed-QoS-Profile\":{\"QoS-Class-Identifier\":9,\"Allocation-Retention-Priority\":{\"Priority-Level\":15,\"Pre-emption-Capability\":0,\"Pre-emption-Vulnerability\":0}},\"AMBR\":{\"Max-Requested-Bandwidth-UL\":50000000,\"Max-Requested-Bandwidth-DL\":100000000},\"PDN-GW-Allocation-Type\":0,\"MIP6-Agent-Info\":{\"MIP-Home-Agent-Address\":[\"172.26.17.183\"]}},\"APN-Configuration\":{\"Context-Identifier\":0,\"PDN-Type\":0,\"Service-Selection\":\"internet\",\"EPS-Subscribed-QoS-Profile\":{\"QoS-Class-Identifier\":9,\"Allocation-Retention-Priority\":{\"Priority-Level\":13,\"Pre-emption-Capability\":1,\"Pre-emption-Vulnerability\":0}},\"AMBR\":{\"Max-Requested-Bandwidth-UL\":50000000,\"Max-Requested-Bandwidth-DL\":100000000},\"PDN-GW-Allocation-Type\":0,\"MIP6-Agent-Info\":{\"MIP-Home-Agent-Address\":[\"172.26.17.183\"]}}},\"Subscribed-Periodic-RAU-TAU-Timer\":0}}\n",
    "INFO:root:15126389698 724990000001046\n",
    "DEBUG:cassandra.io.libevreactor:Closing connection (139941366141448) to 127.0.0.1\n",
    "DEBUG:cassandra.io.libevreactor:Closed socket to 127.0.0.1\n",
    "DEBUG:cassandra.io.libevreactor:Closing connection (139941366142512) to 127.0.0.1\n",
    "DEBUG:cassandra.io.libevreactor:Closed socket to 127.0.0.1\n",
    "DEBUG:cassandra.io.libevreactor:Waiting for event loop thread to join...\n",
    "DEBUG:cassandra.io.libevreactor:All Connections currently closed, event loop ended\n",
    "DEBUG:cassandra.io.libevreactor:Event loop thread was joined\n",
    "DEBUG:cassandra.cluster:Shutting down Cluster Scheduler\n",
    "DEBUG:cassandra.cluster:Shutting down control connection\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "```\n",
    "cd ~/openair-cn/scripts; \\\n",
    "./data_provisioning_mme --id 3 --mme-identity mme.openairinterface.org --realm openairinterface.org --ue-reachability 1 --truncate True  --verbose True -C $Cassandra_Server_IP\n",
    "```\n",
    "\n",
    "Output is \n",
    "\n",
    "```\n",
    "vhss.mmeidentity truncated\n",
    "vhss.mmeidentity_host truncated\n",
    "3 mme-isdn mme.openairinterface.org openairinterface.org 1\n",
    "3 mme-isdn mme.openairinterface.org openairinterface.org 1\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Create HSS configuration files**\n",
    "\n",
    "```\n",
    "cd ~/openair-cn/scripts\n",
    "\n",
    "MY_REALM='openairinterface.org'\n",
    "# prompt has been removed for easier Ctrl+C Ctrl+V\n",
    "# cd $OPENAIRCN_DIR/scripts\n",
    "\n",
    "openssl rand -out $HOME/.rnd 128\n",
    "\n",
    "PREFIX='/usr/local/etc/oai'\n",
    "sudo mkdir -p $PREFIX\n",
    "sudo chmod 777 $PREFIX\n",
    "sudo mkdir  $PREFIX/freeDiameter\n",
    "sudo chmod 777 $PREFIX/freeDiameter\n",
    "\n",
    "# freeDiameter configuration files\n",
    "sudo cp ../etc/acl.conf ../etc/hss_rel14_fd.conf $PREFIX/freeDiameter\n",
    "sudo chmod 666 $PREFIX/freeDiameter/acl.conf $PREFIX/freeDiameter/hss_rel14_fd.conf\n",
    "\n",
    "# HSS configuration files\n",
    "sudo cp ../etc/hss_rel14.conf ../etc/hss_rel14.json $PREFIX\n",
    "sudo chmod 666 $PREFIX/hss_rel14.conf $PREFIX/hss_rel14.json\n",
    "\n",
    "declare -A HSS_CONF\n",
    "HSS_CONF[@PREFIX@]=$PREFIX\n",
    "HSS_CONF[@REALM@]=$MY_REALM\n",
    "HSS_CONF[@HSS_FQDN@]=\"hss.${HSS_CONF[@REALM@]}\"\n",
    "HSS_CONF[@cassandra_Server_IP@]='127.0.0.1' \n",
    "HSS_CONF[@cassandra_IP@]='127.0.0.1' # TODO harmonize these 2\n",
    "HSS_CONF[@OP_KEY@]='07AF65295F9419D7CB45FDDE716AAD26'\n",
    "HSS_CONF[@ROAMING_ALLOWED@]='true'\n",
    "\n",
    "for K in \"${!HSS_CONF[@]}\"; do \n",
    "  egrep -lRZ \"$K\" $PREFIX | xargs -0 -l sed -i -e \"s|$K|${HSS_CONF[$K]}|g\"\n",
    "done\n",
    "\n",
    "### freeDiameter certificate\n",
    "../src/hss_rel14/bin/make_certs.sh hss ${HSS_CONF[@REALM@]} $PREFIX\n",
    "\n",
    "# Finally customize the listen address of FD server (if necessary because FD binds by default on available interfaces)\n",
    "# set in $PREFIX/freeDiameter/hss_rel14_fd.conf and uncomment the following line\n",
    "sudo sed -i -e 's/#ListenOn/ListenOn/g' $PREFIX/freeDiameter/hss_rel14_fd.conf \n",
    "```\n",
    "You can ignore the erros for while on the execution of _make_certs.sh_\n",
    "\n",
    "```\n",
    "Can't open ./demoCA/index.txt.attr for reading, No such file or directory\n",
    "140137160171968:error:02001002:system library:fopen:No such file or directory:../crypto/bio/bss_file.c:72:fopen('./demoCA/index.txt.attr','r')\n",
    "140137160171968:error:2006D080:BIO routines:BIO_new_file:no such file:../crypto/bio/bss_file.c:79:\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Update OPC (Operator Key Ciphered) Cassandra DB if necessary (do it almost one time unless you have only OPC and populate it in DB)\n",
    "```\n",
    "oai_hss -j $PREFIX/hss_rel14.json --onlyloadkey\n",
    "```\n",
    "\n",
    "Output is \n",
    "```\n",
    "Options::jsonConfig            : /usr/local/etc/oai/hss_rel14.json\n",
    "Options::diameterconfiguration : /usr/local/etc/oai/freeDiameter/hss_rel14_fd.conf\n",
    "Options::cassserver            : 127.0.0.1\n",
    "Options::cassuser              : root\n",
    "Options::casspwd               : root\n",
    "Options::cassdb                : vhss\n",
    "Options::randvector            : 1\n",
    "Options::roamallow             : 1\n",
    "Options::optkey                : 1006020f0a478bf6b699f15c062e42b3\n",
    "Options::reloadkey             : 0\n",
    "Options::onlyloadkey           : 1\n",
    "Options::gtwport               : 9080\n",
    "Options::gtwhost               : *\n",
    "Options::resthost              : 9081\n",
    "Options::synchimsi             : \n",
    "Options::synchauts             : \n",
    "Initialized random\n",
    "\n",
    "\n",
    "******************************************\n",
    "IMSI:208931234561005\n",
    "KEY :fec86ba6eb707ed08905757b1bb44b8f\n",
    "OPC :\n",
    "RijndaelKeySchedule: K FEC86BA6EB707ED08905757B1BB44B8F\n",
    "Compute opc:\n",
    "\tK:\tFEC86BA6EB707ED08905757B1BB44B8F\n",
    "\tIn:\t1006020F0A478BF6B699F15C062E42B3\n",
    "\tRinj:\tD4224B3931FD5BDDD0489A9573F93E72\n",
    "\tOut:\tC42449363BBAD02B66D16BC975D77CC1\n",
    "NEW OPC :c42449363bbad02b66d16bc975d77cc1\n",
    "******************************************\n",
    "UPDATE vhss.users_imsi SET OPc='c42449363bbad02b66d16bc975d77cc1' WHERE imsi='208931234561005';\n",
    "******************************************\n",
    "...\n",
    "NEW OPC :c42449363bbad02b66d16bc975d77cc1\n",
    "******************************************\n",
    "UPDATE vhss.users_imsi SET OPc='c42449363bbad02b66d16bc975d77cc1' WHERE imsi='208931234561007';\n",
    "```\n",
    "\n",
    "Note that if option reloadkey is set to true in $PREFIX/hss_rel14.json, this step is not required.\n",
    "\n",
    "If you face the error  below, **go to Trobleshoot to fix it** \n",
    "```\n",
    "openair-cn@openair-cn-vm:~/openair-cn/scripts$ oai_hss -j $PREFIX/hss_rel14.json --onlyloadkey\n",
    "terminate called after throwing an instance of 'spdlog::spdlog_ex'\n",
    "  what():  Failed opening file logs/hss.log for writing: No such file or directory\n",
    "Aborted (core dumped)\n",
    "\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Kill HSS\n",
    "```\n",
    "sudo kill -9 $(ps -aux | grep hss | awk '{print $2}')\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Install MME\n",
    "\n",
    "**Install MME software dependencies**\n",
    "\n",
    "```\n",
    "cd ~/openair-cn/scripts; \\\n",
    "./build_mme --check-installed-software --force\n",
    "```\n",
    "\n",
    "Output is\n",
    "```\n",
    "...\n",
    "Processing triggers for mime-support (3.60ubuntu1) ...\n",
    "Setting up unzip (6.0-21ubuntu1) ...\n",
    "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...\n",
    "sh: 0: getcwd() failed: No such file or directory\n",
    "MME software installation successful\n",
    "MME not compiled, to compile it, re-run build_mme without -i option\n",
    "```\n",
    "\n",
    "**Build MME**\n",
    "\n",
    "```\n",
    "cd ~/openair-cn/scripts; \\\n",
    "./build_mme --clean\n",
    "```\n",
    "Ouput is\n",
    "```\n",
    "Clean the build generated files (build from scratch)\n",
    "mkdir: created directory 'build'\n",
    "Build type is Debug\n",
    "Architecture is x86_64\n",
    "git found: /usr/bin/git\n",
    "NETTLE VERSION_INSTALLED  = 3.4\n",
    "NETTLE_VERSION_MAJOR = 3\n",
    "NETTLE_VERSION_MINOR = 4\n",
    "Compilation log for /home/ubuntu/openair-cn/build/mme/build/mme is here: /home/ubuntu/openair-cn/build/log/mme.txt\n",
    "mme compiled\n",
    "'/home/ubuntu/openair-cn/build/mme/build/mme' -> '/usr/local/bin/mme'\n",
    "mme installed\n",
    "```\n",
    "\n",
    "**Create MME configuration files**\n",
    "\n",
    "```\n",
    "PREFIX='/usr/local/etc/oai'\n",
    "IFACE_LOCAL='enp1s0'\n",
    "MY_REALM='openairinterface.org'\n",
    "IP_LOCAL='192.168.15.14/24'\n",
    "IP_S10='192.168.15.19/24'\n",
    "cd ~/openair-cn/scripts\n",
    "\n",
    "O script pode ser executado, gerando os arquivos de configuração do MME.\n",
    "sudo ifconfig $IFACE_LOCAL:m11 172.16.1.102 up\n",
    "sudo ifconfig $IFACE_LOCAL:m10 192.168.15.19 up\n",
    " \n",
    "INSTANCE=1\n",
    "cp ../etc/mme_fd.sprint.conf  $PREFIX/freeDiameter/mme_fd.conf\n",
    "cp ../etc/mme.conf  $PREFIX\n",
    "declare -A MME_CONF\n",
    " \n",
    "MME_CONF[@MME_S6A_IP_ADDR@]=\"127.0.0.11\"\n",
    "MME_CONF[@INSTANCE@]=$INSTANCE\n",
    "MME_CONF[@PREFIX@]=$PREFIX\n",
    "MME_CONF[@REALM@]=$MY_REALM\n",
    "MME_CONF[@PID_DIRECTORY@]='/var/run'\n",
    "MME_CONF[@MME_FQDN@]=\"mme.${MME_CONF[@REALM@]}\"\n",
    "MME_CONF[@HSS_HOSTNAME@]='hss'\n",
    "MME_CONF[@HSS_FQDN@]=\"${MME_CONF[@HSS_HOSTNAME@]}.${MME_CONF[@REALM@]}\"\n",
    "MME_CONF[@HSS_IP_ADDR@]=127.0.0.1\n",
    " \n",
    "MME_CONF[@MCC@]='724'\n",
    "MME_CONF[@MNC@]='99'\n",
    "MME_CONF[@MME_GID@]='32768'\n",
    "MME_CONF[@MME_CODE@]='3'\n",
    "MME_CONF[@TAC_0@]='1'\n",
    "MME_CONF[@TAC_1@]='1'\n",
    "MME_CONF[@TAC_2@]='1'\n",
    " \n",
    "MME_CONF[@MME_INTERFACE_NAME_FOR_S1_MME@]=\"$IFACE_LOCAL\"\n",
    "MME_CONF[@MME_IPV4_ADDRESS_FOR_S1_MME@]=\"$IP_LOCAL\"\n",
    "MME_CONF[@MME_INTERFACE_NAME_FOR_S11@]=\"${IFACE_LOCAL}:m11\"\n",
    "MME_CONF[@MME_IPV4_ADDRESS_FOR_S11@]='172.16.1.102/24'\n",
    "MME_CONF[@MME_INTERFACE_NAME_FOR_S10@]=\"${IFACE_LOCAL}:m10\"\n",
    "MME_CONF[@MME_IPV4_ADDRESS_FOR_S10@]=\"$IP_S10\"\n",
    "MME_CONF[@OUTPUT@]='CONSOLE'\n",
    "MME_CONF[@SGW_IPV4_ADDRESS_FOR_S11_TEST_0@]='172.16.1.104/24'\n",
    "MME_CONF[@SGW_IPV4_ADDRESS_FOR_S11_0@]='172.16.1.104/24'\n",
    "MME_CONF[@PEER_MME_IPV4_ADDRESS_FOR_S10_0@]='0.0.0.0/24'\n",
    "MME_CONF[@PEER_MME_IPV4_ADDRESS_FOR_S10_1@]='0.0.0.0/24'\n",
    "\n",
    "TAC_SGW_TEST='7'\n",
    "tmph=`echo \"$TAC_SGW_TEST / 256\" | bc`\n",
    "tmpl=`echo \"$TAC_SGW_TEST % 256\" | bc`\n",
    "MME_CONF[@TAC-LB_SGW_TEST_0@]=`printf \"%02x\\n\" $tmpl`\n",
    "MME_CONF[@TAC-HB_SGW_TEST_0@]=`printf \"%02x\\n\" $tmph`\n",
    "MME_CONF[@MCC_SGW_0@]=${MME_CONF[@MCC@]}\n",
    "MME_CONF[@MNC3_SGW_0@]=`printf \"%03d\\n\" $(echo ${MME_CONF[@MNC@]} | sed 's/^0*//')`\n",
    "TAC_SGW_0='1'\n",
    "tmph=`echo \"$TAC_SGW_0 / 256\" | bc`\n",
    "tmpl=`echo \"$TAC_SGW_0 % 256\" | bc`\n",
    "MME_CONF[@TAC-LB_SGW_0@]=`printf \"%02x\\n\" $tmpl`\n",
    "MME_CONF[@TAC-HB_SGW_0@]=`printf \"%02x\\n\" $tmph`\n",
    "MME_CONF[@MCC_MME_0@]=${MME_CONF[@MCC@]}\n",
    "MME_CONF[@MNC3_MME_0@]=`printf \"%03d\\n\" $(echo ${MME_CONF[@MNC@]} | sed 's/^0*//')`\n",
    "TAC_MME_0='1'\n",
    "tmph=`echo \"$TAC_MME_0 / 256\" | bc`\n",
    "tmpl=`echo \"$TAC_MME_0 % 256\" | bc`\n",
    "MME_CONF[@TAC-LB_MME_0@]=`printf \"%02x\\n\" $tmpl`\n",
    "MME_CONF[@TAC-HB_MME_0@]=`printf \"%02x\\n\" $tmph`\n",
    "MME_CONF[@MCC_MME_1@]=${MME_CONF[@MCC@]}\n",
    "MME_CONF[@MNC3_MME_1@]=`printf \"%03d\\n\" $(echo ${MME_CONF[@MNC@]} | sed 's/^0*//')`\n",
    "TAC_MME_1='1'\n",
    "tmph=`echo \"$TAC_MME_1 / 256\" | bc`\n",
    "tmpl=`echo \"$TAC_MME_1 % 256\" | bc`\n",
    "MME_CONF[@TAC-LB_MME_1@]=`printf \"%02x\\n\" $tmpl`\n",
    "MME_CONF[@TAC-HB_MME_1@]=`printf \"%02x\\n\" $tmph`\n",
    "for K in \"${!MME_CONF[@]}\"; do    egrep -lRZ \"$K\" $PREFIX | xargs -0 -l sed -i -e \"s|$K|${MME_CONF[$K]}|g\";   ret=$?;[[ ret -ne 0 ]] && echo \"Tried to replace $K with ${MME_CONF[$K]}\"; done\n",
    "sudo ./check_mme_s6a_certificate $PREFIX/freeDiameter mme.${MME_CONF[@REALM@]}\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Configure with the correct parameters in /usr/local/etc/oai/mme.conf**\n",
    "```\n",
    "NETWORK_INTERFACES :\n",
    "    {\n",
    "        MME_INTERFACE_NAME_FOR_S1_MME   = \"enp6s0\";    \n",
    "        MME_IPV4_ADDRESS_FOR_S1_MME     = \"192.168.15.14/24\";\n",
    "…\n",
    "```\n",
    "}"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Install SPGW-U\n",
    "\n",
    "**Checkout Realeases**\n",
    "```\n",
    "cd ~/openair-cn-cups\n",
    "git checkout v1.0.0 \n",
    "\n",
    "```\n",
    "**Install SPGW-U software dependencies**\n",
    "\n",
    "```\n",
    "cd ~/openair-cn-cups/build/scripts; \\\n",
    "./build_spgwu -I -f\n",
    "```\n",
    "\n",
    "**If the error below was shown, go to Troubleshooting**:\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Build SPGW-U**\n",
    "\n",
    "As a starting point, you can start with a Debug build, then you can change the build type\n",
    "Check build types with './build_spgwu -h'\n",
    "\n",
    "```\n",
    "cd ~/openair-cn-cups/build/scripts; \\\n",
    "./build_spgwu -c -V -b Debug -j\n",
    "```\n",
    "\n",
    "Output is \n",
    "\n",
    "```\n",
    "Clean the build generated files (build from scratch)\n",
    "CMake build process verbose\n",
    "Cleaning S/P-GW-U: generated configuration files, obj files, executable\n",
    "mkdir: created directory 'build'\n",
    "Build type is Debug\n",
    "Architecture is x86_64\n",
    "git found: /usr/bin/git\n",
    "Compilation log for /home/ubuntu/openair-cn-cups/build/spgw_u/build/spgwu is here: /home/ubuntu/openair-cn-cups/build/log/spgwu.txt\n",
    "Scanning dependencies of target 3GPP_COMMON_TYPES\n",
    "[  2%] Building CXX object common/CMakeFiles/3GPP_COMMON_TYPES.dir/logger.cpp.o\n",
    "...\n",
    "[ 97%] Building CXX object CMakeFiles/spgwu.dir/home/ubuntu/openair-cn-cups/src/itti/itti_msg.cpp.o\n",
    "[100%] Linking CXX executable spgwu\n",
    "[100%] Built target spgwu\n",
    "spgwu compiled\n",
    "'/home/ubuntu/openair-cn-cups/build/spgw_u/build/spgwu' -> '/usr/local/bin/spgwu'\n",
    "spgwu installed\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Create SPGW-U configuration files**\n",
    "\n",
    "```\n",
    "IFACE_LOCAL=enp1s0\n",
    "IFACE_NET=enp6s0\n",
    "\n",
    "IP_S1U=192.168.15.18/24\n",
    "\n",
    "cd ~/openair-cn-cups/build/scripts\n",
    "\n",
    "# prompt has been removed for easier Ctrl+C Ctrl+V\n",
    "sudo ip addr add 172.55.55.102/24 dev $IFACE_LOCAL label $IFACE_LOCAL:sxu # SPGW-U SXab interface\n",
    "sudo ip addr add $IP_S1U dev $IFACE_LOCAL label $IFACE_LOCAL:s1u # SPGW-U S1U interface\n",
    "\n",
    "INSTANCE=1\n",
    "PREFIX='/usr/local/etc/oai'\n",
    "sudo mkdir -m 0777 -p $PREFIX\n",
    "cd ~/openair-cn-cups/build/scripts\n",
    "cp ../../etc/spgw_u.conf  $PREFIX\n",
    "\n",
    "declare -A SPGWU_CONF\n",
    "\n",
    "SPGWU_CONF[@INSTANCE@]=$INSTANCE\n",
    "SPGWU_CONF[@PREFIX@]=$PREFIX\n",
    "SPGWU_CONF[@PID_DIRECTORY@]='/var/run'\n",
    "SPGWU_CONF[@SGW_INTERFACE_NAME_FOR_S1U_S12_S4_UP@]=\"$IFACE_LOCAL\"\n",
    "SPGWU_CONF[@SGW_INTERFACE_NAME_FOR_SX@]=\"$IFACE_LOCAL:sxu\"\n",
    "SPGWU_CONF[@SGW_INTERFACE_NAME_FOR_SGI@]=\"$IFACE_NET\"\n",
    "\n",
    "for K in \"${!SPGWU_CONF[@]}\"; do \n",
    "  egrep -lRZ \"$K\" $PREFIX | xargs -0 -l sed -i -e \"s|$K|${SPGWU_CONF[$K]}|g\"\n",
    "  ret=$?;[[ ret -ne 0 ]] && echo \"Tried to replace $K with ${SPGWU_CONF[$K]}\"\n",
    "done\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Important:**\n",
    "\n",
    "**Customize in $PREFIX/spgw_u.conf file the \"SPGW-C_LIST\" and \"PDN_NETWORK_LIST\" sections.**\n",
    "```\n",
    "SPGW-C_LIST = (\n",
    "\t {IPV4_ADDRESS=\"172.55.55.101\";}\n",
    ");\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Install SPGW-C\n",
    "As a starting point, you can start with a Debug build, then you can change the build type\n",
    "Check build types with './build_spgwc -h'\n",
    "\n",
    "```\n",
    "cd ~/openair-cn-cups/build/scripts; \\\n",
    "./build_spgwc -c -V -b Debug -j\n",
    "```\n",
    "\n",
    "Output is \n",
    "\n",
    "```\n",
    "Clean the build generated files (build from scratch)\n",
    "CMake build process verbose\n",
    "Cleaning S/P-GW-C: generated configuration files, obj files, executable\n",
    "mkdir: created directory 'build'\n",
    "Build type is Debug\n",
    "Architecture is x86_64\n",
    "git found: /usr/bin/git\n",
    "Compilation log for /home/ubuntu/openair-cn-cups/build/spgw_c/build/spgwc is here: /home/ubuntu/openair-cn-cups/build/log/spgwc.txt\n",
    "Scanning dependencies of target 3GPP_COMMON_TYPES\n",
    "[  2%] Building CXX object common/CMakeFiles/3GPP_COMMON_TYPES.dir/logger.cpp.o\n",
    "Scanning dependencies of target PGWC\n",
    "...\n",
    "Scanning dependencies of target spgwc\n",
    "[ 92%] Building CXX object CMakeFiles/spgwc.dir/home/ubuntu/openair-cn-cups/src/oai_spgwc/options.cpp.o\n",
    "[ 92%] Building CXX object CMakeFiles/spgwc.dir/home/ubuntu/openair-cn-cups/src/oai_spgwc/main.cpp.o\n",
    "[ 95%] Building CXX object CMakeFiles/spgwc.dir/home/ubuntu/openair-cn-cups/src/itti/itti.cpp.o\n",
    "[ 97%] Building CXX object CMakeFiles/spgwc.dir/home/ubuntu/openair-cn-cups/src/itti/itti_msg.cpp.o\n",
    "[100%] Linking CXX executable spgwc\n",
    "[100%] Built target spgwc\n",
    "spgwc compiled\n",
    "'/home/ubuntu/openair-cn-cups/build/spgw_c/build/spgwc' -> '/usr/local/bin/spgwc'\n",
    "spgwc installed\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Create SPGW-C configuration files**\n",
    "\n",
    "```\n",
    "IFACE_LOCAL=enp1s0\n",
    "\n",
    "cd ~/openair-cn-cups/build/scripts\n",
    "\n",
    "# prompt has been removed for easier Ctrl+C Ctrl+V\n",
    "sudo ip addr add 172.55.55.101 dev ens3 label $IFACE_LOCAL:sxc # SPGW-C SXab interface\n",
    "sudo ip addr add 172.58.58.102 dev ens3 label $IFACE_LOCAL:s5c # SGW-C S5S8 interface\n",
    "sudo ip addr add 172.58.58.101 dev ens3 label $IFACE_LOCAL:p5c # PGW-C S5S8 interface\n",
    "sudo ip addr add 172.16.1.104 dev ens3 label $IFACE_LOCAL:s11 # SGW-C S11 interface\n",
    "\n",
    "INSTANCE=1\n",
    "PREFIX='/usr/local/etc/oai'\n",
    "sudo mkdir -m 0777 -p $PREFIX\n",
    "cp ../../etc/spgw_c.conf  $PREFIX\n",
    "\n",
    "declare -A SPGWC_CONF\n",
    "\n",
    "SPGWC_CONF[@INSTANCE@]=$INSTANCE\n",
    "SPGWC_CONF[@PREFIX@]=$PREFIX\n",
    "SPGWC_CONF[@PID_DIRECTORY@]='/var/run'\n",
    "SPGWC_CONF[@SGW_INTERFACE_NAME_FOR_S11@]=\"$IFACE_LOCAL:s11\"\n",
    "SPGWC_CONF[@SGW_INTERFACE_NAME_FOR_S5_S8_CP@]=\"$IFACE_LOCAL:s5c\"\n",
    "SPGWC_CONF[@PGW_INTERFACE_NAME_FOR_S5_S8_CP@]=\"$IFACE_LOCAL:p5c\"\n",
    "SPGWC_CONF[@PGW_INTERFACE_NAME_FOR_SX@]=\"$IFACE_LOCAL:sxc\"\n",
    "SPGWC_CONF[@DEFAULT_DNS_IPV4_ADDRESS@]='8.8.8.8'\n",
    "SPGWC_CONF[@DEFAULT_DNS_SEC_IPV4_ADDRESS@]='4.4.4.4'\n",
    "\n",
    "for K in \"${!SPGWC_CONF[@]}\"; do \n",
    "  egrep -lRZ \"$K\" $PREFIX | xargs -0 -l sed -i -e \"s|$K|${SPGWC_CONF[$K]}|g\"\n",
    "  ret=$?;[[ ret -ne 0 ]] && echo \"Tried to replace $K with ${SPGWC_CONF[$K]}\"\n",
    "done\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**IMPORTANT:**\n",
    "\n",
    "**Customize in $PREFIX/spgw_c.conf file the \"IP_ADDRESS_POOL\" and \"APN_LIST\" sections.**\n",
    "\n",
    "```\n",
    "APN_LIST = (\n",
    "      {APN_NI = \"default.ng4T.com\"; PDN_TYPE = \"IPv4\"; IPV4_POOL  = 0; IPV6_POOL = -1},\n",
    "      {APN_NI = \"apn1\"; PDN_TYPE = \"IPv4\"; IPV4_POOL = 1; IPV6_POOL = ...\n",
    "    );\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Run EPC Network Functions\n",
    "**Run HSS**\n",
    "\n",
    "```\n",
    "oai_hss -j $PREFIX/hss_rel14.json\n",
    "```\n",
    "Output is \n",
    "```\n",
    "Options::jsonConfig            : /usr/local/etc/oai/hss_rel14.json\n",
    "Options::diameterconfiguration : /usr/local/etc/oai/freeDiameter/hss_rel14_fd.conf\n",
    "Options::cassserver            : 127.0.0.1\n",
    "Options::cassuser              : root\n",
    "Options::casspwd               : root\n",
    "Options::cassdb                : vhss\n",
    "Options::randvector            : 1\n",
    "Options::roamallow             : 1\n",
    "Options::optkey                : 1006020f0a478bf6b699f15c062e42b3\n",
    "Options::reloadkey             : 0\n",
    "Options::onlyloadkey           : 0\n",
    "Options::gtwport               : 9080\n",
    "Options::gtwhost               : *\n",
    "Options::resthost              : 9081\n",
    "Options::synchimsi             : \n",
    "Options::synchauts             : \n",
    "Initialized random\n",
    "12:59:13  NOTI   libfdproto '1.2.1' initialized.\n",
    "12:59:13  NOTI   libgnutls '3.5.18' initialized.\n",
    "12:59:13  NOTI   HASHLIST is enabled\n",
    "...\n",
    "12:59:13  NOTI   Loaded extensions: '/usr/local/lib/freeDiameter/dict_S6c.fdx'[(no config file)], loaded\n",
    "Connecting to cassandra host: 127.0.0.1\n",
    "Registering s6t dictionary\n",
    "Registering s6t command handlers\n",
    "Registering COIR command handler\n",
    "Registering NIIR command handler\n",
    "Registering s6as6d dictionary\n",
    "Registering s6as6d command handlers\n",
    "Registering UPLR command handler\n",
    "Registering AUIR command handler\n",
    "Registering PUUR command handler\n",
    "Registering s6c dictionary\n",
    "Registering s6c command handlers\n",
    "Registering SERIFSR command handler\n",
    "12:59:13  NOTI   Local server address(es): 192.168.123.158{---L-}\n",
    "The freeDiameter engine has been started\n",
    "Started REST server on port [9081]\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Run MME**\n",
    "\n",
    "```\n",
    "./run_mme --config-file $PREFIX/mme.conf --set-virt-if\n",
    "```\n",
    "Output is \n",
    "```\n",
    "setting config file to: /usr/local/etc/oai/mme.conf\n",
    "OPENAIRCN_DIR    = /home/ubuntu/openair-cn\n",
    "Configuring ens3:m1c  192.168.247.102/24\n",
    "Configuring ens3:m11  172.16.1.102/24\n",
    "Configuring ens3:m10  192.168.10.110/24\n",
    "Initializing shared logging\n",
    "Initializing shared logging Done\n",
    "Initializing OAI Logging\n",
    "Initializing OAI logging Done\n",
    "mme_config_parse_opt_line mme_config.config_file /usr/local/etc/oai/mme.conf\n",
    "000006 00000:541475 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1016    ==== EURECOM MME vBranch: master Abrev. Hash: 6a7a8719 Date: Wed May 22 16:11:57 2019 +0200 ====\n",
    "000007 00000:541637 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1018    Built with CMAKE_BUILD_TYPE ................: Debug\n",
    "000008 00000:541810 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1019    Built with DISABLE_ITTI_DETECT_SUB_TASK_ID .: 1\n",
    "000009 00000:541938 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1020    Built with ITTI_TASK_STACK_SIZE ............: 2097152\n",
    "000010 00000:542074 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1021    Built with ITTI_LITE .......................: 0\n",
    "000011 00000:542201 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1022    Built with LOG_OAI .........................: 1\n",
    "000012 00000:542329 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1023    Built with LOG_OAI_CLEAN_HARD ..............: 0\n",
    "000013 00000:542456 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1024    Built with MESSAGE_CHART_GENERATOR .........: 0\n",
    "000014 00000:542589 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1025    Built with PACKAGE_NAME ....................: MME\n",
    "000015 00000:542716 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1026    Built with S1AP_DEBUG_LIST .................: 0\n",
    "000016 00000:542843 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1027    Built with SECU_DEBUG ......................: 1\n",
    "000017 00000:542968 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1028    Built with SCTP_DUMP_LIST ..................: 0\n",
    "000018 00000:543094 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1029    Built with TRACE_HASHTABLE .................: 0\n",
    "000019 00000:543221 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1030    Built with TRACE_3GPP_SPEC .................: 1\n",
    "000020 00000:543349 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1032    Configuration:\n",
    "000021 00000:543476 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1033    - File .................................: /usr/local/etc/oai/mme.conf\n",
    "000022 00000:543604 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1034    - Realm ................................: ng4T.com\n",
    "000023 00000:543753 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1035    - Run mode .............................: BASIC\n",
    "000024 00000:543881 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1036    - Max eNBs .............................: 8\n",
    "000025 00000:544009 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1037    - Max UEs ..............................: 128\n",
    "000026 00000:544136 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1038    - IMS voice over PS session in S1 ......: false\n",
    "000027 00000:544274 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1039    - Emergency bearer services in S1 mode .: false\n",
    "000028 00000:544400 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1040    - Location services via epc ............: false\n",
    "000029 00000:544529 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1041    - Extended service request .............: false\n",
    "000030 00000:544657 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1042    - Unauth IMSI support ..................: false\n",
    "000031 00000:544783 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1043    - Relative capa ........................: 10\n",
    "000032 00000:544918 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1044    - Statistics timer .....................: 10 (seconds)\n",
    "\n",
    "000033 00000:545069 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1045    - S1-MME:\n",
    "000034 00000:545188 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1046        port number ......: 36412\n",
    "000035 00000:545299 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1047    - IP:\n",
    "000036 00000:545418 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1048        s1-MME iface .....: ens3:m1c\n",
    "000037 00000:545530 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1049        s1-MME ip ........: 192.168.247.102\n",
    "000038 00000:545650 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1050        s11 MME iface ....: ens3:m11\n",
    "000039 00000:545761 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1051        s11 MME port .....: 2123\n",
    "000040 00000:545882 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1052        s11 MME ip .......: 172.16.1.102\n",
    "000041 00000:545994 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1053        s10 MME iface ....: ens3:m10\n",
    "000042 00000:546122 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1054        s10 MME port .....: 2123\n",
    "000043 00000:546235 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1055        s10 MME ip .......: 192.168.10.110\n",
    "000044 00000:546354 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1056    - ITTI:\n",
    "000045 00000:546467 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1057        queue size .......: 2000000 (bytes)\n",
    "000046 00000:546587 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1058        log file .........: (null)\n",
    "000047 00000:546699 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1059    - SCTP:\n",
    "000048 00000:546819 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1060        in streams .......: 8\n",
    "000049 00000:546929 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1061        out streams ......: 8\n",
    "000050 00000:547050 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1062    - GUMMEIs (PLMN|MMEGI|MMEC):\n",
    "000051 00000:547161 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1065                208.93 |32768|3 \n",
    "000052 00000:547281 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1068    - TAIs : (mcc.mnc:tac)\n",
    "000053 00000:547391 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1071    - TAI list type one PLMN consecutive TACs\n",
    "000054 00000:547509 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1083                208. 93:600\n",
    "000055 00000:547620 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1083                208. 93:601\n",
    "000056 00000:547800 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1083                208. 93:602\n",
    "000057 00000:547911 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1089    - NAS:\n",
    "000058 00000:548032 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1094        Prefered Integrity Algorithms .: EIA2 EIA1 EIA0 EIA0 (decreasing priority)\n",
    "000059 00000:548143 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1099        Prefered Integrity Algorithms .: EEA0 EEA1 EEA2 EEA0 (decreasing priority)\n",
    "000060 00000:548271 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1100        T3346 ....: 5 min\n",
    "000061 00000:548380 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1101        T3402 ....: 12 min\n",
    "\n",
    "Broadcast message from systemd-journald@test-install-openair-cn (Thu 2019-05-23 14:11:03 UTC):\n",
    "\n",
    "mme[18197]: 000000 00000:541142 7F65369E42C0 DEBUG CONFIG nair-cn/src/mme_app/mme_config.c:1240    Config file is (null)\n",
    "\n",
    "\n",
    "Broadcast message from systemd-journald@test-install-openair-cn (Thu 2019-05-23 14:11:03 UTC):\n",
    "\n",
    "mme[18197]: 000001 00000:541427 7F65369E42C0 INFO  MME-AP nair-cn/src/mme_app/mme_config.c:0791    Parsing configuration file found S1-MME: 192.168.247.102/24 on ens3:m1c\n",
    "\n",
    "000062 00000:550537 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1102        T3412 ....: 54 min\n",
    "000063 00000:550545 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1103        T3422 ....: 6 sec\n",
    "000064 00000:550549 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1104        T3450 ....: 6 sec\n",
    "000065 00000:550553 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1105        T3460 ....: 6 sec\n",
    "000066 00000:550556 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1106        T3470 ....: 6 sec\n",
    "000067 00000:550559 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1107        T3485 ....: 8 sec\n",
    "000068 00000:550562 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1108        T3486 ....: 8 sec\n",
    "000069 00000:550566 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1109        T3489 ....: 4 sec\n",
    "000070 00000:550569 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1110        T3470 ....: 6 sec\n",
    "000071 00000:550572 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1111        T3495 ....: 8 sec\n",
    "000072 00000:550579 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1112        NAS non standart features .:\n",
    "000073 00000:550583 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1113          Force TAU ...................: true\n",
    "000074 00000:550586 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1114          Force reject SR .............: true\n",
    "000075 00000:550590 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1115          Disable Esm information .....: false\n",
    "000076 00000:550593 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1117    - S6A:\n",
    "000077 00000:550596 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1118        conf file ........: /usr/local/etc/oai/freeDiameter/mme_fd.conf\n",
    "000078 00000:550600 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1119    - Logging:\n",
    "000079 00000:550604 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1120        Output ..............: CONSOLE\n",
    "000080 00000:550607 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1121        Output thread safe ..: false\n",
    "000081 00000:550611 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1122        Output with color ...: true\n",
    "000082 00000:550614 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1123        UDP log level........: TRACE\n",
    "000083 00000:550618 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1124        GTPV2-C log level....: TRACE\n",
    "000084 00000:550621 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1125        SCTP log level.......: TRACE\n",
    "000085 00000:550624 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1126        S1AP log level.......: TRACE\n",
    "000086 00000:550628 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1127        ASN1 Verbosity level : 0\n",
    "000087 00000:550631 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1128        NAS log level........: TRACE\n",
    "000088 00000:550635 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1129        MME_APP log level....: TRACE\n",
    "000089 00000:550638 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1130        S10 log level........: INVALID_LOG_LEVEL\n",
    "000090 00000:550642 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1131        S11 log level........: TRACE\n",
    "000091 00000:550645 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1132        S6a log level........: TRACE\n",
    "000092 00000:550649 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1133        UTIL log level.......: TRACE\n",
    "000093 00000:550652 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1134        MSC log level........: ERROR (MeSsage Chart)\n",
    "000094 00000:550656 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1135        ITTI log level.......: ERROR (InTer-Task Interface)\n",
    "000095 00000:550659 7F65369E42C0 INFO  CONFIG nair-cn/src/mme_app/mme_config.c:1136        XML log level........: INVALID_LOG_LEVEL (XML dump/load of messages)\n",
    "\n",
    "Broadcast message from systemd-journald@test-install-openair-cn (Thu 2019-05-23 14:11:03 UTC):\n",
    "\n",
    "mme[18197]: 000002 00000:541441 7F65369E42C0 INFO  MME-AP nair-cn/src/mme_app/mme_config.c:0807    Parsing configuration file found S11: 172.16.1.102/24 on ens3:m11\n",
    "\n",
    " Creating queue of message of size 128\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 256\n",
    " Creating queue of message of size 1024\n",
    " Creating queue of message of size 1024\n",
    " Creating queue of message of size 256\n",
    "\n",
    "Broadcast message from systemd-journald@test-install-openair-cn (Thu 2019-05-23 14:11:03 UTC):\n",
    "\n",
    "mme[18197]: 000003 00000:541448 7F65369E42C0 INFO  MME-AP nair-cn/src/mme_app/mme_config.c:0822    Parsing configuration file found S10: 192.168.10.110/24 on ens3:m10\n",
    "\n",
    "\n",
    "Broadcast message from systemd-journald@test-install-openair-cn (Thu 2019-05-23 14:11:03 UTC):\n",
    "\n",
    "mme[18197]: 000004 00000:541459 7F65369E42C0 INFO  MME-AP nair-cn/src/mme_app/mme_config.c:0962    Parsing configuration file found S-GW S11: 172.16.1.104\n",
    "\n",
    "\n",
    "Broadcast message from systemd-journald@test-install-openair-cn (Thu 2019-05-23 14:11:03 UTC):\n",
    "\n",
    "mme[18197]: 000005 00000:541465 7F65369E42C0 INFO  MME-AP nair-cn/src/mme_app/mme_config.c:0962    Parsing configuration file found S-GW S11: 172.16.1.104\n",
    "\n",
    "000096 00000:569138 7F65369E42C0 DEBUG NAS    ir-cn/src/nas/emm/nas_emm_task.c:0171    Initializing NAS EMM task interface\n",
    "000097 00000:569177 7F65369E42C0 TRACE NAS-EM penair-cn/src/nas/emm/emm_main.c:0092    Entering emm_main_initialize()\n",
    "000098 00000:569193 7F65369E42C0 TRACE NAS    air-cn/src/nas/api/mme/mme_api.c:0120      Entering mme_api_get_emm_config()\n",
    "000099 00000:569204 7F65369E42C0 TRACE NAS    air-cn/src/nas/api/mme/mme_api.c:0250      Leaving mme_api_get_emm_config() (rc=0)\n",
    "000100 00000:569225 7F65369E42C0 TRACE NAS-EM penair-cn/src/nas/emm/emm_main.c:0109    Leaving emm_main_initialize()\n",
    "...\n",
    "...\n",
    "...\n",
    "000287 00000:642737 7F6525FFB700 ERROR S6A    tu/openair-cn/src/s6a/s6a_task.c:0089    ...... 00000:642735 7F6525FFB700 LEVEL S6A --no source file-- No TLS protection negotiated with peer 'hss.ng4T.com'.\n",
    "000288 00000:642765 7F6525FFB700 ERROR S6A    tu/openair-cn/src/s6a/s6a_task.c:0089    ...... 00000:642763 7F6525FFB700 LEVEL S6A --no source file-- 'STATE_WAITCEA'\t-> 'STATE_OPEN'\t'hss.ng4T.com'\n",
    "000289 00001:636354 7F64DDFFB700 DEBUG S6A    tu/openair-cn/src/s6a/s6a_peer.c:0116    Diameter identity of MME: mme.ng4T.com with length: 12\n",
    "000290 00001:636400 7F64DDFFB700 DEBUG S6A    tu/openair-cn/src/s6a/s6a_peer.c:0151    S6a peer connection attempt 1 / 8\n",
    "000291 00001:636417 7F64DDFFB700 DEBUG S6A    tu/openair-cn/src/s6a/s6a_peer.c:0164    Peer hss.ng4T.com is now connected...\n",
    "000292 00001:636597 7F652E9EF700 DEBUG SCTP   rc/sctp/sctp_primitives_server.c:0674    Received SCTP_INIT_MSG\n",
    "000293 00001:636621 7F652E9EF700 DEBUG SCTP   rc/sctp/sctp_primitives_server.c:0320    Creating new listen socket on port 36412 with\n",
    "000294 00001:636626 7F652E9EF700 DEBUG SCTP   rc/sctp/sctp_primitives_server.c:0325    ipv4 addresses:\n",
    "000295 00001:636632 7F652E9EF700 DEBUG SCTP   rc/sctp/sctp_primitives_server.c:0334    \t- 192.168.247.102\n",
    "000296 00010:580341 7F6527FFF700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0045    ======================================= STATISTICS ============================================\n",
    "\n",
    "000297 00010:580364 7F6527FFF700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0046                   |   Current Status| Added since last display|  Removed since last display |\n",
    "000298 00010:580370 7F6527FFF700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0048    Connected eNBs |          0      |              0              |             0               |\n",
    "000299 00010:580375 7F6527FFF700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0050    Attached UEs   |          0      |              0              |             0               |\n",
    "000300 00010:580379 7F6527FFF700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0052    Connected UEs  |          0      |              0              |             0               |\n",
    "000301 00010:580384 7F6527FFF700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0054    Default Bearers|          0      |              0              |             0               |\n",
    "000302 00010:580388 7F6527FFF700 DEBUG MME-AP src/mme_app/mme_app_statistics.c:0056    S1-U Bearers   |          0      |              0              |             0               |\n",
    "...\n",
    "...\n",
    "\n",
    "```\n",
    "\n",
    "\n",
    "**Run SPGW-C**\n",
    "\n",
    "Run SPGW-C prior to SPGW-U.\n",
    "```\n",
    "ubuntu@test-install-openair-cn:~/openair-cn-cups/build/scripts$ sudo spgwc -c $PREFIX/spgw_c.conf\n",
    "\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "**Run SPGW-U**\n",
    "\n",
    "**Reminder: Run SPGW-C prior to SPGW-U.**\n",
    "\n",
    "You will have to do the following only once, each time you power on your host if you want to set a specific gateway for user traffic:\n",
    "\n",
    "```\n",
    "echo '200 lte' | sudo tee --append /etc/iproute2/rt_tables\n",
    "# Here the gateway is at 192.168.78.245\n",
    "sudo ip r add default via 192.168.78.245 dev ens10 table lte\n",
    "# you will have to repeat the following line for each PDN network set in your SPGW-U config file\n",
    "sudo ip rule add from 12.0.0.0/8 table lte\n",
    "```\n",
    "\n",
    "\n",
    "```\n",
    "ubuntu@test-install-openair-cn:~/openair-cn-cups/build/scripts$ sudo spgwu -c $PREFIX/spgw_u.conf\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## EPC Deployment Automatization using tmux \n",
    "See https://github.com/navarrothiago/masters/blob/master/scripts/oai-session.sh"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# RAN\n",
    "* https://gitlab.eurecom.fr/oai/openairinterface5g/wikis/OpenAirUsage\n",
    "\n",
    "## EnodeB\n",
    "\n",
    "Features: https://gitlab.eurecom.fr/oai/openairinterface5g/blob/master/doc/FEATURE_SET.md\n",
    "\n",
    "### EnodeB + USRP [WIP]\n",
    "\n",
    "See:\n",
    "* https://gitlab.eurecom.fr/oai/openairinterface5g/blob/develop/doc/BUILD.md\n",
    "* https://kb.ettus.com/Getting_Started_with_4G_LTE_using_Eurecom_OpenAirInterface_(OAI)_on_the_USRP_2974\n",
    "\n",
    "### E-UTRAN\n",
    "See https://gitlab.eurecom.fr/oai/openairinterface5g/blob/master/targets/DOCS/E-UTRAN_User_Guide.pdf\n",
    "\n",
    "### Configuration [WIP]\n",
    "\n",
    "```\n",
    "sudo apt install git\n",
    "git clone https://gitlab.eurecom.fr/oai/openairinterface5g.git\n",
    "cd openairinterface5g\n",
    "source oaienv\n",
    "cd cmake_targets\n",
    "./build_oai -I -w USRP\n",
    "```\n",
    "\n",
    "### Build eNodeB\n",
    "```\n",
    "./build_oai --eNB -c -w USRP\n",
    "```\n",
    "\n",
    "### Configuration\n",
    "\n",
    "Go to _~/openairinterface5g/ci-scripts/conf_files/enb.band28.conf_ and set the following parameters\n",
    "```\n",
    "eutra_band 28\n",
    "downlink_frequency 763000000L\n",
    "uplink_frequency_offset -55000000\n",
    "mcc 724\n",
    "mnc 99\n",
    "mme_ip_address 192.168.15.14\n",
    "ENB_IPV4_ADDRESS_FOR_S1_MME 192.168.15.7\n",
    "ENB_IPV4_ADDRESS_FOR_S1U 192.168.15.7\n",
    "```\n",
    "### Connect COTS UE with OAI EnodeB\n",
    "\n",
    "See https://gitlab.eurecom.fr/oai/openairinterface5g/wikis/HowToConnectCOTSUEwithOAIeNBNew\n",
    "\n",
    "### OAISIM [WIP]\n",
    "\n",
    "See https://gitlab.eurecom.fr/oai/openairinterface5g/wikis/OpenAirLTEEmulation  \n",
    "\n",
    "**It also shows the OAISIM requirement:  more  than  60%  of  CPU  usage  when  compared with  the use  of  a real UE, since  all  UE baseband  processing is executed within RRH unit in the machine CPU**. [[ref](https://arxiv.org/pdf/2001.08992.pdf)]."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### USRP B210\n",
    "\n",
    "* https://kb.ettus.com/B200/B210/B200mini/B205mini_Getting_Started_Guides\n",
    "* https://kb.ettus.com/Getting_Started_with_4G_LTE_using_Eurecom_OpenAirInterface_(OAI)_on_the_USRP_2974\n",
    "* [Mobile Country Code and Mobile Network Code](https://www.mcc-mnc.com/)\n",
    "\n",
    "## UE\n",
    "* 5972\n",
    "* 5960"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Ecosystem OpenAirInterface [WIP]\n",
    "\n",
    "See https://www.openairinterface.org/?page_id=864\n",
    "https://github.com/OPENAIRINTERFACE/openair-cn/wiki/Full-Deployment-of-OAI-system\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Tools\n",
    "* [bmon](https://www.tecmint.com/bmon-network-bandwidth-monitoring-debugging-linux/)\n",
    "* [T-Tracer](https://gitlab.eurecom.fr/oai/openairinterface5g/wikis/T/basic)\n",
    "* [text analysis tool](https://textanalysistool.github.io/) \n",
    "\n",
    "\n",
    "### Text Analysis Tool\n",
    "#### Install winetricks\n",
    "https://wiki.winehq.org/Winetricks\n",
    "\n",
    "```\n",
    "cd \"${HOME}/Downloads\"\n",
    "wget  https://raw.githubusercontent.com/Winetricks/winetricks/master/src/winetricks\n",
    "chmod +x winetricks\n",
    "```\n",
    "\n",
    "#### Install dotnet40\n",
    "```\n",
    "winetricks dotnet40\n",
    "```\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Knowlogde\n",
    "### Use Cases\n",
    "* Initial attach procedure in a 4G network the UE establishes radio linksynchronization\n",
    "![Initial attach procedure in a 4G network the UE establishes radio linksynchronization](https://www.researchgate.net/profile/Mohammad_Al_Shinwan2/publication/315747469/figure/fig9/AS:668384274419714@1536366637273/Initial-attach-procedure-in-a-4G-network-the-UE-establishes-radio-link-synchronization.ppm)\n",
    "\n",
    "![Initial attach procedure in a 4G network the UE establishes radio link synchronization](https://72a777af-a-62cb3a1a-s-sites.googlegroups.com/site/amitsciscozone/home/lte-notes/default-bearer-setup/Default%20Bearer%20Setup.png?attachauth=ANoY7cpfXEzrklZ6E3BHUfmcZNpWGtPqKt5u7GCYlqFssQo1oRHcbx1bFBEl7Ft6d2dm80UNLW9wE-u9YICrt9Bwj4rpfjE-WL4tWMwcS-kBZ6QibvmvlPrbGXIGdlIR4KI-_8P7KkeWyKUWlkNmFIjmF2CE_7kR0pigwFVty8SpjBWZMffZ76m_WcHzkbQYIcoqUuKR6rRvfd_GxbbyoQYUnegvkrKt2n1SgCDOkihp0sUjVRu3LNY46xibajp658HvVqPKrV5DeyAT9z6hyiydT8zfjdH0mA%3D%3D&attredirects=0)\n",
    "\n",
    "https://sites.google.com/site/amitsciscozone/home/lte-notes/default-bearer-setup\n",
    "\n",
    "###  What is bearer\n",
    "http://www.simpletechpost.com/2012/05/default-bearer-dedicated-bearer-what.html"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Troubleshooting\n",
    "\n",
    "### Install HSS \n",
    "#### Error when execute ./build_cassandra --check-installed-software --force\n",
    "**~~TODO: Check if JAVA installation really needs. The cassandra install open _java-8-openjdk-amd64_ package.~~**   \n",
    "**CHECKED!! JAVA is intalled with cassandra package. DO NOT NEED TO INTALL IT!!**\n",
    "\n",
    "Fix: https://github.com/OPENAIRINTERFACE/openair-cn/pull/93 or you can see other solution in the sections below.\n",
    "\n",
    "\n",
    "#### How to Install Oracle JAVA JDK8 on Ubuntu\n",
    "https://github.com/navarrothiago/masters/blob/master/scripts/download_install_jdk.sh\n",
    "\n",
    "#### Check Oracle JAVA JDK8 on Ubuntu\n",
    "```\n",
    "java -version\n",
    "```\n",
    "The output of the command above should be: \n",
    "```\n",
    "java version \"1.8.0_241\"\n",
    "Java(TM) SE Runtime Environment (build 1.8.0_241-b07)\n",
    "Java HotSpot(TM) 64-Bit Server VM (build 25.241-b07, mixed mode)\n",
    "```\n",
    "\n",
    "#### Cassandra - no valid OpenPGP data found\n",
    "Updates https://github.com/OPENAIRINTERFACE/openair-cn/blob/master/build/tools/build_helper.cassandra\n",
    "```\n",
    "sed -i 's+https://www.apache.org/dist/cassandra/KEYS+https://downloads.apache.org/cassandra/KEYS+g' ../build/tools/build_helper.cassandra \n",
    "```\n",
    "or\n",
    "```\n",
    "Replace\n",
    "curl https://www.apache.org/dist/cassandra/KEYS | $SUDO  apt-key add - \n",
    "with\n",
    "curl https://downloads.apache.org/cassandra/KEYS | $SUDO apt-key add -  \n",
    "```\n",
    "\n",
    "#### Cannot achieve consistency level LOCAL_ONE\n",
    "Other problem is shown below\n",
    "```\n",
    "cd ~/openair-cn/scripts/\n",
    "Cassandra_Server_IP='127.0.0.1'\n",
    "cqlsh --file ../src/hss_rel14/db/oai_db.cql $Cassandra_Server_IP\n",
    "openair-cn@openair-cn-vm:~/openair-cn/scripts$ ./data_provisioning_users --apn default.ng4T.com --apn2 internet --key fec86ba6eb707ed08905757b1bb44b8f --imsi-first 208931234561000 --msisdn-first 001011234561000 --mme-identity mme.ng4T.com --no-of-users 20 --realm ng4T.com --truncate True  --verbose True --cassandra-cluster $Cassandra_Server_IP\n",
    "\n",
    "Traceback (most recent call last):\n",
    "  File \"./data_provisioning_users\", line 178, in <module>\n",
    "    main()\n",
    "  File \"./data_provisioning_users\", line 155, in main\n",
    "    '{\"Subscription-Data\":{\"Access-Restriction-Data\":41,\"Subscriber-Status\":0,\"Network-Access-Mode\":2,\"Regional-Subscription-Zone-Code\":[\"0x0123\",\"0x4567\",\"0x89AB\",\"0xCDEF\",\"0x1234\",\"0x5678\",\"0x9ABC\",\"0xDEF0\",\"0x2345\",\"0x6789\"],\"MSISDN\":\"0x'+str(msisdn)+'\",\"AMBR\":{\"Max-Requested-Bandwidth-UL\":50000000,\"Max-Requested-Bandwidth-DL\":100000000},\"APN-Configuration-Profile\":{\"Context-Identifier\":0,\"All-APN-Configurations-Included-Indicator\":0,\"APN-Configuration\":{\"Context-Identifier\":0,\"PDN-Type\":0,\"Service-Selection\":\"'+args.apn+'\",\"EPS-Subscribed-QoS-Profile\":{\"QoS-Class-Identifier\":9,\"Allocation-Retention-Priority\":{\"Priority-Level\":15,\"Pre-emption-Capability\":0,\"Pre-emption-Vulnerability\":0}},\"AMBR\":{\"Max-Requested-Bandwidth-UL\":50000000,\"Max-Requested-Bandwidth-DL\":100000000},\"PDN-GW-Allocation-Type\":0,\"MIP6-Agent-Info\":{\"MIP-Home-Agent-Address\":[\"172.26.17.183\"]}},\"APN-Configuration\":{\"Context-Identifier\":0,\"PDN-Type\":0,\"Service-Selection\":\"'+args.apn2+'\",\"EPS-Subscribed-QoS-Profile\":{\"QoS-Class-Identifier\":9,\"Allocation-Retention-Priority\":{\"Priority-Level\":13,\"Pre-emption-Capability\":1,\"Pre-emption-Vulnerability\":0}},\"AMBR\":{\"Max-Requested-Bandwidth-UL\":50000000,\"Max-Requested-Bandwidth-DL\":100000000},\"PDN-GW-Allocation-Type\":0,\"MIP6-Agent-Info\":{\"MIP-Home-Agent-Address\":[\"172.26.17.183\"]}}},\"Subscribed-Periodic-RAU-TAU-Timer\":0}}'\n",
    "  File \"/usr/lib/python3/dist-packages/cassandra/cluster.py\", line 1998, in execute\n",
    "    return self.execute_async(query, parameters, trace, custom_payload, timeout, execution_profile, paging_state).result()\n",
    "  File \"/usr/lib/python3/dist-packages/cassandra/cluster.py\", line 3781, in result\n",
    "    raise self._final_exception\n",
    "cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {<Host: 127.0.0.1 dc1>: Unavailable('Error from server: code=1000 [Unavailable exception] message=\"Cannot achieve consistency level LOCAL_ONE\" info={\\'consistency\\': \\'LOCAL_ONE\\', \\'required_replicas\\': 1, \\'alive_replicas\\': 0}',)})\n",
    "openair-cn@openair-cn-vm:~/openair-cn/scripts$ \n",
    "\n",
    "```\n",
    " After change cassandra configuration (**/etc/cassandra/cassandra.yaml**) according to commands below, it works!\n",
    "```\n",
    "endpoint_snitch: SimpleSnitch\n",
    "#endpoint_snitch: GossipingPropertyFileSnitch\n",
    "```\n",
    "\n",
    "If you already have this configuration, see the database file in **../src/hss_rel14/db/oai_db.cql** and check if the name the datacenter is _datacenter1_. The first line should be:\n",
    "```\n",
    "CREATE KEYSPACE IF NOT EXISTS vhss WITH replication = {'class': 'NetworkTopologyStrategy', 'datacenter1': '1'};\n",
    "```\n",
    "This name is the same when you run _nodetool status_\n",
    "```\n",
    "epc@epc-vm:~/openair-cn/scripts$ nodetool status\n",
    "Datacenter: datacenter1\n",
    "=======================\n",
    "Status=Up/Down\n",
    "|/ State=Normal/Leaving/Joining/Moving\n",
    "--  Address    Load       Tokens  Owns (effective)  Host ID                               Rack\n",
    "UN  127.0.0.1  339.73 KB  256     100,0%            b87fc37f-b416-43f9-9a81-06476ec2a3b7  rack1\n",
    "\n",
    "```\n",
    "**Then, clean everything**\n",
    "\n",
    "```\n",
    "sudo service cassandra stop\n",
    "sudo rm -rf /var/lib/cassandra/data/system/*\n",
    "sudo rm -rf /var/lib/cassandra/commitlog/*\n",
    "sudo rm -rf /var/lib/cassandra/data/system_traces/*\n",
    "sudo rm -rf /var/lib/cassandra/saved_caches/*\n",
    "sudo service cassandra start\n",
    "```\n",
    "\n",
    "Finally, run the command again\n",
    "```\n",
    "cd ~/openair-cn/scripts; \\\n",
    "Cassandra_Server_IP='127.0.0.1'; \\\n",
    "cqlsh --file ../src/hss_rel14/db/oai_db.cql $Cassandra_Server_IP; \\\n",
    "./data_provisioning_users --apn oai.ipv4 --apn2 internet --key fec86ba6eb707ed08905757b1bb44b8f --imsi-first 208931234561000 --msisdn-first 001011234561000 --mme-identity mme.openairinterface.org --no-of-users 20 --realm openairinterface.org --truncate True  --verbose True --cassandra-cluster $Cassandra_Server_IP\n",
    "\n",
    "\n",
    "```\n",
    "#### Failed opening file logs/hss.log for writing: No such file or directory \n",
    "Open this file\n",
    "```\n",
    "sudo vim /usr/local/etc/oai/hss_rel14.json\n",
    "```\n",
    "you will see some config where you can find logs/hss.log\n",
    "\n",
    "actually you have to change these 4 value to\n",
    "```\n",
    "logname: \"/var/log/hss.log\"\n",
    "statlogname: \"/var/log/hss_stat.log\"\n",
    "auditlogname: \"/var/log/hss_audit.log\"\n",
    "ossfile: \"~/openair-cn/etc/oss.json\"\n",
    "```\n",
    "then use <i>sudo touch</i> to create these files\n",
    "```\n",
    "sudo touch /var/log/hss.log\n",
    "sudo touch /var/log/hss_stat.log\n",
    "sudo touch /var/log/hss_audit.log\n",
    "\n",
    "or\n",
    "\n",
    "touch /usr/local/etc/oai/log/hss.log\n",
    "touch /usr/local/etc/oai/log/hss_stat.log\n",
    "touch /usr/local/etc/oai/log/hss_audit.log\n",
    "\n",
    "sed -i 's+logs/+/var/log/+g' /usr/local/etc/oai/hss_rel14.json\n",
    "\n",
    "```\n",
    "for logname, statlogname, and auditlogname you can change it to whatever file you want but i like to put them together in /var/log folder.\n",
    "for ossfile , the oss.json is actually in there.\n",
    "hope this help\n",
    "\n",
    "### Cassandra Startup Error - java.io.FileNotFoundException: /var/log/cassandra/system.log (Permission denied)\n",
    "Run the command in order to see if there are any error\n",
    "```\n",
    "dmesg|grep cassandra\n",
    "```\n",
    "If you found the error described in the section, run \n",
    "```\n",
    "sudo chown -R cassandra:cassandra /var/lib/cassandra/\n",
    "```\n",
    "\n",
    "### Cassandra Startup Error - org.apache.cassandra.exceptions.ConfigurationException: Saved cluster name xxxx != yyyyy\n",
    "\n",
    "Run the command in order to see if there are any error\n",
    "```\n",
    "dmesg|grep cassandra\n",
    "```\n",
    "Stop Cassandra and cleanup the log files before modifying the configuration\n",
    "\n",
    "```\n",
    "sudo service cassandra stop\n",
    "sudo rm -rf /var/lib/cassandra/data/system/*\n",
    "sudo rm -rf /var/lib/cassandra/commitlog/*\n",
    "sudo rm -rf /var/lib/cassandra/data/system_traces/*\n",
    "sudo rm -rf /var/lib/cassandra/saved_caches/*\n",
    "```\n",
    "\n",
    "Check the **/etc/cassandra/cassandra.yaml** if the cluster_name is what you have programed"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Install SPGW-U\n",
    "#### _CMake Error at CMake/folly-deps.cmake:213 \\n No \"Findfmt.cmake\" foun in CMAKE_MODULE_PATH\n",
    "If the error is shown when execute the command below\n",
    "```\n",
    "ubuntu@test-install-openair-cn:~/openair-cn-cups/build/scripts$ ./build_spgwu -I -f\n",
    "```\n",
    "execute the following steps\n",
    "```\n",
    "cd ~\n",
    "git clone https://github.com/fmtlib/fmt.git && cd fmt\n",
    "mkdir _build && cd _build\n",
    "cmake ..\n",
    "make -j$(nproc)\n",
    "sudo make install\n",
    "```\n",
    "\n",
    "### Run HSS\n",
    "### mme.localdomain: Going to ZOMBIE state (no more activity) \n",
    "\n",
    "Ignore it. See https://github.com/omec-project/c3po/issues/29\n",
    "### Run eNodeB\n",
    "#### [SIAP] Unknown procedure ID (17) for initiating message\n",
    "\n",
    "This errror may occur when you configure wrong the ursp.conf parameters. Check these ones if it is correct:\n",
    "* ENB_IPV4_ADDRESS_FOR_S1_MME\n",
    "* ENB_IPV4_ADDRESS_FOR_S1U\n",
    "* mme_ip_address\n",
    "\n",
    "### Error ERROR_CODE_OVERFLOW (Overflow)\n",
    "See  See https://gitlab.eurecom.fr/oai/openairinterface5g/wikis/HowToConnectCOTSUEwithOAIeNBNew#issue-5-usrp-exits-saying-it-receivedtransmitted-x-samples-out-of-xxxxx\n",
    "```\n",
    "[PHY][E]rx_rf: Asked for 15360 samples, got 13824 from USRP\n",
    "```\n",
    "It could be releated to USB2.0 .Change it to USB 3.0\n",
    "https://gitlab.eurecom.fr/oai/openairinterface5g/issues/328\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### DIAMETER_AUTHENTICATION_DATA_UNAVAILABLE\n",
    "```\n",
    "EMM-PROC  - EMM context for the ue_id=1 missing valid and active EPS security context. \n",
    "\n",
    "\n",
    "0663 00255:254087 7F63A3FFF700 DEBUG S6A    enair-cn/src/s6a/s6a_auth_info.c:0392    s6a_generate_authentication_info_req plmn: 27F499\n",
    "000664 00255:254102 7F63A3FFF700 DEBUG S6A    enair-cn/src/s6a/s6a_auth_info.c:0393    s6a_generate_authentication_info_req visited_plmn: 27F499\n",
    "000665 00255:256503 7F640AFFD700 DEBUG S6A    enair-cn/src/s6a/s6a_auth_info.c:0230    Received S6A Authentication Information Answer (AIA)\n",
    "000666 00255:256534 7F640AFFD700 ERROR S6A    c/openair-cn/src/s6a/s6a_error.c:0052    Got experimental error 4181:DIAMETER_AUTHENTICATION_DATA_UNAVAILABLE\n",
    "000667 00255:256619 7F6419AB7700 TRACE NAS-EM ir-cn/src/nas/emm/nas_emm_proc.c:0297      Entering nas_proc_authentication_info_answer()\n",
    "000668 00255:256635 7F6419AB7700 DEBUG NAS-EM ir-cn/src/nas/emm/nas_emm_proc.c:0305         Handling imsi 724990000001048\n",
    "000669 00255:256643 7F6419AB7700 INFO  NAS-EM ir-cn/src/nas/emm/emm_data_ctx.c:0662         EMM-CTX - get UE id 1 context 0x7f6380002d40\n",
    "000670 00255:256647 7F6419AB7700 DEBUG NAS-EM ir-cn/src/nas/emm/emm_data_ctx.c:0684         EMM-CTX - get UE id 1 context 0x7f6380002d40 by imsi 724990000001048\n",
    "000671 00255:256651 7F6419AB7700 ERROR NAS-EM ir-cn/src/nas/emm/nas_emm_proc.c:0326         INFORMING NAS ABOUT AUTH RESP ERROR CODE\n",
    "000672 00255:256655 7F6419AB7700 TRACE NAS-EM ir-cn/src/nas/emm/nas_emm_proc.c:0374         Entering nas_proc_auth_param_fail()\n",
    "000673 00255:256662 7F6419AB7700 TRACE NAS-EM air-cn/src/nas/emm/sap/emm_sap.c:0120            Entering emm_sap_send()\n",
    "000674 00255:256666 7F6419AB7700 TRACE NAS-EM nair-cn/src/nas/emm/sap/emm_cn.c:0347               Entering emm_cn_send()\n",
    "000675 00255:256672 7F6419AB7700 INFO  NAS-EM nair-cn/src/nas/emm/sap/emm_cn.c:0348                  EMMCN-SAP - Received primitive EMM_CN_AUTHENTICATION_PARAM_FAIL (402)\n",
    "000676 00255:256679 7F6419AB7700 TRACE NAS-EM nair-cn/src/nas/emm/sap/emm_cn.c:0124                  Entering _emm_cn_authentication_fail()\n",
    "000677 00255:256685 7F6419AB7700 INFO  NAS-EM ir-cn/src/nas/emm/emm_data_ctx.c:0662                     EMM-CTX - get UE id 1 context 0x7f6380002d40\n",
    "000678 00255:256692 7F6419AB7700 TRACE NAS-EM -cn/src/nas/emm/Authentication.c:0483                     Entering _auth_info_proc_failure_cb()\n",
    "000679 00255:256698 7F6419AB7700 TRACE NAS-EM src/nas/emm/nas_emm_procedures.c:0556                        UE 1 Delete AUTH INFO procedure\n",
    "000680 00255:256722 7F6419AB7700 DEBUG NAS-EM ir-cn/src/nas/emm/emm_data_ctx.c:1136                        Ts6a_auth_info stopped UE 1\n",
    "000681 00255:256734 7F6419AB7700 TRACE NAS-EM src/nas/emm/nas_emm_procedures.c:0613                        UE 1 Delete CN procedure 0x7f6380003820\n",
    "000682 00255:256744 7F6419AB7700 TRACE NAS-EM /openair-cn/src/nas/emm/Attach.c:1257                        Entering _emm_attach_failure_authentication_cb()\n",
    "000683 00255:256756 7F6419AB7700 TRACE NAS-EM /openair-cn/src/nas/emm/Attach.c:0982                           Entering _emm_attach_reject()\n",
    "000684 00255:256768 7F6419AB7700 WARNI NAS-EM /openair-cn/src/nas/emm/Attach.c:0985                              EMM-PROC  - EMM attach procedure not accepted by the network (ue_id=1, cause=2)\n",
    "000685 00255:256782 7F6419AB7700 WARNI NAS-EM /openair-cn/src/nas/emm/Attach.c:1000                              EMM-PROC  - ESM message is missing but attach reject reason due ESM. Continuing with attach reject.\n",
    "000686 00255:256795 7F6419AB7700 INFO  NAS-EM ir-cn/src/nas/emm/emm_data_ctx.c:0662                              EMM-CTX - get UE id 1 context 0x7f6380002d40\n",
    "000687 00255:256808 7F6419AB7700 TRACE NAS-EM nair-cn/src/nas/emm/LowerLayer.c:0531                              Entering emm_as_set_security_data()\n",
    "```\n",
    "\n",
    "Otherwise, if no corresponding pre-computed AV is available, and the AuC is unable to calculate any corresponding AVs due to unknown failures, such as the internal database error, the result code shall be set to DIAMETER_AUTHENTICATION_DATA_UNAVAILABLE. \n",
    "\n",
    "**Check the ./data_provisioning_users parameters. The parameter truncate true means that the table will be deleted**\n",
    "\n",
    "**After that, do not forget to rur load the key with the option --only-key**"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.6"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}