Backbase assignment QA Engineer

Toolkit used

• Driver: Protractor
• BDD: Cucumberjs (GitHub)
• Assertions: Chai and Chai Smoothie
• Non-Functional testing: Lighthouse
• Ad-hoc load testing: Artillery

Prerequisites

• To run the regression tests Node.js is required https://nodejs.org/en/.

• The application under test is: Sample Computer Database. This application needs to be available in order for the tests to run. Sometimes the application is down (503 response).

Setup

Run the following commands from the project root:

npm i

Run regression tests

The e2e tests are run headless in Google Chrome (using Chrome Mobile Simulation for the mobile devices).

• Desktop
• Nexus 7
• iPhone 4
• iPad

---

Known errors:

• the ordering of tables is broken, after clicking a table header to order that column the data is not ordered.

Known errors are tagged by @bug, they are excluded from the regression test until the are fixed.

---

To run these e2e regression tests:

npm run test:e2e

The reports of the regression tests can be found in de reports directory.

/reports/e2e/index.html

Run non-functional tests

To get some non-functional feedback, run Google lighthouse.

npm run test:lighthouse

Run load tests

To run an ad-hoc load test run artillery.

npm run test:artillery

Run HTML validator

To run a w3c HTML validator against the computer database site.

npm run test:validate-html

Manual test cases

A PDF file with manual test cases can be found here:

/manual/TestCases.pdf

Todo

• Make the e2e regression tests for the different device simulations run parralel. When I do this now, the reporting is broken.