pytest_mozwebqa

pytest_mozwebqa is a plugin for py.test that provides additional features needed for Mozilla's WebQA projects.

Requires:

• py.test
• selenium
• pyyaml
• requests

Continuous Integration

Installation

$ python setup.py install

Running tests with pytest_mozwebqa

Usage: py.test [options] [file_or_dir] [file_or_dir] [...]

For full usage details run py.test --help.

Configuration

You can also create a mozwebqa.cfg file that will be used to set defaults. This is so that projects can keep this alongside the tests to simplify running them via the command line. The options are currently limited to those that could be project specific.

[DEFAULT]
baseurl: 'http://www.example.com'
api: 'rc'
tags: 'tag1, tag2'
privacy: 'public restricted'

The tags entry is an optional comma separated list of tags that are set when using Sauce Labs. This is useful for filtering the list of jobs based on the application under test or similar.

The privacy entry is used to determine who you share your Sauce Labs jobs with. Check the documentation for the accepted values. This defaults to public restricted.

Examples

Run tests against a standalone RC server using Firefox in the default location:

$ py.test --baseurl=http://example.com --api=rc --browser="*firefox"

Run tests against a grid server with an RC node environment named 'Firefox 5 on Mac OS X':

$ py.test --baseurl=http://example.com --api=rc --environment="Firefox 5 on Mac OS X"

Run tests against a local webdriver using Firefox:

$ py.test --baseurl=http://example.com --driver=firefox --firefoxpath=/Applications/Firefox.app/Contents/MacOS/firefox-bin

Run tests against a local webdriver using Google Chrome:

$ py.test --baseurl=http://example.com --driver=chrome --chromepath=/Applications/chromedriver

Run tests against a remote webdriver server either directly or via grid:

$ py.test --baseurl=http://example.com --browsername=firefox --browserver=5 --platform=mac

Run tests against Sauce Labs using RC API using Firefox 5 on Windows 2003:

$ py.test --baseurl=http://example.com --api=rc --browsername=firefox --browserver=5.0 --platform="Windows 2003" --saucelabs=sauce_labs.yaml

Run tests against Sauce Labs using webdriver API using Firefox 5 on Windows:

$ py.test --baseurl=http://example.com --browsername=firefox --browserver=5.0 --platform=WINDOWS --saucelabs=sauce_labs.yaml

Run tests against Sauce Labs (Mobile Web Application) using webdriver API using Default Browser on Android with Appium:

$ py.test --baseurl=http://example.com --browsername=browser --platformver=4.4 --platform=android --device=Android --appium=1.2.2 --saucelabs=sauce_labs.yaml

Writing tests for pytest_mozwebqa

You will need to include the mozwebqa in the method signature for your tests, and pass it when constructing page objects.

Example

def test_new_user_can_register(self, mozwebqa):
    home_pg = home_page.HomePage(mozwebqa)
    home_pg.go_to_home_page()
    home_pg.login_region.click_sign_up()

    registration_pg = registration_page.RegistrationPage(mozwebqa)
    registration_pg.register_new_user()
    Assert.equal(registration_pg.page_title, "Sign Up Complete!")

Destructive tests

In order to prevent accidentally running destructive tests, only tests marked as nondestructive will run by default. If you want to mark a test as nondestructive then add the appropriate marker as shown below:

Example (mark test as nondestructive)

import pytest
@pytest.mark.nondestructive
def test_safely(self, mozwebqa):
    ...

If you want to run destructive tests then you can specify the --destructive command line option.

Sensitive environments

If running against a sensitive (production) environment any destructive tests will be skipped with an appropriate error message. You can specify a regular expression that matches your sensitive environments using the --sensitiveurl command line option.

Setting WebDriver capabilities

If you're using WebDriver it's possible to specify additional capabilities on the command line:

Example (accept SSL certificates)

--capability=acceptSslCerts:true

Setting Firefox preferences

If you're using WebDriver and Firefox it's possible to set custom preferences:

Example (disable addon compatibility checking)

--firefoxpref=extensions.checkCompatibility.nightly:false

Specifying a Firefox profile

If you're using WebDriver and Firefox it's possible to specify an existing Firefox profile to use when starting Firefox.

Example (use the profile located at /path/to/profile_directory)

--profilepath='/path/to/profile_directory'

Installing Firefox extensions

If you're using WebDriver and Firefox it's possible to install extensions when starting the browser.

Example (install the extensions located at /path/to/ext1/ext1.xpi and /path/to/ext2/ext2.xpi)

--extension='/path/to/ext1/ext1.xpi' --extension='/path/to/ext2/ext2.xpi'

Setting Google Chrome options

If you're using WebDriver and Google Chrome then you can set various options on the command line using a JSON string.

Valid keys are:

• arguments: a list of command-line arguments to use when starting Google Chrome.
• binary_location: path to the Google Chrome executable to use.

For more details on Google Chrome options see: http://code.google.com/p/chromedriver/wiki/CapabilitiesAndSwitches

Example (set initial homepage)

--chromeopts='{"arguments":["homepage=http://www.example.com"]}'

Installing Google Chrome extensions

If you're using WebDriver and Google Chrome it's possible to install extensions when starting the browser.

Example (install the extensions located at /path/to/ext1/ext1.crx and /path/to/ext2/ext2.crx)

--extension='/path/to/ext1/ext1.crx' --extension='/path/to/ext2/ext2.crx'

Using credentials files

The credentials files use YAML syntax, and the usage will vary depending on the project. A typical file will contain at least one user with a unique identifier and login credentials:

Example

# admin:
#   email: [email protected]
#   username: admin
#   password: password

Custom report

By default a custom HTML report will be written to results/index.html. If you wish this to be located elsewhere, or have a different filename, you can specify the --webqareport command line option.

Privacy

With Selenium RC you can capture log files. By default log files are not captured as these may contain confidential data such as user credentials. If you are confident that a test does not contain such data, you can explicitly set the test as public. This mark is also used to set the job sharing level for Sauce Labs jobs:

Privacy marks have higher priority than the privacy entry in mozwebqa.cfg.

Example

import pytest

@pytest.mark.privacy('public')
def test_public(self, mozwebqa):
    home_pg = home_page.HomePage(mozwebqa)

You can also explicitly mark the test as private, which sets the test appopriately in Sauce Labs jobs.

Example

import pytest

@pytest.mark.privacy('private')
def test_private(self, mozwebqa):
    home_pg = home_page.HomePage(mozwebqa)

For the full list of accepted values, check the Sauce Labs documentation.

Using a proxy server

If you want the browser launched to use a proxy (currently only supported by Firefox and Google Chrome) you must specify the --proxyhost and --proxyport command line arguments.

Example (proxy is running on localhost port 8080)

--proxyhost=localhost --proxyport=8080

Testing with Appium on Saucelabs

If you want, you have the option to use Appium to drive your Mobile Web Application tests instead of using the deprecated AndroidDriver.

self.desired_capabilities = {}
self.desired_capabilities['platformName'] = 'android'
self.desired_capabilities['platformVersion'] = '4.4'
self.desired_capabilities['browserName'] = 'browser'
self.desired_capabilities['deviceName'] = 'Android'
self.desired_capabilities['appiumVersion'] = '1.2.2'

Note that this will only work with the latest Appium version (i.e version 1.2.2) and the latest Android emulators (i.e Android 4.4 or later). The deviceName must be 'Android' and be careful because it is case sensitive. Also if you would like to specify the Chrome browser instead of the Android default browser you can modify the browserName desired capability as follows: self.desired_capabilities['browserName'] = 'chrome'