guides-page_object

Contents

Introducing the Page Object Pattern

Automated testing of an application through the Graphical User Interface (GUI) is inherently fragile. These tests require regular review and attention during the development cycle. This is known as Interface Sensitivity (“even minor changes to the interface can cause tests to fail”). Utilizing the page-object pattern, alleviates some of the problems stemming from this fragility, allowing us to do automated user acceptance testing (UAT) in a sustainable manner.

The Page Object Pattern comes from the Selenium community and is the best way to turn a flaky and unmaintainable user acceptance test into a stable and useful part of your release process. A page is what’s visible on the screen at a single moment. A user story consists of a user jumping from page to page until they achieve their goal. Thus pages are modeled as objects following these guidelines:

  1. The public methods represent the services that the page offers.
  2. Try not to expose the internals of the page.
  3. Methods return other PageObjects.
  4. Assertions should exist only in tests
  5. Objects need not represent the entire page.
  6. Actions which produce multiple results should have a test for each result

Lets take the page objects of the Ubuntu Clock App as an example, with some simplifications. This application is written in QML and Javascript using the Ubuntu SDK.

1. The public methods represent the services that the page offers.

This application has a stopwatch page that lets users measure elapsed time. It offers services to start, stop and reset the watch, so we start by defining the stop watch page object as follows:

class Stopwatch(object):
def start(self):
raise NotImplementedError()
def stop(self):
raise NotImplementedError()
def reset(self):
raise NotImplementedError()

2. Try not to expose the internals of the page.

The internals of the page are more likely to change than the services it offers. A stopwatch will keep the same three services we defined above even if the whole design changes. In this case, we reset the stop watch by clicking a button on the bottom-left of the window, but we hide that as an implementation detail behind the public methods. In Python, we can indicate that a method is for internal use only by adding a single leading underscore to its name. So, lets implement the reset_stopwatch method:

def reset(self):
self._click_reset_button()
def _click_reset_button(self):
reset_button = self.wait_select_single(
'ImageButton', objectName='resetButton')
self.pointing_device.click_object(reset_button)

Now if the designers go crazy and decide that it’s better to reset the stop watch in a different way, we will have to make the change only in one place to keep all the tests working. Remember that this type of tests has Interface Sensitivity, that’s unavoidable; but we can reduce the impact of interface changes with proper encapsulation and turn these tests into a useful way to verify that a change in the GUI didn’t introduce any regressions.

3. Methods return other PageObjects

An UAT checks a user story. It will involve the journey of the user through the system, so he will move from one page to another. Lets take a look at how a journey to reset the stop watch will look like:

stopwatch = clock_page.open_stopwatch()
stopwatch.start()
stopwatch.reset()

In our sample application, the first page that the user will encounter is the Clock. One of the things the user can do from this page is to open the stopwatch page, so we model that as a service that the Clock page provides. Then return the new page object that will be visible to the user after completing that step.

class Clock(object):
...
def open_stopwatch(self):
self._switch_to_tab('StopwatchTab')
return self.wait_select_single(Stopwatch)

Now the return value of open_stopwatch will make available to the caller all the available services that the stopwatch exposes to the user. Thus it can be chained as a user journey from one page to the other.

4. Assertions should exist only in tests

A well written UAT consists of a sequence of steps or user actions and ends with one single assertion that verifies that the user achieved its goal. The page objects are the helpers for the user actions part of the test, so it’s better to leave the check for success out of them. With that in mind, a test for the reset of the stopwatch would look like this:

def test_restart_button_must_restart_stopwatch_time(self):
# Set up.
stopwatch = self.clock_page.open_stopwatch()
stopwatch.start()
stopwatch.reset_stopwatch()
# Check that the stopwatch has been reset.
self.assertThat(
stopwatch.get_time,
Eventually(Equals('00:00.0')))

We have to add a new method to the stopwatch page object: get_time. But it only returns the state of the GUI as the user sees it. We leave in the test method the assertion that checks it’s the expected value.

class Stopwatch(object):
...
def get_time(self):
return self.wait_select_single(
'Label', objectName='time').text

5. Need not represent an entire page

The objects we are modeling here can just represent a part of the page. Then we build the entire page that the user is seeing by composition of page parts. This way we can reuse test code for parts of the GUI that are reused in the application or between different applications. As an example, take the _switch_to_tab(‘StopwatchTab’) method that we are using to open the stopwatch page. The Clock application is using the Header component provided by the Ubuntu SDK, as all the other Ubuntu applications are doing too. So, the Ubuntu SDK also provides helpers to make it easier the user acceptance testing of the applications, and you will find an object like this:

class Header(object):
def switch_to_tab(tab_object_name):
"""Open a tab.
        :parameter tab_object_name: The QML objectName property of the tab.
        :return: The newly opened tab.
        :raise ToolkitException: If there is no tab with that object
            name.
        """
...

This object just represents the header of the page, and inside the object we define the services that the header provides to the users. If you dig into the full implementation of the Clock test class you will find that in order to open the stopwatch page we end up calling Header methods.

6. Actions which produce multiple results should have a test for each result

According to the guideline 3. Methods return other PageObjects, we are returning page objects every time that a user action opens the option for new actions to execute. Sometimes the same action has different results depending on the context or the values used for the action. For example, the Clock app has an Alarm page. In this page you can add new alarms, but if you try to add an alarm for sometime in the past, it will result in an error. So, we will have two different tests that will look something like this:

def test_add_alarm_for_tomorrow_must_add_to_alarm_list(self):
tomorrow = ...
test_alarm_name = 'Test alarm for tomorrow'
alarm_page = self.alarm_page.add_alarm(
test_alarm_name, tomorrow)
saved_alarms = alarm_page.get_saved_alarms()
self.assertIn(
(test_alarm_name, tomorrow),
saved_alarms)
def test_add_alarm_for_earlier_today_must_display_error(self):
earlier_today = ...
test_alarm_name = 'Test alarm for earlier_today'
error_dialog = self.alarm_page.add_alarm_with_error(
test_alarm_name, earlier_today)
self.assertEqual(
error_dialog.text,
'Please select a time in the future.')

Take a look at the methods add_alarm and add_alarm_with_error. The first one returns the Alarm page again, where the user can continue his journey or finish the test checking the result. The second one returns the error dialog that’s expected when you try to add an alarm with the wrong values.