Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Panel

Test Execution
Anchor
Execution Tests
Execution Tests

Rover provides you with the ability to run tests from Enterprise Tester when you are on the go - working in remote locations, or in areas where internet connectivity is unreliable or unavailable.

Rover supports synchronizing both script assignments and incidents with Enterprise Tester.

...

This article covers

...

synchronizing and running script assignments.

Although internet access is not required to run tests in Rover, internet access is required

...

when performing the following;

  • When downloading script assignments and incidents from

...

  • Enterprise Tester server.
  • When uploading test run results, new incidents and new comments on

...

  • existing incidents to Enterprise Tester server.

...

The Getting Started

...

article provides an introduction to help users become familiarized with Rover.

Copying

...

Scripts and Execution Sets to Rover

An internet connection is required for this task.

After logging into Rover, and selecting a project, the navigator will display the execution set folders and their script assignments (but not their agile runs) in the

...

selected project listed in the Enterprise Tester navigator.

In Enterprise Tester:

...

Image Added

In Rover, the execution

...

icon is highlighted in green and the packages and any script assignments of the

...

selected project

...

are displayed

...

:

...

Image Added


You can change the project by selecting from the drop down list. Projects are organised into categories, just like in

...

Enterprise Tester. Users will only be able to see projects that are defined in their user permissions on the

...

Enterprise Tester server.

...

Image Added

Once the project is selected, you can then review and select the execution sets

...

you wish to download from

...

Enterprise Tester server.

On the left select the tab with the bug icon to view all incidents in a project:

Image Removed

 

...

By default the folders are collapsed. The white Image Added button shows that the folder can be expanded and has sub-folders. Click on this to expand the folder.
Once the folder can no longer be expanded the button will turn black and point downwards Image Added 

Image Added

Execution sets and script assignments that have not yet been

...

downloaded (or have been changed since you last downloaded) to your device will display the download icon

...

Image Added.

To download execution sets, click on the download icon for the folder or the individual script assignment you wish to download.

Image Removed

 

 

You can also

...

download all execution sets and script assignments by clicking

...

on the

...

download icon for the Execution Sets folder.

Image Added

Once you have downloaded the execution set or the script assignment, the download icon will disappear.


Image Added

...

You'll also notice that once a

...

script assignment has been downloaded from the server to the client

...

device, the script assignment icon will change from:

...

Image Added  - White left corner with a green dot  - this icon denotes that the script assignment is on the

...

server and has not been downloaded.

...

to:

...

Image Added - solid green square - this icon denotes that the script assignment has been downloaded, and has not yet been altered on the client

...

device.

You can view a list of all icons on the Entity Icon section of

...

the Getting Started

...

article.


Viewing and Running Tests

Once you have downloaded your script assignments, depending on the machine or device you are using, you can click or tap on the script assignment in the tree view to view or run your script.

The following fields will be displayed on the screen. If any of the fields are blank in Enterprise Tester then the fields will not be displayed in Rover when viewing.

  • Script Description
  • Script Objective
  • Script Pre-Conditions
  • Script Post Conditions
  • Script Notes
  • All completed script custom fields and the run history 


Image Added


You can choose to view any of the previous runs on the run history grid. The run history grid will provide you with some basic details including the Run Number, the Run By details, the status of each run, the Sync Status and any Incidents associated to the Test Run. The sync status will tell you whether the run has been recorded on the server or whether it only resides locally.


Starting a New Run

You can start a new run by selecting the Create New Run button located above the run history grid. This will load the run screen which will provide you with all the custom fields scoped for script assignments and you'll also see your steps in a list view. You'll also see:

  • The run number
  • User running the test
  • Step status bar (to the right of the scrollbar)
  • The active step is highlighted with a blue border
  • Step navigation and Step Result menu at the bottom of the screen


Image Added


Similarly to executing a test run in Enterprise Tester, there is a text field for entering Actual Results. While a step is active you can select the step result at the bottom of the screen to set that step's status. If you Pass a step, the next step will automatically be selected, otherwise the actual result field will be focused so that you can start typing.
There are keyboard shortcuts for this screen:

  • Ctrl+Up selects the previous step
  • Ctrl+Down selects the next step
  • Ctrl+P - Pass the current step
  • Ctrl+F - Fail the current step
  • Ctrl+B - Block the current step
  • Ctrl+U  - marks the current step as undetermined

Rover allows copying and pasting text from another source i.e. Excel and pasting it into the Expected Result field (by using CTRL+V).

You can also copy all of the Test Step details and paste them into the Expected Results field.
Select the Copy Text button and use CTRL+V to paste.

Image Added

Hyperlinks and local paths can be added in the Actual Result field.

Depending on the status for the step you'll notice that a status icon will be added to the step and the step background will be shaded. You'll also notice that the bottom status menu highlights the status of the current step.  In the image below, Step 2 is highlighted and the status is Failed.  You'll also notice that the status bar is color coded according to the status of each step. This makes it easy to see the status of each step at a glance.

Image Added

Passed

Image Added

Failed

Image Added


Blocked

Image Added

Undetermined

Image Added


Failing a Step and logging an Incident

To log an incident on a Failed step, click or tap on the Incidents button under the Actual Results field on the step to open the Create Link screen.

The Create Link screen will display:

  • Any incidents that are already linked to the step
  • An area for creating a new incident, or linking to an existing incident that was either downloaded from Enterprise Tester or was previously created.
  • The Test Script Name will automatically be populated in the Summary field.

Image Added


You can either edit the Summary field (Bug Name) or leave it as the default name.
As you type a name, you'll also see the list of existing incidents narrow down. Select the Link button on one of these if you'd prefer to link to an existing incident instead of creating a new one. For more information on linking incidents, see Incidents.

Image Added

 
Select the Create Incident button to open the Incident Create screen. Complete the fields and select Save to create a new incident and link it to the step.

Image Added


Once you have selected Save the window will close and you will be returned to your run. 
Once you have completed the run, the icon in the tree for the script assignment should now show
Image Added which indicates that the script assignment has local changes which have not yet been uploaded to the server. See Synchronization to find out how to upload these changes back to the server.

Limitations

Rover does not currently support the following Enterprise Tester features:

  • agile runs
  • run timer

The Incident can be viewed and updated by clicking on the incident in the list. 

Managing Incidents 

When running a test you can log an incident straight from the failed step ( see the Execution Sets article for more information of running test) by clicking on the Incidents button.

 

Image Removed

 

The incidents screen will display any incidents that are already linked to the script assignment on the same step and an area from creating a new incident or linking to an incident that was downloaded from the ET server or was previously created. You can also create a new incident that will automatically be linked to the step.

 

Linking Incidents to the Script Step

From the Step Incident screen, you can view all linked incidents, link additional incidents or create a new incident.

 

Image Removed

Incidents linked to the step can be added by clicking or tapping on the Link button associated with an existing incident. All incidents that are already associated with the step are listed in the Linked Incidents section. These can be disassociated from the step by clicking or tapping on the Unlink button.

 

Image Removed

 

You can filter the existing incidents by starting to type in the Summary field.  This will automatically filter all incidents that match the text you have entered

Image Removed

Creating an Incident

Incidents are easily created by adding a summary in the text field under Create Link and then clicking or tapping on Create Incident.

Image Removed

The Incident Create screen will appear where you can all of your details including all the fields that have been configured in ET, attachments and comments. You can also select the External System Link ( Defect Tracker Project Link e.g. JIRA or TFS projects) that have been pre-configured in ET for your project. If you select a external link, the incident will be synchronized with your external system ( JIRA or TFS) when the incident is uploaded to the ET Server.

Image Removed

When you have finished entering your details, click or tap on Save. You will be returned to the Step Incident screen and your newly created incident will appear in the Linked Incidents section.  

Image Removed

 

 

You can now either close the screen to return to your run or log another incident.

Once you have completed your testing, you can synchronize your runs and incident back to the ET Server. The Synchronization article provides details on how to complete this task.

 

...