Remote usability testing

Remote usability testing is a form of user testing where the users share the screen with the test moderator over the internet. This means that regardless of whether your users are in Ulan Bator or Oslo, you can test them both on the same day.

A remote usability test is essentially an internet meeting between the test subject and the test moderator. The testing is performed more or less the same way as a normal usability test, but it requires a little more preparation.
The test moderator needs separate equipment to see the user’s screen and the user has to install a plug-in to their machine. This allows the test moderator to see the user’s mouse movements and which web pages they visit. The parties can talk to each other over a normal phone line.

 

Advantages

Disadvantages

Lab

Face to face contact
Can "point and explain"
Accepted, ‘tried and tested’ method

No geographical spread
Unnatural environment

Remote

Fast and flexible
Avoids need for travel
User’s natural environment
Geographical spread

No face to face contact
No "perfect" technical solutions as yet
No recording of the user’s face
Test subject must be reasonably computer literate

Remote usability testing is suitable if:

• it is difficult to find test users locally
• it is expensive/demanding to find test users locally
• the development team is not all in one location

Activity plan for remote usability testing

Recruitment

A professional agency can be used to recruit testers. You can also do it by way of an online form on the website to be tested. The form can be presented using a pop up (the type that is not blocked by pop up filters – for example a “landslide”).
The form will ask for the user’s name, phone number, e-mail address and possibly answers to some screening questions. We will then contact the user and agree a suitable time for the test.

Test set-up

To be able to see the test user’s screen, you need an additional tool.

Examples include:

Adobe Acrobat

ConnectBoltPeters

EthnioWebEx

Prepare the test user

Before the test starts, the test user must install a plug-in to their computer. It is very important to explain clearly what this plug-in is and that it does not present any kind of security risk for the user. This should be done when the test user is phoned before the test commences. The link for installing the plug-in is sent to the test user by e-mail and they install it under instruction over the phone. This takes about 30 seconds.

Carrying out the test

The test can be recorded at the moderator’s end using Morae or other recording equipment for usability testing. Sound recording can be done by attaching recording equipment to the phone or using a loudspeaker and a microphone. The test user must of course be advised in advance that you will be doing this.