You have decided to conduct international usability research. Great! Now where exactly should you start? Outlined below are some things you will want to keep in mind as you plan for your international test.
On-Location vs. Remote Testing
One of the first things that will need to be considered is whether your international test will be conducted on location or remotely. Each method has certain advantages. One clear advantage of remote testing is the cost savings from not having to travel to various locations across the globe, while still gaining the insight of participants across various target markets.
However, remote testing can be challenging as well. If going the remote testing route, you will want to be sure the screen sharing service you will be utilizing functions properly across locations and minimizes latency or keeps it within acceptable bounds.
Also, there is the question of whether you will be testing the user directly from their home or office, or arrange for them to go to a local lab facility for the session. Although testing users directly from their home or office will save money on lab rental and associated fees, you may very well find the money worth spending. A key advantage to a local, in-country lab facility is that you will have a consistent test environment and available support if an issue arises. You may want to seriously consider a lab facility if the testing requires participants to install software for remote viewing. This will simplify having to troubleshoot the install for each individual user. The lab can also provide a fluent moderator or translator to operate on location as opposed to over the phone. This segues to our next topic…
Scripted with Fluent Moderator vs. Real-Time Translation
If the goals of your study are fixed, well defined and relatively narrow, you can consider translating your testing script and having a local-language moderator run the sessions, while a simultaneous translator translates the discussion into your language. However, this limits your ability to react in real time to observed issues during testing, or the flexibility of probing deeper into issues to gain additional insight.
If you are employing a more flexible study design, you probably want to moderate in your own language and use real-time translation. You’ll want to consider a professional skilled in simultaneous translation to translate your questions to the participant, with an additional translator translating participant responses back into your language.
Time and Schedule
When planning testing overseas, be sure to build in extra preparation time to account for expected lags in communication and responses due to day/night work schedule conflicts. When creating your testing schedule, remember that session times will need to be extended to account for technical setup and translation time. A session that takes 60 minutes in a single language can easily take 75 or even 90 minutes when run internationally.
You will also want to be aware of the local users’ perception of timeliness. 2:00pm in some countries means 2:00pm, while in others it means 2:15pm or 2:20pm. It’s a good idea to allow for additional time in between sessions in those countries so, if users arrive late to their session, you can still cover all necessary content. Some cultures also start their work day much later than in the US, so starting sessions at 8 or 9am local time may not be ideal for your users.
If traveling to perform the test, a day or two may need to be built into the schedule to adjust to local time, so as to avoid poor testing due to jet lag. If testing remotely, keep in mind that sessions will likely be taking place at odd hours, potentially over night, due to time difference between your country and the country where testing is taking place.
Differences in Technology or Equipment
When thinking about differences in technology or equipment, one thing you will want to be sure to plan for is having the appropriate adapters and convertors for any electronic equipment that needs to be plugged in. You certainly don’t want to fly 8,000 miles to find out you can’t charge your testing laptop or damage the power supply for your microphone!
Another consideration of in-person testing is using variances in video cameras and connection formats. If you plan to rent any equipment at the facility you’ll want to make sure you can connect your own equipment.
Yet another consideration with differences in technology is internet connection speed, reliability and availability. If for example you were user testing in China, internet connections may be readily available in most all of the moderate sized towns, but may not be available in smaller villages…or could be unreliable where available in such locations. Other countries, such as South Africa, may not have reliable high-speed connections even in the larger cities, which can impact how much content you’re able to cover during your session.
You should also be knowledgeable about the cultural differences your participants may be sensitive to. For example, it may be difficult to recruit participants in some cultures during working hours or even during the work week. Some cultures are less likely to criticize products or services even constructively. In some cultures eye contact is extremely important to have, while in others it is considered offensive.
Male/Female interactions are another cultural difference to be taken into account. In some countries it is forbidden for married women to talk to men they are not related to. So, if testing locations where this may be problematic, it is wise to have both genders represented on the testing team.
In summary, when planning for international research, some considerations are:
- Selecting the appropriate test method (on-location or remote)
- Employing the appropriate translation style (scripted or real-time)
- Ensuring adequate time is allotted in the schedule
- Preparing for any differences in technology
- Accounting for specific cultural considerations
Hopefully this has given you an overview of the tradeoffs between in-person and remote international testing, as well as some basic things to keep in mind as you begin planning your international research. Best of luck to you!