The best UX of your life starts with creating and launching your first remote usability test. This guide is a step-by-step tutorial on how to set up your first remote usability test on TryMyUI’s platform. Note that some of these features may not be available for each plan type, so refer to our features list for more information. Visit for more information Better with age shorts
In step 1, you’ll be giving your test a title, choosing the interface type you’ll be testing, picking the device you want testers to use, and entering in the URL.
Next, you’ll select the number of testers to request and whether or not you want to allow previous testers. Depending on your testing goals, the number of testers may vary. Read our article regarding this topic here.
Then, you select the amount of time allotted to complete the test. Remember how much time you select when you’re writing your task script later so you can give testers ample time to explore your product and explain their thoughts!
Note that if you select HTML/CSS under interface, you will need to upload a zip file. Also, if you select any of the mobile devices, you will be prompted with enabling face recording and selecting the screen orientation of the videos.
Next, you’ll choose who you want to take your test. If you choose to use your own testers, you will simply send them a URL to the test for them to enter into their TryMyUI tester app. The custom panel is for customers who have already tested and want to keep testing with the same panel of testers as before.
If you use testers from the TryMyUI panel, you will pick your target audience with demographic filters for factors like gender, age, country, and more.
You can select more than one subgroup for the same filter (for example, the “top” and “second” quartile have both been chosen in the Income filter above).
A gauge displaying your estimated fulfillment time will appear at the bottom of this section. If the dial is in the red, consider loosening your requirements.
Some testers may meet your selected demographics requirements, but some tests will require nuance that can be refined through screeners. You can input custom requirements, from extra demographic factors (“Must speak Spanish”) to interests (“Must consider yourself an environmentalist”).
The screener questions will refine your tester-base further.
In this step you can also upload a non-disclosure agreement (NDA) for testers to sign if your test will contain sensitive materials.
Step 3 contains the meat of the test setup, where you’ll write the scenario and tasks for testers to follow. It’s important to get your test script right so you get the highest quality feedback. Pay close attention to the tips, and consider taking a look at our posts on writing usability testing tasks before you finalize your test.
By the way, if your test will start with a landing page or are really just focused on GUI, we recommend using a 15-second Impression Test to see what people think of your site before they’ve had time to explore it.
Remember, you only have a matter of seconds to keep a potential customer on your page, so impressions are everything!
Next, you’ll start writing the task script for your testers. These are the actions you want your testers to perform on your website. Sometimes, it can be helpful to ask an open-ended question to get your testers to talk about their experience.
We’ve compiled guides for tasks related to e-commerce tests, prototypes and wireframes, as well as a more general guide.
Each task will have the option to include Task Usability and Task Completion. These are quantitative metrics and part of the UX Diagnostics feature. We highly recommend using these user testing metrics, as they will help you and your team hone in on specific pain-points.
You can delete and sort your tasks with the two icons on the right of the text boxes.
Now we come to setting up the Post-test section of your first remote usability test. This is where more qualitative feedback will come into play via your post-test user testing survey.
We provide you with 4 post-test survey questions that are open to free response from testers, but these are customizable and only suggestions. Here, too, is a bank of survey questions you might want to refer to.
If you want more options than Free Response, you can select other types from the dropdown. Slider-ratings, multiple-choice (select one), and multiple-choice (select multiple) are all available and add flexibility to your post-test survey results and data.
Think about which survey types will be relevant to your test script, interface type, and always be mindful of tester fatigue. Too many questions can spoil your data!
After the qualitative surveys, we come to the juicy quantitative data options. Here’s where you’ll choose which additional metrics to include in the test, such as:
5. Review and Confirmation
Lastly, once you have finished the post-test section, you will be able to review your test. Each section is displayed and can quickly be edited in case you missed something.
The checkout screen will display the amount of credits you currently have, the amount you’re requesting, and if you will need to purchase more. After clicking “Submit” your test will be launched and you will receive results within hours!
Try out the new flow at trymyui.com/use_tests/new/ if you have an account, or start a 14-day free trial to setup and launch your first remote usability test. Let us know what you think – user feedback shaped this flow, and always keeps shaping our product!