Frequently Asked Questions

Below are some common questions we receive from people interested in using TryMyUI as a usability research platform. If you don’t see your question here, please submit it using the Feedback tab and we will get back to you.

If you are a TryMyUI tester, check out the Tester FAQ page for help.


How TryMyUI works

How you should use TryMyUI

How TryMyUI compares with other testing tools and methods

When you’re running your tests


How much does it cost?

$35 for a single test, with monthly plans available. And you can try it FREE.

That’s a heck of a lot less than recruiting users for a panel. And it’s considerably less than some other user testing sites out there.

Do my credits roll over?

Credits that you purchase at our regular $35 rate never expire. Until you use them to collect test results, they will stay in your account.

On our subscription-based Team and Enterprise plans, you receive a monthly allowance of credits to use for ordering tests. These credits do NOT roll over. Any that are unused at the end of your monthly payment cycle will be lost.

How TryMyUI works

How do I get started?

Creating your first test is easy. Just click here, fill out a simple 4-step form to set up your test, and video results will be ready for you in a few hours.

What do I get?

You get a narrated video (20 minutes maximum) of each user navigating your website. You see their screen, mouse movements, and keystrokes. You hear them say everything they see, read, think or do. In addition, you get written answers to 4 questions posed to users after the test.

Can I ask users my own questions?

Yes. In addition to giving a scenario and tasks for users to perform on your website, you can ask 4 questions that they will respond to in writing after they have performed the test.

Where do the users come from?

TryMyUI’s user pool is comprised of normal people who we recruit online.

How are users selected and qualified?

TryMyUI qualifies candidate users based on their ability to stay on task and to clearly voice everything they, see, read, think, or do as they are interacting with your website. That way you get high-quality, insight-dense feedback without the high cost of a moderated user test.

What demographics can I control?

You can currently filter the tester pool by gender, age, income range, country of residence, education level, family status, social networks usage, employment type, and more. You can also add your own custom qualification criteria, such as: must be an avid gamer, or must have taken an overseas vacation in the last year. Would you like further control? Let us know!

How do I set up a test?

Its best to just try it and see. But if you really want to read about it…

Using the TryMyUI website, you submit the URL you want to test and present a general scenario and a set of tasks for the testers to follow. For example, the scenario may be: “You’re invited to a very fancy cocktail party and are looking for black shoes to match your dress”. The tasks might include:

  • Talk about how you would go about finding the perfect shoe.
  • Which factors are most important to you in looking for a pair of shoes?
  • Come up with a listing of candidate shoes you’re interested in.
  • Which ones are in your price range? Eliminate any that are not.
  • Make sure the shoes you like are available in your size.
  • Make a final decision about which shoe you are going to buy. What would your next step be?
  • You don’t want to buy them right now - how would you finish the purchase if you close your browser and then come back later?

Finally, you specify your demographic criteria and indicate how many test users you would like. TryMyUI presents this scenario and task script to its pool of qualified testers. Users who take the test are “video-taped” by having their screens and their voices recorded as they go through the tasks on your website. At the end of the 10-20 minute test, they also fill out a written questionnaire. Very soon afterwards, the narrated video and the written summary are delivered to you.

Can I use my own testers?

Absolutely! Instead of using our testers, you can buy our Enterprise plan, which allows you to send your usability tests out to an unlimited number of your own testers – or our Team plan, which allows you to collect 10 test results from your own users each month.

How you should use TryMyUI

When in my development process should I use TryMyUI?

TryMyUI is so simple and inexpensive that you can benefit from it at ALL stages for great user feedback.

Pre-product testing

  • Market validation – Ever wonder how the average customer approaches the market segment or industry you’re in? Suppose you are an online retailer selling digital cameras. Why not perform a general test asking: How would you use the Web to find the best digital camera for you? See how potential customers approach the marketplace. What sites do they visit? What makes them go there? What are they thinking?
  • Competitor analysis – Ever wonder what customers think of your competitors’ websites or offerings? Why not use TryMyUI on your competitors’ websites and find out?
  • Conceptualization – You don’t need a live website or even a clickable prototype to benefit from TryMyUI. You can get immediate user reactions to your static concepts, marketing messages and so on before you even have a working website.

Post-product testing

  • Early prototypes – It is never too early to put your prototypes in front of users to help guide your design and priorities. Agile development methods promote acceptance testing by stakeholders including potential customers as a part of each development sprint. TryMyUI is a great way to get user feedback in the early stages of development.
  • Beta and production – Use TryMyUI to gauge overall user impressions as well as each of your expected use cases after launch.
  • New features – Use TryMyUI to test each new feature you develop before and after you roll it out.

How many users should I test with?

We recommend testing with 4-6 users to get a sense of what works and what doesn’t. With too few users, you may or may not get representative feedback; and while any testing is better than none, it’s best to make sure your results are reliable. Testing with 15 users will uncover virtually all of the major usability issues, and 20 or more will provide statistically significant data. However, with just 5 or 6 users, you will probably have already seen several actionable themes to work on.

Are 4 to 6 tests statistically significant?

Statistically significant conclusions cannot be derived from a few samples. But with narrated video you are literally seeing your website through someone else’s eyes. This alone can provide you with several “aha” moments, as you realize that the user’s mental model, interpretation of terminology, and reaction to your website content is quite different than what you imagined. The depth of this information illuminates WHY the user is acting as he/she is and provides you with enough insight to decide whether you should correct it or not.

How TryMyUI compares with other testing tools and methods

Web log analytics – I can review my web logs to see what users do. What does TryMyUI add?

Excellent point! We agree that web logs have a wealth of useful information that can help you understand what features users are exercising, what pages get the most interest, etc. However, while web logs, or even tools like Google Analytics, answer many questions involving “what” users are doing, they don’t shed much light on “why” they are doing what they are doing. To gain insight on the “why”, you need to ask the user. At TryMyUI, we’re trying to facilitate this deep interaction with the user.

Moderated user studies – How does TryMyUI compare with moderated user studies?

There’s no doubt that an expert moderator brings a lot to the table. Like a good psychologist, a good moderator can probe the user, understanding his or her motivations without biasing them. Unfortunately, expert service is both difficult to obtain and expensive. TryMyUI provides several advantages over a moderated usability study:

  • It’s extremely simple to set up. You can have the results of your tests within hours of submitting your scenario and tasks, less time than it would take to engage a usability testing firm to set up the first meeting.
  • It’s very inexpensive. For the price of a single moderated usability study involving 5 users, you can have tests from hundreds of users (not that you would want to).
  • It’s very simple to interpret. All you have to do is review the videos of the users executing your scenarios and read their written summaries.

Other remote user testing services – How is TryMyUI different from competitors?

A number of other companies provide remote usability testing services. In general, the basic data each one provides is more or less the same: self-narrated videos of the tester’s screen as they follow a series of tasks.

What sets us apart is our toolkit designed for making usability research faster and easier. We have developed a variety of tools that streamline the user testing process, including: the UX Diagnostics quantitative panel, the UXCrowd for ranking usability problems through crowdsourcing, video annotations for saving key moments, highlight reels for sharing them, Collaborative Analysis for working on research together with your team, and the Executive Summary for generating end-of-study reports.

Everything we build is focused on deepening our customers’ understanding of their video data, helping them to analyze better and faster, then synthesize, share, and iterate!

When you’re running your tests

Can I preview how my test will look before I send it out?

Yes! After creating your test, scroll down to the bottom of the test page and find the link that says “Take the test yourself.” This will allow you to walk through the test exactly how testers will see it.

My test results are “In progress” – what does that mean?

The “In progress” status means that a tester has begun work on this test, but the video is not yet ready for viewing. A test result is “In progress” as soon as someone begins recording their video feedback.

After the video and other data have been submitted and uploaded to our server, it will be reviewed by one of our graders to ensure that the tester followed instructions and has provided useful, high-quality feedback.

When a grader decides that the test result meets our standards, they approve that result and the status changes to “Complete,” at which time it will be available for you to view.

What if I’m not happy with one of my results?

If for any reason you find a test result unsatisfactory, please rate it 2 stars or lower. Then, you will automatically be given the option to replace that result at no additional cost.


Related Reading: