Frequently Asked Questions


Below are some common questions we receive from people interested in using TryMyUI as a usability research platform. If you don’t see your question here, please submit it using the Feedback tab and we will get back to you.

If you are a TryMyUI tester, check out the Tester FAQ page for help.


Plans and pricing

How TryMyUI works

How you should use TryMyUI

How TryMyUI compares with other testing tools and methods

When you’re running your tests

Plans and pricing

How much does a usability test cost?

On the Personal Plan, it costs $35 for a single desktop test result, or $70 for a mobile result. (A test result consists of one user’s narrated video and written responses.)

That’s a heck of a lot less than recruiting your own panel of users and administering a test on-site. It’s also considerably less than some other user testing sites out there.

Get your first test result for $0 by signing up for a free trial now!


What is a credit?

Credits are used to order test results from our user panel. One credit costs $35, and can be used to order one user’s test result.

You can buy credits on an ad-hoc basis, or get monthly credit allowances on our Team or Enterprise Plans.

Credits are only for ordering tests with TryMyUI’s panel. If you provide your own users, you can test with them using a separate count of invites.


What comes with the monthly plans?

Our Team and Enterprise Plans are subscription-based options that give you a monthly allowance of test results from our panel and from your own users. In addition, they include advanced features to help you analyze results quickly, quantify and benchmark your usability, and easily share findings with colleagues and stakeholders.

See a full list of our features here.


Can I pay month to month?

You can always pay month to month with TryMyUI – no long-term contract necessary! We know that every product and UX team has its own budget and schedule challenges; we stay flexible, so you can too.


What are the benefits of buying annually?

When you buy a year of the Team or Enterprise Plan, you get all 12 months’ worth of credits up front. You’ll have maximum control to decide how you want to apportion those credits (and invites for your own testers) throughout the year.

That's great if you might be testing a lot in some months, but not at all during other months.


Can I buy extra tests if I’m on a subscription plan?

Yes! If you run out of your monthly allowance of credits on your plan, or you just need to collect more results than usual, you can always buy additional credits at the price of $35 each.


Do my credits roll over?

Credits that you purchase at our regular $35 rate never expire. Until you use them to order a test, they will stay in your account.

On our subscription-based Team and Enterprise plans, you receive a monthly allowance of credits for ordering tests. These credits do NOT roll over. Any that are unused at the end of your monthly payment cycle will be lost.

However, if you purchase an annual plan you get all year to use your credits.

How TryMyUI works

What do I get with one test?

You get a narrated video of each user navigating your website, app, or prototype, talking about what they like and dislike as they go.

You see their full screen (not just the browser window), plus mouse movements or finger gestures. You hear them say everything they’re seeing, reading, thinking, and doing. In addition, you get their written answers to 4 customizable post-test questions.


How long does it take to get results back?

For most tests, your results will be ready within 3-6 hours. However, the turnaround time is related to the strictness of your demographic filters, so if your requirements are very specific – especially if you have custom criteria or screener questions – it can take us a bit longer to find eligible users. In such cases, it may take up to 24-36 hours for us to completely fulfill your order.


What demographics can I control?

You can currently filter the tester pool by gender, age, income range, country of residence, education level, family status, social networks usage, employment type, and more. You can also add your own custom qualification criteria, such as: must be an avid gamer, or must have taken an overseas vacation in the last year. Would you like further control? Let us know!


Where do TryMyUI's panelists come from?

TryMyUI’s user pool is comprised of normal people we recruit online. All of our panelists must pass a qualification test demonstrating their ability to vocalize and explain their thoughts before performing tests for our customers.


How are users selected and qualified?

TryMyUI qualifies candidate users based on their ability to stay on task and to clearly voice everything they, see, read, think, or do as they are interacting with your website. That way you get high-quality, insight-dense feedback without the high cost of a moderated user test.

We continually re-evaluate our testers using a rating system to ensure that the results we deliver are valuable, meaningful, and actionable.


How do I set up a test?

Its best to just try it and see. But if you really want to read about it…

Using the TryMyUI website, you submit the URL you want to test and present a general scenario and a set of tasks for the testers to follow. For example, the scenario may be: “You’re invited to a very fancy cocktail party and are looking for black shoes to match your dress”. The tasks might include:

  • Talk about how you would go about finding the perfect shoe.
  • Which factors are most important to you in looking for a pair of shoes?
  • Come up with a listing of candidate shoes you’re interested in.
  • Which ones are in your price range? Eliminate any that are not.
  • Make sure the shoes you like are available in your size.
  • Make a final decision about which shoe you are going to buy. What would your next step be?
  • You don’t want to buy them right now - how would you finish the purchase if you close your browser and then come back later?

Finally, you specify your demographic criteria and indicate how many test users you would like. TryMyUI presents this scenario and task script to its pool of qualified testers. Users who take the test are “video-taped” by having their screens and their voices recorded as they go through the tasks on your website. At the end of the 10-20 minute test, they also fill out a written questionnaire. Very soon afterwards, the narrated video and the written summary are delivered to you.


Can I use my own testers?

Absolutely! Instead of using our testers, you can test with an unlimited number of your own users on our Enterprise plan, or with up to 10 of your own users per month on the Team plan.

How you should use TryMyUI

When in my development process should I use TryMyUI?

TryMyUI is so simple and inexpensive that you can benefit from it at ALL stages for great user feedback.

Pre-product testing

  • Market validation – Ever wonder how the average customer approaches the market segment or industry you’re in? Suppose you are an online retailer selling digital cameras. Why not perform a general test asking: How would you use the Web to find the best digital camera for you? See how potential customers approach the marketplace. What sites do they visit? What makes them go there? What are they thinking?
  • Competitor analysis – Ever wonder what customers think of your competitors’ websites or offerings? Why not use TryMyUI on your competitors’ websites and find out?
  • Conceptualization – You don’t need a live website or even a clickable prototype to benefit from TryMyUI. You can get immediate user reactions to your static concepts, marketing messages and so on before you even have a working website.

Post-product testing

  • Early prototypes – It is never too early to put your prototypes in front of users to help guide your design and priorities. Agile development methods promote acceptance testing by stakeholders including potential customers as a part of each development sprint. TryMyUI is a great way to get user feedback in the early stages of development.
  • Beta and production – Use TryMyUI to gauge overall user impressions as well as each of your expected use cases after launch.
  • New features – Use TryMyUI to test each new feature you develop before and after you roll it out.

How many users should I test with?

We recommend testing with 4-6 users to get a sense of what works and what doesn’t. With too few users, you may or may not get representative feedback; and while any testing is better than none, it’s best to make sure your results are reliable. Testing with 15 users will uncover virtually all of the major usability issues, and 20 or more will provide statistically significant data. However, with just 5 or 6 users, you will probably have already seen several actionable themes to work on.

Are 4 to 6 tests statistically significant?

Statistically significant conclusions cannot be derived from a few samples. But with narrated video you are literally seeing your website through someone else’s eyes. This alone can provide you with several “aha” moments, as you realize that the user’s mental model, interpretation of terminology, and reaction to your website content is quite different than what you imagined. The depth of this information illuminates WHY the user is acting as he/she is and provides you with enough insight to decide whether you should correct it or not.

How TryMyUI compares with other testing tools and methods

Web log analytics – I can review my web logs to see what users do. What does TryMyUI add?

Excellent point! We agree that web logs have a wealth of useful information that can help you understand what features users are exercising, what pages get the most interest, etc. However, while web logs, or even tools like Google Analytics, answer many questions involving “what” users are doing, they don’t shed much light on “why” they are doing what they are doing. To gain insight on the “why”, you need to ask the user. At TryMyUI, we’re trying to facilitate this deep interaction with the user.

Moderated user studies – How does TryMyUI compare with moderated user studies?

There’s no doubt that an expert moderator brings a lot to the table. Like a good psychologist, a good moderator can probe the user, understanding his or her motivations without biasing them. Unfortunately, expert service is both difficult to obtain and expensive. TryMyUI provides several advantages over a moderated usability study:

  • It’s extremely simple to set up. You can have the results of your tests within hours of submitting your scenario and tasks, less time than it would take to engage a usability testing firm to set up the first meeting.
  • It’s very inexpensive. For the price of a single moderated usability study involving 5 users, you can have tests from hundreds of users (not that you would want to).
  • It’s very simple to interpret. All you have to do is review the videos of the users executing your scenarios and read their written summaries.

Other remote user testing services – How is TryMyUI different from competitors?

A number of other companies provide remote usability testing services. In general, the basic data each one provides is more or less the same: self-narrated videos of the tester’s screen as they follow a series of tasks.

What sets us apart is our toolkit designed for making usability research faster and easier. We have developed a variety of tools that streamline the user testing process, including: the UX Diagnostics quantitative panel, the UXCrowd for ranking usability problems through crowdsourcing, video annotations for saving key moments, highlight reels for sharing them, Collaborative Analysis for working on research together with your team, and the Executive Summary for generating end-of-study reports.

Everything we build is focused on deepening our customers’ understanding of their video data, helping them to analyze better and faster, then synthesize, share, and iterate!

When you’re running your tests

Can I preview how my test will look before I send it out?

Yes! After creating your test, scroll down to the bottom of the test page and find the link that says “Take the test yourself.” This will allow you to walk through the test exactly how testers will see it.

My test results are “In progress” – what does that mean?

The “In progress” status means that a tester has begun work on this test, but the video is not yet ready for viewing. A test result is “In progress” as soon as someone begins recording their video feedback.

After the video and other data have been submitted and uploaded to our server, it will be reviewed by one of our graders to ensure that the tester followed instructions and has provided useful, high-quality feedback.

When a grader decides that the test result meets our standards, they approve that result and the status changes to “Complete,” at which time it will be available for you to view.

What if I’m not happy with one of my results?

If for any reason you find a test result unsatisfactory, please rate it 2 stars or lower. Then, you will automatically be given the option to replace that result at no additional cost.

 

Related Reading: