Thoughts on listening to users

« Older posts

How to Talk to Your Users

By Farhad Farzaneh | Published: July 13, 2011

We met Diane Loviglio, a user experience researcher at Mozilla, at a recent SF  Bay Area meetup, and she shared some insights on the traditional Recruit-Observe-Interview-Navigate user testing process.

1. Recruit your target audience.  Diane suggests not talking to just anyone or everyone.  Instead, recruit people based on “behaviors” or “personas” versus standard demographics.  For example, if you target “homeowners” versus “married couples in their 30s”, you’re likely to gain more insights from the former group than the latter if what you wanted to learn was related to finding a home loan. Young married couples may or may not have gone through the mortgage process yet.

Read More »

Posted in Practice, TryMyUi | 1 Comment

Customer Spotlight: Woolik.com and DIY User Testing

By Sani El-Fishawy | Published: July 13, 2011

Woolik.com develops cool tools for browsers that personalize and improve the user experience.   The first tool available helps saves time while searching by providing logos of familiar sites and brands within the Google search results.  Ido Sever — Woolik’s co-founder, CEO and product manager — has been incorporating TryMyUI as part of Woolik’s R&D cycle.  Woolik just released a beta version of its Web 2.0 site, so we asked Ido to share some tips and insights from that pre-launch experience.Woolik.com

Remote usability testing versus moderated user testing

“We had several user tests before using TryMyUI, but organizing them was always a hassle. It was hard to combine user tests within our R&D cycle. TryMyUI enabled me to get relevant user experience tests of designated segments within hours – this was VERY convenient. We had some relatively complicated prerequisites for some of our tests, and the guys at TryMyUI support team were incredibly useful, so we kept coming back.”

Tips on Setting Up User Tests in TryMyUI

“If you want to see how a user thinks, it is always better to ask a question rather than providing an answer. Let’s say you have integrated a feedback system [on your website] and would like to see if users can easily use it. If you request the user to simply provide feedback you might receive many results which won’t help you. On the other hand, if you ask – ‘how would you provide feedback for our site?’ you will probably see the user going through the same thinking process he would go through in a real situation.”

“If possible, start building a new test based on an existing test [you already created] in TryMyUI.  This is a great time saver.”

How to Involve R&D Teams in User Testing

“A key challenge is turning a test into real features with the blessing and enthusiasm of the R&D team. Therefore, we usually show 1-2 tests (selected out of 5) every product cycle to our R&D team. We then have a brainstorming session about the things we should change and fix. We usually choose the top 1-2 features and toss them in the R&D coming iteration. This is a great effective way to have your R&D team involved.”

Posted in Customers | Leave a comment

Updated usability demographics

By admin | Published: July 8, 2011

We recently upgraded the software to support finer age-based demographics, and also “fixed” our notion of demographics on education and social networks usage.

Previously, we only allowed the choices of the following very specific age groups: 18-34, 35-55, and above 55, which was fine for many users.  However, we received several requests to allow our customers to fine-tune the age selection, for example, to only college age or above 50 (to get access to a bigger pool of testers).  So now you can do that.

Finer selections based upon age

Additionally, you could set the education demographics to ‘high school’, or ‘college’, but did not allow the more likely requirement of ‘college or higher’.  We have changed it so that specifying a demographic education level now assumes you want at least that level.  We have applied this also to social networks usage, so that you can specify that you only want testers who use social networks at least several times a week, rather than only several times a week.  So selecting this will now also include testers who use social networks daily.

Keep those suggestions for improvement coming.

Posted in TryMyUi | Leave a comment

Five Secrets to Writing a Great Remote Usability Test

By Sani El-Fishawy | Published: June 16, 2011

With the advent of remote usability testing services such as TryMyUI and others just about anyone can create a usability test in minutes and have it performed by a user somewhere in the world in a matter of hours. The can receive a video of the users screen and his voice as he performs the test for as little as $35.

Because it is so easy and cheap to conduct remote usability tests, designers, developers product managers and others who don’t have a great deal of experience in writing a good test script are writing them. We run the remote usability testing service TryMyUI and we have reviewed thousands of tests and have found that the way the scenario and tasks portion of a test is written greatly affects the results you get when a user performs the test. There are a few common mistakes that novice test creators make. Writing a good usability test is quite straightforward especially if you keep in mind the following guidelines.

Read More »

Posted in Customers, TryMyUi, Uncategorized | 1 Comment

Tips On Writing Usability Tests When You Need Them

By Farhad Farzaneh | Published: June 2, 2011

Previously, we wrote about some tips on how to write a good usability test on this blog.  We have now incorporated some of those tips into a tips page that you can access whenever you are creating a new usability test or editing one you have previously created, on the upper right hand corner of the window:

You can access tips on writing usability tests when you are creating or editing a usability test

When you click on this link, an overlay window is displayed showing the tips:

Please use these and get more out of your tests.

Posted in Practice, TryMyUi | Leave a comment

Tips for writing a usability test

By Farhad Farzaneh | Published: June 2, 2011

To date at TryMyUi we have  reviewed many thousands of usability test videos based upon tests created by our customers so we’ve learned what types of questions and tasks elicit good test results.  Writing a good usability test is not something that is intuitive, but with a bit of thought and planning, it’s easy to accomplish.  The first question is: what are you trying to learn? Nominally, there are two general types of learnings:

  1. Do users understand my value proposition?  Do they understand what services are provide, and are they enticed?
  2. I want to see if users understand how to accomplish various tasks (these are presumably based upon the “use cases” or “user stories” that drove development)

Read More »

Posted in Practice, TryMyUi | 2 Comments

Video Indexing!

By Farhad Farzaneh | Published: May 20, 2011

We have introduced a new feature that we call

“video indexing”.  It allows you to quickly click and set the video to the start of each task, kind of like the index you find in DVD’s.  The way it works is that we mark the time when the tester clicks on “next task”, then use that to position the video.  Videos that have this task timing are presented with a new “video index” tab, where each task has a “play” marker  that allows you to go to its position in the video.   In addition, we show the task’s duration. This should help you both get a quantitative view on how longs tasks take, and also quickly go to a task of interest.

Let us know what you think

Posted in TryMyUi | Leave a comment

New features on trymyui.com

By admin | Published: May 20, 2011

Responding to your requests, we’ve added a couple of nifty features on trymyui.com.

Autosaved notes

A couple of you had the unpleasant experience that if you rated a use test without saving your notes, the notes window would disappear, causing you to lose your notes.  Our bad  - that was a design flaw.  As penance, we’ve double-fixed that:

  1. We now auto-save your notes every 15 seconds, else you can save it manually with the “save now” button
  2. We now keep you on the video page when you submit the rating – the video overlay no longer disappears

Autosized video display

Second, a number of you indicated that you were unable to take advantage of your large screens because the size of the overlay window was fixed.  We fixed that too.  Now the player determines how big your main window is, and auto-adjusts to take maximum advantage.  Additionally, if you resize your window, the overlay resizes with it!   We think you’ll like these.

Play overlay now takes up the whole screen

Play overlay now takes up the whole screen

Keep those suggestions coming – we’re eager to please.


Posted in TryMyUi | Leave a comment

Remedies for “Oops – I made a mistake in setting up my use test”

By Farhad Farzaneh | Published: May 6, 2011

dohWe added a couple of features recently to handle the oops case.  This happens when you set up a use test, send it out to testers, and then realize that you had made a mistake.  Previously, once a test had been commissioned, it was like a letterin the mailbox – it was in the system and no longer changeable.  Having received many requests from customers to change this, we now have 2 remedies.

Live Editing

If the error is in one of the test fields, such as the url, scenario, or tasks, simply click the edit button at the bottom of the test on your “my tests” page, and you can edit any of the descriptive fields.  You cannot, however, change any demographics once a test has been commissioned, because the test has already gone out to the testers.

Cancelling the order

We have now also added the ability to cancel an order, and have the credits returned to your account, with some caveats.  If a test has already been picked up, then we (and therefore you) are obligated to pay the tester for their time and effort.  So you will not immediately get any credits for such tests that are in progress.  However, we will credit your account if the test is not accepted for whatever reason.  We do prohibit testers from picking up tests from canceled ordered though, so if you cancel a test immediately, you will likely get all credits back and can then create a new test based upon the canceled one, make necessary modifications, and re-issue the test.

Posted in TryMyUi | Leave a comment

Don’t count on people to read instructions

By Farhad Farzaneh | Published: April 26, 2011

While user testing on trymyui is easy,  it’s even easier for us to test our own design because each test that comes back reflects whether we’ve done a good job with how we display our instructions.  In a trymyui test, the test creator establishes a “frame-of-mind” for the tester, such as, “Imagine you’re going on a trip to italy with your family of 6.  Use this website to find accommodations”.   We presented this text prior to launching the recording windows, and also on the recording window, and yet we found that some testers (who have already been through a qualification round) would often not read it carefully.    Why? Presumably because the “frame-of-mind” section was on a page with other instructions, and the testers were missing it because the other instructions don’t change from test to test.

A remedy that we recently implemented was to add a first test task asking testers to read the “frame-of-mind” section out loud.   Not necessarily pretty, but quite effective.

Posted in TryMyUi | Leave a comment
« Older posts
  • Pages

    • About
  • Categories

    • Customers
    • Entrepreneurship
    • Gallery
    • Musings
    • Partners
    • Practice
    • TryMyUi
    • Uncategorized
  • Blogroll

    • TryMyUi
  • RSS Links

    • All posts
    • All comments
  • Meta

    • Log in