After the results came in, we parsed the survey results and analyzed key pieces of the video data to see how the two sites compared. This post describes our methods, what we learned, and the implications for running your own competitive user testing study.
Personal biases can affect every part of your usability testing research, from the setup to the analysis and implementation of the findings. What can we do to eliminate bias and see the user experience clearly?
Download a spreadsheet containing every dataset for your user test: the videos, written responses, SUS scores, SEQ scores, task completion ratings, task duration times, and UXCrowd voting tallies, all in one file.
The best research doesn’t make a difference unless it has an advocate that can analyze, interpret, and communicate it effectively. Data does not matter on its own; its our job to make it matter.