Evaluation of Digital Mock-ups
With such small sample sizes, it is difficult to draw many conclusions from this data, and we cannot identify any clear trends in the closed form question responses between the original and updated versions. Question 1′s results appear to be a bit at odds with question 2′s, however several answers to question 6 (”Did the app provide you with any unpleasant surprises or disappointments?”) indicated that the respondent was unclear on what task the mock-up was trying to demonstrate, as well as the context of this being one part of a social network app. One respondent reported that “I wasn't quite sure what task user was trying to accomplish...” while another wrote that “I wasn't totally clear on the broader context of the app. Is this its own social network?” A more thorough introduction to the project and the mock-up may yield different results for question 1.
Question 3′s results suggest an overall lack of enthusiasm toward the solution. It’s not clear to what extent this is due to an unclear explanation of the problem being solved (see above re: question 6), but an analysis of the individual responses suggests another explanation. Of the six respondents overall, only two identified as racial, gender, or sexual minority. One of the self-identified minority respondents was also the only one to report blocking users on any social network more frequently than “a few times a year,” making them the only one of the sex respondents who appears to be in the target market for the product. Encouragingly, they reported that they “Strongly Agree” on all three closed form questions.
