Get the Most out of 5-Second Tests
Are 5-second tests a useful tool for evaluating web pages? Several online tools offer them, and they are easy to set up, but what value do they provide? My doubts boiled down to:
Who only spends 5 seconds looking at a website? In my normal browsing behavior I rarely hit the back button after only 5 seconds, unless the site is very obviously the wrong thing or it's a broken page.
The usual instruction to "remember as much as you can" makes me scan the page totally differently than when I'm actually seeking information.
What should a user be able to take away from a page after such a short time?
I've come to the conclusion that 5-second tests can have some value for certain pages when set up well.
Five-second tests are best suite to judge pages where users most often land, and which generally serve a single purpose and audience.
One of the few authoritative articles I found on 5-second test was written by Christine Perfetti on UIE's website. It is an in-depth explanation with a great example. One key component she mentions is to start the users off with a specific task/context (not just "remember everything you can!").
What is the typical scenario for users arriving to the page you're testing?Paid search? Following a link from a friend? An email newsletter? Provide that specific context to put the user in the right mindset.
Ask the right follow-up questions
Another element Perfetti recommends is specific follow-up questions. Don't just ask users to "list everything you remember". Also ask 1 to 2 specific follow up questions. For example, "Who is this website for?", "What can you do on this website?", "Is this site for buying or browsing?"
Develop expectations beforehand
In order to write the best follow-up questions, you have to decide what you want and expect your page's visitors to understand immediately about the page. Is it enough to pick out the right audience ("this site is for schoolteachers")? Or, do you need to communicate the product or service as well ("this site helps schoolteachers asses students' reading levels")?
Make sure to try out a few 5-second tests to see for yourself how little you may actually register of a web page in that time. Set your expectations of users accordingly.
The best site I've seen so far for 5-second tests is UsabilityHub.com. Try out some tests and set up your own. The results are presented in a word cloud along with raw answers.
VerifyApp.com also provides 5-second tests, but you can't specify your own follow-up questions. However, you can do a split test.