What do thinking-aloud participants say? A comparison of moderated and unmoderated usability sessions

Research output: Contribution to journalJournal articlepeer-review

Documents

  • Morten Hertzum
  • Pia Borlund
  • Kristina Bonde Kristoffersen
The value of thinking aloud in usability tests depends on the content of the users’ verbalizations. We investigated moderated and unmoderated users’ verbalizations during relaxed thinking aloud (i.e., verbalization at levels 1 through 3). Verbalizations of user experience were frequent and mostly relevant to the identification of usability issues. Explanations and redesign proposals were also mostly relevant, but infrequent. The relevance of verbalizations of user experience, explanations, and redesign proposals showed the value of relaxed thinking aloud but did not clarify the tradeoff between rich verbalizations and test reactivity. Action descriptions and system observations – two verbalization categories consistent with both relaxed and classic thinking aloud – were frequent but mainly of low relevance. Across all verbalizations, the positive or negative verbalizations were more often relevant than those without valence. Finally, moderated and unmoderated users made largely similar verbalizations, the main difference being a higher percentage of high-relevance verbalizations by unmoderated users
Original languageEnglish
JournalInternational Journal of Human-Computer Interaction
Volume31
Issue number9
Pages (from-to)557-570
Number of pages14
ISSN1044-7318
DOIs
Publication statusPublished - 2015

    Research areas

  • Faculty of Humanities - Thinking aloud, Verbalization, Usability evaluation method, User test, Usability, User experience

Number of downloads are based on statistics from Google Scholar and www.ku.dk


No data available

ID: 135720899