What Do Usability Test Moderators Say? ‘Mm hm’, ‘Uh-huh’, and Beyond

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Standard

What Do Usability Test Moderators Say? ‘Mm hm’, ‘Uh-huh’, and Beyond. / Hertzum, Morten; Kristoffersen, Kristina Bonde.

NordiCHI2018: Proceedings of the 10th Nordic Conference on Human-Computer Interaction. New York : Association for Computing Machinery, 2018. p. 364-375.

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Harvard

Hertzum, M & Kristoffersen, KB 2018, What Do Usability Test Moderators Say? ‘Mm hm’, ‘Uh-huh’, and Beyond. in NordiCHI2018: Proceedings of the 10th Nordic Conference on Human-Computer Interaction. Association for Computing Machinery, New York, pp. 364-375. https://doi.org/10.1145/3240167.3240181

APA

Hertzum, M., & Kristoffersen, K. B. (2018). What Do Usability Test Moderators Say? ‘Mm hm’, ‘Uh-huh’, and Beyond. In NordiCHI2018: Proceedings of the 10th Nordic Conference on Human-Computer Interaction (pp. 364-375). Association for Computing Machinery. https://doi.org/10.1145/3240167.3240181

Vancouver

Hertzum M, Kristoffersen KB. What Do Usability Test Moderators Say? ‘Mm hm’, ‘Uh-huh’, and Beyond. In NordiCHI2018: Proceedings of the 10th Nordic Conference on Human-Computer Interaction. New York: Association for Computing Machinery. 2018. p. 364-375 https://doi.org/10.1145/3240167.3240181

Author

Hertzum, Morten ; Kristoffersen, Kristina Bonde. / What Do Usability Test Moderators Say? ‘Mm hm’, ‘Uh-huh’, and Beyond. NordiCHI2018: Proceedings of the 10th Nordic Conference on Human-Computer Interaction. New York : Association for Computing Machinery, 2018. pp. 364-375

Bibtex

@inproceedings{08a3ec1438dd4938b21da2dbb3ca41dd,
title = "What Do Usability Test Moderators Say? {\textquoteleft}Mm hm{\textquoteright}, {\textquoteleft}Uh-huh{\textquoteright}, and Beyond",
abstract = "Moderators in usability tests wrestle with the conflicting goals of obtaining relevant information from the users while at the same time avoiding to influence the users in ways that change how they use and feel about the tested system. In this study we investigate what moderators say by categorizing the moderator verbalizations from 12 test sessions. During the test tasks affirmations (38%) were the most common moderator verbalizations, followed by task instructions (32%) and prompts for reflection (16%). In addition, more of the moderator verbalizations during the tasks were closed (31%) than open (14%) and many more were positive (16%) than negative (1%). The moderators verbalized at a lower rate during the tasks than in the part of the sessions before the first task and after the last task. Still, they talked quite a lot. We discuss the content of their verbalizations and the implications of our findings.",
keywords = "Faculty of Humanities, Usability evaluation method, Usability testing, Test moderation, Test instructions, Verbal reports, Thinking aloud",
author = "Morten Hertzum and Kristoffersen, {Kristina Bonde}",
year = "2018",
doi = "10.1145/3240167.3240181",
language = "English",
pages = "364--375",
booktitle = "NordiCHI2018: Proceedings of the 10th Nordic Conference on Human-Computer Interaction",
publisher = "Association for Computing Machinery",

}

RIS

TY - GEN

T1 - What Do Usability Test Moderators Say? ‘Mm hm’, ‘Uh-huh’, and Beyond

AU - Hertzum, Morten

AU - Kristoffersen, Kristina Bonde

PY - 2018

Y1 - 2018

N2 - Moderators in usability tests wrestle with the conflicting goals of obtaining relevant information from the users while at the same time avoiding to influence the users in ways that change how they use and feel about the tested system. In this study we investigate what moderators say by categorizing the moderator verbalizations from 12 test sessions. During the test tasks affirmations (38%) were the most common moderator verbalizations, followed by task instructions (32%) and prompts for reflection (16%). In addition, more of the moderator verbalizations during the tasks were closed (31%) than open (14%) and many more were positive (16%) than negative (1%). The moderators verbalized at a lower rate during the tasks than in the part of the sessions before the first task and after the last task. Still, they talked quite a lot. We discuss the content of their verbalizations and the implications of our findings.

AB - Moderators in usability tests wrestle with the conflicting goals of obtaining relevant information from the users while at the same time avoiding to influence the users in ways that change how they use and feel about the tested system. In this study we investigate what moderators say by categorizing the moderator verbalizations from 12 test sessions. During the test tasks affirmations (38%) were the most common moderator verbalizations, followed by task instructions (32%) and prompts for reflection (16%). In addition, more of the moderator verbalizations during the tasks were closed (31%) than open (14%) and many more were positive (16%) than negative (1%). The moderators verbalized at a lower rate during the tasks than in the part of the sessions before the first task and after the last task. Still, they talked quite a lot. We discuss the content of their verbalizations and the implications of our findings.

KW - Faculty of Humanities

KW - Usability evaluation method

KW - Usability testing

KW - Test moderation

KW - Test instructions

KW - Verbal reports

KW - Thinking aloud

U2 - 10.1145/3240167.3240181

DO - 10.1145/3240167.3240181

M3 - Article in proceedings

SP - 364

EP - 375

BT - NordiCHI2018: Proceedings of the 10th Nordic Conference on Human-Computer Interaction

PB - Association for Computing Machinery

CY - New York

ER -

ID: 203624002