The participants recruited for the study represented the personas for the project or the participants engaged in designed role play that effectively simulated the personas.
The method was appropriate for answering the research questions and to gain insight into the project. The method included descriptions of the participants, role play, tasks, evaluation locations, dates, duration, what was observed, and what interview or survey questions were asked of the participants. There was enough detail that the method could be repeated.
Missed opportunities to fully answer the research questions or gain insight (e.g., due to ineffective or incomplete task design). Alternatively, some critical details of the method (e.g., about the participants, tasks, or procedure) were missing, preventing replicability.
Data collection was complete, comprehensive, and insightful in relation to the research questions and project goals. The method of data collection and how the data related to the research questions was clearly explained.
Results were summarized to answer the research questions and drew from participant feedback, interaction data, and observations of use. The data was aggregated, visually summarized where appropriate, and interpreted in relation to the research questions and project goals.
Results were provided for only some of the research questions, were difficult to understand, or were not interpreted in relation to the research questions.
Three or more non-trivial design ideas were described from the study results. The ideas were plausible and, if implemented, the design ideas would significantly improve the prototype.
Find Rubric