Rubric

Keep in mind that 194 students have already been assessed using this rubric. Changing it will affect their evaluations.
User testing of the functional prototype
User testing of the functional prototype
Criteria Ratings Pts
Research Questions
threshold: pts
20 pts Exemplary Three or more research questions were described and the motivation for these questions was explained. The questions were meaningful, appropriate, and testable for the project.
15 pts Accomplished
10 pts Acceptable Some of the research questions were not explained well or were inappropriate for the project.
5 pts Emerging
0 pts Unacceptable No questions were described, were not appropriate for the project, or were not comprehensible.
pts
20 pts
--
Method
threshold: pts
14 pts Exemplary The method was appropriate for answering the research questions and to gain insight into the project. The method included descriptions of the participants, tasks, evaluation locations, dates, duration, what was observed, and what questions were asked of the participants. There was enough detail that the method could be repeated.
10.5 pts Accomplished
7 pts Acceptable The method was not clearly described, important details were omitted preventing replicability, or was ineffective for answering the research questions.
3.5 pts Emerging
0 pts Unacceptable No method was reported or was not appropriate for answering the research questions.
pts
14 pts
--
Data Collection
threshold: pts
14 pts Exemplary Data collection was reported with clear explanation for how the data was collected and how the data relates to the research questions. The data was complete, comprehensive, and insightful in relation to the research questions.
10.5 pts Accomplished
7 pts Acceptable The reporting of the data collection was unclear, or related to only a subset of the research questions.
3.5 pts Emerging
0 pts Unacceptable No data collection was reported.
pts
14 pts
--
Results and Interpretation
threshold: pts
32 pts Exemplary Results were provided for the research questions and drew from the user feedback, interaction data, and observations of use. The data was aggregated, visually summarized where appropriate, and interpreted in relation to the research questions.
24 pts Accomplished
16 pts Acceptable Results were provided for only some of the research questions, were difficult to understand, or were not interpreted in relation to the research questions.
8 pts Emerging
0 pts Unacceptable No results were provided.
pts
32 pts
--
Design Ideas
threshold: pts
20 pts Exemplary Three non-trivial design ideas were described and were rooted in the study results. The ideas were plausible and, if implemented, would significantly improve the effectiveness of the prototype.
15 pts Accomplished
10 pts Acceptable Three design ideas were described, but some were not plausible or would not improve the user interface of the project.
5 pts Emerging
0 pts Unacceptable The design ideas were not described or were not relevant to the user interface of the project.
pts
20 pts
--
Participants
threshold: pts
10 pts Exemplary The participants recruited for the study represented the personas for the project or the participants engaged in designed role play that effectively simulated the personas.
7.5 pts Accomplished
5 pts Acceptable The participants recruited for the study were only partially representative of the personas for the project.
2.5 pts Emerging
0 pts Unacceptable The participants were not representative or described in relation to the personas for the project.
pts
10 pts
--