Rubric

Keep in mind that 195 students have already been assessed using this rubric. Changing it will affect their evaluations.
User evaluation of the low-fidelity prototype
User evaluation of the low-fidelity prototype
Criteria Ratings Pts
Participants
threshold: pts
20 pts Exemplary The participants recruited for the evaluation represented the personas for the project or the participants engaged in designed role play that effectively simulated the personas.
15 pts Accomplished
10 pts Acceptable The participants recruited for the evaluation were only partially representative of the personas for the project.
5 pts Emerging
0 pts Unacceptable The participants were not representative or described in relation to the personas for the project.
pts
20 pts
--
Method
threshold: pts
10 pts Exemplary The method test the concept and usability of the prototype with as much realism as possible. The method included descriptions of the participants, tasks, evaluation locations, dates, duration, what was observed, and what questions were asked of the participants. There was enough detail that the method could be repeated.
7.5 pts Accomplished
5 pts Acceptable The method missed opportunities to gain insight (e.g., due to ineffective or incomplete task design). Alternatively, some critical details of the method (e.g., about the participants, tasks, or procedure) were missing, preventing replicability.
2.5 pts Emerging
0 pts No Marks No method was reported or was irrelevant to evaluating the prototype for the project.
pts
10 pts
--
Results
threshold: pts
20 pts Full Marks The results describe three or more non-trivial usability problems discovered from the evaluation. In addition, the results describe users' perceived strengths and weaknesses of the prototype in relation to the project goals.
15 pts Accomplished
10 pts Acceptable The results were incomplete. For example, only one or two non-trivial usability problems were identified or described clearly. Alternatively, some of the user perceptions were unclear, trivial, or did not follow from the user evaluation.
5 pts Emerging
0 pts Unacceptable The results were trivial, did not follow from the user evaluation, or were irrelevant to the project.
pts
20 pts
--
Design ideas
threshold: pts
30 pts Exemplary Three or more non-trivial, plausible design ideas were provided and address nearly all of the issues reported. If incorporated, the design ideas have the potential to significantly improve the prototype.
22.5 pts Accomplished
15 pts Acceptable Only one or two non-trivial design ideas were provided or may not lead to significant improvements in the prototype. Alternatively, the design ideas may not be plausible or only addressed about half of the issues reported.
7.5 pts Emerging
0 pts Unacceptable No design ideas were described, the ideas were trivial, or the ideas were irrelevant to the project.
pts
30 pts
--
Slide design
threshold: pts
10 pts Exemplary The design of the slide deck for the planned presentation enhanced the content. The choice of imagery, fonts, colors, and layout were effective; and the content had a logical organization.
7.5 pts Accomplished
5 pts Acceptable The design of the slide deck had noticeable problems, such as fonts being too small, too much textual content on the slide, or illogical organization. The problems, though present, did not overpower the content.
2.5 pts Emerging
0 pts Unacceptable The design of the slide deck had many noticeable problems, such as the fonts being too small, having too much text on the slides, or illogical organization. The problems overpowered the content.
pts
10 pts
--
Delivery
threshold: pts
10 pts Exemplary The team delivered the presentation effectively, highlighted the key insights of the prototype, and were well prepared for the presentation.
7.5 pts Accomplished
5 pts Acceptable The team delivered the presentation but there were noticeable issues with the delivery such as awkward pauses, skipping content, or team members interrupting each other or forgetting what to say.
2.5 pts Emerging
0 pts Unacceptable The delivery of the presentation was ineffective because the team was unprepared.
pts
10 pts
--