How usable is Coursera? A usability analysis through eye-tracking and authentic tasks

Abstract

Massive Open Online Courses (MOOCs) are considered learning environments that eliminate many learning barriers. Online courses in MOOCs have become an opportunity for everyone during the lockdown of the COVID-19 outbreak. However, usability issues may cause problems such as high dropout rates and lack of learner's motivation. Therefore, in this study, the usability of Coursera, one of the most known MOOCs in the world, was evaluated. The evaluation was performed with ISO 9241-11 standard. The environment's effectiveness, efficiency, and satisfaction were evaluated with the authentic tasks requested to be done in Coursera. Additionally, the findings were supported by eye-tracking metrics such as fixation duration, fixation counts, heat maps, and gaze plots. Twelve individuals (six females, six males) participated in the authentic tasks, and three individuals (two females, one male) participated in the eye-tracking phase. Results of the study revealed that most participants successfully performed the authentic tasks and are generally satisfied with the usability of the environment. However, considering eye-tracking findings and Coursera Usage Satisfaction Survey, some usability problems such as inadequate language support and the difficulty of using the search feature emerged. In the end, possible reasons were discussed, and the suggestions were presented for usability improvements.