Smartwatch Usability

Using the industry-known Jakob Nielsen’s 10 heuristics principles, I evaluated a feature in Fitbit Sense, a smartwatch released in September 2020. The goal was to systematically document usability issues that are present in wearable interfaces like this one and gather insights to improve future designs.

Following the approach recommended by the Interaction Design Foundation to conduct heuristics evaluations, I initiated the process by defining the scope of the assessment. Considering the broad range of features offered by Fitbit Sense (see Fig. 1), I focused the analysis on the stress management feature, which provides users with information on their stress level & recommendations on how to manage it by tracking electrical variations on the skin, called electrodermal activity (EDA) responses (see Video 1). 

Device Features

Fig. 1: List of Fitbit Sense features. Source: www.fitbit.com, fair use.

Video 1: EDA functionality to help users manage stress.

The next step was to determine the target users, their goals, context of use, and mental models. In this evaluation, I am both the user and the evaluator. To have a point of reference, I would match with users with this persona (see Fig. 2): female, aged in the range 30-35, married, young professional, with a post-graduate education, and living in Europe, in an urban zone. I am very interested in how technology helps improve people's quality of life, while at the same time respecting people's data and embracing sustainability principles. My goal using this smartwatch is fundamentally to learn more about my health and get empowered to do things to improve it. Following Lundell and Bates' classification of user journeys using smartwatches, this persona falls into the category "Tool Techie".

Fig. 2: Avatar of a target user of smartwatches.

Finding usability experts who would also own the same type of smartwatch was difficult. For that reason, I am the single evaluator in this study. I am a Digital Product Designer with 9+ years of experience working as a Researcher & recently as a freelance UX Designer. I am trained & experienced in user research, usability testing, and the management of the smartwatch in the study. 

After determining the usability criteria to evaluate (see above), I selected a ranking to assess the severity of the usability issues. Using a scale from 0 to 4 (see Fig. 3), ranging from no usability problem to serious usability issue, I assessed the feature in the smartwatch & complimentary mobile app. Then, I documented the observations and derived conclusions from the patterns identified. 

This exercise helps to better understand what usability aspects are particularly relevant to wearable devices like smartwatches and allows to improve the user experience in future designs. 

Fig. 3: Assessment scale used in the heuristics evaluation.

Usability observations

Heuristic Evaluation Template_Smartwatch_Fitbit Sense.pdf

Fig. 4: Images of Fitbit Sense smartwatch & mobile application during the usability heuristics evaluation. View complete image repository in OneDrive.

Fig. 5: Radar chart indicating the results of the heuristics evaluation. Note: The numbers refer to Jakob Nielsen’s 10 heuristics principles listed in the report.

As indicated in the documentation and made visible in Fig. 5, usability heuristics #1, #8, and #9 require attention since they significantly affect the quality of users' interaction with the smartwatch & the app. The recommendations are:

Outlook

Limitations of the Assessment

References

Note: We are not responsible for the content, accuracy, or data security of third-party links. 

Next on Designing for AI

Human Factors in AI

AI Product Design