Smartwatch Usability

Using the industry-known Jakob Nielsen’s 10 heuristics principles, I evaluated a feature in Fitbit Sense, a smartwatch released in September 2020. The goal was to systematically document usability issues that are present in wearable interfaces like this one and gather insights to improve future designs.

Following the approach recommended by the Interaction Design Foundation to conduct heuristics evaluations, I initiated the process by defining the scope of the assessment. Considering the broad range of features offered by Fitbit Sense (see Fig. 1), I focused the analysis on the stress management feature, which provides users with information on their stress level & recommendations on how to manage it by tracking electrical variations on the skin, called electrodermal activity (EDA) responses (see Video 1).

Device Features

Fig. 1: List of Fitbit Sense features. Source: www.fitbit.com, fair use.

Video 1: EDA functionality to help users manage stress.

The next step was to determine the target users, their goals, context of use, and mental models. In this evaluation, I am both the user and the evaluator. To have a point of reference, I would match with users with this persona (see Fig. 2): female, aged in the range 30-35, married, young professional, with a post-graduate education, and living in Europe, in an urban zone. I am very interested in how technology helps improve people's quality of life, while at the same time respecting people's data and embracing sustainability principles. My goal using this smartwatch is fundamentally to learn more about my health and get empowered to do things to improve it. Following Lundell and Bates' classification of user journeys using smartwatches, this persona falls into the category "Tool Techie".

Fig. 2: Avatar of a target user of smartwatches.

Finding usability experts who would also own the same type of smartwatch was difficult. For that reason, I am the single evaluator in this study. I am a Digital Product Designer with 9+ years of experience working as a Researcher & recently as a freelance UX Designer. I am trained & experienced in user research, usability testing, and the management of the smartwatch in the study.

After determining the usability criteria to evaluate (see above), I selected a ranking to assess the severity of the usability issues. Using a scale from 0 to 4 (see Fig. 3), ranging from no usability problem to serious usability issue, I assessed the feature in the smartwatch & complimentary mobile app. Then, I documented the observations and derived conclusions from the patterns identified.

This exercise helps to better understand what usability aspects are particularly relevant to wearable devices like smartwatches and allows to improve the user experience in future designs.

Fig. 3: Assessment scale used in the heuristics evaluation.

Usability observations

Heuristic Evaluation Template_Smartwatch_Fitbit Sense.pdf

Fig. 4: Images of Fitbit Sense smartwatch & mobile application during the usability heuristics evaluation. View complete image repository in OneDrive.

Fig. 5: Radar chart indicating the results of the heuristics evaluation. Note: The numbers refer to Jakob Nielsen’s 10 heuristics principles listed in the report.

As indicated in the documentation and made visible in Fig. 5, usability heuristics #1, #8, and #9 require attention since they significantly affect the quality of users' interaction with the smartwatch & the app. The recommendations are:

  • During the scan process, provide users with regular & subtle haptics (e.g., a pulse), to encourage them to be patient. An alternative could be to play background music, which could also aid users to reduce their levels of stress.

  • Further summarize the background information provided. And lead users to the mobile app whenever more detailed information is presented to them. Also, bullet points, graphs, and icons can help increase usability, conveying more information in a shorter time and generating less cognitive load.

  • Users should also be given an immediate possibility to re-start the scan or help fix it with, e.g., a longer scan process to gather the necessary data. In this way, we avoid making users wait until the end of the scan to realize that no data was captured to make a stress assessment.

Outlook

  • Fitbit Sense is assisted by advanced technologies like biosensors and AI to provide users with detailed information about the state of their health. Considering this aspect, the next phase of this analysis can incorporate, for example, Google AI + People Design Guideline, to evaluate how AI features were integrated into the product in light of transparency (ethics, explainability & data protection), errors & feedback management, and user control.

  • It would be useful to expand the functionality of the product to integrate components that further help users manage their mental health, which is part of the Sustainable Development Goals. Currently, Fitbit addresses mental health as stress management. It would be useful to further evaluate how meaningful EDA is to assess the depth of mental health quality in users.

  • Given the broad range of health indicators that can be tracked with the smartwatch in combination with the mobile app, users could benefit from having a combined, comprehensive assessment of their health status. Having integrations between the health features could assist users, e.g., understanding how long periods of inactivity influences parts of their health, like blood pressure, heartbeat, stress levels, etc. Interconnection is key here, however, that adds more complexity and the need of further medical/scientific involvement in the development of the app.

  • Although not covered in this usability analysis, setting up the device should be as straightforward as the regular use of the different features. From my experience and what I could notice from several users on Fitbit community forums, users experience difficulties setting up the Google Assistant and taking calls from the wrist. Frustrations on complementary features like these ones influence users' perception of the whole device's capabilities and usefulness. Fitbit could integrate more help options on these specific features that are now known to cause problems to users.

Limitations of the Assessment

  • The analysis was performed by a single evaluator due to limited access to the same type of device by other potential contributors.

  • The reviewer was also the user.

References

  1. Fitbit. Sense. Online Documentation. Visited on Jan. 26, 2022. Available here: https://www.fitbit.com/global/us/products/smartwatches/sense?sku=512SRSG.

  2. Fitbit. Technology: Stress Management. Online Documentation. Visited on Jan. 29, 2022. Available here: https://www.fitbit.com/global/us/technology/stress.

  3. Google PAIR. People + AI Guidebook. 2019. Online Documentation. Visited on Jan. 28, 2022. Available here: pair.withgoogle.com/guidebook.

  4. Interaction Design Foundation. Heuristic Evaluation. Online Documentation. Visited on Jan. 26, 2022. Available here: https://www.interaction-design.org/literature/topics/heuristic-evaluation.

  5. Lundell J., Bates C. (2016) Understanding User Experience Journeys for a Smart Watch Device. In: Nah FH., Tan CH. (eds) HCI in Business, Government, and Organizations: Information Systems. HCIBGO 2016. Lecture Notes in Computer Science, vol 9752. Springer, Cham. https://doi.org/10.1007/978-3-319-39399-5_40.

  6. Nielsen, J. 2020. 10 Usability Heuristics for User Interface Design. Nielsen Norman Group. Online Documentation. Visited on Jan. 26, 2022. Available here: https://www.nngroup.com/articles/ten-usability-heuristics/.

  7. WHO. Mental health. Online Documentation. Visited on Jan. 26, 2022. Available here: https://www.who.int/health-topics/mental-health#tab=tab_1.

Next on Designing for AI

Human Factors in AI

AI Product Design