Automatic Identification of Physical Activity Type and Duration by Wearable Activity Trackers: A Validation Study

Abstract

BACKGROUND: Activity trackers are now ubiquitous in certain populations, with potential applications for health promotion and monitoring and chronic disease management. Understanding the accuracy of this technology is critical to the appropriate and productive use of wearables in health research. Although other peer-reviewed validations have examined other features (eg, steps and heart rate), no published studies to date have addressed the accuracy of automatic activity type detection and duration accuracy in wearable trackers. OBJECTIVE: The aim of this study was to examine the ability of 4 commercially available wearable activity trackers (Fitbits Flex 2, Fitbit Alta HR, Fitbit Charge 2, and Garmin Vívosmart HR), in a controlled setting, to correctly and automatically identify the type and duration of the physical activity being performed. METHODS: A total of 8 activity types, including walking and running (on both a treadmill and outdoors), a run embedded in walking bouts, elliptical use, outdoor biking, and pool lap swimming, were tested by 28 to 34 healthy adult participants (69 total participants who participated in some to all activity types). Actual activity type and duration were recorded by study personnel and compared with tracker data using descriptive statistics and mean absolute percent error (MAPE). RESULTS: The proportion of trials in which the activity type was correctly identified was 93% to 97% (depending on the tracker) for treadmill walking, 93% to 100% for treadmill running, 36% to 62% for treadmill running when preceded and followed by a walk, 97% to 100% for outdoor walking, 100% for outdoor running, 3% to 97% for using an elliptical, 44% to 97% for biking, and 87.5% for swimming. When activities were correctly identified, the MAPE of the detected duration versus the actual activity duration was between 7% and 7.9% for treadmill walking, 8.7% and 144.8% for treadmill running, 23.6% and 28.9% for treadmill running when preceded and followed by a walk, 4.9% and 11.8% for outdoor walking, 5.6% and 9.6% for outdoor running, 9.7% and 13% for using an elliptical, 9.5% and 17.7% for biking, and was 26.9% for swimming. CONCLUSIONS: In a controlled setting, wearable activity trackers provide accurate recognition of the type of some common physical activities, especially outdoor walking and running and walking on a treadmill. The accuracy of measurement of activity duration varied considerably by activity type and tracker model and was poor for complex sets of activity, such as a run embedded within 2 walking segments.