INTRODUCTION: Although numerous activity trackers have been validated in healthy populations, validation is lacking in chronic heart failure patients who normally walk at a slower pace, making it difficult for researchers and clinicians to implement activity monitors during physical activity interventions. METHODS: Six consumer-level activity monitors were validated in a 3-day field study in patients with chronic heart failure and healthy individuals under free living conditions. Furthermore, the same devices were evaluated in a lab-based study during treadmill walking at speeds of 2.4, 3.0, 3.6, and 4.2 km·h-1. Concordance correlation coefficients (CCC) were used to evaluate the agreement between the activity monitors and the criterion, and mean absolute percentage errors (MAPE) were calculated to assess differences between each device and the criterion (MAPE <10% was considered as a threshold for validity). RESULTS: In the field study of healthy individuals, all but one of the activity monitors showed a substantial correlation (CCC ≥0.95) with the criterion device and MAPE <10%. In patients with heart failure, the correlation of only two activity monitors (Garmin vívofit 3 and Withings Go) was classified as at least moderate (CCC ≥0.90) and none of the devices had MAPE <10%. In the lab-based study at speeds 4.2 and 3.6 km·h-1, all activity monitors showed substantial to almost perfect correlations (CCC ≥0.95) with the criterion and MAPE in the range 1%-3%. However, at slower speeds of 3.0 and 2.4 km·h-1, the accuracy of all devices substantially deteriorated: their correlation with the criterion decreased below 90% and their MAPE increased to 4-8% and 10-45%, respectively. CONCLUSIONS: Even though none of the tested activity monitors fall within arbitrary thresholds for validity, most of them perform reasonably well enough to be useful tools that clinicians can use to simply motivate chronic heart failure patients to walk more.

2nd Department of Medicine Department of Cardiovascular Medicine 1st Faculty of Medicine Charles University and General University Hospital Prague Prague Czech Republic

2nd Faculty of Medicine Charles University Prague Czech Republic

Faculty of Physical Education and Sport Charles University Prague Czech Republic

Zobrazit více v PubMed

Piepoli MF, Conraads V, Corrà U, Dickstein K, Francis DP, Jaarsma T, et al. Exercise training in heart failure: from theory to practice. A consensus document of the Heart Failure Association and the European Association for Cardiovascular Prevention and Rehabilitation. Eur J Heart Fail. 2011. April;13(4):347–57. 10.1093/eurjhf/hfr017 PubMed DOI

Long L, Mordi IR, Bridges C, Sagar VA, Davies EJ, Coats AJ, et al. Exercise-based cardiac rehabilitation for adults with heart failure. Cochrane Heart Group, editor. Cochrane Database Syst Rev. 2019. January 29;8(5):860–184. PubMed PMC

Nolte K, Herrmann-Lingen C, Wachter R, Gelbrich G, Düngen H-D, Duvinage A, et al. Effects of exercise training on different quality of life dimensions in heart failure with preserved ejection fraction: the Ex-DHF-P trial. Eur J Prev Cardiol. 2015. May;22(5):582–93. 10.1177/2047487314526071 PubMed DOI

Conraads VM, Deaton C, Piotrowicz E, Santaularia N, Tierney S, Piepoli MF, et al. Adherence of heart failure patients to exercise: barriers and possible solutions: a position statement of the Study Group on Exercise Training in Heart Failure of the Heart Failure Association of the European Society of Cardiology. Eur J Heart Fail. 2012. May;14(5):451–8. 10.1093/eurjhf/hfs048 PubMed DOI

Vetrovsky T, Siranec M, Parenica J, Griva M, Stastny J, Precek J, et al. Effect of a 6-month pedometer-based walking intervention on functional capacity in patients with chronic heart failure with reduced (HFrEF) and with preserved (HFpEF) ejection fraction: study protocol for two multicenter randomized controlled trials. J Transl Med. 2017. July 3;15(1):153–62. 10.1186/s12967-017-1257-x PubMed DOI PMC

Bravata DM, Smith-Spangler C, Sundaram V, Gienger AL, Lin N, Lewis R, et al. Using pedometers to increase physical activity and improve health: a systematic review. JAMA. 2007. November 21;298(19):2296–304. 10.1001/jama.298.19.2296 PubMed DOI

Harris T, Kerry SM, Limb ES, Victor CR, Iliffe S, Ussher M, et al. Effect of a primary care walking intervention with and without nurse support on physical activity levels in 45- to 75-year-olds: the pedometer and consultation evaluation (PACE-UP) cluster randomised clinical trial. PLoS Med. 2017. January;14(1):e1002210 10.1371/journal.pmed.1002210 PubMed DOI PMC

Vetrovsky T, Čupka J, Dudek M, Kuthanova B, Vetrovska K, Capek V, et al. A pedometer-based walking intervention with and without email counseling in general practice: a pilot randomized controlled trial. BMC Public Health. 2018. May 13;18(1):635–47. 10.1186/s12889-018-5520-8 PubMed DOI PMC

Lee JA, Williams SM, Brown DD, Laurson KR. Concurrent validation of the Actigraph gt3x+, Polar Active accelerometer, Omron HJ-720 and Yamax Digiwalker SW-701 pedometer step counts in lab-based and free-living settings. J Sports Sci. 2014. December 20;33(10):991–1000. 10.1080/02640414.2014.981848 PubMed DOI

Evenson KR, Goto MM, Furberg RD. Systematic review of the validity and reliability of consumer-wearable activity trackers. Int J Behav Nutr Phys Act. 2015. December 18;12(1):e192. PubMed PMC

Šimůnek A, Dygrýn J, Gába A, Jakubec L, Stelzer J, Chmelík F. Validity of Garmin Vívofit and polar loop for measuring daily step counts in free-living conditions in adults. Acta Gymnica. 2016. January 1;46(3):129–35.

Panizzolo FA, Maiorana AJ, Naylor LH, Dembo L, Lloyd DG, Green DJ, et al. Gait analysis in chronic heart failure: The calf as a locus of impaired walking capacity. J Biomech. 2014. November 28;47(15):3719–25. 10.1016/j.jbiomech.2014.09.015 PubMed DOI

Fokkema T, Kooiman TJM, Krijnen WP, van der Schans CP, De Groot M. Reliability and validity of ten consumer activity trackers depend on walking speed. Med Sci Sports Exerc. 2017. April;49(4):793–800. 10.1249/MSS.0000000000001146 PubMed DOI

Crouter SE, Schneider PL, Karabulut M, Bassett DR. Validity of 10 electronic pedometers for measuring steps, distance, and energy cost. Med Sci Sports Exerc. 2003. August;35(8):1455–60. 10.1249/01.MSS.0000078932.61440.A2 PubMed DOI

van Remoortel H, Giavedoni S, Raste Y, Burtin C, Louvaris Z, Gimeno-Santos E, et al. Validity of activity monitors in health and chronic disease: a systematic review. Int J Behav Nutr Phys Act. 2012;9(1):84. PubMed PMC

Thorup CB, Andreasen JJ, Sørensen EE, Grønkjær M, Dinesen BI, Hansen J. Accuracy of a step counter during treadmill and daily life walking by healthy adults and patients with cardiac disease. BMJ Open. 2017. March 30;7(3):e011742–12. 10.1136/bmjopen-2016-011742 PubMed DOI PMC

Moy ML, Janney AW, Nguyen HQ, Matthess KR, Cohen M, Garshick E, et al. Use of pedometer and Internet-mediated walking program in patients with chronic obstructive pulmonary disease. J Rehabil Res Dev. 2010;47(5):485–96. PubMed PMC

Jehn M, Schmidt-Trucksäss A, Schuster T, Hanssen H, Halle M, Köhler F. Pedometer accuracy in patients with chronic heart failure. Int J Sports Med. 2010. March;31(3):186–91. 10.1055/s-0029-1243641 PubMed DOI

Tudor-Locke C, Barreira TV, Schuna JM. Comparison of step outputs for waist and wrist accelerometer attachment sites. Med Sci Sports Exerc. 2014. August 13;47(4):1–842. PubMed

Treacy D, Hassett L, Schurr K, Chagpar S, Paul SS, Sherrington C. Validity of different activity monitors to count steps in an inpatient rehabilitation setting. Phys Ther. 2017. May 1;97(5):581–8. 10.1093/ptj/pzx010 PubMed DOI

Alshurafa N, Eastwood J-A, Nyamathi S, Xu W, Liu JJ, Sarrafzadeh M. Battery optimization in smartphones for remote health monitoring systems to enhance user adherence. Proceedings of the International Conference on Pervasive Technologies Related to Assistive Environments. New York, NY, USA: ACM Press; 2014. https://muyangamigo.github.io/HAbitsLabWeb/assets/papers/29.pdf, accessed on 29 July 2019.

Henriksen A, Haugen Mikalsen M, Woldaregay AZ, Muzny M, Hartvigsen G, Hopstock LA, et al. Using fitness trackers and smartwatches to measure physical activity in research: analysis of consumer wrist-worn wearables. J Med Internet Res. 2018;20(3):e110–9. 10.2196/jmir.9157 PubMed DOI PMC

Ferguson T, Rowlands AV, Olds T, Maher C. The validity of consumer-level, activity monitors in healthy adults worn in free-living conditions: a cross-sectional study. Int J Behav Nutr Phys Act. 2015;12(1):42. PubMed PMC

Ponikowski P, Voors AA, Anker SD, Bueno H, Cleland JGF, Coats AJS, et al. 2016 ESC Guidelines for the diagnosis and treatment of acute and chronic heart failure. Eur J Heart Fail. 2016. May 20;18(8):891–975. 10.1002/ejhf.592 PubMed DOI

Sasaki JE, John D, Freedson PS. Validation and comparison of ActiGraph activity monitors. J Sci Med Sport. 2011. September;14(5):411–6. 10.1016/j.jsams.2011.04.003 PubMed DOI

John D, Freedson P. ActiGraph and Actical physical activity monitors: a peek under the hood. Med Sci Sports Exerc. 2012. January;44(1 Suppl 1):S86–9. 10.1249/MSS.0b013e3182399f5e PubMed DOI PMC

Shoemaker MJ, Cartwright K, Hanson K, Serba D, Dickinson MG, Kowalk A. Concurrent validity of daily activity data from Medtronic ICD/CRT devices and the Actigraph GT3X triaxial accelerometer. Cardiopulm Phys Ther J. 2017. January;28(1):3–11.

An H-S, Jones GC, Kang S-K, Welk GJ, Lee J-M. How valid are wearable physical activity trackers for measuring steps? Eur J Sport Sc. 2016. November 14;17(3):360–8. PubMed

Figueiredo P, Ribeiro PAB, Bona RL, Peyré-Tartaruga LA, Ribeiro JP. Ventilatory determinants of self-selected walking speed in chronic heart failure. Med Sci Sports Exerc. 2013. March;45(3):415–9. 10.1249/MSS.0b013e318277968f PubMed DOI

Ainsworth BE, Haskell WL, Herrmann SD, Meckes N, Bassett DR, Tudor-Locke C, et al. 2011 Compendium of physical activities: a second update of codes and MET values. Med Sci Sports Exerc. 2011. August;43(8):1575–81. 10.1249/MSS.0b013e31821ece12 PubMed DOI

Lin LI-K. A Concordance correlation coefficient to evaluate reproducibility. Biometrics. 1989;45(1):255 PubMed

McBride GB. A proposal for strength-of-agreement criteria for Lin’s concordance correlation coefficient. NIWA Client Report: HAM2005-062; National Institute of Water & Atmospheric Research: Hamilton, New Zeeland, May 2005. http://www.medcalc.org/download/pdf/McBride2005.pdf, accessed on 29 July 2019.

DeShaw KJ, Ellingson L, Bai Y, Lansing J, Perez M, Welk G. Methods for activity monitor validation studies: an example with the Fitbit Charge. J Meas Phys Behav. 2018. September;1(3):130–5.

Welk GJ, McClain J, Ainsworth BE. Protocols for evaluating equivalency of accelerometry-based activity monitors. Med Sci Sports Exerc. 2012. January;44(1 Suppl 1):S39–49. 10.1249/MSS.0b013e3182399d8f PubMed DOI

Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016. June;15(2):155–63. 10.1016/j.jcm.2016.02.012 PubMed DOI PMC

Boudreaux BD, Hebert EP, Hollander DB, Williams BM, Cormier CL, Naquin MR, et al. Validity of wearable activity monitors during cycling and resistance exercise. Med Sci Sports Exerc. 2018. March;50(3):624–33. 10.1249/MSS.0000000000001471 PubMed DOI

Ehrler F, Weber C, Lovis C. Influence of pedometer position on pedometer accuracy at various walking speeds: a comparative study. J Med Internet Res. 2016;18(10):e268–10. 10.2196/jmir.5916 PubMed DOI PMC

Chen M-D, Kuo C-C, Pellegrini CA, Hsu M-J. Accuracy of wristband activity monitors during ambulation and activities. Med Sci Sports Exerc. 2016. October;48(10):1942–9. 10.1249/MSS.0000000000000984 PubMed DOI

Adamakis M. Preliminary validation study of consumer-level activity monitors and mobile applications for step counting under free living conditions. J Mob Technol Med. 2017. April;6(1):26–33.

Figueroa IA, Lucio ND, Gamez JL, Salazar VE, Funk MD. Validity of daily physical activity measurements of Fitbit Charge 2. Int J Exerc Sci. 2018;2(10):27.

Toth LP, Park S, Pittman WL, Sarisaltik D, Hibbing PR, Morton AL, et al. Validity of activity tracker step counts during walking, running, and activities of daily living. Transl J Am Coll Sports Med. 2018. April 1;3(7):52.

Šimůnek A, Dygrýn J, Jakubec L, Neuls F, Frömel K, Welk GJ. Validity of Garmin vívofit 1 and Garmin vívofit 3 for school-based physical activity monitoring. Pediatr Exerc Sci. 2019;31(1):130–6. 10.1123/pes.2018-0019 PubMed DOI

Paul SS, Tiedemann A, Hassett LM, Ramsay E, Kirkham C, Chagpar S, et al. Validity of the Fitbit activity tracker for measuring steps in community-dwelling older adults. BMJ Open Sport Exerc Med. 2015;1(1):e000013 10.1136/bmjsem-2015-000013 PubMed DOI PMC

John D, Morton A, Arguello D, Lyden K, Bassett D. “What is a step?” differences in how a step is detected among three popular activity monitors that have impacted physical activity research. Sensors (Basel). 2018. April;18(4):1206–15. PubMed PMC

Hoodless DJ, Stainer K, Savic N, Batin P, Hawkins M, Cowley AJ. Reduced customary activity in chronic heart failure: assessment with a new shoe-mounted pedometer. Int J Cardiol. 1994. January;43(1):39–42. 10.1016/0167-5273(94)90088-4 PubMed DOI

Walsh JT, Charlesworth A, Andrews R, Hawkins M, Cowley AJ. Relation of daily activity levels in patients with chronic heart failure to long-term prognosis. Am J Cardiol. 1997. May 15;79(10):1364–9. 10.1016/s0002-9149(97)00141-0 PubMed DOI

Lifestyle Walking Intervention for Patients With Heart Failure With Reduced Ejection Fraction: The WATCHFUL Trial

Statistical analysis plan for a randomized controlled trial examining pedometer-based walking intervention in patients with heart failure with reduced ejection fraction: the WATCHFUL trial

mHealth intervention delivered in general practice to increase physical activity and reduce sedentary behaviour of patients with prediabetes and type 2 diabetes (ENERGISED): rationale and study protocol for a pragmatic randomised controlled trial

Advances in accelerometry for cardiovascular patients: a systematic review with practical recommendations

The detrimental effect of COVID-19 nationwide quarantine on accelerometer-assessed physical activity of heart failure patients