Measurement properties of device-based physical activity instruments in ambulatory adults with physical disabilities and/or chronic diseases: a scoping review

Brandenbarg, Pim; Hoekstra, Femke; Barakou, Ioulia; Seves, Bregje L.; Hettinga, Florentina J.; Hoekstra, Trynke; van der Woude, Lucas H. V; Dekker, Rienk; Krops, Leonie A.

doi:10.1186/s13102-023-00717-0

BMC Sports Science, Medicine and Rehabilitation

Table 3 Overview of consumer grade devices evaluated on their measurement properties in the 67 studies

From: Measurement properties of device-based physical activity instruments in ambulatory adults with physical disabilities and/or chronic diseases: a scoping review

								Result
Type	PA outcome	Population	Study	Measurement property	Criterion	Placement	Algorithm	Test	Outcome
Fitbit
Alta	Steps	Cancer	Rossi [98]	Con V	SR	N.R	N.R	CCC	CCC = 0.00005 [CI -0.22—0.22]
		COPD	Blondeel [67]	CV	Acc	Wrist	Prop	LoA	306 [-2068; 2680] (oe)
		MS	Lavelle [80]	CV	DO	Wrist	N.R	LoA	-302.8 [-1036.8; 431.1] (oe)
		Stroke	Holubova [65]	CV	DO	Upper limb (b)	Prop	MARD	3.05—85.67%
						Lower limb (b)	Prop	MARD	1.33—11.08%
						Waist	Prop	MARD	0.47—3.66%
	Activity time	MS	Lavelle [80]	CV	Acc	Wrist	N.R	% error	100% [range -38.7—100]
Charge	Steps	Amputation	Smith [101]	CV	DO	Wrist	N.R	ICC	ICC = 0.86
		Multi	Treacy [23]	CV	DO	Wrist	N.R	ICC	ICC = 0.399 [CI -0.026- 0.654]
		PDs	Lamont [137]	CV	Acc	Wrist	N.R	ICC	ICC: 0.18 – 0.94
Charge 2	EE	CAD	Herkert [122]	CV	IC	Wrist	Prop	ICC	ICC = 0.10
		Heart failure	Herkert [122]	CV	IC	Wrist	Prop	ICC	ICC = 0.42
	Steps	Heart failure	Vetrovsky [141]	CV	Acc	Wrist	N.R	CCC	CCC = 0.48 [CI 0.20—0.69]
		Osteoarthritis	Collins [94]	CV	Acc	Wrist	Prop	ICC	ICC = 0.602
		PD	Lai [97]	CV	DO	Wrist	N.R	ICC	ICC: 0.27 – 0.47
		Progressive muscle diseases	Roberts-Lewis et al. [118]	CV	DO	Wrist	N.R	Spearman's rho	rho = 0.97 [CI 0.96—0.98]
	Intensity time	Osteoarthritis	Collins [94]	CV	Acc	Wrist	Cust	% bias	-5 – 37%
Flex	Steps	Amputation	Smith [101]	CV	DO	Wrist	N.R	ICC	ICC = 0.843
		CAD	Alharbi [140]	CV	Acc	N.R	Prop	Pearson's r	r = 0.947
		Post heart operation	Daligadu [109]	CV	DO	Wrist	N.R	CCC	CCC = 0.43
		MS	Balto [83]	CV	DO	Wrist	N.R	MPE	12.4 – 13.8%
			Block [85]	CV	DO + ACC	Wrist	N.R	ICC	2MWT DO: ICC = 0.69
			Block [85]	CV	DO + ACC	Wrist	N.R	ICC	2MWT ACC: ICC = 0.59
			Block [85]	CV	ACC	Wrist	N.R	ICC	ICC = 0.74
			Block [84]	CV	DO	Wrist	N.R	ICC	ICC = 0.69 [CI 0.53—0.80]
			Block [84]	CV	ACC	Wrist	N.R	ICC	ICC = 0.98 [CI 0.97—0.98]
		Multi	Ummels [75]	CV	DO	Wrist	N.R	Pearson's r	r = 0.31
	Intensity time	Chronic knee symptoms	Semanik [99]	CV	Acc	Wrist	Prop	Spearman's rho	rho: 0.25 – 0.73
		CAD	Alharbi [140]	CV	Acc	N.R	Prop	Pearson's r	r: 0.04 – 0.72
		Stroke	Hei Chow [60]	CV	Acc	Wrist	Prop	ICC	ICC: -0.236—0.884
	Distance walked	Post heart operation	Daligadu [109]	CV	DO	Wrist	N.R	CCC	CCC = 0.37
Flex 2	Steps	MS	Block [84]	CV	Acc	Wrist	N.R	ICC	ICC = 0.98 [CI 0.97—0.99]
		Osteoarthritis	Yu [136]	CV	SR	Wrist	N.R	Correlation	0.20—0.28
				Resp	SR & tests	Wrist	N.R	Correlation	-0.28—0.28
Inc	Steps	PD	de Carvalho Lana [133]	CV	DO	Waist	N.R	Pearson's r	r = 0.82
Inspire HR	Steps	MS	Polhemus [81]	CV	DO	Wrist	N.R	CCC	CCC = 0.66 (CI 0.14—0.80)
				CV	Acc	Wrist	N.R	CCC	CCC: 0.33—0.65
		Progressive muscle diseases	Roberts-Lewis [118]	CV	Acc	Wrist	N.R	Spearman's rho	rho = 0.76 (CI 0.60—0.87)
				TRT R	Acc	Wrist	N.R	ICC	ICC = 0.96 (CI 0.92—0.98)
				Resp	Acc	Wrist	N.R	AUC	AUC = 0.86 (CI 0.75—0.97)
	Activity time	MS	Polhemus [81]	CV	Acc	Wrist	N.R	CCC	CCC: 0.18—0.52
	Intensity time	MS	Polhemus [81]	CV	Acc	Wrist	N.R	CCC	CCC: 0.41—0.80
		Progressive muscle diseases	Roberts-Lewis et al. [118]	CV	Acc	Wrist	N.R	Spearman's rho	rho = 0.51 (CI 0.29—0.69)
				TRT R		Wrist	N.R	ICC	ICC = 0.78 (CI 0.63—0.87)
				Resp	Acc	Wrist	N.R	AUC	AUC = 0.72 (CI 0.56—0.88)
	MET	Progressive muscle diseases	Roberts-Lewis et al. [118]	CV	Acc	Wrist	N.R	Spearman's rho	rho = 0.63 (CI 0.47—0.74)
				TRT R		Wrist	N.R	ICC	ICC = 0.94 (CI 0.89—0.97)
				Resp	Acc	Wrist	N.R	AUC	AUC = 0.90 (CI 0.81—0.98)
One	Steps	Amputation	Arch [92]	CV	DO	Ankle (a)	N.R	ICC	ICC: 0.88 – 0.97
		Cancer	Van Blarigan [102]	CV	Acc	Waist	N.R	Pearson's r	r = 0.94
					Acc	Waist	N.R	Pearson's r	r = 0.67
		MS	Balto [83]	CV	DO	Waist	N.R	MPE	1.9%—1.9%
		Multi	Unmeis (2018)	CV	DO	Waist	N.R	Pearson's r	r = -0.15
			Treacy [23]	CV	DO	Ankle	N.R	ICC	ICC = 0.919 [CI 0.772—0.961]
						Waist	N.R	ICC	ICC = 0.397 [CI -0.087—0.689]
		Myositis	Saygin [106]	CV	Acc	Waist	Prop	ICC	ICC = 0.96 (CI 0.92—0.98)
				TRT R		Waist	Prop	ICC	ICC = 0.89 (CI 0.72—0.96)
				Resp	SR	Waist	Prop	Spearman's rho	rho = 0.63
		PDs	Lai [97]	CV	DO	Waist	N.R	ICC	ICC: 0.98 – 0.98
		Stroke	Duclos [47]	CV	DO	Ankle	Prop	% error	0.50 – 2.67%
			Henderson [64]	CV	DO	Ankle (a)	Prop	ICC	ICC: 0.71—0.92
						Ankle (ua)	Prop	ICC	ICC: 0.78—0.92
			Hui [50]	CV	Acc	Ankle (ua)	Prop	Regression r	r: 0.97 – 0.99
			Klassen [52]	CV	DO	Ankle (ua)	Prop	MPE	4.0 – 15.8%
						Waist	Prop	MPE	7.7 – 84.6%
			Klassen [53]	CV	Acc	Ankle (ua)	Prop	LoA	156.1 [-239.6; 551.9] (u)
	Intensity time	Cancer	Van Blarigan [102]	CV	Acc	Waist	Prop	Pearson's r	r: 0.65 – 0.85
		Myositis	Saygin [106]	CV	Acc	Waist	Prop	ICC	ICC: 0.59—0.96
		Stroke	Hui [50]	CV	Acc	Ankle (ua)	Prop	Regression r	r: 0.41 – 0.97
Surge	Steps	PD	Wendel [103]	CV	DO	Wrist (la)	Prop	ICC	ICC: -0.003 – 0.41
Ultra	Steps	Stroke	Costa [46]	CV	DO	Wrist (b)	N.R	Pearson's r	r = 0.67
Zip	Steps	COPD	Blondeel [67]	CV	Acc	Waist	Prop	LoA	-1055 [-2820; 589] (ue)
			Prieto-Centurion [74]	CV	DO	Waist	N.R	LoA	6 [-14; 25] (ue)
		Cardiac diseases	Thorup [127]	CV	Acc	Waist	Prop	ICC	ICC: 0.60 – 0.96
		MS	Lavelle [80]	CV	DO	Waist	N.R	LoA	-6.2 [-717.4; 705.0] (oe)
		Multi	Farmer [90]	CV	DO	Foot	Prop	ICC	ICC: 0.60—0.85
		PD	Wendel [103]	CV	DO	Waist	Prop	ICC	ICC: -0.03 – 0.98
		Polymyalgia rheumatica	Chandrasekar [112]	CV	DO	Waist	N.R	LoA	1 [-8;10] – 10 [-55; 74]
						Shirt, midline	N.R	LoA	-6 [-81; 68] – 12 [-58; 83]
		Stroke	Clay [41]			Waist	N.R	Kendall Tau-b	τ = 0.80
			Schaffer [58]	CV	DO	Waist	N.R	MAPE	-88.2 – 4.2%
				TRT R		Waist	N.R	ICC	ICC = 0.974
Garmin
Forerunner 35	Steps	Stroke	Huber [66]	CV	Acc	Wrist (ua)	N.R	LoA	-1.6 [-86.9; 83.5]—5.0 [-63.7; 2689.5]
Forerunner 35				TRT R		Wrist (ua)	N.R	ICC	ICC: 0.989—0.996
Vivofit	Steps	Amputation	Smith [101]	CV	DO	Wrist (b)	N.R	ICC	ICC = 0.86
		Heart failure	Vetrovsky [141]	CV	Acc	Wrist	N.R	CCC	CCC = 0.89 [CI 0.75; 0.96]
		Multi	Treacy [23]	CV	DO	Wrist	N.R	ICC	ICC = 0.259 [CI -0.071; 0.556]
		PD	Lamont [137]	CV	Acc	Wrist	N.R	ICC	ICC: 0.36 – 0.97
		Stroke	Schaffer [58]	CV		Wrist (ua)	N.R	MAPE	-90.1 – -16.0%
						Wrist (a)	N.R	MAPE	-68.2 – -4.0%
				TRT R		Wrist (ua)	N.R	ICC	ICC = 0.964 [CI 0.916; 0.984]
						Wrist (a)	N.R	ICC	ICC = 0.858 [CI 0.672; 0.939]
Vivofit 3	Steps	Amputation	Smith & Guerra [107]	CV	DO	Ankle	N.R	ICC	ICC = 0.122 (CI -0.141—0.398)
						Wrist	N.R	ICC	ICC = 0.895 (CI 0.802—0.945)
		Heart failure	Vetrovsky [141]	CV	Acc	Wrist	N.R	CCC	CCC = 0.92 [CI 0.78; 0.97]
Vivifit 4	Steps	MS	Lavelle [80]	CV	DO	Wrist	N.R	LoA	-251.05 [-717.4; 253.6] (oe)
Vivifit 4	Activity time	MS	Lavelle [80]	CV	DO	Wrist	N.R	% error	100% [range 100—100]
Vivosmart 3	Steps	PD	Lai [97]	CV	DO	Wrist (la)	N.R	ICC	ICC: 0.67 – 0.97
Vivosmart 4	Steps	PD	Bianchini [130]	CV	DO	Wrist (b)	Prop	ICC	ICC = 0.66 (CI 0.31—0.83)
Omron
Active Style Pro HJA-350	MET	Stroke	Shimizu [59]	CV	MET com	Waist	Prop	T-test (1-sample)	P < .05
Active Style Pro HJA-750c	EE	DM	Nishida [134]	CV	DLW	Waist	TEE = BMR (Ganpule's equation) * PAL	Pearson's r	TEE: r = 0.87
	PAL	DM	Nishida [134]	CV	DLW	Waist	PAL = ([BMR (Ganpule's equation) + AEE (prop)]10/9)BMR	Pearson's r	r = 0.71
	Intensity time	COPD	Miyamoto [73]		Acc	Waist	Cust	Pearson's r	r: 0.38 – 0.81
					Acc	Waist	Cust	Pearson's r	r: -0.05 – 0.83
HJ-113	Steps	Amputation	Smith [101]	CV	DO	Waist	N.R	ICC	ICC = 0.928
HJ-322U-E	Steps	Heart failure	Vetrovsky [141]	CV	Acc	Waist	N.R	CCC	CCC = 0.82 [CI 0.56; 0.93]
HJ-720ITC	Steps	COPD	Danilack [69]	CV	DO	Waist	N.R	LoA	34 [-186; 253]
Walking Style x	Steps	Multi	Ummels [75]	CV	DO	Waist	N.R	Pearson's r	r = 0.25
Yamax
Digiwalker CW-700	Steps	Bronchiectasis	O'Neill [117]	CV	Acc	Waist	N.R	LoA	-167 [-3078; 2745] (oe)
		Multi	Ummels [75]	CV	DO	Wrist	N.R	Pearson's r	r = -0.33
	Activity time	Bronchiectasis	O'Neill [117]	CV	Acc	Waist	N.R	LoA	Daily activity time: 165 [62; 269] min
Digiwalker SW-200	Steps	MS	Anens [79]	CV	DO	N.R	N.R	Spearman's rho	rho: 0.64—0.97
			Balto [83]	CV	DO	Waist	N.R	MPE	8.5 – 9.7%
			Lavelle [80]	CV	DO	Waist	N.R	LoA	119.4 [-498.0; 736.8] (ue)
	EE	COPD	Farooqi [71]	CV	DLW	Waist	Harris-Benedict	ICC	ICC = 0.70 [CI 0.23; 0.89]
							Schofield	ICC	ICC = 0.71 [CI 0.21; 0.89]
							WHO	ICC	ICC = 0.74 [CI 0.33; 0.90]
							Moore	ICC	ICC = 0.69 [CI 0.21; 0.88]
							Nordic Nutrtion Recommendation	ICC	ICC = 0.70 [CI 0.17; 0.89]
							Nordenson	ICC	ICC = 0.40 [CI -0.16; 0.77]
	PAL	COPD	Farooqi [71]	CV	DLW + IC	Waist	Cust	ICC	ICC = 0.34
Google
Fit	Steps	PD	de Carvalho Lana [133]	CV	DO	Waist	N.R	Pearson's r	r = 0.92
		Stroke	Costa [46]	CV	DO	Waist	N.R	Pearson's r	r = 0.66
				TRT R		Waist	N.R	ICC	ICC = 0.76
			Polese [57]	CV	DO	Front pocket (a)	N.R	ICC	ICC = 0.93 [CI 0.86; 0.96]
	EE	Stroke	Faria [49]	CV	IC	Front pocket (a)	N.R	Pearson's r	r = 0.30
Android stepcounter	Steps	RA	Wagner [129]	CV	DO	Waist	Prop	MAPE	1.0—19.3%
Apple
Watch Sport	EE	Multi	Falter [88]	CV	IC	Wrist	Prop	ICC	ICC = 0.797
Health	Steps	MS	Balto [83]	CV	DO	Front pocket	N.R	MPE	2.7 – 2.9%
Iphone CMPedometer	Steps	PAD	Ata [93]	CV	DO	Hand/front pocket	N.R	% error	-7.2 ± 13.8%
Iphone SE	Steps	Cancer	Douma [121]	CV	Acc	Waist	N.R	ICC	ICC = 0.97 [CI 0.95; 0.98]
Iphone SE	Distance walked	Cancer	Douma [121]	CV	Acc	Waist	N.R	ICC	ICC = 0.47 [CI 0.21; 0.67]
Geonaute
Onstep 400	EE	Stroke	Compagnat [43]	CV	IC	Waist	Prop	Pearson's r	TEE: r = 0.66
							Cust	Pearson's r	TEE: r = 0.87
			Mandigout [55]	CV	IC	Neck	N.R	Spearman's rho	rho = -0.16
						Waist	N.R	Spearman's rho	rho = -0.07
	Distance walked	Stroke	Compagnat [44]	CV	DO	Neck	Prop	Pearson's r	r = 0.91
						Waist	Prop	Pearson's r	r = 0.98
JawBone
Up2	Steps	MS	Balto [83]	CV	DO	Wrist	N.R	MPE	1.9 – 3.9%
Up2		PD	Wendel [103]	CV	DO	Wrist	Prop	ICC	ICC: -0.02 – 0.17
Up24	Steps	Multi	Ummels [75]	CV	DO	Wrist	N.R	Pearson's r	r = 0.09
Up Move	Steps	MS	Balto [83]	CV	DO	Waist	N.R	MPE	8.4 – 8.9%
Up Move		PD	Wendel [103]	CV	DO	Waist	Prop	ICC	ICC: -0.03 – 0.85
Polar
A300	Steps	COPD	Boeselt [68]	CV	Acc	Wrist	Prop	ICC	ICC = 0.986
	Activity time	COPD	Boeselt [68]	CV	Acc	Wrist	Prop	ICC	Daily activity: ICC = 0.335
	MET	COPD	Boeselt [68]	CV	Acc	Wrist	Prop	ICC	ICC = 0.066
	Calories	COPD	Boeselt [68]	CV	Acc	Wrist	Prop	ICC	ICC = 0.829
Loop	Steps	Amputation	Smith [101]	CV	DO	Wrist	N.R	ICC	ICC = 0.723
T131	EE	Chronic lung disease	Dhillon [70]	CV	IC	N.R	Flex Heart Rate Method	LoA	-0.5 [-1.6; 0.7] – 0.4 [-0.3; 1.1]
Samsung
Galaxy S4 mini	Mean vector magnitude	MS	Zhai [87]	CV	Acc	Habitual phone pos	N.R	Spearman's rho	rho: 0.06 – 0.33
Galaxy S4 mini	Variance vector magnitude	MS	Zhai [87]	CV	Acc	Habitual phone pos	N.R	Spearman's rho	rho: -0.13 – 0.29
Health	Steps	PD	de Carvalho Lana [133]	CV	DO	Waist	N.R	Pearson's r	r = 0.54
		Stroke	Costa [46]	CV	DO	Waist	N.R	Pearson's r	r: 0.18 – 0.19
				TRT R		Waist	N.R	ICC	ICC: -0.70 – 0.10
Lumo
Lumoback	Steps	Multi	Ummels [75]	CV	DO	Lower back	N.R	Pearson's r	r = 0.19
Lumoback	Intensity time	Lower back pain	Takasaki [135]	TRT R		Lower back	Prop	ICC	Sed.: ICC = 0.75 [CI 0.26; 0.91]
Pacer Health
Pacer Pedometer	Steps	PD	de Carvalho Lana [133]	CV	DO	Waist	N.R	Pearson's r	r = 0.77
		Stroke	Costa [46]	CV	DO	Waist	N.R	Pearson's r	r: 0.68 – 0.80
				TRT R		Waist	N.R	ICC	r: 0.68 – 0.80
Withings
Go	Steps	Heart failure	Vetrovsky [141]	CV	Acc	Wrist	N.R	CCC	CCC = 0.90 [CI 0.77–0.96]
Health Mate	Steps	MS	Balto [83]	CV	DO	Front pocket	N.R	MPE	1.5 – 3.5%
Alexander et al
mSteps	Distance walked	MS	Alexander [78]	CV	DO	Arm	N.R	LoA	0.262 [-1.496; 2.020] m (oe)
Corussen LLC
Accupedo	Steps	Multi	Ummels [75]	CV	DO	Waist	N.R	Pearson's r	r = 0.32
DHS group
MOVEBAND	Steps	Amputation	Smith [101]	CV	DO	Wrist (b)	N.R	ICC	ICC = 0.897
Juen
MoveSense	Distance walked	Pulmonary disease	Juen [72]	CV	DO	Lower back	Cust	LoA	-7.7 [CI -33.0; 17.6] meter (oe)
Leap Fitness Group
Pedometro	Steps	Chronic pain	Ferreira [132]	CV	DO	Arm & waist	N.R	Pearson's r	For all tasks and placements: p ≥ 0.99
Letscom
Letscom smartwatch	Steps	MS	Lavelle [80]	CV	DO	Wrist	N.R	LoA	-390.0 [-1006.7; 226.7] (oe)
Letscom smartwatch	Activity time	MS	Lavelle [80]	CV	Acc	Wrist	N.R	% error	52.9% [range 5.6—65.1]
Mario Herzberg
EasyFit pedometer	Steps	Chronic pain	Ferreira [132]	CV	DO	Arm & waist	N.R	Pearson's r	For all tasks and placements: p between -0.32 and 0.24
Mio
Slice	EE	CAD	Herkert [122]	CV	IC	Wrist	Prop	ICC	ICC = 0.12
Slice		Heart failure	Herkert [122]	CV	IC	Wrist	Prop	ICC	ICC = 0.11
Nakosite
3D walking	Steps	Stroke	Negrini [56]	CV	DO	Ankle (a)	Prop	ICC	ICC: -0.20 – 0.70
						Ankle (ua)	Prop	ICC	ICC: -0.28 – 0.69
						Waist	Prop	ICC	ICC: -0.42 – 0.57
						Wrist (a)	Prop	ICC	ICC: -0.50 – 0.45
						Wrist (ua)	Prop	ICC	ICC: -0.41 – 0.45
Pedometer Australia
G-Sensor 2026	Steps	Multi	Treacy [23]	CV	DO	Waist	N.R	ICC	ICC = 0.308 [CI -0.094; 0.604]
ProtoGeo Oy
Moves	Steps	MS	Balto [83]	CV	DO	Front pocket	N.R	MPE	12.5 – 14.2%
Technogym
MyWellnes Key	Intensity time	DM	McGinley [110]	CV	SR	Waist	Prop	Spearman's rho	rho = 0.81 [CI 0.76; 0.85]

Ordering on number of studies evaluating manufacturer. This is a condensed version of the more detailed table in Supplementary file 6
EE Energy expenditure, MET Metabolic equivalent, PAL Physical activity level, CAD Coronay artery disease, COPD Chronic obstructive pulmonary disease, DM Diabetes mellitus, iSCI incomplete spinal cord injury, MS Multiple sclerosis, PAD Pulmonary artery disease, PD Parkinson's disease, RA Rheumatoid arthritis, SCI Spinal cord injury, CV Criterion validity, Con V Construct validity, Resp Responsiveness, TRT R Test–retest reliability, Acc Accelerometer, DLW Doubly labelled water, DO Direct observation, IC Indirect calorimetry, SR Self-report, (a) Affected side, (b) Both affected and unaffected side, (la) Less affected side, (LRL) Longest residual limb, (SRL) Shortest residual limb, (ua) Unaffected side, Cust Custom algorithm, LFE Low frequency effect, N.R. Not reported, Prop Proprietary algorithm, TEE Total energy expenditure, APE Absolute percentage error, CCC Concordance correlation coefficients, ICC Intraclass correlation coefficient, LoA Limits of agreement, MAPE Mean absolute percentage error, MARD Mean absolute relative difference, MPE Mean percentage error, [CI] 95% confidence intervals, (oe) Over estimation, (ue) Under estimation, MVPA Moderate to vigorous physical activity, MWT Minutes walking test, Sed Sedentary, STS Sit-to-stand test, SWT Steps walk test

Back to article page

ISSN: 2052-1847

Contact us

General enquiries: journalsubmissions@springernature.com