Validation of two short questionnaires assessing physical activity in colorectal cancer patients
BMC Sports Science, Medicine and Rehabilitation volume 10, Article number: 8 (2018)
In order to investigate the impact of adherence to recommendations of physical activity and sedentary time on health outcomes in clinical trials, there is a need for feasible tools such as questionnaires that can give representative estimates of these measures. The primary aim of the present study was to validate two such questionnaires and their ability to estimate adherence to the recommendations of physical activity defined as moderate-to- vigorous physical activity or moderate physical activity of at least 150 min/week in colorectal cancer patients. Secondarily, self-reported sedentary time from the HUNT-PAQ was also evaluated.
Participants from 'The Norwegian dietary guidelines and colorectal cancer survival-study’ (CRC-NORDIET study) completed two short questionnaires; the NORDIET-FFQ (n = 78) and the HUNT-PAQ (n = 77). The physical activity monitor SenseWear Armband Mini was used as the reference method during seven consecutive days.
The NORDIET-FFQ provided better estimates of time in moderate-to- vigorous physical activity and moderate physical activity than the HUNT-PAQ. The NORDIET-FFQ was unable to rank individual time in moderate-to- vigorous physical activity and moderate physical activity (Spearman’s rho = 0.08, p = 0.509 and Spearman’s rho rho = 0.01, p = 0.402, respectively). All intensities were under-reported by the HUNT-PAQ, but ranking of individual time in moderate physical activity and sedentary time were acceptable among women only (Spearman’s rho = 0.37, p = 0.027 and Spearman’s rho = 0.36, p = 0.035, respectively). The HUNT-PAQ correctly classified 71% of those not meeting the recommendations (sensitivity), and the NORDIET-FFQ correctly classified 63% of those who met the recommendations (specificity). About 67% and 33% reported to meet the recommendation of moderate-to- vigorous physical activity with the NORDIET-FFQ and HUNT-PAQ, respectively, whereas 55% actually met the moderate-to- vigorous physical activity according to the SenseWear Armband Mini.
The NORDIET-FFQ provided better specificity and better estimates of PA than the HUNT-PAQ. The HUNT-PAQ provided better sensitivity, and provided better ranking of PA and sedentary time among women than NORDIET-FFQ. It is important to be aware of the limitations documented in the present study.
The study is registered on the National Institutes of Health Clinical Trials (Identifier: NCT01570010). Registered 4 April 2012.
The preventive effect of physical activity (PA) on risk of colorectal cancer is well-established [1,2,3]. However, an increasing number of studies also examine beneficial effects of PA during cancer treatment as well as in the posttreatment period [4,5,6,7,8,9,10,11,12,13,14,15,16], such as decreased all-cause mortality, increased disease-free survival, improved physical function and quality of life [5, 6, 11,12,13, 17, 18]. Moreover, reduced sedentary time, such as sitting during daytime, may be associated with reduced mortality and lower risk of recurrence in cancer patients [19,20,21,22].
The recommendations of PA for cancer patients and survivors provided by the American Cancer Society  emphasize that exercise is safe and feasible during cancer treatment, and improves outcomes such as physical function, fatigue and completion of chemotherapy . The American Cancer Society, the World Health Organization and others [24,25,26,27] recommend at least 150 min of moderate intensity PA (MPA) or 75 min of vigorous intensity PA (VPA) per week or an equivalent combination. In 2011, the Norwegian Directorate of Health published the Norwegian Food-Based Dietary Guidelines (FBDG) which also includes similar recommendations on PA as well as for sedentary time .
In Norway, colorectal cancer (CRC) is the third most common cancer type, and the incidence is among the highest in Europe . Implementing the recommendations of PA and incorporating specific exercises in the clinical care may improve the health outcomes of CRC patients [1,2,3, 24].
In order to estimate adherence to PA recommendations according to the Norwegian FBDG in a Norwegian CRC population, a valid and accurate physical assessment tool is needed. Importantly, assessment of adherence to the PA recommendations is required in counselling and when evaluating effectiveness of intervention studies. The use of objective monitors to record PA has increased during recent decades and gives valid and reliable data on intensity of PA and energy expenditure . However, these activity monitors are expensive and time consuming for the clinician and researcher, particularly when recording PA in larger populations. Therefore, less expensive and easier methods are required to measure adherence to PA recommendations.
The most common self-reporting method to assess PA is the use of questionnaires [30, 31]. Over the past 2 or 3 decades, more than 30 PA questionnaires have been developed and validated . Long questionnaires are challenging to complete for cancer patients often experiencing treatment and disease related side-effects such as fatigue and functional decline [33,34,35,36]. Questionnaires which contains few and well-defined questions regarding the different intensities of PA may be more suitable for this group of patients .
Although many previous questionnaires have been successfully used to assess PA, there is no questionnaire specifically designed to assess adherence to the PA recommendations as defined in Norwegian FBDG. For a clinical trial in colorectal cancer patients , a new short semi-quantitative questionnaire (NORDIET-FFQ) was developed to measure adherence to the Norwegian FBDG. The NORDIET-FFQ includes two questions on PA related to intensity levels similar to MPA and VPA. Another short questionnaire, the HUNT-PAQ  has been used in large healthy populations in Norway; however this questionnaire has not previously been validated in a CRC population.
Thus, the primary aim of the present study was to validate the two short questionnaires and their ability to estimate adherence to the PA recommendations according to the Norwegian FBDG. Secondarily, self-reported sedentary time from the HUNT-PAQ was also evaluated.
Subjects and study design
The present validation study was a sub-study of the ongoing CRC-NORDIET study, of which design and methods have been published elsewhere . In brief, the aim of the CRC-NORDIET study is to investigate the effect of a diet similar to the Norwegian FBDG  on disease-free and overall survival among CRC patients post-diagnosis . The risk factors shown to be related to CRC, i.e. diet and physical activity, are included in the Norwegian FBDG . The CRC-NORDIET study is a prospective randomised controlled intervention trial, randomising 500 CRC patients into one of two study groups (i.e. 250 to diet intervention group and 250 to the control group). All patients are invited to the Study centre 3 times during the intensive 1-year intervention (i.e. at baseline 2–9 months post-surgery and at the two visits 6- and 12 months after baseline), and subsequently followed up for 14 years. Both study groups are offered equal recommendations on PA .
All patients from both study groups in the CRC-NORDIET study, who attended the follow-up at 6 months after baseline of intervention (i.e. 2–9 months post-surgery) from January 2014 to October 2015, were invited to take part in the present validation study. The patients were men and women aged 50–80 years old, with a confirmed CRC (ICD-10 C18–20), and staged I-III (i.e. locoregional disease without metastasis) according to the TNM staging system . None of the patients included in the validation study underwent chemotherapy during the time-frame covered by the physical assessment methods used in the validation study (e.g. mean time from last chemotherapy injection to the start of the validation study (i.e 6 months after baseline) was 155 days among the 15% who received adjuvant treatment). During the 6-months visit, the patients completed the self-administered NORDIET-FFQ and HUNT-PAQ. In addition, they received the SenseWear Armband Mini (SWA), which was returned by mail to the CRC-NORDIET-study at the end of the test period of 7 days. Exclusion criteria for the present study were pacemaker implantation, not completed questionnaires or not wearing the SWA.
Characteristics of the participants
To characterize the subjects, anthropometric measurements (weight, height, and hip-and waist circumference) and physical tests (hand-grip strength and 30-s sit-to-stand test) were measured by the researchers of the CRC-NORDIET study during all visits at the Study centre, as previously described elsewhere . In addition, education level and smoking status were self-reported by completion of questionnaires during the visits at the Study centre. Information about tumour location status was retrieved from medical records in cooperation with the hospital personnel. Energy expenditure (kJ/d) was estimated from the SWA.
Short semi-quantitative frequency questionnaire (NORDIET-FFQ)
The NORDIET-FFQ (available upon request to corresponding author), was designed to report both dietary intakes and PA in recent weeks (i.e. the last 1–2 months). The validity of the dietary items of the NORDIET-FFQ has been published elsewhere . Completion of the NORDIET-FFQ as well as protocol for data handling followed the same procedures as described in detail in Henriksen et al. . In brief, the NORDIET-FFQ was completed by the patients at the Study centre. The completed questionnaires were scanned by trained researchers and the image files translated into data files using the Cardiff Teleform 2006 Software (6.0) (Datascan). The last two questions in the NORDIET-FFQ asked for PA with two different intensities, MPA and VPA estimated in pre-defined intervals of frequency per week and duration in minutes. The explanatory texts for both PA questions included examples of typical activities: moderate intensity was exemplified by brisk walking, household chores or other activities resulting in slight breathlessness, and vigorous intensity was exemplified by running, cross-country skiing or other activities resulting in high breathlessness. The question about frequency contained different responses in times per week (time divided by seven) coded as follows: 0 = 0, 1 = 0.14, 2 = 0.29, 3 = 0.43, 4 = 0.57, 5 = 0.71, 6–7 = 0.93 and 8+ = 1.37 (added 20% to 8 and divided by 7). Moreover the responses of duration in minutes were coded as follows: 1–4 = 2, 5–9 = 7, 10–15 = 12.5, 16–20 = 18, 21–30 = 25.5, 31–45 = 38, 46–60 = 53 and 60 + =72 (added 20% to 60). Amounts in minutes of PA per day for each intensity were calculated by multiplying frequency (i.e. times per day) with duration (i.e. minutes each time). This resulted in variables of total-MPA and total-VPA, of which all minutes within each intensity were included (Additional files 1 and 2). Additionally, categories of 10-min bouts were computed and defined as ten or more consecutive minutes within each intensity level. This resulted in data on 10-min bouts of MPA and VPA.
HUNT (the Nord-Trøndelag health study) physical activity questionnaire (HUNT-PAQ)
The HUNT-PAQ was based on the questionnaire used in the HUNT 3-study . Only the five questions about PA as described in Kurtze et al.  were used. The question about frequency contained the following responses: Never and Less than once a week, both coded as 0, Once a week coded as 1, 2–3 times a week coded as 2.5, and Almost every day coded as 7. The question about duration of activity contained the following responses: Less than 15 min coded as 12 (subtracted 20% from 15), 15–29 min coded as 22, 30–1 h coded as 45 and more than 1 h coded as 72 (added 20% to 60). The products of frequency and duration were weighed by intensity level, i.e. Low, Moderate or Vigorous coded as 1, 2 and 3, respectively. The low intensity level was not evaluated in the present study. Additionally, there was a question about daily sedentary time in hours on a usual day (not included sleeping at night-time). The questionnaire generated data on activities in bouts of 10 and more consecutive minutes for each intensity level, such as MPA and VPA.
Objective physical activity measurement
The objective PA monitor SenseWear Armband Mini (SWA) (BodyMedia, Pittsburgh, Pennsylvania, USA) was used to record daily PA and energy expenditure during seven consecutive days . A priori, we defined a valid day of recording if the wear time was ≥80% of a 24-h sampling period. The SWA has previously been validated against double-labelled water , indirect calorimetry  and other accelerometers  in adults and cancer patients. It monitors physiological data such as heat flux, galvanic skin response, 3-axis accelerometer and skin temperature. The SWA was pre-programmed by the researcher with the co-predictors such as weight, height, birth date, sex, smoking status (smoker/non-smoker) and whether the participant was left or right handed, and placed around the triceps muscle halfway on the upper non-dominant arm. The participants were instructed to continue their normal activity level while wearing the SWA. Water-based activities were not recorded by the SWA because the monitor is not waterproof. Participants were asked to remove the SWA when performing activities in water. All data were retrieved from the SWA to a computer with the SenseWear Professional Software Version 7.0 BodyMedia Inc. (Pittsburgh, Pennsylvania, USA).
Activity intensities were integrated into algorithms, providing estimates of energy expenditure expressed in metabolic equivalents (METs). The definition of 1 MET is the amount of oxygen consumed while sitting at rest and is equal to 3.5 ml O2 per kg bodyweight per min . Moderate and vigorous intensities were defined as 3–6 and > 6 METs, respectively, as calculated by Ainsworth and coworkers [49, 50]. Sedentary time was defined as all daily activities ≤1.5 METs, of which nighttime sleep was removed (a priori defined as from 12 midnight to 6.00 a.m.). All activities were calculated and expressed in minutes or hours per week (sedentary time).
The SWA records all intensities in 1-min intervals, which were translated into different categories of data such as total-MPA and total-VPA. Furthermore, the data were also computed into 10-min intervals, which were defined as ten or more consecutive minutes within the relevant intensity level. The bouts of 10-min were calculated for the two intensity levels, which gave data on bouts of 10-min for MPA and VPA.
Recommendations of physical activity
The CRC patients were advice to follow the recommendations of moderate-to-vigorous intensity PA (MVPA), MPA and VPA. MVPA was defined as ‘MPA + (VPA*2)’  and the cut-off points for fulfilling recommendations of MVPA and MPA were at least 150 min per week, and at least 75 min per week for VPA. The activities should be in bouts of 10 and more consecutive minutes.
Statistical analyses were performed by use of IBM SPSS Statistics, version 22. Results were considered significant with two-sided p-values below 0.05. Normal distribution was checked for all data by inspection of histograms, normal Q-Q-Plots and Kolmogorov-Smirnov test (p > 0.05).
All anthropometric measurements and other characteristics of the study population were normally distributed and are presented as means with standard deviations (SD). The categorical data are presented as frequency with percentages and compared by the Fischer exact test and Pearson chi-square test. As most of the estimates of PA from the SWA, NORDIET-FFQ and HUNT-PAQ were not normally distributed, they are presented as medians and 5th - and 95th percentile. Statistical significant differences in median activity between the two questionnaires compared to the SWA were tested with Wilcoxon Signed-Rank test for paired data. Bland-Altman plots with limits of agreements were used to explore the differences between the measurements from the two methods (i.e. questionnaire minus SWA) plotted against the average of the two measurements, for each individual subject, as well as to identify outliers [52, 53]. Systematic under- or over-reporting was tested by linear regression with MVPA and MPA from SWA as the independent variable and the difference between the questionnaires and SWA as the dependent variable. Ranking of individual time in PA and degree of association between the continuous variables from the two different methods were analysed by Spearman Rank Order Correlation (rho). The ability of the NORDIET-FFQ and the HUNT-PAQ to classify the individual’s activity intensity into the same category as the SWA was estimated by the use of sensitivity and specificity analysis. Sensitivity was defined as the number of subjects reported not to fulfil the MVPA with both questionnaires and SWA as a percentage of those who had reported not to fulfil the MVPA with the SWA. Specificity was defined as the number of subjects reported to fulfil the MVPA with both questionnaires and SWA as a percentage of those who had reported to fulfil the MVPA with the SWA.
In order to detect a Pearson correlation coefficient of 0.5 or higher between the test-method (i.e. questionnaires) and the reference method (i.e. SWA), a sample size of 38 men and 38 women was required to achieve a significance level of 5% and power of 90% . With an expected consent rate of 90% and exclusion rate of maximum 5%, we aimed to invite 90 participants in order to include 76 participants to the present study.
Of the 88 invited participants, three were excluded due do pacemaker implantation and 7 declined to participate. Hence, 78 participants used the SWA and completed the NORDIET-FFQ, whereas 77 of these also completed the HUNT-PAQ. General characteristics of the participants are presented in Table 1. Mean age of the participants was 64.8 years, and did not differ significantly between men and women (Table 1). Mean time between surgery and baseline was 120.7 days ±41.4 days (mean ± SD) and between baseline and 6-months visit was 184.4 ± 39.1 days (mean ± SD). Total energy expenditure estimated from the SWA was 11.4 and 9.0 MJ for men and women, respectively. About 8% of the participants were smokers and 51% were highly educated (college/university education) (Table 1).
Moderate-to-vigorous intensity physical activity recorded from the NORDIET-FFQ, HUNT- PAQ and SWA
Participants wore the SWA monitors for 97.9 ± 3.8% (mean, ± SD) of the time during 6.2 ± 0.8 days (mean, ± SD) of monitoring.
Median duration of PA estimated from the NORDIET-FFQ, HUNT-PAQ and the SWA is presented in Table 2. There was no significant difference between the NORDIET-FFQ and SWA for the measure for activity of moderate-to-vigorous intensity PA (MVPA), either for the total population (p = 0.897) or when analyzing sexes separately. The HUNT-PAQ, however, significantly measured MVPA differently on a group level compared to SWA (p < 0.001).
Mean differences in PA measures (i.e. questionnaire minus SWA) with corresponding limits of agreements between questionnaires and the SWA are shown in Bland Altman plots in Fig. 1. MVPA (Fig. 1a) was reported only 4% differently with the NORDIET-FFQ compared to the SWA (mean difference and limits of agreement − 12 ± 624 min/week). The under-estimation of MVPA (Fig. 1d) with the HUNT-PAQ was 58% compared to SWA (mean difference and limits of agreement − 162 ± 576 min/week). Moreover, the Bland Altman-plot for MVPA revealed an increase in the differences between both questionnaires and SWA with increased PA level. Additionally, the differences were randomly and evenly distributed above and below the mean difference for both questionnaires compared to SWA up to about 250 min/week (Fig. 1a and d). The slope of the linear regression was negative and significant for both questionnaires (β = − 0.79, p < 0.001(NORDIET-FFQ) and β = − 0.85, p < 0.001 (HUNT-PAQ)), indicating under-reporting at higher levels of PA (MVPA from SWA as independent variable). Removing of two outliers shown in the Bland Altman plot (Fig. 1a) did not have any effect on the limits of agreement or the linear regression (data not shown). Therefore, they were included in further analyses. The Spearman’s rho of the MVPA was insignificant and weak (rho = 0.08, p = 0.509) for the NORDIET-FFQ, indicating that the questionnaire was not able to rank individual time in MVPA. Likewise, in the HUNT-PAQ, ranking of individual time in MVPA was also poor (Spearman’s rho of 0.14, p = 0.238). The NORDIET-FFQ captured 63% individuals fulfilling the recommendation of MVPA (specificity), whereas only 29% of those in need of PA counselling (sensitivity) (Table 3). The HUNT-PAQ was better at capturing individuals not fulfilling the recommendation of MVPA (sensitivity of 71%), but worse in identifying those who did (specificity of 36%).
Moderate intensity physical activity recorded from the NORDIET-FFQ, HUNT- PAQ and SWA
Time spent in activity of moderate intensity PA (MPA) did not differ significantly by sex between the NORDIET-FFQ and SWA, whereas in HUNT-PAQ time in MPA was measured significantly different from SWA on group level (Table 2).
MPA was under-reported in both questionnaires as shown by the mean differences and limits of agreement from the Bland-Altman plots of − 83 ± 512 min/week and − 153 ± 523 min/week from the NORDIET-FFQ and HUNT-PAQ, respectively (Fig. 1b and e). The differences of MPA were randomly and evenly distributed above and below the mean difference for both questionnaires compared to SWA up to about 250 and 200 min/week with the NORDIET-FFQ and HUNT-PAQ, respectively (Fig. 1b and e). Linear regression also revealed a significant systematic under-reporting at higher levels of PA (MPA from SWA as independent variable) in both questionnaires (β = − 0.78, p < 0.001(NORDIET-FFQ) and β = − 0.83, p < 0.001 (HUNT-PAQ)).
Ranking of individual time in MPA was fair among women only (Spearman’s rho = 0.37, p = 0.027) with the HUNT-PAQ, but weak and insignificant with the NORDIET-FFQ (Spearman’s rho = 0.01, p = 0.402). The HUNT-PAQ captured 74% of individuals not fulfilling the recommendation of MPA (sensitivity), but only 36% of those who did (specificity). Both sensitivity and specificity for MPA were low with the NORDIET-FFQ (Table 3).
Vigorous intensity physical activity recorded from the NORDIET-FFQ, HUNT- PAQ and SWA
Median time in activity at vigorous intensity PA (VPA) was reported significantly differently between both questionnaires and SWA. The Bland Altman plot for VPA revealed an over-reporting of 36 ± 176 min/week (mean difference ± limits of agreement) with the NORDIET-FFQ, which increased with increased activity (Fig. 1c). Since only one participant reported VPA with the HUNT-PAQ, data from this activity are not presented. Moreover, the NORDIET-FFQ identified 75% of the individuals not fulfilling VPA.
Sedentary time recorded from the HUNT- PAQ and SWA
Amount of sedentary time was only measured in the HUNT-PAQ. Median time in sedentary intensity was significantly different between the questionnaire and SWA (Table 2). The Bland Altman plot revealed a high under-reporting of about 52% (6.5 h/day) compared to SWA, which decreased with increased sedentary time (Fig. 1f). However, the questionnaire was able to rank individuals according to sedentary time among women (r = 0.36. p = 0.035), but not among men or all participants in total.
Adherence to the recommendations of physical activity recorded from the NORDIET-FFQ, HUNT- PAQ and SWA
Looking at each method separately, participants who reported to fulfil the MVPA of at least 150 min per week were 66% and 33% with the NORDIET-FFQ and HUNT-PAQ, respectively. However, only 55% of the participants actually met this recommendation according to the SWA (Table 4).
In the present study, we evaluated the ability of the questionnaires, NORDIET-FFQ and HUNT-PAQ, to estimate adherence to PA recommendations among CRC patients participating in the ongoing intervention, CRC-NORDIET study .
Generally, self-reported measures tend to over-report both duration and level of PA compared to objective methods , but under-reporting has also frequently been documented [55, 56] which may have several different explanations. A review of studies focusing on the comparison of objective measures versus self-reporting of PA was performed by Prince et al. . They found that self-reported measures of PA were higher than the objective measure when accelerometers were used. However, in the present study MVPA (only HUNT-PAQ) and MPA were under-reported with the questionnaires compared to SWA. This may be for several reasons; firstly, the intensity level of MPA was defined as activities resulting in slight breathlessness. Cancer patients undergoing disease-related treatment and in a recovery phase post-surgery might experience breathlessness at lighter intensity than before, due to treatment effects and comorbidities such as anaemia, chronic obstructive pulmonary disease, and physical deconditioning [57, 58]. Breathlessness may result in over-reporting of higher intensity (VPA) and under-reporting of MPA. Slightly reduced physical function, measured by handgrip-strength and 30-s sit-to-stand test, was observed in the CRC patients participating in the present study as compared to healthy individuals in Norway (Table 1) .
Secondly, the under-reporting of MPA might also be explained by the different techniques in recording physical activities used by the two methods. All activities are recorded by the SWA within a 24 h day, whereas the questionnaires rely on the participant’s memory and subjective evaluation of activity while responding to just a few questions .
Thirdly, the degree of under-reporting of MVPA and MPA was higher with the HUNT-PAQ than with the NORDIET-FFQ. This might be due to the restricted opportunity for the participants to report both MPA and VPA in the HUNT-PAQ, which is possible with the NORDIET-FFQ. Moreover, under-reporting may also be explained by the different reporting intervals of frequencies in the responses; the NORDIET-FFQ contained responses for activities lasting both less than and above 10-min intervals, while the HUNT-PAQ only asked for activities lasting more than 10-min intervals. Therefore, increased accuracy in reporting of intensities was possible with the NORDIET-FFQ compared to the HUNT-PAQ, since intensities performed for less than 10 min were not recorded with the HUNT-PAQ.
Bias in reporting of intensity seems to be influenced by the amount of questions for a specific activity within a questionnaire, i.e. whether it contains a single-item question or domain-item questions [61,62,63,64]. The self-reported sedentary time in the present study was based on a single-item question and was greatly under-reported by the HUNT-PAQ compared to SWA, an effect supported by other studies [61, 64]. Since the HUNT-PAQ asked for sedentary time during day-time, a general definition of a day in the SWA was performed by removing night-hours between midnight and 6 am. Consequently, sedentary time during day-time recorded by the SWA was calculated from 6 am to midnight. However, this definition may be challenged in cancer patients facing several disease- and treatment side-effects influencing sleeping pattern due to increased need for resting time . A diary report from each participant would probably improve the definition of night-time resulting in higher precision in reporting sedentary time during day-time.
Vassbakk- Brovold et al.  documented an over-reporting of 366% of MVPA recommendation with the short form International Physical Activity Questionnaire (IPAQ-sf) compared to the SWA among cancer patients undergoing chemotherapy. The IPAQ-sf contains 9 questions on PA , whereas the NORDIET-FFQ and HUNT-PAQ contains 2 and 4 questions on PA, respectively. Both questionnaires in the present study contained few detailed question about type of PA activities. Thus, under-reporting of the activities may be due to decreased precision in reporting different kinds of activities during a day. However, the number of questions depends on the rationale of the questionnaire. In the present study, the aim was to estimate adherence to the PA recommendations based on the Norwegian FBDG. In clinical practice as well as intervention studies, it is advantageous to have a short and easy PA assessment tool to be used when monitoring adherence to the PA recommendations.
A small mean difference of only 4% was revealed for MVPA by the NORDIET-FFQ, whereas HUNT-PAQ under-estimated by 58% compared to the SWA. This is comparable with previous studies, which have reported mean differences around 44% (ranging from − 78% to 500%) . Evenly distributed differences above and below the mean difference in the Bland Altman plots indicated no systematic bias of activities in any of the questionnaires. However, linear regression revealed a systematic bias as shown by the significant negative slope for both questionnaires, indicating a trend towards more under-reporting with increased amount of PA. As can be seen from the Bland Altman plots, this negative trend seems to be accounted for by intensities higher than 250 and 200 min/week with the NORDIET-FFQ and HUNT-PAQ, respectively.
The limits of agreements were wide for both questionnaires, indicating weak ability to assess MVPA and MPA on an individual level. This has been supported by Ekelund et al.  and by Vassbakk- Brovold et al. , who validated the short form of the International Physical Activity Questionnaire (IPAQ-s) against an objective monitor among healthy Swedish adults and adult cancer patients, respectively. In the present study, limits of agreement were smaller at 150 min/week for MVPA and MPA for both questionnaires (about 500 min/week) than at higher levels of PA.
Hence, the NORDIET-FFQ was able to measure intensities up to about 250 min/week (i.e. including the PA recommendation of at least 150 min/week), but the HUNT-PAQ was less well suited to measure the corresponding intensities.
Studies including physical activities categorized in terms of different levels of exertion (light, moderate, vigorous) tend to result in more outliers, with VPA contributing the most outliers . The present study reported more outliers at higher levels of all intensities, of which the more extreme differences in reporting tended to be among males. Importantly, there were few observations with high amounts of PA, indicating high uncertainty and low interpretation of those data.
Previous studies differ in degrees of correlation between self-reported methods and objective measurements of PA , with no specific trend. In the present study, there were poor correlations for all variables between the NORDIET-FFQ and SWA, whereas fair correlations were found between the HUNT-PAQ and SWA for MPA and sedentary time among women only. Ranking of individuals according to time in MPA and sedentary time were thus fairly good with the HUNT-PAQ.
NORDIET-FFQ identified 63% of individuals fulfilling the MVPA (specificity), but was not able to identify those in need of PA counselling (sensitivity). However, the HUNT-PAQ was able to identify 71% not fulfilling the MVPA and 36% of those who did. Hence, the NORDIET-FFQ provided a fairly specific measure of PA, but limited sensitivity to correctly classify individuals not fulfilling the MVPA. Thus, NORDIET-FFQ should be used with care in a clinical setting. In contrast, the HUNT-PAQ was able to identify those in need of PA counselling, but limited in identifying those who fulfilled the PA recommendations.
About 66% reported meeting the recommended level of MVPA with the NORDIET-FFQ (i.e. 150 min/week) whereas 55% actually met the MVPA according to the SWA. This is comparable with Vassbakk- Brovold et al.  who also documented a higher proportion (i.e. 90%) of cancer patients perceiving themselves as meeting the MVPA recommendation of 150 min/week, while less than 50% actually met the PA recommendations recorded with SWA. This compares with a normal adult population in Norway, in which one in five met the national PA recommendations (i.e. 30 min/day) . Importantly, the physical activity assessment method used in the normal Norwegian population survey was different from the one used in the present study and the study of Vassbakk-Brovold et al. . Several barriers to meet PA recommendations among cancer survivors have been documented, of which treatment and disease-related factors are dominant [68, 69]. Consequently, cancer patients may feel breathlessness at lighter intensities than normal, as abovementioned, resulting in over-reporting of PA. Thus, these considerations are important to bear in mind when using self-reported data on PA in cancer patients.
The main strength in the present study was the use of SWA as the objective reference method in evaluating self-reported PA from the two questionnaires. Additionally, there was high compliance with the protocols for both self-reporting PA and wearing time of SWA. The NORDIET-FFQ and the HUNT-PAQ asked for PA in recent weeks (i.e. the previous 1–2 months), whereas the SWA recorded PA the subsequent week. Since none of the patients in the present study underwent chemotherapy during the validation period (i.e. mean time since last treatment of 155 days), less variation due to treatment effect on physical activity was therefore assumed. The limitation in our study was the use of different cut-off points defining frequency and duration of PA, which might have caused misclassification into MVPA, MPA and VPA activities between the questionnaires and SWA. This is supported by other studies, of which one should be aware of the different qualities in measuring levels of PA between methods [21, 66].
There are many inherent limitations in using short questionnaires to assess PA as compared to objective monitors. In the present study we observed that the NORDIET-FFQ provided better specificity and better estimates of PA than the HUNT-PAQ in CRC patients. The HUNT-PAQ provided better sensitivity, and provided better ranking of PA and sedentary time among women than NORDIET-FFQ. However, it is important to be aware of the limitations when interpreting the results from these questionnaires. An objective monitor should be considered to be used when more accurate individual data on PA and sedentary time are needed.
Food frequency questionnaire
The Nord-Trøndelag Health Study Physical activity questionnaire
International classification of diseases and related health problems
Moderate intensity physical activity
Moderate-to-vigorous intensity physical activity
Norwegian dietary guidelines food frequency questionnaire
SenseWear Armband Mini
Tumor node metastasis
Vigorous intensity physical activity
World Cancer Research Fund/American Institute for Cancer Research. Food, nutrition, physical activity, and the prevention of cancer: a global perspective. Washington DC: American Institute for Cancer Research; 2007.
Continuous Update Project Report. Food, nutrition, physical activity, and the prevention of colorectal Cancer. 2011.
Kostråd for å fremme folkehelsen og forebygge kroniske sykdommer: metodologi og vitenskapelig kunnskapsgrunnlag. Oslo: Nasjonalt råd for ernæring, Helsedirektoratet; 2011.
Anderson AS, Caswell S, Wells M, Steele RJC, Mac Askill S. “It makes you feel so full of life” LiveWell, a feasibility study of a personalised lifestyle programme for colorectal cancer survivors. Support Care Cancer. 2010;18(4):409–15.
Boyle T, Fritschi L, Platell C, Heyworth J. Lifestyle factors associated with survival after colorectal cancer diagnosis. Br J Cancer. 2013;109(3):814–22.
Lee J, Jeon JY, Meyerhardt JA. Diet and lifestyle in survivors of colorectal cancer. Hematol Oncol Clin North Am. 2015;29(1):1–27.
Meyerhardt JA, Giovannucci EL, Holmes MD, Chan AT, Chan JA, Colditz GA, et al. Physical activity and survival after colorectal Cancer diagnosis. J Clin Oncol. 2006;24(22):3527–34.
Meyerhardt JA, Heseltine D, Niedzwiecki D, Hollis D, Saltz LB, Mayer RJ, et al. Impact of physical activity on Cancer recurrence and survival in patients with stage III Colon Cancer: findings from CALGB 89803. J Clin Oncol. 2006;24(22):3535–41.
Morey MC, Snyder DC, Sloane R, Cohen HJ, Peterson B, Hartman TJ, et al. Effects of home-based diet and exercise on functional outcomes among older, overweight long-term cancer survivors: RENEW: a randomized controlled trial. JAMA. 2009;301(18):1883–91.
Mosher CE, Sloane R, Morey MC, Snyder DC, Cohen HJ, Miller PE, et al. Associations between lifestyle factors and quality of life among older long-term breast, prostate, and colorectal cancer survivors. Cancer. 2009;115(17):4001–9.
Schlesinger S, Walter J, Hampe J, von Schonfels W, Hinz S, Kuchler T, et al. Lifestyle factors and health-related quality of life in colorectal cancer survivors. Cancer Causes Control. 2014;25(1):99–110.
Van Blarigan EL, Meyerhardt JA. Role of physical activity and diet after colorectal cancer diagnosis. J Clin Oncol. 2015;33(16):1825–34.
van Waart H, Stuiver MM, van Harten WH, Geleijn E, Kieffer JM, Buffart LM, et al. Effect of low-intensity physical activity and moderate- to high-intensity physical exercise during adjuvant chemotherapy on physical fitness, fatigue, and chemotherapy completion rates: results of the PACES randomized clinical trial. J Clin Oncol. 2015;33(17):1918–27.
Haydon AM, Macinnis RJ, English DR, Giles GG. Effect of physical activity and body size on survival after diagnosis with colorectal cancer. Gut. 2006;55(1):62–7.
Lin KY, Shun SC, Lai YH, Liang JT, Tsauo JY. Comparison of the effects of a supervised exercise program and usual care in patients with colorectal cancer undergoing chemotherapy. Cancer Nurs. 2014;37(2):E21–9.
van Zutphen M, Winkels RM, van Duijnhoven FJ, van Harten-Gerritsen SA, Kok DE, van Duijvendijk P, et al. An increase in physical activity after colorectal cancer surgery is associated with improved recovery of physical functioning: a prospective cohort study. BMC Cancer. 2017;17(1):74.
Arem H, Pfeiffer RM, Engels EA, Alfano CM, Hollenbeck A, Park Y, et al. Pre- and postdiagnosis physical activity, television viewing, and mortality among patients with colorectal cancer in the National Institutes of Health-AARP diet and health study. J Clin Oncol. 2015;33(2):180–8.
Grimmett C, Simon A, Lawson V, Wardle J. Diet and physical activity intervention in colorectal cancer survivors: a feasibility study. Eur J Oncol Nurs. 2015;19(1):1–6.
Biswas A, Oh PI, Faulkner GE, et al. Sedentary time and its association with risk for disease incidence, mortality, and hospitalization in adults: a systematic review and meta-analysis. Ann Intern Med. 2015;162(2):123–32.
Fassier P, Zelek L, Partula V, Srour B, Bachmann P, Touillaud M, et al. Variations of physical activity and sedentary behavior between before and after cancer diagnosis: results from the prospective population-based NutriNet-Sante cohort. Medicine (Baltimore). 2016;95(40):e4629.
Hansen BH, Kolle E, Dyrstad SM, Holme I, Anderssen SA. Accelerometer-determined physical activity in adults and older people. Med Sci Sports Exerc. 2012;44(2):266–72.
Loyen A, Clarke-Cornwell AM, Anderssen SA, Hagstromer M, Sardinha LB, Sundquist K, et al. Sedentary time and physical activity surveillance through accelerometer pooling in four European countries. Sports Med. 2017;47(7):1421–35.
Rock CL, Doyle C, Demark-Wahnefried W, Meyerhardt J, Courneya KS, Schwartz AL, et al. Nutrition and physical activity guidelines for cancer survivors. CA Cancer J Clin. 2012;62(4):243–74.
Diet, Nutrition and the Prevention of Chronic Diseases: report of a joint WHO/FAO expert consultation. 2003.
Nelson ME, Rejeski WJ, Blair SN, Duncan PW, Judge JO, King AC, et al. Physical activity and public health in older adults: recommendation from the American College of Sports Medicine and the American Heart Association. Med Sci Sports Exerc. 2007;39(8):1435–45.
World Health Organization: Global recommendations on physical activity for health. 2010.
Schmitz KH, Courneya KS, Matthews C, Demark-Wahnefried W, Galvao DA, Pinto BM, et al. American College of Sports Medicine roundtable on exercise guidelines for cancer survivors. Med Sci Sports Exerc. 2010;42(7):1409–26.
Cancer Registry of Norway. http://www.kreftregisteret.no. Accessed 1 Dec 2015.
Garatachea N, Torres Luque G, Gonzalez Gallego J. Physical activity and energy expenditure measurements using accelerometers in older adults. Nutr Hosp. 2010;25(2):224–30.
Forsen L, Loland NW, Vuillemin A, Chinapaw MJ, van Poppel MN, Mokkink LB, et al. Self-administered physical activity questionnaires for the elderly: a systematic review of measurement properties. Sports Med. 2010;40(7):601–23.
van Poppel MN, Chinapaw MJ, Mokkink LB, van Mechelen W, Terwee CB. Physical activity questionnaires for adults: a systematic review of measurement properties. Sports Med. 2010;40(7):565–600.
Willett W. Nutritional epidemiology. Oxford: Oxford University Press; 2013.
Craig CL, Marshall AL, Sjostrom M, Bauman AE, Booth ML, Ainsworth BE, et al. International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc. 2003;35(8):1381–95.
Vassbakk-Brovold K, Kersten C, Fegran L, Mjaland O, Mjaland S, Seiler S, et al. Cancer patients participating in a lifestyle intervention during chemotherapy greatly over-report their physical activity level: a validation study. BMC Sports Sci Med Rehabil. 2016;8:10.
Pekmezi DW, Demark-Wahnefried W. Updated evidence in support of diet and exercise interventions in cancer survivors. Acta Oncol. 2011;50(2):167–78.
Stull VB, Snyder DC, Demark-Wahnefried W. Lifestyle interventions in cancer survivors: designing programs that meet the needs of this vulnerable and growing population. J Nutr. 2007;137(1 Suppl):243s–8s.
Bertheussen GF, Oldervoll L, Kaasa S, Sandmæl J-A, Helbostad JL. Measurement of physical activity in cancer survivors—a comparison of the HUNT 1 physical activity questionnaire (HUNT 1 PA-Q) with the international physical activity questionnaire (IPAQ) and aerobic capacity. Support Care Cancer. 2013;21(2):449–58.
Henriksen HB, Ræder H, Bohn SK, Paur I, Kværner AS, Billington SÅW, et al. The Norwegian dietary guidelines and colorectal cancer survival (CRC-NORDIET) study: a food-based multicenter randomized controlled trial. BMC Cancer. 2017;17(1):83.
Helseundersøkelsen i Nord-Trøndelag (HUNT). http://www.ntnu.edu/hunt/databank. Accessed 1 Dec 2015.
World Cancer Research Fund/ American Institute for Cancer research: Diet, nutrition, physical activity and colorectal cancer, continuous update project report. 2017.
Edge SB. AJCC cancer staging handbook: from the AJCC cancer staging manual. New York: Springer; 2009.
Henriksen HB, Carlsen MH, Paur I, Berntsen S, Bohn SK, Skjetne AJ, et al. Relative validity of a short food frequency questionnaire assessing adherence to the Norwegian dietary guidelines among colorectal cancer patients. Food Nutr Res. 2018;62
Kurtze N, Rangul V, Hustvedt B-E, Flanders WD. Reliability and validity of self-reported physical activity in the Nord-Trøndelag health study (HUNT 2). Eur J Epidemiol. 2007;22(6):379–87.
SenseWear Body Media. https://www.manualslib.com/manual/895732/Bodymedia-Sensewear.html. Accessed 1 Dec 2017.
Mackey DC, Manini TM, Schoeller DA, Koster A, Glynn NW, Goodpaster BH, et al. Validation of an armband to measure daily energy expenditure in older adults. J Gerontol A Biol Sci Med Sci. 2011;66(10):1108–13.
Cereda E, Turrini M, Ciapanna D, Marbello L, Pietrobelli A, Corradi E. Assessing energy expenditure in cancer patients: a pilot validation of a new wearable device. JPEN J Parenter Enteral Nutr. 2007;31(6):502–7.
Berntsen S, Hageberg R, Aandstad A, Mowinckel P, Anderssen SA, Carlsen KH, et al. Validity of physical activity monitors in adults participating in free-living activities. Br J Sports Med. 2010;44(9):657–64.
Jette M, Sidney K, Blumchen G. Metabolic equivalents (METS) in exercise testing, exercise prescription, and evaluation of functional capacity. Clin Cardiol. 1990;13(8):555–65.
Ainsworth BE, Haskell WL, Herrmann SD, Meckes N, Bassett DR Jr, Tudor-Locke C, et al. 2011 compendium of physical activities: a second update of codes and MET values. Med Sci Sports Exerc. 2011;43(8):1575–81.
Ainsworth BE, Haskell WL, Whitt MC, Irwin ML, Swartz AM, Strath SJ, et al. Compendium of physical activities: an update of activity codes and MET intensities. Med Sci Sports Exerc. 2000;32(9 Suppl):S498–504.
The Norwegian Directorate of Health https://helsedirektoratet.no/English. Accessed 24 Apr 2017.
Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.
Schmidt ME, Steindorf K. Statistical methods for the validation of questionnaires--discrepancy between theory and practice. Methods Inf Med. 2006;45(4):409–13.
Bland M. An introduction to medical statistics, 3rd ed. edn. Oxford: Oxford University Press; 2000.
Prince SA, Adamo KB, Hamel ME, Hardt J, Connor Gorber S, Tremblay M. A comparison of direct versus self-report measures for assessing physical activity in adults: a systematic review. Int J Behav Nutr Phys Act. 2008;5:56.
Tomioka K, Iwamoto J, Saeki K, Okamoto N. Reliability and validity of the international physical activity questionnaire (IPAQ) in elderly adults: the Fujiwara-kyo study. J Epidemiol. 2011;21(6):459–65.
Thomas S, Bausewein C, Higginson I, Booth S. Breathlessness in cancer patients – implications, management and challenges. Eur J Oncol Nurs. 2011;15(5):459–69.
Cachia E, Ahmedzai SH. Breathlessness in cancer patients. Eur J Cancer. 2008;44(8):1116–23.
Tveter AT, Dagfinrud H, Moseng T, Holm I. Health-related physical fitness measures: reference values and reference equations for use in clinical practice. Arch Phys Med Rehabil. 2014;95(7):1366–73.
Warren JM, Ekelund U, Besson H, Mezzani A, Geladas N, Vanhees L. Assessment of physical activity - a review of methodologies with reference to epidemiological research: a report of the exercise physiology section of the European Association of Cardiovascular Prevention and Rehabilitation. Eur J Cardiovasc Prev Rehabil. 2010;17(2):127–39.
Chau JY, Grunseit A, Midthjell K, Holmen J, Holmen TL, Bauman AE, et al. Sedentary behaviour and risk of mortality from all-causes and cardiometabolic diseases in adults: evidence from the HUNT3 population cohort. Br J Sports Med. 2015;49(11):737–42.
Clemes SA, David BM, Zhao Y, Han X, Brown W. Validity of two self-report measures of sitting time. J Phys Act Health. 2012;9(4):533–9.
Marshall AL, Miller YD, Burton NW, Brown WJ. Measuring total and domain-specific sitting: a study of reliability and validity. Med Sci Sports Exerc. 2010;42(6):1094–102.
Åsvold BO, Midthjell K, Krokstad S, Rangul V, Bauman A. Prolonged sitting may increase diabetes risk in physically inactive individuals: an 11 year follow-up of the HUNT study. Norway Diabetologia. 2017;60(5):830–5.
van Roekel EH, Winkler EA, Bours MJ, Lynch BM, Willems PJ, Meijer K, et al. Associations of sedentary time and patterns of sedentary time accumulation with health-related quality of life in colorectal cancer survivors. Prev Med Rep. 2016;4:262–9.
Lee PH, Macfarlane DJ, Lam TH, Stewart SM. Validity of the international physical activity questionnaire short form (IPAQ-SF): a systematic review. Int J Behav Nutr Phys Act. 2011;8:115.
Ekelund U, Sepp H, Brage S, Becker W, Jakes R, Hennings M, et al. Criterion-related validity of the last 7-day, short form of the international physical activity questionnaire in Swedish adults. Public Health Nutr. 2006;9(2):258–65.
Courneya KS, Friedenreich CM, Quinney HA, Fields AL, Jones LW, Vallance JK, et al. A longitudinal study of exercise barriers in colorectal cancer survivors participating in a randomized controlled trial. Ann Behav Med. 2005;29(2):147–53.
Midtgaard J, Baadsgaard MT, Moller T, Rasmussen B, Quist M, Andersen C, et al. Self-reported physical activity behaviour; exercise motivation and information among Danish adult cancer patients undergoing chemotherapy. Eur J Oncol Nurs. 2009;13(2):116–21.
We would like to thank the patients for their valuable contribution to this study. We would also like to thank Torgrim Langleite, Karoline Borg, Magnhild Håskjold, Stine Fallingen Ødegaard, Jonas Grenne, Hanna Ræder, Siv Åshild Billington and Ane Sørlie Kværner for their contributions to data collection and study administration.
This project has received funding from Research Council of Norway, Throne Holst Foundation of Nutrition Research, Norwegian Cancer Society and South Eastern Norway Regional Health Authority. The funder had no role in the design of the study, no role in collection, analysis, and interpretation of data, and no role in writing the manuscript.
Availability of data and materials
Anonymized data resulting from this study may be available upon request by corresponding author.
Ethics approval and consent to participate
The CRC-NORDIET study is carried out in accordance with the Helsinki Declaration and informed consent was obtained from all participants. The study was approved by the Norwegian Regional Committees for Medical and Health Research Ethics, Protocol Approval 2011/836, and by the data protection officials at Oslo University Hospital and Akershus University Hospital. The study is registered on the National Institutes of Health Clinical Trials (http://www.clinicaltrials.gov; Identifier: NCT01570010). Registered 4 April 2012. All participants provided informed written consent prior to participation.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Physical activity, all participants in total and stratified by sex. Physical activity levels based on Norwegian Food Based Dietary Guideline (i.e. moderate intensity physical activity and vigorous intensity physical activity) are presented in minutes per week as both self-reported by NORDIET-FFQ and objectively measured by SenseWear Armband (SWA). (DOCX 18 kb)
Bland-Altman plots depicting the mean differences (NORDIET-FFQ minus SenseWear Armband (SWA)) for physical activity in minutes per week; A. total-moderate intensity physical activity in minutes/week, B. total-vigorous intensity physical activity, minutes/week. The solid line represents the mean, and the dashed lines represent the 1.96 SDs of the observations. Females denoted as ♀ and males denoted as ♂. (TIF 1133 kb)
About this article
Cite this article
Henriksen, H.B., Berntsen, S., Paur, I. et al. Validation of two short questionnaires assessing physical activity in colorectal cancer patients. BMC Sports Sci Med Rehabil 10, 8 (2018). https://doi.org/10.1186/s13102-018-0096-2
- Short questionnaire
- Physical activity
- Sedentary time
- SenseWear armband mini
- Physical activity recommendations