Cardiopulmonary exercise testing for the selection of patients undergoing surgery for lung cancer: friend or foe? ================================================================================================================= * Eric Lim * Michael Beckles * Chris Warburton * David Baldwin * Lung cancer * respiratory measurement * thoracic surgery The contribution of exercise testing for risk assessment for lung resection is well established and has been embedded in international guidelines from Europe1 and the USA.2 There are many forms of exercise tests (6 min walk, 12 min walk, shuttle walk, stair climbing), but the most established investigation is formal assessment of maximum oxygen consumption during exercise (Vo2 max). British and American (American College of Chest Physicians (ACCP)) guidelines use Vo2 max as the ultimate assessment of operative risk, positioned at or near the end of the functional algorithm,3 whereas European guidelines recommend the use of this test much earlier in patients with a forced expiratory volume in 1 s (FEV1) or carbon monoxide transfer factor (Tlco) <80% predicted.1 2 Numerous cohort studies and a meta-analysis report the association of low Vo2 max and ‘high risk’ lung resection.4–18 However ‘high’ is not quantified and ‘risk’ is not defined, two fundamentally important definitions if guidelines that use these terms are to be applied clinically. Here we focus on validity of the Vo2 max studies and the clinical utility of the available evidence with respect to individual interpretation of risk. ## Sample size and precision of risk estimation of death Arguably, the most important outcome when considering surgery for lung cancer is the ability to survive the procedure. The most apparent limitation of the currently available evidence is the lack of appropriately powered studies to address this. The precision of a risk model is not specifically dependent on sample size, but rather the number of events—that is deaths—an uncommon outcome in thoracic surgery. In the UK, lobectomy, the most common procedure for lung cancer, carried an operative mortality of ∼2% in 2004–2005,19 and in the USA the mortality rate has been reported to range from 2.3% to 4.1%.20 Reflective of this, the largest study in this context on Vo2 max (422 patients) had only 15 deaths. What is clearly more disconcerting is that publications for which recommendations on estimation of operative mortality risk have been based have sample sizes ranging from 8 to 160.21 ## Upper limits of uncertainty for safe cut-off values Many studies have defined arbitrary cut-off values ranging from 15 to 20/ml/kg/min as a ‘safe’ cut-off value4 12–14 because above these levels no patient experienced an adverse event. What is the validity of this type of recommendation? The answer lies in the uncertainly that surrounds the observation of no events (ie, upper 95% CI), a function of the sample size. For a standard binomial distribution, the upper limit of the CI of zero events with the sample size of 8–160 corresponds to 42–2.7%, respectively (figure 1), illustrating high limits of uncertainty in the majority of studies with smaller sample sizes. ![Figure 1](http://thorax.bmj.com/https://thorax.bmj.com/content/thoraxjnl/65/10/847/F1.medium.gif) [Figure 1](http://thorax.bmj.com/content/65/10/847/F1) Figure 1 Upper binomial confidence limit for ‘no observations’. ## Alternative models for risk estimation of death Given these limitations, are there any other alternatives for the risk assessment for operative morality? Thoracoscore is a composite scoxring system that can be used to quantify risk. It is a logistic regression-derived model with coefficients provided for individual risk factors, calculated to provide a percentage probability of death. It is currently the best model and was developed from a sample size of 15 183 patients with 338 deaths, and provides excellent discrimination with an area under the curve of 0.82.22 Furthermore, it has been validated in different populations.23 Apart from superior statistical power, much larger sample size, external validity and excellent performance, the logistic risk model carries two further attractive advantages compared with Vo2 max assessment: it is cost free and can be universally available. ## Other outcomes and composite end points The consistent message that lower values of Vo2 max are associated with higher risk of complications is to be expected as a measure of cardiovascular fitness. From a patient's and clinician's perspective, however, the nature of the complications is of central importance. All studies to date have used composite end points and, when multiple outcomes are combined, it becomes difficult to interpret the impact of each individual component. It has been recommended that each outcome should have a similar weighting or clinical importance to facilitate clinical interpretation.24 For example, death and myocardial infarction would be combined to estimate the total number of patients that may have experienced a myocardial infarction and survived, added to those that have (presumably) experienced a myocardial infarction and died. Researchers, however, may use composite outcomes to increase the power of the study (by increasing event rate) and therefore increasing the chances of achieving statistically significant results.25 The corollary is that important outcomes such as death can be piggybacked within the pool of less important outcomes such as atelectasis5 7–9 11–14 16 or purulent sputum,4 giving rise to considerable difficulties for the clinician and, more importantly, the patient to evaluate the importance of the overall result. We believe that most patients would not consider readmission to the intensive care unit,11 atelectasis,5 7–9 11–14 16 arrhythmia4 6–8 10 13 14 or postoperative CO2 retention6 8–10 13 16 as ‘prohibitive’ complications leading them to refuse surgery. ## Quantification and interpretation of risk A clear explanation of risks and benefits is central to good consenting practice when offering treatment options to our patients. Dichotomous categorisation of ‘high’ and ‘standard’ risk using Vo2 max for risk assessment, accompanied by a combination of varied outcomes (some of which have little influence on patient decision making) renders the information difficult to apply in practice. The lack of a numerical estimate leads to subjective interpretation of ‘high’; moreover, many studies do not document the uncertainty (confidence limits) that surround their estimates. As there is no accepted level of baseline risk, it is not possible to quantify the relative magnitude of ‘high’ to facilitate the interpretation. ## Cost of getting it wrong It is intuitive that clinicians seek to protect the interests of their patients, and some may wonder if a discussion of the quantification and interpretation of risk is relevant as opposed to acceptance and avoidance of risk based on published values. In the CALGB 9238 study, the largest in the series (with 422 patients), physicians were allowed to offer surgical treatment of patients with ‘very high risk’, defined as FEV1 <900 ml and Vo2 max of <15/ml/kg/min. Of the 68 patients in the ‘very high risk’ group, there was only one postoperative death within 30 days and a total of three in-hospital deaths.17 More importantly, on follow-up, the operated patients in the very high risk group had more than double the median survival compared with the non-operated patients (36.0 months vs 15.8 months, p<0.001), illustrating acceptable procedural mortality and morbidity with twice the median survival with case selection on parameters independent of Vo2 max. Denying patients with ‘prohibitive’ values of Vo2 max the opportunity to consider surgery as a management option may in fact be against their best interests. As the study was not randomised, it is important to bear in mind the invariable presence of selection bias, and the possibility that a better result was achieved by offering surgery to fitter patients with less co-morbidity. Our point is more to question the ‘conventional’ lower limit of safety and the results that can be achieved by further selection. ## The future We acknowledge the consistent message that low levels of Vo2 max are associated with increased complications from surgery. However, we believe current recommendations are flawed by small sample sizes, resulting in imprecise risk estimates. Moreover, the lack of numerical quantification leads to difficulties in defining the level of acceptable risk. Furthermore, the use of composite outcomes leads to a lack of agreement on the importance of the risks, and the incongruence limits the clinical applicability to inform patients on the decision to undergo surgery. We believe that management options should be discussed at a multidisciplinary level but decisions should be undertaken at patient level. This is because patients are heterogeneous, with individual perceptions on the value of benefit and risk. As the lower limits of safety remain imprecisely defined, patients with multidisciplinary team-defined ‘prohibitive’ levels of risk may not be offered the opportunity to consider surgery as an option and denied the possibility of increased life expectancy. There may also be a degree of concern if postoperative quality of life may be a trade-off for any increase in life expectancy in the high risk cohort; however, prospective studies indicated that patients traditionally considered at higher risk of lung resection had postoperative physical and emotional quality of life scores similar to those observed in younger and fitter patients.26 Before widespread use, further work needs to be performed to determine if cardiopulmonary exercise testing is an independent predictor of mortality (eg, above and beyond that of Thorascore), to relate the study to individual outcomes that would influence the decision to undergo surgery, to provide numerical quantification of risk with an estimate of uncertainty and to demonstrate validity in different cohorts. ## Footnotes * Competing interests None. * Provenance and peer review Commissioned; externally peer reviewed. ## References 1. Brunelli A, Charloux A, Bolliger CT, et al. ERS/ESTS clinical guidelines on fitness for radical therapy in lung cancer patients (surgery and chemo-radiotherapy). Eur Respir J 2009;34:17–41. [Abstract/FREE Full Text](http://thorax.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiZXJqIjtzOjU6InJlc2lkIjtzOjc6IjM0LzEvMTciO3M6NDoiYXRvbSI7czoyNToiL3Rob3JheGpubC82NS8xMC84NDcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 2. Colice GL, Shafazand S, Griffin JP, et al. Physiologic evaluation of the patient with lung cancer being considered for resectional surgery: ACCP evidenced-based clinical practice guidelines (2nd edition). Chest 2007;132(3 Suppl):161S–77S. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.1378/chest.07-1359&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=17873167&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=000249889400012&link_type=ISI) 3. British Thoracic Society; Society of Cardiothoracic Surgeons of Great Britain and Ireland Working Party. BTS guidelines: guidelines on the selection of patients with lung cancer for surgery. Thorax 2001;56:89–108. [FREE Full Text](http://thorax.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6OToidGhvcmF4am5sIjtzOjU6InJlc2lkIjtzOjc6IjU2LzIvODkiO3M6NDoiYXRvbSI7czoyNToiL3Rob3JheGpubC82NS8xMC84NDcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 4. Bechard D, Wetstein L. Assessment of exercise oxygen consumption as preoperative criterion for lung resection. Ann Thorac Surg 1987;44:344–9. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.1016/S0003-4975(10)63787-3&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=3662680&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=A1987K491900003&link_type=ISI) 5. Bolliger CT, Jordan P, Soler M, et al. Exercise capacity as a predictor of postoperative complications in lung resection candidates. Am J Respir Crit Care Med 1995;151:1472–80. [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=7735602&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=A1995QX80400030&link_type=ISI) 6. Boysen PG, Clark CA, Block AJ. Graded exercise testing and postthoracotomy complications. J Cardiothorac Anesth 1990;4:68–72. [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=2131859&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) 7. Brunelli A, Belardinelli R, Refai M, et al. Peak oxygen consumption during cardiopulmonary exercise test improves risk stratification in candidates to major lung resection. Chest 2009;135:1260–7. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.1378/chest.08-2059&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=19029436&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=000265876100022&link_type=ISI) 8. Brutsche MH, Spiliopoulos A, Bolliger CT, et al. Exercise capacity and extent of resection as predictors of surgical risk in lung cancer. Eur Respir J 2000;15:828–32. [Abstract](http://thorax.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiZXJqIjtzOjU6InJlc2lkIjtzOjg6IjE1LzUvODI4IjtzOjQ6ImF0b20iO3M6MjU6Ii90aG9yYXhqbmwvNjUvMTAvODQ3LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 9. Epstein SK, Faling LJ, Daly BD, et al. Predicting complications after pulmonary resection. Preoperative exercise testing vs a multifactorial cardiopulmonary risk index. Chest 1993;104:694–700. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.1378/chest.104.3.694&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=8365278&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=A1993LW51700014&link_type=ISI) 10. Richter Larsen K, Svendsen UG, Milman N, et al. Exercise testing in the preoperative evaluation of patients with bronchogenic carcinoma. Eur Respir J 1997;10:1559–65. [Abstract](http://thorax.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiZXJqIjtzOjU6InJlc2lkIjtzOjk6IjEwLzcvMTU1OSI7czo0OiJhdG9tIjtzOjI1OiIvdGhvcmF4am5sLzY1LzEwLzg0Ny5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 11. Markos J, Mullan BP, Hillman DR, et al. Preoperative assessment as a predictor of mortality and morbidity after lung resection. Am Rev Respir Dis 1989;139:902–10. [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=2930068&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=A1989T871200008&link_type=ISI) 12. Morice RC, Peters EJ, Ryan MB, et al. Exercise testing in the evaluation of patients at high risk for complications from lung resection. Chest 1992;101:356–61. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.1378/chest.101.2.356&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=1735254&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=A1992HC55700017&link_type=ISI) 13. Smith TP, Kinasewitz GT, Tucker WY, et al. Exercise capacity as a predictor of post-thoracotomy morbidity. Am Rev Respir Dis 1984;129:730–4. [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=6721272&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=A1984SR46500015&link_type=ISI) 14. Torchio R, Gulotta C, Parvis M, et al. Gas exchange threshold as a predictor of severe postoperative complications after lung resection in mild-to-moderate chronic obstructive pulmonary disease. Monaldi Arch Chest Dis 1998;53:127–33. [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=9689796&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) 15. Villani F, Busia A. Preoperative evaluation of patients submitted to pneumonectomy for lung carcinoma: role of exercise testing. Tumori 2004;90:405–9. [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=15510984&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=000224333500008&link_type=ISI) 16. Wang J, Olak J, Ultmann RE, et al. Assessment of pulmonary complications after lung resection. Ann Thorac Surg 1999;67:1444–7. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.1016/S0003-4975(99)00255-6&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=10355428&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=000080548200055&link_type=ISI) 17. Loewen GM, Watson D, Kohman L, et al. Preoperative exercise Vo2 measurement for lung resection candidates: results of Cancer and Leukemia Group B Protocol 9238. J Thorac Oncol 2007;2:619–25. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.1097/JTO.0b013e318074bba7&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=17607117&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=000247888600009&link_type=ISI) 18. Bobbio A, Chetta A, Internullo E, et al. Exercise capacity assessment in patients undergoing lung resection. Eur J Cardiothorac Surg 2009;35:419–22. [Abstract/FREE Full Text](http://thorax.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiZWpjdHN1cmciO3M6NToicmVzaWQiO3M6ODoiMzUvMy80MTkiO3M6NDoiYXRvbSI7czoyNToiL3Rob3JheGpubC82NS8xMC84NDcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 19. Page R, Keogh B. National Thoracic Surgery Activity and Outcomes Report. Oxford; Dendrite Clinical Systems Ltd, 2008. 20. Schipper PH, Diggs BS, Ungerleider RM, et al. The influence of surgeon specialty on outcomes in general thoracic surgery: a national sample 1996 to 2005. Ann Thorac Surg 2009;88:1566–72;discussion 1572–63. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.1016/j.athoracsur.2009.08.055&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=19853114&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=000271215700027&link_type=ISI) 21. Benzo R, Kelley GA, Recchi L, et al. Complications of lung resection and exercise capacity: a meta-analysis. Respir Med 2007;101:1790–7. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.1016/j.rmed.2007.02.012&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=17408941&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=000248406900025&link_type=ISI) 22. Falcoz PE, Conti M, Brouchet L, et al. The Thoracic Surgery Scoring System (Thoracoscore): risk model for in-hospital death in 15,183 patients requiring thoracic surgery. J Thorac Cardiovasc Surg 2007;133:325–32. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.1016/j.jtcvs.2006.09.020&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=17258556&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=000243783900010&link_type=ISI) 23. Chamogeorgakis TP, Connery CP, Bhora F, et al. Thoracoscore predicts midterm mortality in patients undergoing thoracic surgery. J Thorac Cardiovasc Surg 2007;134:883–7. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.1016/j.jtcvs.2007.06.020&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=17903501&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=000249800600009&link_type=ISI) 24. Montori VM, Permanyer-Miralda G, Ferreira-Gonzalez I, et al. Validity of composite end points in clinical trials. Br Med J 2005;330:594–6. [FREE Full Text](http://thorax.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEyOiIzMzAvNzQ5MS81OTQiO3M6NDoiYXRvbSI7czoyNToiL3Rob3JheGpubC82NS8xMC84NDcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 25. Lim E, Brown A, Helmy A, et al. Composite outcomes in cardiovascular research: a survey of randomized trials. Ann Intern Med 2008;149:612–17. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.7326/0003-4819-149-9-200811040-00004&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=18981486&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=000260585700002&link_type=ISI) 26. Brunelli A, Socci L, Refai M, et al. Quality of life before and after major lung resection for lung cancer: a prospective follow-up analysis. Ann Thorac Surg 2007;84:410–16. [CrossRef](http://thorax.bmj.com/lookup/external-ref?access_num=10.1016/j.athoracsur.2007.04.019&link_type=DOI) [PubMed](http://thorax.bmj.com/lookup/external-ref?access_num=17643607&link_type=MED&atom=%2Fthoraxjnl%2F65%2F10%2F847.atom) [Web of Science](http://thorax.bmj.com/lookup/external-ref?access_num=000248192400007&link_type=ISI)