Diagnostic expansion in clinical trials: myocardial infarction, stroke, cancer recurrence, and metastases may not be the hard endpoints you thought they were

Specialties Article 11 Minute Read The BMJ

Go Nishikawa, instructor1, Vinay Prasad, assistant professor of medicine1



It is intuitive and obvious that no person desires a myocardial infarction, stroke, or recurrence or metastasis of a previously localised cancer. Reducing the risk of these endpoints is therefore used as the evidentiary basis of a wide range of drugs, devices, and surgical procedures. However, recent trials in cardiovascular and cancer medicine force us to revisit the assumption of their value as endpoints. Several studies have produced discordant results, with interventions that reduce myocardial infarction, stroke, or metastasis having no effect on cardiovascular death, health related quality of life, cancer related death, and overall mortality—four harder clinical endpoints.

Is the avoidance of myocardial infarction, stroke, and cancer recurrence or metastasis less meaningful than it used to be? Or has the severity of these events lessened, partly because of advances in imaging and assay sensitivity? As technology advances and diagnostic categories broaden we need to consider whether there comes a point when endpoints that are widely believed to be measures of patient centred outcomes become test based, non-clinical endpoints. We have selected four recent randomised trials that highlight how benefits hinge on the nature of events averted.

Trials with discordant results

The FOURIER trial compared the effect of evolocumab, a monoclonal antibody that inhibits proprotein convertase subtilisin-kexin type 9 (PCSK9), with placebo in patients with cardiovascular disease.1 The trial used a primary composite endpoint of cardiovascular death, myocardial infarction, stroke, hospital admission for unstable angina, or coronary revascularisation and found a  benefit for the drug (1344/13 784 (9.8%) had reductions in the composite endpoint v 1563/13 780 (11.3%) with placebo; hazard ratio=0.85, 95% confidence interval 0.79 to 0.92; P<0.001). However, the drug had no favourable effect on cardiovascular death (251/13 784 (1.8%) v 240/13 780 (1.7%); HR=1.05, 95% CI 0.88 to 1.25; P=0.62) or overall mortality (444/13 784 (3.2%) v 426/13 780 (3.1%); HR=1.04, 95% CI 0.91 to 1.19; P=0.54).

The findings contrast with those of older secondary prevention trials in which cardiovascular endpoints and mortality improved in parallel. A decade earlier, for example, the PROVE IT–TIMI 22 trial randomised patients admitted to hospital with an acute coronary syndrome to standard dose pravastatin or high intensity atorvastatin.2 At two years follow-up, the trial found significant improvement in the composite primary endpoint of stroke, death from any cause, myocardial infarction, unstable angina requiring hospital admission, or, the most common event contributing to the composite, revascularisation. This occurred alongside non-significant improvements in death from all cause (3.2% standard dose statin v 2.2% with high intensity statin; absolute numbers and P value were not reported), and death from coronary heart disease (1.4% v 1.1%).

Patients in FOURIER and PROVE IT-TIMI 22 were evaluated at comparable time points (average follow up 26.4 months and 24 months, respectively). In other words, the 15% relative risk reduction in the primary composite endpoint in FOURIER was associated with no perceivable difference in harder endpoints, whereas the 16% reduction in the primary endpoint of PROVE-IT-TIMI-22 occurred alongside suggestion of improvement in harder outcomes.

Cancer medicine provides three further examples, with the endpoint of recurrence or metastasis after potentially curative therapy not translating into survival benefits. For prostate cancer, the ProtecT investigators found no difference between active surveillance, radical prostatectomy, and radical radiotherapy with hormones on cancer specific mortality among men with localised prostate cancer.3 Among the arms, prostatectomy had the greatest negative effect on sexual function and urinary continence, while radiotherapy had significant negative effects on sexual function and bowel function. Higher rates of metastases were observed in the active monitoring group.

There was no difference in health related quality of life between the arms, but, because of the increased rate of metastases, some experts argue that active surveillance is inferior.4 In a defence of this view, D’Amico writes, “Developing metastatic PC is a life-changing event … which brings the fear of dying of PC into” patients’ lives,4 and, “Is it really considered a success if a man suffers recurrence with metastatic disease, which often means a painful bone fracture along with castration and all of its toxicities”?4

Another example is sunitinib, which the US Food and Drug Administration approved for the adjuvant treatment of resected kidney cancer in 2017.5 This approval was granted on the basis of one randomised trial (S-TRAC) that showed sunitinib, when compared against observation, delayed the time until the composite endpoint of recurrence or death (hazard ratio=0.76, 95% CI 0.59 to 0.98; P=0.03),6 though it did so without any improvement in overall survival (1.01, 0.72 to 1.44; P=0.94). Overall survival curves, presented in the paper’s supplement, are superimposable over the first eight years of follow-up, suggesting that the lowered rate of recurrence has shown no evidence of translating into improved survival.

Finally, consider gefitinib, a small molecular inhibitor of the epidermal growth factor receptor. In a randomised trial of patients with lung cancer who had their tumours resected (ADJUVANT), the drug improved the time till disease recurrence or death (hazard ratio=0.60; 95% CI 0.42 to 0.87; P=0.005).7 Overall survival was virtually identical between the arms, with 34.2% of patients in the trial dying, whereas in previous studies of non-small cell lung cancer, improvements in disease recurrence strongly predicted improvements in overall survival.8

Weighing the benefits and harms

Together these examples show a new challenge facing patients and providers. If the myocardial infarctions, strokes, and metastases averted in these studies are severe, then the interventions probably offer net benefit. At the same time, if the events averted are mild— for instance, if most metastases are asymptomatic or indolent—then net benefit becomes questionable, particularly when weighed against side effects and therapeutic and financial burden.

At some point, if observed endpoints do not directly affect patients’ perceived health or health related quality of life, they may be thought of as a risk factor for a future clinical event, and not an event themselves. An easy way to adjudicate these concerns is appealing to health related quality of life—did it improve? However, in the trials described above this was not reported for evolocumab, showed no difference in ProtecT, was worse in S-TRAC, and modestly improved when comparing gefitinib with chemotherapy in the ADJUVANT trial.

Evidence exists of a progressive expansion of all these disease categories over time. Diagnoses of myocardial infarctions have changed substantially since the introduction of more sensitive cardiac markers, including creatinine phosphokinase (CK), myocardial band fraction of CK, and high sensitivity cardiac troponin.910 This expansion requires that we consider two new aspects when interpreting the biomarkers: a gradient risk in biomarker levels, as suggested by the prognostic value of different troponin levels,11 and increased sensitivity of the disease.12 Professional cardiology societies have cautioned about the importance of applying constant definitions when tracking time trends in the rate of myocardial infarction when diagnostic criteria are altered.13

In the case of stroke, improvements in the availability and quality of imaging techniques may have resulted in more silent infarcts being identified, leading to a lower diagnostic threshold.14 Asymptomatic ischaemic lesions occur in 7-28% of elderly people, more than fivefold higher than the prevalence of symptomatic stroke.1415 These infarcts have been reported to be associated with subtle deficits in physical and cognitive function and increased risk of subsequent stroke or dementia,14 but it is not clear whether these events compromise health related quality of life and, most importantly, whether their avoidance is worth the side effects and burden of intervention.

In the evolocumab study, the drug’s massive effect on low density lipoprotein cholesterol level—reducing it from a mean of 2.3 mmol/L in the control arm to 0.8 mmol/L in the intervention arm—is likely to have effectively unblinded the study.16 Knowledge of LDL may have influenced decision making and coding of subsequent events. Cardiologists may be more likely to recommend percutaneous coronary angioplasty in a patient with LDL over 2.6 mmol/L than below 1.3 mmol/L at similar levels of chest pain or discomfort. And, though the FOURIER authors report there was no increase in type 4 (or percutaneous angioplasty related) myocardial infarctions between the arms, they fail to report what percentage of infarctions were ST elevated, leaving open the question of the clinical severity of the events.17

Moreover, although the trial met its primary composite endpoint, cardiovascular death and overall mortality were not improved. Beyond type 4 myocardial infarctions, knowledge of LDL may influence the coding of other cardiac events that require provider discretion. For instance, in a case of suspected unstable angina in someone with an ambiguous clinical history, a clinician may rely on a low but detectable troponin level, and knowledge of a patient’s most recent LDL measurement may affect such decisions.1618

Interpretation of the FOURIER trial requires knowledge of the rates of ST elevated infarction (an echocardiography driven endpoint) and infarction leading to cardiogenic shock requiring pressors, another more objective endpoint. Additionally, further data, including the presence of new ST-T changes or Q waves, new left bundle branch block, imaging evidence of loss of viable myocardium, or new regional wall motion abnormality should be reported.19

In the case of ProtecT, the higher incidence in metastasis did not worsen a true patient centred endpoint: health related quality of life. The trial defined metastasis broadly as the spread of prostate cancer to bone, viscera, or lymph nodes or a PSA level >100 ng/mL, and it does not report how often metastasis led to fracture. Earlier trials used narrower definitions. For example, compared with the Scandinavian Prostate Cancer Group 4 study,2021 ProtecT added PSA rise over 100 ng/mL and regional lymph node disease to the definition of metastasis.

This disease expansion matters because metastatic disease becomes a composite outcome of several discrete events, not unlike composite outcomes in cardiology. And while there is clear evidence that skeletal related events do confer a poor prognosis,22 there is not comparable evidence for each of the other events included in the composite.

Making endpoints more meaningful

An important step towards untangling these endpoints is further details on trial outcomes. The evolocumab investigators could break down myocardial infarction into ST elevation, non-ST elevation, those that occurred immediately after revascularisation and those that occurred spontaneously, and those that resulted in shock or long term diminished ejection fraction and those that did not. Among infarctions without ST elevation, the investigators could provide breakdown by TIMI risk score to further gauge severity and, again, those leading to shock or systolic dysfunction. Authors should report events based on the third universal definition of myocardial infarction.19 The ultimate solution to interpreting endpoints would be the reporting of outcomes with individual endpoint biomarker or quantitative imaging data for independent review.

In the case of ProtecT, given concern about metastasis leading to fracture, this outcome could be explicitly reported. There seems little value in having experts speculate about the consequences of metastasis4 when these are known. Data sharing has potential to lead to greater clarity and transparency, as other investigators may further refine the breakdown and transparency of endpoints, particularly in trials over time.

Finally, validity of outcomes may also be improved by greater patient involvement at the outset of clinical trials, in their design and conduct. Patients can help to develop instruments that best capture their burden of symptoms or sequelae of disease. Promising efforts are already being made, including the collaborative group OMERACT in rheumatoid arthritis outcomes. We suggest that this process is iterative, performed before, during, and after trials. This way, patient experiences during the clinical trial process may improve capture of outcomes in subsequent investigations.

Conclusion

It is understandable that investigators would be tempted to declare reductions in cancer metastasis, myocardial infarction, or stroke as proof of therapeutic efficacy. However, because diagnostic drift now includes illness of lesser severity, it is no longer clear that any of these events implies loss in health related quality of life. Direct consideration of health related quality of life has the added advantage of balancing benefit against the harm of interventions, such as side effects, toxicity, treatment burden, time commitment, and financial costs. We believe greater detail in outcomes reporting and data sharing can overcome this challenge, which, to a large degree, represents our success in the technological advancement of diagnostic testing.

Key messages

  • Improved diagnostic technology and expanding definitions may be reducing the relevance of accepted trial endpoints

  • Reductions in myocardial infarction, stroke, and cancer metastases may not always translate to improved quality of life or survival

  • Trialists must routinely measure and report health related quality of life

  • Data sharing and patient involvement in developing trial protocol may ameliorate these concerns

Notes

  1. Contributors and sources: GN and VP have an interest in evidence based medicine and outcome adjudication. VP has published many articles on trial methods and evidence. They have worked together on this and several papers.
  2. Competing interests: We have read and understood BMJ policy on declaration of interests and declare that VP is funded by the Laura and John Arnold Foundation and receives royalties for his book Ending Medical Reversal. VP has received honorariums for lectures to universities, non-profit medical centres, non-profit groups, and professional societies. VP is a writer for Medscape.
  3. Provenance and peer review: Not commissioned; externally peer reviewed

References

  1. MS SabatineRP GiuglianoAC KeechFOURIER Steering Committee and Investigators. Evolocumab and clinical outcomes in patients with cardiovascular disease. N Engl J Med2017;376:1713-22. 10.1056/NEJMoa1615664 28304224
  2. CP CannonE BraunwaldCH McCabePravastatin or Atorvastatin Evaluation and Infection Therapy-Thrombolysis in Myocardial Infarction 22 Investigators. Intensive versus moderate lipid lowering with statins after acute coronary syndromes. N Engl J Med2004;350:1495-504. 10.1056/NEJMoa040583 15007110
  3. JL DonovanFC HamdyJA LaneProtecT Study Group. patient-reported outcomes after monitoring, surgery, or radiotherapy for prostate cancer. N Engl J Med2016;375:1425-37. 10.1056/NEJMoa1606221 27626365
  4. AV D’Amico. Active surveillance versus treatment of prostate cancer: should metastasis be the primary end point?J Clin Oncol2016; 35:1638-40. 10.1200/JCO.2016.70.9527 28240975
  5. V PrasadS Mailankody. Research and development spending to bring a single cancer drug to market and revenues after approval. JAMA Intern Med2017;177:1569-75. 10.1001/jamainternmed.2017.3601 28892524
  6. A RavaudRJ MotzerHS PandhaS-TRAC Investigators. Adjuvant sunitinib in high-risk renal-cell carcinoma after nephrectomy. N Engl J Med2016;375:2246-54. 10.1056/NEJMoa1611406 27718781
  7. W-Z ZhongQ WangW-M MaoADJUVANT investigators. Gefitinib versus vinorelbine plus cisplatin as adjuvant treatment for stage II-IIIA (N1-N2) EGFR-mutant NSCLC (ADJUVANT/CTONG1104): a randomised, open-label, phase 3 study. Lancet Oncol2018;19:139-48. 10.1016/S1470-2045(17)30729-5 29174310
  8. A MauguenJP PignonS BurdettSurrogate Lung Project Collaborative Group. Surrogate endpoints for overall survival in chemotherapy and radiotherapy trials in operable and locally advanced lung cancer: a re-analysis of meta-analyses of individual patients’ data. Lancet Oncol2013;14:619-26. 10.1016/S1470-2045(13)70158-X 23680111
  9. RS CrowPJ HannanDR Jacobs JrSM LeeH BlackburnRV Luepker. Eliminating diagnostic drift in the validation of acute in-hospital myocardial infarction–implication for documenting trends across 25 years: the Minnesota Heart Survey. Am J Epidemiol2005;161:377-88. 10.1093/aje/kwi048 15692082
  10. MC KontosLM FritzFP AndersonJL TatumJP OrnatoRL Jesse. Impact of the troponin standard on the prevalence of acute myocardial infarction. Am Heart J2003;146:446-52. 10.1016/S0002-8703(03)00245-X 12947361
  11. MC KontosR ShahLM Fritz. Implication of different cardiac troponin I levels for clinical outcomes and prognosis of acute chest pain patients. J Am Coll Cardiol2004;43:958-65. 10.1016/j.jacc.2003.10.036 15028350
  12. NL MillsKK LeeDA McAllister. Implications of lowering threshold of plasma troponin concentration in diagnosis of myocardial infarction: cohort study. BMJ2012;344:e1533. 10.1136/bmj.e1533 22422871
  13. K ThygesenJS AlpertAS JaffeWriting Group on the Joint ESC/ACCF/AHA/WHF Task Force for the Universal Definition of Myocardial InfarctionESC Committee for Practice Guidelines (CPG). Third universal definition of myocardial infarction. Eur Heart J2012;33:2551-67. 10.1093/eurheartj/ehs184 22922414
  14. SE VermeerWT Longstreth JrPJ Koudstaal. Silent brain infarcts: a systematic review. Lancet Neurol2007;6:611-9. 10.1016/S1474-4422(07)70170-9 17582361
  15. MW VernooijMA IkramHL Tanghe. Incidental findings on brain MRI in the general population. N Engl J Med2007;357:1821-8. 10.1056/NEJMoa070972 17978290
  16. F BonnetP PoulizacJ-P Joseph. Safety and efficacy of statins. Lancet2017;389:1097-8. 10.1016/S0140-6736(17)30712-2 28322812
  17. RF RedbergV Prasad. Evolocumab in patients with cardiovascular disease. N Engl J Med2017;377:786-7.28836420
  18. Powers JH, 3rd, Patrick DL, Walton MK, et al. Clinician-reported outcome assessments of treatment benefit: report of the ISPOR Clinical Outcome Assessment Emerging Good Practices Task Force. Value in Health 2017;20:2-14.
  19. K ThygesenJS AlpertAS JaffeJoint ESC/ACCF/AHA/WHF Task Force for Universal Definition of Myocardial InfarctionAuthors/Task Force Members ChairpersonsBiomarker SubcommitteeECG SubcommitteeImaging SubcommitteeClassification SubcommitteeIntervention SubcommitteeTrials & Registries SubcommitteeTrials & Registries SubcommitteeTrials & Registries SubcommitteeTrials & Registries SubcommitteeESC Committee for Practice Guidelines (CPG)Document Reviewers. Third universal definition of myocardial infarction. J Am Coll Cardiol2012;60:1581-98. 10.1016/j.jacc.2012.08.001 22958960
  20. FC HamdyJL DonovanJA LaneProtecT Study Group. 10-year outcomes after monitoring, surgery, or radiotherapy for localized prostate cancer. N Engl J Med2016;375:1415-24. 10.1056/NEJMoa1606220 27626136
  21. A Bill-AxelsonL HolmbergH Garmo. Radical prostatectomy or watchful waiting in early prostate cancer. N Engl J Med2014;370:932-42. 10.1056/NEJMoa1311593 24597866
  22. JA McDougallA BansalBH Goulart. The clinical and economic impacts of skeletal-related events among medicare enrollees with prostate cancer metastatic to bone. Oncologist2016;21:320-6. 10.1634/theoncologist.2015-0327 26865591

Journal Information

Article Information

Author Affiliations

MEDICAL DISCLAIMER NOTICE: To the fullest extent permitted by law, the material and information displayed in The BMJ is provided “as is” without any guarantees, conditions or warranties as to accuracy. We rely on our authors of articles, contractors and third party data providers to confirm the accuracy of information and advertisements presented and to describe generally accepted practices and therefore we as the publisher and editors cannot warrant its accuracy. Differences may occur also between the print and online text of articles and advertisements. Readers should be aware that professionals in the field may have different opinions. Because of this fact and also because of regular advances in medical research we strongly recommend that readers independently verify any information that they chose to rely upon. Ultimately it is the reader’s responsibility to make their own professional judgements. Opinions posted on Rapid Responses, the Advice Zone, International Experience and any other parts of the sites are those of the individuals posting them and not the views of BMJ.

This article was written by BMJ from The BMJ and was legally licensed through the NewsCred publisher network. Please direct all licensing questions to legal@newscred.com.