Validation of the PREDICT Prognostication Tool in US Patients With Breast Cancer

Authors:
Nickolas Stabellini Case Western Reserve University School of Medicine, Cleveland, Ohio
Faculdade Israelita de Ciências da Saúde Albert Einstein, Hospital Israelita Albert Einstein, São Paulo, Brazil
Division of Hematology and Oncology, Department of Medicine, University Hospitals Seidman Cancer Center, Case Western Reserve University School of Medicine, Cleveland, Ohio

Search for other papers by Nickolas Stabellini in
Current site
Google Scholar
PubMed
Close
 BS
,
Lifen Cao Division of Hematology and Oncology, Department of Medicine, University Hospitals Seidman Cancer Center, Case Western Reserve University School of Medicine, Cleveland, Ohio

Search for other papers by Lifen Cao in
Current site
Google Scholar
PubMed
Close
 MD, PhD
,
Christopher W. Towe Division of Thoracic and Esophageal Surgery, Department of Surgery, University Hospitals Seidman Cancer Center, Case Western Reserve University School of Medicine, Cleveland, Ohio
University Hospitals Research in Surgical Outcomes and Effectiveness (UH-RISES), Cleveland, Ohio

Search for other papers by Christopher W. Towe in
Current site
Google Scholar
PubMed
Close
 MD
,
Megan E. Miller University Hospitals Research in Surgical Outcomes and Effectiveness (UH-RISES), Cleveland, Ohio
Division of Surgical Oncology, Department of Surgery, University Hospitals Seidman Cancer Center, Case Western Reserve University School of Medicine, Cleveland, Ohio

Search for other papers by Megan E. Miller in
Current site
Google Scholar
PubMed
Close
 MD
,
Artur H. Sousa-Santos Faculdade Israelita de Ciências da Saúde Albert Einstein, Hospital Israelita Albert Einstein, São Paulo, Brazil

Search for other papers by Artur H. Sousa-Santos in
Current site
Google Scholar
PubMed
Close
 MD
,
Amanda L. Amin University Hospitals Research in Surgical Outcomes and Effectiveness (UH-RISES), Cleveland, Ohio
Division of Surgical Oncology, Department of Surgery, University Hospitals Seidman Cancer Center, Case Western Reserve University School of Medicine, Cleveland, Ohio

Search for other papers by Amanda L. Amin in
Current site
Google Scholar
PubMed
Close
 MD, MS
, and
Alberto J. Montero Case Western Reserve University School of Medicine, Cleveland, Ohio
Division of Hematology and Oncology, Department of Medicine, University Hospitals Seidman Cancer Center, Case Western Reserve University School of Medicine, Cleveland, Ohio

Search for other papers by Alberto J. Montero in
Current site
Google Scholar
PubMed
Close
 MD, MBA
Restricted access

Background: PREDICT is an online prognostication tool derived from breast cancer registry information on approximately 6,000 women treated in the United Kingdom that estimates the postsurgical treatment benefit of surgery alone, chemotherapy, trastuzumab, endocrine therapy, and/or adjuvant bisphosphonates in early-stage breast cancer. Our aim was to validate the PREDICT algorithm in predicting 5- and 10-year overall survival (OS) probabilities using real-world outcomes among US patients with breast cancer. Methods: A retrospective study was performed including women diagnosed with unilateral breast cancer in 2004 through 2012. Women with primary unilateral invasive breast cancer were included. Patients with bilateral or metastatic breast cancer, no breast surgery, or missing critical clinical information were excluded. Prognostic scores from PREDICT were calculated and external validity was approached by assessing statistical discrimination through area under time-dependent receiver-operator curves (AUC) and comparing the predicted survival to the observed OS in relevant subgroups. Results: We included 708,652 women, with a median age of 58 years. Most patients were White (85.4%), non-Hispanic (88.4%), and diagnosed with estrogen receptor–positive breast cancer (79.6%). Approximately 50% of patients received adjuvant chemotherapy, 67% received adjuvant endocrine therapy, 60% underwent a partial mastectomy, and 59% had 1 to 5 axillary sentinel nodes removed. Median follow-up time was 97.7 months. The population’s 5- and 10-year OS were 89.7% and 78.7%, respectively. Estimated 5- and 10-year median survival with PREDICT were 88.3% and 73.8%, and an AUC of 0.77 and 0.76, respectively. PREDICT performed most poorly in patients with high Charlson-Deyo comorbidity scores (2–3), where PREDICT overestimated OS. Sensitivity analysis by year of diagnosis and HER2 status showed similar results. Conclusions: In this prognostic study utilizing the National Cancer Database, the PREDICT tool accurately predicted 5- and 10-year OS in a contemporary and diverse population of US patients with nonmetastatic breast cancer.

Submitted April 4, 2023; final revision received June 19, 2023; accepted for publication June 20, 2023.

Previous presentation: Presented in abstract form and awarded top abstract at the NCCN 2022 Virtual Annual Conference; March 30–April 2, 2022. Abstract BPI22-014.

Author contributions: Study concept or design: Stabellini, Cao, Montero. Data acquisition, analysis, or interpretation: Stabellini, Cao, Towe. Manuscript preparation: Stabellini, Cao. Critical revision: All authors.

Data availability statement: NCDB data are available through an application process to investigators associated with Commission on Cancer–accredited cancer programs.

Disclosures: The authors have disclosed that they have not received any financial consideration from any person or organization to support the preparation, analysis, results, or discussion of this article.

Funding: N. Stabellini is supported through funding from the Sociedade Beneficente Israelita Brasileira Albert Einstein on the program “Marcos Lottenberg & Marcos Wolosker International Fellowship for Physicians Scientist - Case Western.”

Correspondence: Nickolas Stabellini, BS, University Hospitals Seidman Cancer Center, Breen Pavilion, 11100 Euclid Avenue, Cleveland, OH 44106. Email: nickolastab@gmail.com

Supplementary Materials

    • Supplemental Materials (PDF 752 KB)
  • Collapse
  • Expand
  • 1.

    Sung H, Ferlay J, Siegel RL, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 2021;71:209249.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 2.

    Siegel RL, Miller KD, Wagle NS, et al. Cancer statistics, 2023. CA Cancer J Clin 2023;73:1748.

  • 3.

    Nardin S, Mora E, Varughese FM, et al. Breast cancer survivorship, quality of life, and late toxicities. Front Oncol 2020;10:864.

  • 4.

    Wishart GC, Bajdik CD, Azzato EM, et al. A population-based validation of the prognostic model PREDICT for early breast cancer. Eur J Surg Oncol 2011;37:411417.

  • 5.

    Wishart GC, Azzato EM, Greenberg DC, et al. PREDICT: a new UK prognostic model that predicts survival following surgery for invasive breast cancer. Breast Cancer Res 2010;12:R1.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 6.

    Gray E, Marti J, Brewster DH, et al. Independent validation of the PREDICT breast cancer prognosis prediction tool in 45,789 patients using Scottish Cancer Registry data. Br J Cancer 2018;119:808814.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 7.

    American College of Surgeons. National Cancer Database. Accessed July 27, 2020. Available at: https://www.facs.org/quality-programs/cancer/ncdb

  • 8.

    Su C, Peng C, Agbodza E, et al. Publication trend, resource utilization, and impact of the US National Cancer Database: a systematic review. Medicine (Baltimore) 2018;97:e9823.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 9.

    Wishart GC, Bajdik CD, Dicks E, et al. PREDICT plus: development and validation of a prognostic model for early breast cancer that includes HER2. Br J Cancer 2012;107:800807.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 10.

    Candido Dos Reis FJ, Wishart GC, Dicks E, et al. An updated PREDICT breast cancer prognostication and treatment benefit prediction model with independent validation. Breast Cancer Res 2017;19:58.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 11.

    American College of Surgeons. Participant user files. Accessed September 2, 2022. Available at: https://www.facs.org/quality-programs/cancer-programs/national-cancer-database/puf/

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 12.

    Edge SB, Compton CC. The American Joint Committee on Cancer: the 7th edition of the AJCC Cancer Staging Manual and the future of TNM. Ann Surg Oncol 2010;17:14711474.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 13.

    Anampa J, Makower D, Sparano JA. Progress in adjuvant chemotherapy for breast cancer: an overview. BMC Med 2015;13:195.

  • 14.

    Tramonti G. nhs.predict: breast cancer survival and therapy benefits. Accessed September 2, 2022. Available at: https://CRAN.R-project.org/package=nhs.predict

  • 15.

    Kamarudin AN, Cox T, Kolamunnage-Dona R. Time-dependent ROC curve analysis in medical research: current methods and applications. BMC Med Res Methodol 2017;17:53.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 16.

    Marzban C. The ROC curve and the area under it as performance measures. Weather Forecast 2004;19:11061114.

  • 17.

    Collins GS, Reitsma JB, Altman DG, et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMC Med 2015;13:1.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 18.

    Cao L, Stabellini N, Towe CW, et al. Independent validation of the PREDICT prognostication tool in U.S. breast cancer patients using the National Cancer Database (NCDB). J Natl Compr Canc Netw 2022;20:Abstract BPI22-014.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 19.

    Stabellini N, Cullen J, Cao L, et al. Racial disparities in breast cancer treatment patterns and treatment related adverse events. Sci Rep 2023;13:1233.

  • 20.

    Ravdin PM, Siminoff LA, Davis GJ, et al. Computer program to assist in making decisions about adjuvant therapy for women with early breast cancer. J Clin Oncol 2001;19:980991.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 21.

    Engelhardt EG, Pieterse AH, van Duijn-Bakker N, et al. Breast cancer specialists’ views on and use of risk prediction models in clinical practice: a mixed methods approach. Acta Oncol 2015;54:361367.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 22.

    Engelhardt EG, van den Broek AJ, Linn SC, et al. Accuracy of the online prognostication tools PREDICT and Adjuvant! for early-stage breast cancer patients younger than 50 years. Eur J Cancer 2017;78:3744.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 23.

    Kattan MW, Hess KR, Amin MB, et al. American Joint Committee on Cancer acceptance criteria for inclusion of risk models for individualized prognosis in the practice of precision medicine. CA Cancer J Clin 2016;66:370374.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 24.

    van Maaren MC, van Steenbeek CD, Pharoah PD, et al. Validation of the online prediction tool PREDICT v. 2.0 in the Dutch breast cancer population. Eur J Cancer 2017;86:364372.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 25.

    Zaguirre K, Kai M, Kubo M, et al. Validity of the prognostication tool PREDICT version 2.2 in Japanese breast cancer patients. Cancer Med 2021;10:16051613.

  • 26.

    de Glas NA, Bastiaannet E, Engels CC, et al. Validity of the online PREDICT tool in older patients with breast cancer: a population-based study. Br J Cancer 2016;114:395400.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 27.

    Maishman T, Copson E, Stanton L, et al. An evaluation of the prognostic model PREDICT using the POSH cohort of women aged ≤40 years at breast cancer diagnosis. Br J Cancer 2015;112:983991.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 28.

    National Health Service, Predict Breast Cancer. What is PREDICT? Accessed September 2, 2022. Available at: https://breast.predict.nhs.uk/

  • 29.

    Cardoso F, van’t Veer LJ, Bogaerts J, et al. 70-gene signature as an aid to treatment decisions in early-stage breast cancer. N Engl J Med 2016;375:717729.

  • 30.

    Dowsett M, Nielsen TO, A’Hern R, et al. Assessment of Ki67 in breast cancer: recommendations from the International Ki67 in breast cancer working group. J Natl Cancer Inst 2011;103:16561664.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 31.

    Niikura N, Masuda S, Kumaki N, et al. Prognostic significance of the Ki67 scoring categories in breast cancer subgroups. Clin Breast Cancer 2014;14:323329.e3.

Metrics

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 3901 3903 218
PDF Downloads 2417 2417 80
EPUB Downloads 0 0 0