Applying Quality Indicators to Examine Quality of Care During Active Surveillance in Low-Risk Prostate Cancer: A Population-Based Study

Authors:
Narhari Timilshina Department of Medicine, University Health Network, Toronto, Ontario, Canada
Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada

Search for other papers by Narhari Timilshina in
Current site
Google Scholar
PubMed
Close
 MPH, PhD
,
Antonio Finelli Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
Division of Urology and Surgical Oncology, University Health Network, Toronto, Ontario, Canada

Search for other papers by Antonio Finelli in
Current site
Google Scholar
PubMed
Close
 MD, MSc
,
George Tomlinson Department of Medicine, University Health Network, Toronto, Ontario, Canada
Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada

Search for other papers by George Tomlinson in
Current site
Google Scholar
PubMed
Close
 PhD
,
Beate Sander Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
The Toronto Health Economics and Technology Assessment Collaborative, Toronto, Ontario, Canada
Toronto General Hospital Research Institute, University Health Network, Toronto, Ontario, Canada
Institute of Clinical Research Services, Toronto, Ontario, Canada
Public Health Ontario, Toronto, Ontario, Canada

Search for other papers by Beate Sander in
Current site
Google Scholar
PubMed
Close
 PhD
, and
Shabbir M.H. Alibhai Department of Medicine, University Health Network, Toronto, Ontario, Canada
Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada

Search for other papers by Shabbir M.H. Alibhai in
Current site
Google Scholar
PubMed
Close
 MD, MSc
Restricted access

Background: Although a few studies have reported wide variations in quality of care in active surveillance (AS), there is a lack of research using validated quality indicators (QIs). The aim of this study was to apply evidence-based QIs to examine the quality of AS care at the population level. Methods: QIs were measured using a population-based retrospective cohort of patients with low-risk prostate cancer diagnosed between 2002 and 2014. We developed 20 QIs through a modified Delphi approach with clinicians targeting the quality of AS care at the population level. QIs included structure (n=1), process of care (n=13), and outcome indicators (n=6). Abstracted pathology data were linked to cancer registry and administrative databases in Ontario, Canada. A total of 17 of 20 QIs could be applied based on available information in administrative databases. Variations in QI performance were explored according to patient age, year of diagnosis, and physician volume. Results: The cohort included 33,454 men with low-risk prostate cancer, with a median age of 65 years (IQR, 59–71 years) and a median prostate-specific antigen level of 6.2 ng/mL. Compliance varied widely for 10 process QIs (range, 36.6%–100.0%, with 6 [60%] QIs >80%). Initial AS uptake was 36.6% and increased over time. Among outcome indicators, significant variations were observed by patient age group (10-year metastasis-free survival was 95.0% for age 65–74 years and 97.5% in age <55 years) and physician average annual AS volume (10-year metastasis-free survival was 94.5% for physicians with 1–2 patients with AS and 95.8% for those with ≥6 patients with AS annually). Conclusions: This study establishes a foundation for quality-of-care assessments and monitoring during AS implementation at a population level. Considerable variations appeared with QIs related to process of care by physician volume and QIs related to outcome by patient age group. These findings may represent areas for targeted quality improvement initiatives.

Submitted June 29, 2022; final revision received December 20, 2022; accepted for publication December 21, 2022.

Author contributions: Study concept and design: All authors. Data analysis: Timilshina, Tomlinson. Interpretation of results: All authors. Supervision: Finelli, Alibhai. Writing—original draft: Timilshina, Finelli, Alibhai. Writing—review & editing: Finelli, Tomlinson, Sander, Alibhai.

Disclosures: The authors have not received any financial contribution from any person or organization to support the preparation, results, analysis, or discussion of this article.

Acknowledgement: This study contracted ICES data & analytic services and used de-identified data from the ICES Data Repository, which is managed by ICES with support from its funders and partners: Canada’s Strategy for Patients-Oriented Research (SPOR), the Ontario SPOR Support unit, the Canadian Institute for Health Research and the Government of Ontario. This study was supported through provision of data by ICES and Ontario Health-Cancer Care Ontario and through funding support to ICES from an annual grant by the Ministry of Health and the Ontario Institute for Cancer Research. The opinions, results and conclusions reported in this paper are those of the authors. No endorsement by ICES or any of its funders or partners is intended or should be inferred.

Correspondence: Shabbir M.H. Alibhai, MD, MSc, Department of Medicine, University Health Network, Institute of Health Policy, Management and Evaluation, University of Toronto, 200 Elizabeth Street, Room EN14-214, Toronto, Ontario M5G 2C4, Canada. Email: Shabbir.Alibhai@uhn.ca

Supplementary Materials

    • Supplemental Materials (PDF 1.45 MB)
  • Collapse
  • Expand
  • 1.

    Cooperberg MR, Lin DW, Morgan TM, et al. Active surveillance: very much “preferred” for low-risk prostate cancer. J Urol 2022;207:262264.

  • 2.

    Canadian Cancer Statistics Advisory Committee in collaboration with the Canadian Cancer Society, Statistics Canada, and the Public Health Agency of Canada. Canadian cancer statistics 2021. Accessed January 12, 2023. Available at: https://cdn.cancer.ca/-/media/files/research/cancer-statistics/2021-statistics/2021-pdf-en-final.pdf

    • PubMed
    • Export Citation
  • 3.

    Timilshina N, Komisarenko M, Martin LJ, et al. Factors associated with discontinuation of active surveillance among men with low-risk prostate cancer: a population-based study. J Urol 2021;206:903913.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 4.

    Sampurno F, Earnest A, Kumari PB, et al. Quality of care achievements of the Prostate Cancer Outcomes Registry-Victoria. Med J Aust 2016;204:319.

  • 5.

    Cheng JY. The Prostate Cancer Intervention Versus Observation Trial (PIVOT) in perspective. J Clin Med Res 2013;5:266268.

  • 6.

    Birkmeyer JD, Dimick JB, Birkmeyer NJ. Measuring the quality of surgical care: structure, process, or outcomes? J Am Coll Surg 2004;198:626632.

  • 7.

    Birkmeyer JD, Siewers AE, Finlayson EV, et al. Hospital volume and surgical mortality in the United States. N Engl J Med 2002;346:11281137.

  • 8.

    Donabedian A. The quality of care: how can it be assessed? JAMA 1988;260:17431748.

  • 9.

    Donabedian A. The role of outcomes in quality assessment and assurance. QRB Qual Rev Bull 1992;18:356360.

  • 10.

    Blumenthal D, Epstein AM. Quality of health care. Part 6: the role of physicians in the future of quality management. N Engl J Med 1996;335:13281331.

  • 11.

    Ullman M, Metzger CK, Kuzel T, et al. Performance measurement in prostate cancer care: beyond report cards. Urology 1996;47:356365.

  • 12.

    Spencer BA, Steinberg M, Malin J, et al. Quality-of-care indicators for early-stage prostate cancer. J Clin Oncol 2003;21:19281936.

  • 13.

    Miller DC, Litwin MS, Sanda MG, et al. Use of quality indicators to evaluate the care of patients with localized prostate carcinoma. Cancer 2003;97:14281435.

  • 14.

    Miller DC, Saigal CS. Quality of care indicators for prostate cancer: progress toward consensus. Urol Oncol 2009;27:427434.

  • 15.

    Patt D, Page R. Measuring quality is complicated. J Oncol Pract 2018;14:12.

  • 16.

    Hillner BE, Smith TJ, Desch CE. Hospital and physician volume or specialization and outcomes in cancer treatment: importance in quality of cancer care. J Clin Oncol 2000;18:23272340.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 17.

    Spencer BA, Miller DC, Litwin MS, et al. Variations in quality of care for men with early-stage prostate cancer. J Clin Oncol 2008;26:37353742.

  • 18.

    Luckenbaugh AN, Auffenberg GB, Hawken SR, et al. Variation in guideline-concordant active surveillance follow-up in diverse urology practices. J Urol 2017;197:621626.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 19.

    Ortelli L, Spitale A, Mazzucchelli L, et al. Quality indicators of clinical cancer care for prostate cancer: a population-based study in southern Switzerland. BMC Cancer 2018;18:733.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 20.

    Kith G, Lisker S, Sarkar U, et al. Defining and measuring adherence in observational studies assessing outcomes of real-world active surveillance for prostate cancer: a systematic review. Eur Urol Oncol 2021;4:192201.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 21.

    Sampurno F, Zheng J, Di Stefano L, et al. Quality indicators for global benchmarking of localized prostate cancer management. J Urol 2018;200:319326.

  • 22.

    Cooperberg MR. Active surveillance for low-risk prostate cancer—an evolving international standard of care. JAMA Oncol 2017;3:13981399.

  • 23.

    Timilshina N, Finelli A, Tomlinson G, et al. National consensus quality indicators to assess quality of care for active surveillance in low-risk prostate cancer: an evidence-informed, modified Delphi survey of Canadian urologists/radiation oncologists. Can Urol Assoc J 2022;16:E212219.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 24.

    McLaughlin JR, Kreiger N, Marrett LD, et al. Cancer incidence registration and trends in Ontario. Eur J Cancer 1991;27:15201524.

  • 25.

    Richard PO, Alibhai SM, Panzarella T, et al. The uptake of active surveillance for the management of prostate cancer: a population-based analysis. Can Urol Assoc J 2016;10:333338.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 26.

    Minami CA, Wayne JD, Yang AD, et al. National evaluation of hospital performance on the new Commission on Cancer melanoma quality measures. Ann Surg Oncol 2016;23:35483557.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 27.

    Karve S, Cleves MA, Helm M, et al. Good and poor adherence: optimal cut-point for adherence measures using administrative claims data. Curr Med Res Opin 2009;25:23032310.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 28.

    Lai LY, Shahinian VB, Oerline MK, et al. Understanding active surveillance for prostate cancer. JCO Oncol Pract 2021;17:e16781687.

  • 29.

    Tosoian JJ, Trock BJ, Landis P, et al. Active surveillance program for prostate cancer: an update of the Johns Hopkins experience. J Clin Oncol 2011;29:21852190.

  • 30.

    Ginsburg KB, Cher ML, Montie JE. Defining quality metrics for active surveillance: the Michigan Urological Surgery Improvement Collaborative experience. J Urol 2020;204:11191121.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 31.

    Lee EK, Baack J, Penn H, et al. Active surveillance for prostate cancer in a veteran population. Can J Urol 2010;17:54295435.

  • 32.

    Bul M, Zhu X, Valdagni R, et al. Active surveillance for low-risk prostate cancer worldwide: the PRIAS study. Eur Urol 2013;63:597603.

  • 33.

    Bokhorst LP, Alberts AR, Rannikko A, et al. Compliance rates with the Prostate Cancer Research International Active Surveillance (PRIAS) protocol and disease reclassification in noncompliers. Eur Urol 2015;68:814821.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 34.

    Evans MA, Millar JL, Earnest A, et al. Active surveillance of men with low-risk prostate cancer: evidence from the Prostate Cancer Outcomes Registry-Victoria. Med J Aust 2018;208:439443.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 35.

    Auffenberg GB, Lane BR, Linsell S, et al. Practice- vs physician-level variation in use of active surveillance for men with low-risk prostate cancer: implications for collaborative quality improvement. JAMA Surg 2017;152:978980.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 36.

    Tyson MD, Graves AJ, O’Neil B, et al. Urologist-level correlation in the use of observation for low- and high-risk prostate cancer. JAMA Surg 2017;152:2734.

  • 37.

    Chen RC, Rumble RB, Loblaw DA, et al. Active surveillance for the management of localized prostate cancer (Cancer Care Ontario guideline): American Society of Clinical Oncology clinical practice guideline endorsement. J Clin Oncol 2016;34:21822190.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 38.

    Bruinsma SM, Bangma CH, Carroll PR, et al. Active surveillance for prostate cancer: a narrative review of clinical guidelines. Nat Rev Urol 2016;13:151167.

  • 39.

    Merriel SWD, Moon D, Dundee P, et al. A modified Delphi study to develop a practical guide for selecting patients with prostate cancer for active surveillance. BMC Urol 2021;21:18.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 40.

    Chiew KL, Sundaresan P, Jalaludin B, et al. A narrative synthesis of the quality of cancer care and development of an integrated conceptual framework. Eur J Cancer Care (Engl) 2018;27:e12881.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 41.

    Robles SC, Marrett LD, Clarke EA, et al. An application of capture-recapture methods to the estimation of completeness of cancer registration. J Clin Epidemiol 1988;41:495501.

    • PubMed
    • Search Google Scholar
    • Export Citation

Metrics