A centrally generated primary care physician audit report does not improve colonoscopy uptake after a positive result on a fecal occult blood test in Ontario’s ColonCancerCheck program

Short Communication

A centrally generated primary care physician audit report does not improve colonoscopy uptake after a positive result on a fecal occult blood test in Ontario’s ColonCancerCheck program

D. Stock, PhD*, L. Rabeneck, MD MPH,,§,#, N.N. Baxter, MD PhD,,**††, L.F. Paszat, MD MSc,§‡‡, R. Sutradhar, PhD§, L. Yun, MSc, J. Tinmouth, MD PhD,,#

doi: https://doi.org/10.3747/co.24.3025



Timely follow-up of fecal occult blood screening with colonoscopy is essential for achieving colorectal cancer mortality reduction. In the present study, we evaluated the effectiveness of centrally generated, physician-targeted audit and feedback to improve colonoscopy uptake after a positive fecal occult blood test (fobt) result within Ontario’s population-wide ColonCancerCheck Program.


This prospective cohort study used data sets from Ontario’s ColonCancerCheck Program (2008–2011) that were linked to provincial administrative health databases. Cox proportional hazards regression was used to estimate the effect of centralized, physician-targeted audit and feedback on colonoscopy uptake in an Ontario-wide fobt-positive cohort.


A mailed physician audit and feedback report identifying individuals outstanding for colonoscopy for 3 or more months after a positive fobt result did not increase the likelihood of colonoscopy uptake (hazard ratio: 0.95; 95% confidence interval: 0.79 to 1.13). Duration of positive fobt status was strongly inversely associated with the hazard of follow-up colonoscopy (p for linear trend: <0.001).


In a large population-wide setting, centralized tracking in the form of physician-targeted mailed audit and feedback reports does not improve colonoscopy uptake for screening participants with a positive fobt result outstanding for 3 or more months. Mailed physician-targeted screening audit and feedback reports alone are unlikely to improve compliance with follow-up colonoscopy in Ontario. Other interventions such as physician audits or automatic referrals, demonstrated to be effective in other jurisdictions, might be warranted.

KEYWORDS: Fecal occult blood test, colonoscopy, colorectal cancer, screening, program evaluation


Fecal occult blood test (fobt) screening depends on follow-up colonoscopy. As of 2011, only 74.6% of participants with a positive fobt in Ontario’s ColonCancerCheck program proceeded to colonoscopy within 6 months. That proportion fell short of early results from European population-wide screening programs and the ColonCancer Check program targets based on Canadian consensus1.

To increase follow-up colonoscopy uptake, Colon-CancerCheck introduced patient- and physician-targeted strategies, two of which have already been evaluated2. The Screening Activity Report (sar) provides primary care physicians (pcps) with periodic summaries of screening participation and identifies fobt-positive patients in their practice who remain outstanding for colonoscopy. In the present study, we evaluate the effectiveness of the sar in improving colonoscopy uptake after a positive fobt result.


Our study was approved by the institutional review board at Sunnybrook Health Sciences Centre, Toronto, Ontario. All data were sourced from Ontario health administrative databases, which were linked using unique encoded identifiers and analyzed at the Institute for Clinical Evaluative Sciences2.

The population-based prospective cohort comprised all screening-age Ontarians (50–74 years) who received a positive fobt result from 1 September 2008 through 31 December 2010. Participants were excluded if they had a previous diagnosis of colorectal cancer, or if they received a colonoscopy between 31 December 2010 and 1 April 2011.

The main exposure was inclusion in a sar, based on whether the ordering pcp participated in a patient enrolment model (pem) practice. Practitioners participating in the Ontario pem are remunerated using a blended capitation and fee-for-service model that requires patient rostering. In Ontario, pem and traditional models (the latter almost exclusively fee-for-service without stipulation for patient rostering) coexist. The 2011 sars were mailed to pem-participating pcps in February and March of that year, with 97% being mailed during 8–23 March. Physicians practicing in a traditional model did not receive a sar. Only positive fobt results that were outstanding before the end of 2010 were included in the sar.

The primary outcome was time to colonoscopy. Table i presents the covariates by dichotomous sar exposure. Definitions of those variables have been provided elsewhere2.

TABLE I Distribution of sociodemographic and clinical factors for the cohort of individuals participating in the Ontario-wide ColonCancerCheck program between 1 April 2008 and 31 December 2010 who had a positive fecal occult blood test (FOBT+) and who did not have colonoscopy follow-up before 1 April 2011


Cox proportional hazards models were used to estimate crude and multivariable-adjusted main effects on the hazard of follow-up colonoscopy within 6 months of 1 April 2011.


Over the 6-month follow-up, 15.1% of the 9661 participants who were fobt-positive for 3 or more months received a follow-up colonoscopy. Approximately half those colonoscopies occurred within the first 2 months. Participants included in a sar (n = 8799) tended to be older and of higher socioeconomic status (Table i). They were also more likely to have higher continuity of care from their ordering pcp. The sar-included participants were moderately more likely to have had a colonoscopy in the preceding 2 years. Conversely, prior colonoscopies among the sar-excluded participants (n = 862) were proportionally more remote.

Crude and adjusted effects indicate that the hazard of colonoscopy was not meaningfully different for sar-exposed participants (Table ii). Duration of positive fobt status was observed to be strongly inversely associated with hazard of follow-up colonoscopy (p for linear trend: <0.001).

TABLE II Crude and multivariable-adjusted hazard ratios for the effects of inclusion in a screening activity report and duration of positive fecal occult blood test (FOBT+) status on hazard of follow-up colonoscopy, 1 April to 1 October 2011



Our findings indicate that the first ColonCancerCheck sar did not meaningfully improve colonoscopy uptake for patients who had been fobt-positive for 3 or more months.

Previous evaluations of physician-targeted approaches have incorporated multifaceted interventions. In the United States, Veteran Affairs centres and a large Seattle-based health cooperative found that electronic reminders prompting physician feedback35, in addition to other infrastructure upgrades4, improved colonoscopy uptake after an abnormal fobt. Another U.S. study found that physician reminders, combined with practice-tailored education, improved the same outcome6. Localized U.S. settings have supported the effectiveness of automated referrals7,8. Given that the foregoing reports were not examples of population-wide screening, comparisons with Ontario’s ColonCancerCheck and European programs might be of limited utility.

The literature evaluating physician- or participant-targeted interventions and aiming specifically to improve colonoscopy uptake after a positive fobt in population-wide settings has been sparse. However, prior evaluations of two ongoing interventions in Ontario’s ColonCancerCheck have demonstrated that interventions targeting participants are more effective2.

The present evaluation is the first to consider a mailed, physician-targeted intervention that provides practice-specific screening status updates about fobt-positive patients in a population-wide setting. Our findings should be interpreted with a view to two main limitations. First, residual confounding is a possibility. The sar-included participants might have differed from the sar-excluded ones by unmeasured factors beyond inclusion in the sar, either related to having a pem-participating pcp or associated with follow-up colonoscopy. A second limitation is that the intervention effect could be assessed only for participants who had been fobt-positive for 3 or more months. Poorer follow-up with increasing duration of fobt positivity, as supported by our findings (Table ii), suggests that those who do not proceed to colonoscopy directly are less likely to do so, perhaps regardless of intervention type or target.

Although clinical data for ColonCancerCheck screening participants have been found to be 93% accurate, and although pilot evaluations have indicated that Ontario pcps are highly supportive of the sar audit-feedback strategy9, refinement of the sar based on pcp feedback is ongoing. In subsequent iterations of the sar, the lag between a positive fobt result and issuance of the pcp report was substantially reduced. Finally, although no formal validation has yet been performed, we have no reason to doubt the accuracy of the sar.


Mailed physician-targeted audit and feedback reports alone are unlikely to improve compliance with follow-up colonoscopy in Ontario for ColonCancerCheck participants who have remained fobt-positive for 3 or more months. Other possible interventions include physician audits soliciting response or automatic referrals (demonstrated to be effective in localized U.S. settings in addition to participant-targeted correspondence). However, some of these inventions could be onerous, particularly for population-wide screening programs of comparable scope to Ontario’s ColonCancerCheck, given that the requisite infrastructure is not already in place.


This study was supported by the Institute for Clinical Evaluative Sciences (ices), which is funded by an annual grant from the Ontario Ministry of Health and Long-Term Care (mohltc). The opinions, results, and conclusions reported in this paper are those of the authors and are independent from the funding sources. Nor endorsement by ices or the Ontario mohltc is intended or should be inferred.

Parts of this material are based on data and information compiled and provided by the Canadian Institute for Health Information (cihi) and Cancer Care Ontario (cco). However, the analyses, conclusions, opinions, and statements expressed herein are those of the authors and not necessarily those of cihi. No endorsement by cihi or cco is intended or should be inferred.

We acknowledge Cory Borkhoff for preliminary work in planning and accessing data for this study.


We have read and understood Current Oncology’s policy on disclosing conflicts of interest, and we declare that we have none.


*Sunnybrook Research Institute, Sunnybrook Health Sciences Centre,
Department of Medicine, University of Toronto,
Institute for Clinical Evaluative Sciences,
§Dalla Lana School of Public Health, University of Toronto,
Institute of Health Policy Management and Evaluation, University of Toronto,
#Cancer Care Ontario,
**Department of General Surgery and Li Ka Shing Knowledge Institute, St. Michael’s Hospital,
††Institute of Medical Sciences, University of Toronto, and,
‡‡Radiation Oncology, University of Toronto, Toronto, ON..


1. Paterson WG, Depew WT, Pare P, et al. on behalf of the Canadian Association of Gastroenterology Wait Time Consensus Group. Canadian consensus on medically acceptable wait times for digestive health care. Can J Gastroenterol 2006;20:411–23.
cross-ref  pubmed  pmc  

2. Stock D, Rabeneck L, Baxter NN, et al. Mailed participant reminders are associated with improved colonoscopy uptake after a positive fobt result in Ontario’s ColonCancerCheck program. Implement Sci 2015;10:35.

3. Larson MF, Ko CW, Dominitz JA. Effectiveness of a provider reminder on fecal occult blood test follow-up. Dig Dis Sci 2009;54:1991–6.
cross-ref  pubmed  

4. Singh H, Kadiyala H, Bhagwath G, et al. Using a multifaceted approach to improve the follow-up of positive fecal occult blood test results. Am J Gastroenterol 2009;104:942–52.
cross-ref  pubmed  pmc  

5. Miglioretti DL, Rutter CM, Bradford SC, et al. Improvement in the diagnostic evaluation of a positive fecal occult blood test in an integrated health care organization. Med Care 2008;46(suppl 1):S91–6.
cross-ref  pubmed  pmc  

6. Myers RE, Turner B, Weinberg D, et al. Impact of a physician-oriented intervention on follow-up in colorectal cancer screening. Prev Med 2004;38:375–81.
cross-ref  pubmed  

7. Van Kleek E, Liu S, Conn LM, Hoadley A, Ho SB. Improving the effectiveness of fecal occult blood testing in a primary care clinic by direct colonoscopy referral for positive tests. J Healthc Qual 2010;32:62–9.
cross-ref  pubmed  

8. Humphrey LL, Shannon J, Partin MR, O’Malley J, Chen Z, Helfand M. Improving the follow-up of positive Hemoccult screening tests: an electronic intervention. J Gen Intern Med 2011;26:691–7.
cross-ref  pubmed  pmc  

9. Tinmouth, J, Ritvo P, McGregor SE, et al. ColonCancerCheck primary care invitation pilot project: family physician perceptions. Can Fam Physician 2012;58:e570–7.
pubmed  pmc  

Correspondence to: David Stock, Sunnybrook Health Sciences Centre, 2075 Bayview Avenue, Room HG40, Toronto, Ontario M4N 3M5 E-mail: d.stock@mail.utoronto.ca

(Return to Top)

Current Oncology, VOLUME 24, NUMBER 1, February 2017

Copyright © 2017 Multimed Inc.
ISSN: 1198-0052 (Print) ISSN: 1718-7729 (Online)