Clinical practice guidelines in breast cancer

Review Article

Clinical practice guidelines in breast cancer

N. Kumar Tyagi, MB BCh BAO*, S. Dhesy-Thind, MD MSc*




A number of clinical practice guidelines (cpgs) concerning breast cancer (bca) screening and management are available. Here, we review the strengths and weaknesses of cpgs from various professional organizations and consensus groups with respect to their methodologic quality, recommendations, and implementability.


Guidelines from four groups were reviewed with respect to two clinical scenarios: adjuvant ovarian function suppression (ofs) in premenopausal women with early-stage estrogen receptor–positive bca, and use of sentinel lymph node biopsy (slnb) after neoadjuvant chemotherapy (nac) for locally advanced bca. Guidelines from the American Society of Clinical Oncology (asco); Cancer Care Ontario’s Program in Evidence Based Care (cco’s pebc); the U.S. National Comprehensive Cancer Network (nccn); and the St. Gallen International Breast Cancer Consensus Conference were reviewed by two independent assessors. Guideline methodology and applicability were evaluated using the agree ii tool.


The quality of the cpgs was greatest for the guidelines developed by asco and cco’s pebc. The nccn and St. Gallen guidelines were found to have lower scores for methodologic rigour. All guidelines scored poorly for applicability. The recommendations for ofs were similar in three guidelines. Recommendations by the various organizations for the use of slnb after nac were contradictory.


Our review demonstrated that cpgs can be heterogeneous in methodologic quality. Low-quality cpg implementation strategies contribute to low uptake of, and adherence to, bca cpgs. Further research examining the barriers to recommendations—such as intrinsic guideline characteristics and the needs of end users—is required. The use of bca cpgs can improve the knowledge-to-practice gap and patient outcomes.

KEYWORDS: Breast cancer, clinical practice guidelines, agree ii


Despite significant progress in screening, treatment, and survivorship, breast cancer (bca) remains the 2nd leading cause of cancer death in Canadian women. In 2017, bca accounted for 25% of new cancer diagnoses and 13% of cancer deaths in women1. The rapid pace of scientific discovery and the sheer volume of the evolving medical literature, as well as the varied level of expertise in critically appraising or systematically integrating the literature, can pose challenges for busy clinicians aiming to provide optimal and current care for patients. Clinical practice guidelines (cpgs) have become an essential tool to aid health care practitioners in synthesizing and summarizing available evidence to help improve patient management2. The use of oncology cpgs in clinical practice has been shown to improve recurrence-free survival and overall survival35. In addition, cpgs identify gaps in evidence and highlight opportunities for further research6. They can also guide health care policy development and support allocation of health care funding and health care structure6.

Several professional organizations and consensus groups have developed bca cpgs with the overarching goal of translating evidence into recommendations for best patient care. A search for bca guidelines published in the last 5 years, using the Guidelines International Network, the National Guideline Clearinghouse, the Standards and Guidelines Evidence Database (maintained by the Canadian Partnership Against Cancer), and PubMed (search terms in Table i) yielded 232 guidelines. The sheer volume of bca cpgs could cause confusion for health care practitioners, especially if recommendations conflict.

TABLE I The PubMed search


Despite the myriad of bca guidelines, guideline uptake has been varied. Wockel et al.4 demonstrated 51.9% adherence to guideline recommendations for complete treatment of bca patients. Simos et al.7 showed that 65.0% of oncologists did not follow the American Society of Clinical Oncology (asco) and Choosing Wisely guidelines related to diagnostic imaging for stage i and ii bca surveillance.

Barriers to guideline uptake are complex. One systematic review8 identified 3 categories of barriers for guideline use:

  • ■ Personal barriers such as physician knowledge, including lack of awareness and lack of familiarity with cpgs

  • ■ Barriers that influence the physician’s attitude toward change in practice

  • ■ External barriers related to the guideline, patients, and environment

Many practitioners might not use guidelines because of concerns about data or methodologic quality8. The definition of a high-quality cpg varies, and quality assessment of cpgs can be complicated. The U.S. Institute of Medicine defined “high quality” cpgs as “statements that include recommendations, intended to optimize patient care, that are informed by a systematic review of evidence and an assessment of the benefits and harms of alternative care options”2. That definition focuses on methodologic rigour as a standard for high quality. However, consensus statements and expert opinions developed from meeting proceedings might not include a robust systematic review of the literature, but might still be an effective tool in patient care. Alternatively, the agree (Appraisal of Guidelines for Research and Evaluation) collaboration defines guideline quality as “the confidence that the potential biases of guidelines have been addressed adequately and that the recommendations are both internally and externally valid and are feasible for practice”9. That definition includes the guideline methodology and recommendations, and guideline applicability, as required components of high-quality cpgs. The collaboration has developed the agree ii instrument as a framework for quality assessment and provides a methodology checklist for high-quality guideline development and reporting9,10. The agree ii instrument is a 23-item tool with 6 quality domains that are rated using a 7-point Likert scale (Table ii)9. Although several other instruments have been developed for guideline assessment, a systematic review evaluating 40 guideline appraisal tools ranked the agree ii tool the highest for comprehensive guideline evaluation11.

TABLE II Quality domains in AGREE I and AGREE IIa


Synthesis and reporting of the medical literature is only one aspect of a cpg. Clinicians also rely on cpgs to provide high-quality recommendations. Recommendations can be evaluated by instruments such as the Grading of Recommendations Assessment, Development and Evaluation12. Although agree ii is a comprehensive tool, it does not evaluate the validity or clinical appropriateness of recommendations10. The agree-rex project is developing a tool to address that gap13.

Simple publication of a cpg does not ensure that the guideline will be used. Effective implementation strategies are also necessary. The implementability of a guideline refers to guideline characteristics that predict its implementation or uptake into clinical practice14,15. Tools such as the Guideline Implementability Appraisal14, adapte16, and form17 are used to assess cpg implementability in both the guideline development phase and the evaluation phase. More recently, a realist review using a multidisciplinary approach demonstrated that guideline uptake was influenced by 6 implementability domains, including stakeholder involvement, evidence synthesis, considered judgment (clinical relevance), implementation feasibility, message, and the format of the cpg18.

Overall, evaluating a cpg requires a comprehensive review of the cpg’s development, including data selection and content quality, linkage of the data to the final recommendations, and implementability of the recommendations in clinical practice. Furthermore, clinicians have indicated a preference for simple, patient-specific, and user-friendly guidelines1921.

Here, we evaluate the strengths and weaknesses of bca cpgs based on two clinical scenarios. Using the agree ii instrument, we demonstrate differences in the methodology and quality of the guidelines and their recommendations. Issues with respect to guideline applicability and implementability are reviewed. For bca cpgs to make sense to clinicians for everyday use, the guidelines have to be high-quality, relevant, and applicable to patients.


We selected four guideline-developing organizations: asco, Cancer Care Ontario’s Program in Evidence Based Care (cco’s pebc), the U.S. National Comprehensive Cancer Network (nccn), and the St. Gallen Consensus Conference. We acknowledge that this list of organizations is limited and that many other reputable guideline developers operate internationally. However, for the present work, those four organizations were chosen to highlight similarities and differences in guideline development methods, guideline recommendations, and presentation of recommendations.

Guidelines relating to two representative clinical scenarios encountered by oncologists treating early-stage bca and covered by all four guidelines groups in cpgs during the last 5 years were selected:

  • ■ When should adjuvant ovarian function suppression (ofs) be given to premenopausal women with early-stage estrogen receptor–positive (er+) bca?

  • ■ After neoadjuvant chemotherapy (nac) for locally advanced bca (labc), when is a sentinel lymph node biopsy (slnb), compared with a complete axillary lymph node dissection, recommended for axillary staging?

Two reviewers (NKT and SDT) independently examined and evaluated the most recent version of each guideline. Descriptive comparisons of guideline recommendations from the four organizations are reported. The agree ii tool was used to evaluate the quality of each guideline according to the tool’s user manual. The agree ii domain scores are calculated by summing the scores for the individual items in the domain and then scaling the total as a percentage9. Domain scores exceeding 60% were defined as good quality. That definition is consistent with scoring by agencies such as the Canadian Partnership Against Cancer guideline database assessment22. Brouwers et al.10 found that high-quality guidelines have an average score of 78% in the rigour domain and that low-quality guidelines have an average score of 55%. Guidelines were evaluated using the online tool My AGREE II Plus23.


Many differences between the guidelines were noted for multiple areas such as guideline format and presentation, methodologic rigour, and recommendations.

Guideline Presentation

The asco24,25 and pebc26,27 guidelines are similarly presented. They are expansive documents that consist of multiple components. The asco guidelines consist of a full guideline, with additional data and methodology supplements24,25. A patient supplement is also available, together with pocket resource guides28. The pebc guidelines often include a summary statement, an evidentiary base or systematic review, and a methodology statement of guideline development and external review26,27. Details of the panel’s votes on recommendations are also readily available and included in supporting documents26.27.

The nccn guidelines follow an algorithmic approach with succinct recommendations29. Details about the evidence supporting the recommendations can be found in a separate “Discussion” document30. A St. Gallen consensus is presented both as a summary31 and as a full statement32. The recommendations about ofs were limited to one paragraph in the full statement, and only supportive evidence was provided. A discussion of the evidence and voting results were not published within the consensus document, but are available online in supplementary files32.

Guideline Methodology

Table iii highlights differences in guideline methodology between the four guideline developers. Although a multidisciplinary panel consisting of bca experts and researchers is found in each group, the asco and pebc guideline teams also include methodology expertise for conducting a systematic review of the literature related to a specific clinical question33,34. Both asco and the pebc provide detailed search criteria, critical analyses of the studies found, and a detailed explanation accounting for the inclusion and exclusion of studies in their analysis and recommendations33,34. Neither the nccn nor St. Gallen report on the methodology used for their literature review or critical evaluation of the evidence30,32. Moreover, they do not report the studies reviewed and excluded in the discussions leading to their recommendations30,32. St. Gallen does publish information about the extent of the consensus achieved on the various statements included in its guideline32.

TABLE III Characteristics of the clinical practice guidelines


Guideline Recommendation Ratings

All four guideline organizations use different tools and rating systems to evaluate their recommendations. The asco rating system ranges from “insufficient” to “high,” based on confidence in the available evidence33. Unlike asco, the pebc does not rate its guideline recommendations; instead, a qualifying statement is provided26,27. The nccn guidelines provide a category of recommendations in the range 1–329. All recommendations are category 2A unless specifically noted to be different29. A category 2A recommendation is based on lower-level evidence, together with uniform nccn consensus (>90%) that the intervention is appropriate29. St. Gallen does not rate its recommendations; however, the strength of a recommendation can be reflected in the choice of phrasing (that is, “strongly recommended,” “clearly recommends”)31,32.

Guideline Review

Table iv summarizes the various guidelines and their recommendations.

TABLE IV Summary of guideline recommendations


Clinical Scenario 1

  • ■ When should adjuvant ofs be given to premenopausal women with early-stage er+ bca?

Three of the four guidelines recommended ofs in addition to endocrine therapy for premenopausal women with er+ bca24,3032.

The asco guideline on ofs was a focused guideline update dedicated to the topic24, and asco endorsed ofs in addition to endocrine therapy for women with stages ii and iii bca. In women with stage i bca having a high risk of recurrence, for whom chemotherapy would be advised, the asco guideline recommended ofs with endocrine therapy24. For women with stage i bca not requiring chemotherapy, asco recommended endocrine therapy alone. Ovarian function suppression was recommended in combination with tamoxifen or an aromatase inhibitor, and only for 5 years. The recommendation strength was moderate and was based on large clinical trials3537.

The nccn guideline for ofs was presented in one section of a large, comprehensive statement about the treatment of bca30. Specific guideline recommendations for ofs were therefore brief. Guideline recommendation binv-j states that ofs, in addition to either tamoxifen or an aromatase inhibitor, should be recommended to patients with a higher risk of recurrence after a balanced discussion about the risks and benefits30. Patients are considered higher risk if they are diagnosed at a younger age (not defined), if evidence of lymph node involvement is present, or if the tumour is high grade. References for ofs were limited to the soft and text trials35,36. Notably absent from the discussion was the abcsg (Austrian Breast and Colorectal Cancer Study Group) 12 trial, which was referenced in the other three guidelines37. The nccn did reference abcsg-12 with respect to its adjuvant bisphosphonate recommendations30.

Like the nccn guideline, the St. Gallen consensus sets out broad guidelines for all aspects of treatment in early-stage bca, with ofs being one topic discussed at the consensus conference31,32. The recommendations from the consensus meeting strongly advised ofs in addition to endocrine therapy for women at high risk of recurrence. Specifically, the St. Gallen consensus developers defined women with a high risk of recurrence as those diagnosed at less than 35 years of age, having 4 or more involved lymph nodes, or requiring chemotherapy31,32. The evidentiary base for the recommendations lists the soft, text, and abcsg-12 trials3537.

The pebc guideline recommendations for ofs differed from those given in the other three guidelines. This specific clinical scenario forms part of a larger and comprehensive cpg focused on all aspects of adjuvant therapy26. Recommendation 1–21 states that cco does not recommend ofs in addition to endocrine therapy for any premenopausal woman with an er+ tumour. A recommendation for ofs alone was given for patients in whom other systematic therapy was not advised26. Published in 2014, the pebc guideline acknowledged new data emerging from the soft35 and text36 trials, but indicated that the applicability of the evidence in clinical practice was unclear at the time26. That evaluation was reflected in a qualifying statement26:

Clinicians were unsure how to incorporate into their clinical practice.... 83.3% of participants agreed that the addition of [ovarian ablation] or suppression to tamoxifen in premenopausal patients is not standard of care; however, 16.7% of participants disagreed or were undecided given the existence of data that suggests a benefit in female patients aged < 40 years. There was significant discussion and divergent opinions on this issue. Pending upcoming data, the addition of ovarian ablation or suppression to tamoxifen in premenopausal patients it is not standard of care.

Clinical Scenario 2

  • ■ After nac for labc, when is a slnb, compared with a complete axillary lymph node dissection, recommended for axillary staging?

The 2017 asco guideline was a focused update to a 2014 guideline on slnb in early-stage bca25. The guideline expert panel, after a systematic review, concluded that no new evidence had emerged to warrant a change to the 2014 guideline recommendations38. The asco guideline recommendations conclude that clinicians could offer slnb to patients who have received nac25. The evidence quality was judged to be intermediate, and the overall strength of the recommendation was moderate25. However, given insufficient evidence (quality was poor, and overall strength of the evidence was weak)25, asco did not recommend slnb for larger tumours—T3 (>5 cm) or T4 (with direct extension to skin or chest wall)39—or for inflammatory bca. The cco guidelines, published in 2014, also state that lack of evidence led to a recommendation against the routine use of slnb after the administration of nac for labc27. Studies included in the asco and cco guidelines were similar4042.

In contrast, nccn and St. Gallen identified specific scenarios in which a slnb could be considered (Table iv). The nccn guideline recommendation binv-11 states that if the lymph node evaluation before nac is clinically negative, then slnb can be recommended30. A slnb can also be recommended if axillary lymph nodes that are positive before nac are found to be clinically negative after treatment30. The recommendation was given a category 2B rating30. That rating was based on lower-level evidence and a nccn consensus in the 75%–90% range29. The recommendation also states that the false-negative rate of 10% after slnb should be discussed with patients30. A slnb was not recommended if a lymph node that was positive before nac remains positive after treatment30. The specific studies supporting the nccn recommendations for clinical scenario 2 were not discussed30.

St. Gallen recommended slnb for women with lymph nodes that are initially clinically positive, with subsequent downstaging to a negative axilla after nac31,32. If the axilla remains clinically positive after nac, then slnb is appropriate if at least 3 negative lymph nodes are found31,32. A slnb would not be sufficient if, after nac, macrometastatic nodal disease were to be osberved31,32. The studies justifying those recommendations were similar to those considered by asco and the pebc4042 as well as by others43,44. The St. Gallen consensus states that a slnb is appropriate for a woman with clinically and radiologically negative axilla before nac31,32. The recommendation was strongly supported, with 95.7% consensus32.

AGREE II Evaluation of Guidelines

Tables v and vi present the results of the agree ii evaluations of the guidelines for the two scenarios. All guidelines scored highest on clarity and presentation. All guidelines scored poorly on applicability. The asco and pebc guidelines met all minimum quality thresholds in each domain for scenario 1, but not for scenario 2. The nccn and St. Gallen guidelines scored poorly on rigour of development. The nccn and St. Gallen guidelines scored well on clarity of presentation.

TABLE V AGREE II scoresa of guidelines used for clinical scenario 1, ovarian function suppression


TABLE VI AGREE II scoresa of guidelines for clinical scenario 2, sentinel lymph node biopsy



Research suggests that end users of cpgs value guidelines with an easy-to-use format, evidence validity, expert guidance for applying recommendations to individual patients, and engagement of patients in shared decision-making19,20,45. Using two clinical scenarios in bca treatment, we applied the agree ii tool to evaluate the quality of guidelines from four different organizations. Distinct guidelines were available from asco and the pebc for each of the two clinical scenarios; the nccn and St. Gallen covered the two scenarios within a single larger guideline.

Rigorous and clear methodologic support for guideline recommendations was found to vary between the guideline organizations. The asco and pebc guideline panels included identified methodologists33,34, and not surprisingly, their guidelines, compared with those from the nccn and the St. Gallen Consensus Conference, scored higher in the domains of rigour of development3032. However, the quality support from methodologists did not translate into improved applicability; all the guidelines scored low on the applicability domain.

Despite differences in methodologic rigour, each of the organizations used similar evidence to reach fairly consistent recommendations for clinical scenario 13537. That observation might be explained by the topic’s available evidentiary base. The pebc recommendations for ofs were completed in September 2014 and must be interpreted with care given the emergence of more recent and mature data considered by the other three guideline organizations, all of whom published their recommendations more recently.

For scenario 2, recommendations were more contradictory and confusing. The asco and pebc panels were unable to recommend slnb because of a paucity of evidence relating to slnb after nac. However, the nccn and St. Gallen groups relied on expert opinion and consensus to make recommendations in the absence of high-level studies. In this particular scenario, the issues with respect to the quality of the data content and the lack of high-level evidence, coupled with a very specific clinical question, could have adversely affected the applicability of the guideline recommendations, thus resulting in low agree ii scores.

The agree ii evaluation performed for the present study has limitations. First, the evaluation was performed by 2 reviewers. The agree consortium recommends at least 2 reviewers, but more reviewers will increase the reliability of the assessment9. Another limitation was that guideline implementability was not further assessed using tools such as the Guideline Implementability Appraisal14; can-implement46; Grading of Recommendations Assessment, Development and Evaluation12; and adapte16.

Our results are similar to those emerging from other studies evaluating bca guidelines. Hogeveen et al.47 used the agree instrument to evaluate the quality of bca cpgs developed by three international organizations. They found variability in guideline quality within and between organizations. They also showed that, for all bca guidelines, the lowest score on the agree instrument occurred in the domain of applicability47. The applicability domain in the agree ii tool evaluates whether the cpg identifies facilitators to help end users of the guideline apply the guideline recommendations, and assesses whether barriers impeding the implementation process were identified and whether solutions were provided9.

The applicability of cpgs has been problematic in several other studies, including an evaluation of surgical guidelines for bca treatment48 and a systematic review of bca guidelines and their sensitivity to differing resources around the globe49. The latter finding was important, given that oncology cpgs from asco and the nccn are used internationally50,51. A low score in the domain of applicability for bca guidelines evaluated using either agree or agree ii identifies a weakness in most guidelines52.

The uptake of oncology guideline recommendations in clinical practice is challenging to ascertain. In 2013, the nccn recorded 4.9 million pdf downloads of their guidelines51 However, guideline downloads do not necessarily translate into guideline use or adherence. An international survey conducted in 2012 of 691 oncologists practicing internationally found that 83.1% of respondents used asco guidelines, followed by St. Gallen and nccn guidelines50. The same study also used the agree ii instrument to compare the popularity of guidelines with their assessed quality50. The asco guidelines were found to receive the highest score for both rigour and popularity. Interestingly, the nccn and St. Gallen guidelines were very popular with the surveyed oncologists, but achieved overall agree ii domain scores below the high-quality threshold50. Although the survey study was small, it demonstrated that high-quality scores did not directly correspond with increased use of a guideline. That observation might reflect barriers to uptake and adherence that were not addressed in the cpgs4,7,53,54. Factors that were thought to increase guideline uptake included prominence of the guideline panel members as opinion leaders in the field and successful dissemination techniques, particularly with respect to electronic or Internet tools51.

Successful uptake of guidelines requires effective implementation strategies21 that could include pilot-testing guidelines to identify facilitators and barriers to implementation, particularly factors influencing feasibility in local jurisdictions. Feasibility of guideline implementation depends on factors such as capacity, resource availability, and cultural and societal norms and practice49. Additional tools such as summary documents or links to algorithms or checklists could also be helpful9,21,55,56. Kastner et al.18 found that guideline implementability is influenced by two major factors: creation of the guideline content, and effective communication of the guideline content. Specific guideline characteristics shown to be associated with poor uptake include length and format of the guideline, lack of clarity, and applicability of recommendations21. However, oversimplification could lead to misinterpretation of the evidence, and thus a balance between simplicity and full clarity of guideline recommendations must be found. Some researchers suggest incorporating literature from the fields of cognitive research, behavioural science, and marketing to improve implementation strategies18.

Uptake of guideline recommendations can be influenced by resource implications and cost-effectiveness. Guidelines that place excess demands or require additional resources, or that necessitate acquisition of new skills or knowledge are often difficult to implement21. Unfortunately, those aspects of implementability were not considered in any of the guidelines assessed for our review. The nccn is attempting to address the issue with its new “evidence block,” which is a separate guideline that incorporates affordability and the costs of therapies into its guidelines57.

The abundance of bca cpgs is not necessarily problematic. Although duplication of effort might be significant, attempts are increasingly being made to combine resources, as is evident in several joint collaborations by cco’s pebc and asco58,59. The challenge lies in contextual issues of local resources and making cpgs more patient-focused. Moreover, cpgs might also have culture-building capabilities both at the local level and more broadly within the oncology community. Efforts to pool resources and subsequently adapt guidelines for local practice might be appropriate and might also increase cpg applicability and use.

Guidelines also face challenges of staying up to date in the face of emerging data60. The maintenance of methodologic rigour can conflict with the need to remain relevant and current61,62. One solution that organizations such as asco and the European Society of Medical Oncology have recommended is to conduct focused updates or electronic updates for smaller topics. The nccn conducts an annual review of its guidelines, which could be a factor in their reported high rates of uptake29.

An assessment of the quality of guideline recommendation content is important for further understanding the issues related to guideline implementation and applicability. It is important to recognize that high methodologic quality does not necessarily equate to high content quality. The lack of quality assessments of guideline content is a recognized deficiency. The agree-rex project is currently developing a resource to complement the agree ii instrument by evaluating the clinical credibility and implementability of cpgs13. Future research in this area will be important to improve guideline implementation.

In addition to informing clinicians about current practices, guidelines can highlight areas of insufficient evidence. When evidence is lacking, expert opinion and consensus recommendations can take on increased prominence, as was evident in the nccn and St. Gallen recommendations. The lack of evidence can potentially result in increased bias2. Transparency is necessary to counter that bias and is achieved by identifying a well-defined search strategy, justifications for including or excluding studies, voting results, and commercial and intellectual conflicts of interest. Reliance on expert consensus was evident in the clinical scenario involving slnb after nac for labc. Data to guide decision-making in this context are limited, raising concerns about potential adverse patient outcomes. On reviewing the guidelines, it is evident that the medical literature contains gaps and that further research in this area is warranted.

In interpreting and using cpgs, clinicians must be vigilant in understanding the development and methodologic rigour involved. Attention should be given to the selection of studies for the guidelines and the interpretation of results. Guidelines should be transparent and up to date, and should reflect the limitations of the literature. Finally, context-specific applicability will determine which guideline truly makes sense for the practicing clinician to use in providing the best possible care for patients.


We have read and understood Current Oncology’s policy on disclosing conflicts of interest, and we declare the following interests: SDT’s institution receives funding from Novartis for a trial in which she is a co-investigator.


*Division of Medical Oncology, Department of Oncology, McMaster University, Hamilton, ON..


1. Canadian Cancer Society. Breast Cancer Statistics [Web page]. Toronto, ON: Canadian Cancer Society; 2017. [Available at:; cited 3 November 2017]

2. Graham R, Mancher M, Miller Wolman D, Greenfield S, Steinbeerg E, eds. on behalf of the U.S. Institute of Medicine, Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical Practice Guidelines We Can Trust. Washington, DC: National Academies Press; 2011. [Available online at:; cited 23 October 2017]

3. Varga D, Wischnewsky M, Atassi Z, et al. Does guideline-adherent therapy improve the outcome for early-onset breast cancer patients? Oncology 2010;78:189–95.
cross-ref  pubmed  

4. Wockel A, Kurzeder C, Geyer V, et al. Effects of guideline adherence in primary breast cancer—a 5-year multi-center cohort study of 3976 patients. Breast 2010;19:120–7.

5. Schewentner L, Wockel A, Konig J, et al. Adherence to treatment guidelines and survival in triple-negative breast cancer: a retrospective multi-center cohort study with 9156 patients. BMC Cancer 2013;13:487.

6. Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. BMJ 1999;318:527–30.
cross-ref  pubmed  pmc  

7. Simos D, Hutton B, Graham ID, Arnaout A, Caudrelier JM, Clemons M. Imaging for metastatic disease in patients with newly diagnosed breast cancer: are doctor’s perceptions in keeping with the guidelines? J Eval Clan Pact 2015;21:67–73.

8. Cabana MD, Rand CS, Powe NR, et al. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA 1999;282:1458–65.
cross-ref  pubmed  

9. agree Next Steps Consortium. Appraisal of Guidelines for Research and Evaluation II. Hamilton, ON: agree Enterprise project office; 2017. [Available online at:; cited 3 January 2018]

10. Brouwers MC, Kho ME, Bowman GP, et al. agree ii: advancing guideline development, reporting and evaluation in health care. CMAJ 2010;182:E839–42.
cross-ref  pubmed  pmc  

11. Vlayen J, Aertgeerts B, Hannes K, Seremus W, Ramaekers D. A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit. Int J Qual Health Care 2005;17:235–42.
cross-ref  pubmed  

12. Guyatt G, Oxman A, Kunz R, et al. Going from evidence to recommendations. BMJ 2008;336:1049–51.
cross-ref  pubmed  pmc  

13. agree Next Steps Consortium. AGREE-REX: recommendation excellence [Web page]. Hamilton, ON: agree Enterprise project office; 2017. [Available at:; cited 19 January 2018]

14. Schifman RN, Dixon J, Brandt C, et al. The Guideline Implementability Appraisal (glia): development of an instrument to identify obstacles to guideline implementation. BMC Med Inform Decis Mak 2005;5:23.

15. Eccles MP, Mittman BS. Welcome to implementation science. Implement Sci 2006;1:1.
cross-ref  pmc  

16. Harrison MB, Legare F, Graham ID, Ferbers B. Adapting clinical practice guidelines to local context and assessing barriers to their use. CMAJ 2009;182:E78–E84.
cross-ref  pubmed  pmc  

17. Hillier S, Grimmer-Somers K, Merlin T, et al. form: an Australian method for formulating and grading recommendations in evidence-based clinical guidelines. BMC Med Res Methodol 2011;11:23.

18. Kastner M, Bhattacharyya O, Hayden L, et al. Guideline uptake is influenced by six implementability domains for creating and communicating guidelines: a realist review. J Clin Epidemiol 2015;68:498–509.
cross-ref  pubmed  

19. Doherty J, Tanamor M, Feigert J, Goldberg-Dey J. Oncologists’ experience in reporting cancer staging and guideline adherence: lessons from the 2006 Medicare Oncology Demonstration. J Oncol Pract 2010;6:56–9.
cross-ref  pubmed  pmc  

20. Gagliardi AR, Brouwers MC, Palda VA, Lemieux-Charles L, Grimshaw JM. How can we improve guideline use? A conceptual framework of implementability. Implementat Sci 2011;6:26.

21. Katsner M, Estey E, Bhattacharya O. Better guidelines for better care: enhancing the implementability of clinical practice guidelines. Expert Rev Pharmacoecon Outcomes Res 2011;11:315–24.

22. Canadian Partnership Against Cancer (cpac). How we evaluate guidelines [Web page]. Toronto, ON: cpac; n.d. [Available at:; cited 31 January 2018]

23. agree Next Steps Consortium. My AGREE II Plus [Web resource]. Hamilton, ON: agree Enterprise project office; n.d. [Available at:; cited 29 January 2018]

24. Burstein HJ, Lacchetti C, Anderson H, et al. Adjuvant endocrine therapy for women with hormone receptor-positive breast cancer: American Society Oncology clinical practice guideline update on ovarian suppression. J Clin Oncol 2016;34:1689–701.
cross-ref  pubmed  

25. Lyman GH, Somerfield MR, Bosserman LD, Perkins CL, Weaver DL, Giuliano AE. Sentinel lymph node biopsy for patient with early-stage breast cancer: American Society for Clinical Oncology clinical practice guideline update. J Clin Oncol 2017;35:561–4.

26. Eisen A, Fletcher GG, Gandhi S, et al. Optimal systemic therapy for early female breast cancer. Curr Oncol 2015;22(suppl 1):S67–81.
cross-ref  pubmed  pmc  

27. Brackstone M, Fletcher GG, Dayes IS, Madarnas Y, SenGupta SK, Verma S on behalf of the Breast Cancer Disease Site Group. Locoregional therapy of locally advanced breast cancer (labc). Curr Oncol 2015;22(suppl 1):S54–66.
cross-ref  pubmed  pmc  

28. Burstein HJ, Lacchetti C, Anderson H, et al. Adjuvant endocrine therapy for women with hormone receptor–positive breast cancer update on ovarian suppression [Web resource]. Alexandria, VA: American Society for Clinical Oncology; 2018. [Available at:; cited 20 January 2018]

29. National Comprehensive Cancer Network (nccn). Development and Update of the NCCN Guidelines [Web page]. Fort Washington, PA: nccn; 2017. [Available at:; cited 3 April 2017]

30. National Comprehensive Cancer Network (nccn). NCCN Clinical Practice Guidelines in Oncology: Breast Cancer. Ver. 3.2017. Fort Washington, PA: nccn; 2017. [Current version available online at: (free registration required); cited 21 November 2017]

31. Gnant M, Harbeck N, Thomssen C. St. Gallen/Vienna 2017: a brief summary of the consensus discussion about escalation and de-escalation of primary breast cancer treatment. Breast Care (Basel) 2017;12:102–7.

32. Curigliano, G, Burstein HJ, Winer EP, et al. De-escalating and escalating treatments of early-stage breast cancer: the St. Gallen International Expert Consensus Conference on Primary Therapy of Early Breast Cancer. Ann Oncol 2017;28:1700–12.

33. American Society of Clinical Oncology (asco). ASCO Guidelines Methods Supplement. Adjuvant Endocrine Therapy for Women with Hormone Receptor–Positive Breast Cancer: American Society of Clinical Oncology Clinical Practice Guideline Focused Update. Alexandria, VA: asco; 2015. [Available online at:; cited 27 March 2018]

34. Cancer Care Ontario (cco). Program in Evidence-Based Care Handbook. Toronto, ON: cco; 2012. [Available online at:; cited 3 April 2017]

35. Pagani O, Regan MM, Walley BA, et al. on behalf of the text and soft investigators and the International Breast Cancer Study Group. Adjuvant exemestane with ovarian suppression in premenopausal breast cancer. N Engl J Med 2014;371:107–18.
cross-ref  pubmed  pmc  

36. Francis PA, Regan MM, Fleming GF, et al. on behalf of the soft investigators and the International Breast Cancer Study Group. Adjuvant ovarian suppression in premenopausal breast cancer. N Eng J Med 2015;372:436–46.

37. Gnant M, Mlineritsch B, Schippinger W, et al. Endocrine therapy plus zoledronic acid in premenopausal breast cancer. N Engl J Med 2009;360:679–91.
cross-ref  pubmed  

38. Lyman GH, Temin S, Edge SB, et al. on behalf of the American Society of Clinical Oncology Clinical Practice. Sentinel lymph node biopsy for patients with early-stage breast cancer: American Society of Clinical Oncology clinical practice guideline update. J Clin Oncol 2014;32:1365–83.
cross-ref  pubmed  

39. Compton CC, Byrd DR, Garcia-Aguilar J, Kurtzman SH, Olawaiye A, Washington MK, eds. Breast cancer. In: Edge S, Byrd D, Compton C, Fritz A, Greene F, Trotti A, eds. AJCC Cancer Staging Manual. 7th ed. New York, NY: Springer; 2010: 347–76.

40. Kuehn T, Bauerfield I, Fehm T, et al. Sentinel lymph-node biopsy on patient with breast cancer before and after neoadjuvant chemotherapy (sentina): a prospective multicenter cohort study. Lancet Oncol 2013;14:609–18.
cross-ref  pubmed  

41. Boughey JC, Suman VJ, Miteendorf EA, et al. on behalf of the Alliance for Clinical Trials in Oncology. Sentinel lymph node surgery after neoadjuvant chemotherapy in patients with node-positive breast cancer: the acosog Z1071 (Alliance) clinical trial. JAMA 2013;310:1455–61.
cross-ref  pubmed  pmc  

42. Boileau JF, Poirier B, Basik M, et al. Sentinel node biopsy after neoadjuvant chemotherapy in biopsy-proven node-positive breast cancer the snfnac study. J Clin Oncol 2015;33:258–64.

43. Mamtani A, Barrio AV, King TA, et al. How often does neoadjuvant chemotherapy avoid axillary dissection in patients with histologically confirmed nodal metastases? Results of a prospective study. Ann Surg Oncol 2016;23:3467–74.
cross-ref  pubmed  pmc  

44. El Hage Chehade H, Headon H, El Tokhy O, et al. Is sentinel lymph node biopsy a viable alternative to complete axillary dissection following neoadjuvant chemotherapy in women with node-positive breast cancer at diagnosis? An updated meta-analysis involving 3,398 patients. Am J Surg 2016;212:969–81.
cross-ref  pubmed  

45. Francke AL, Smit MC, de Veer AJ, Mistiaen P. Factors influencing the implementation of clinical guidelines for health care professionals: a systematic meta-review. BMC Med Inform Decis Mak 2008;8:38.
cross-ref  pubmed  pmc  

46. Harrison MB, Graham ID, van den Hoek J, Dogherty EJ, Carley ME, Angus V. Guideline adaptation and implementation planning: a prospective observational study. Implement Sci 2013;8:49.
cross-ref  pubmed  pmc  

47. Hogeveen SE, Han D, Trudeau-Tavara S, et al. Comparison of international breast cancer guidelines: are we globally consistent? Cancer guideline agreement. Curr Oncol 2012;19:e184–90.
cross-ref  pubmed  pmc  

48. Lei X, Liu F, Luo S, et al. Evaluation of guidelines regarding surgical treatment of breast cancer using the agree instrument: a systematic review. BMJ Open 2017;7:e014883.

49. Gandhi S, Verma S, Ethier JL, Simmons CE, Burnett H, Alibhai SM. A systemic review and quality appraisal of international guidelines for early breast cancer systemic therapy: are recommendations sensitive to different global resources? Breast 2015;24:309–17.
cross-ref  pubmed  

50. Gandhi S. A Systemic Review and Appraisal of International Early Breast Cancer Guidelines for Systemic Therapy and a Global Physician Survey Examining Practice Patterns by Resource Setting: Potential Implication for International Health Policy [Master’s thesis]. Toronto, ON: University of Toronto; 2012. [Available online at:; cited 24 January 2018]

51. Ettinger DS, Kuettel M, Malin J, et al. nccn roundtable: what are the characteristics of an optimal clinical practice guideline? J Natl Compr Canc Netw 2015;13(suppl):640–2.
cross-ref  pubmed  

52. Gagliardi AR, Brouwers MC. Do guidelines offer implementation advice to target users? A systematic review of guideline applicability. BMJ Open 2015;5:e007047.
cross-ref  pubmed  pmc  

53. Tang SS, Kaptanis S, Haddon JB, et al. Current margin practice and effect on re-excision rates following the publication of the sso-astro consensus and abs consensus guidelines: a national prospective study of 2858 women undergoing breast-conserving therapy in the U.K. and Ireland. Eur J Cancer 2017;84:315–24.
cross-ref  pubmed  

54. Seroussi B, Laounenan C, Gligorov J, Uzan S, Mentre F, Bouaud J. Which breast cancer decisions remain non-compliant with guidelines despite the use of computerised decision support? Br J Cancer 2013;109:1147–56.
cross-ref  pubmed  pmc  

55. Prior M, Guerin M, Grimmer-Somers K. The effectiveness of clinical guideline implementation strategies—a synthesis of systematic review findings. J Eval Clin Pract 2008;14:888–97.
cross-ref  pubmed  

56. Flodgren G, Hall AM, Goulding L, et al. Tools developed and disseminated by guideline producers to promote the uptake of their guidelines. Cochrane Database Syst Rev 2016;:CD010669.

57. National Comprehensive Cancer Network (nccn). NCCN Clinical Practice Guidelines in Oncology: Breast Cancer. NCCN Evidence Blocks. Ver. 4.2017. Fort Washington, PA: nccn; 2018. [Current version available online at: (free registration required); cited 27 February 2018]

58. Dhesy-Thind S, Fletcher GG, Blanchette P, et al. Use of adjuvant bisphosphonates and other bone-modifying agents in breast cancer. A Cancer Care Ontario and American Society of Clinical Oncology clinical practice guideline. J Clin Oncol 2017;35:2062–81.
cross-ref  pubmed  

59. Van Poznak C, Somerfield MR, Barlow WE, et al. Role of bone-modifying agents in metastatic breast cancer: an American Society of Clinical Oncology–Cancer Care Ontario focused guideline update. J Clin Oncol 2017;35:3978–86.
cross-ref  pubmed  

60. Luftner D. Clinical practice guidelines for breast cancer: current limitations. Breast J 2015;21:450–3.
cross-ref  pubmed  

61. Alonso-Coello P, Martinez Garcia L, Carrasco JM, Sola I, Qureshi S, Burgers JS on behalf of the Updating Guidelines Working Group. The updating of clinical practice guidelines: insights from an international survey. Implement Sci 2011;6:107.
cross-ref  pubmed  pmc  

62. Browman GP, Somerfield MR, Lyman GH, Brouwers MC. When is good, good enough? Methodological pragmatism for sustainable guideline development. Implement Sci 2015;10:28.
cross-ref  pubmed  pmc  

Correspondence to: Sukhbinder Dhesy-Thind, Juravinski Cancer Centre, 3rd Floor, 699 Concession Street, Hamilton, Ontario L8V 5C2. E-mail:

(Return to Top)

Current Oncology, VOLUME 25, SUPPLEMENT 1, June 2018

Copyright © 2019 Multimed Inc.
ISSN: 1198-0052 (Print) ISSN: 1718-7729 (Online)