Are patient education materials about cancer screening more effective when co-created with patients? A qualitative interview study and randomized controlled trial

Background Patient education materials (pems) are frequently used to help patients make cancer screening decisions. However, because pems are typically developed by experts, they might inadequately address patient barriers to screening. We co-created, with patients, a prostate cancer (pca) screening pem, and we compared how the co-created pem and a pem developed by experts affected decisional conflict and screening intention in patients. Methods We identified and used patient barriers to pca screening to co-create a pca screening pem with patients, clinicians, and researchers. We then conducted a parallel-group randomized controlled trial with men 40 years of age and older in Ontario to compare decisional conflict and intention about pca screening after those men had viewed the co-created pem (intervention) or an expert-created pem (control). Participants were randomized using dynamic block randomization, and the study team was blinded to the allocation. Results Of 287 participants randomized to exposure to the co-created pem, 230 were analyzed, and of 287 randomized to exposure to the expert-created pem, 223 were analyzed. After pem exposure, intervention and control participants did not differ significantly in Decisional Conflict Scale scores [mean difference: 0.37 ± 1.23; 95% confidence interval (ci): –2.05 to 2.79]; in sure (Sure of myself, Understand information, Risk–benefit ratio, or Encouragement) scores (odds ratio: 0.75; 95% ci: 0.52 to 1.08); or in screening intention (mean difference: 0.09 ± 0.08; 95% ci: –0.06 to 0.24]). Conclusions The effectiveness of the co-created pem did not differ from that of the pem developed by experts. Thus, pem developers should choose the method that best fits their goals and resources.

barriers to the uptake of cancer screening recommendations 11,12 .For example, pems that are co-created with patients using established participatory design methods might enhance a patient's understanding about the harms and benefits of prostate cancer (pca) screening [13][14][15] .By facilitating collaboration 14 , structured participatory design activities could help clinicians, researchers, and patients co-create pems that meet patient needs.
Co-creation with patients extends patient engagement in guideline development to the creation of guideline dissemination tools [16][17][18] .Because co-creation might require more time and resources than traditional approaches (for example, experts developing pems with minimal patient involvement) 15,19 , determining whether co-creation with patients adds value is important.Although researchers have previously co-created pems with patients, they have not compared the effectiveness of the co-created pems and the pems developed by experts [20][21][22][23] .We therefore compared a pca screening pem that was co-created by patients and one that was developed by experts for their effectiveness with respect to patient decisional conflict and intention to be screened (primary outcomes).We also compared the two pems with respect to pca screening knowledge and screening preferences, pem usability, and pem preferences on the part of patients (secondary outcomes).

METHODS
The study was conducted in 3 phases.In phase 1, we used established behaviour change frameworks and theories to systematically identify patient barriers to pca screening 24,25 .In phase 2, based on the barriers identified in phase 1, we co-created a pem with patients, researchers, and clinicians.In phase 3, we compared the effectiveness of the co-created pem and a pem developed by experts.The study was conducted with the Canadian Task Force on Preventive Health Care ("the Task Force"), which creates national guidelines for screening and prevention targeted to primary care physicians 26 .Patient engagement was guided by the patient engagement framework set out by Deverka et al. 27 , and patients were engaged in all phases.

Phase 1: Qualitative Interviews
This report of phase 1 is consistent with the coreq (Consolidated Criteria for Reporting Qualitative Research) guidelines 28 .

Recruitment
Eligible participants were English-speaking men 40 years of age and older living in Ontario who were targets for the Task Force guidelines about pca screening (men at average risk of pca).Participants were ineligible to participate if they were experiencing symptoms of pca, had been diagnosed with pca, worked in health care, or had conflicts of interest related to pca.
We recruited participants by posting recruitment ads on Kijiji (https://www.kijiji.ca/)and Craigslist (https://geo.craigslist.org/iso/ca/on) and by sending ads by e-mail to individuals who had participated in our previous research projects.After participants responded to the recruitment ad, they received a link to a screening survey designed to assess the eligibility criteria already described.Participants who completed the screening survey and who met inclusion criteria were eligible to participate.Participants were remunerated for their participation based on our institutional guidelines.

Procedure
Participants received an e-mail message with a link to a video about the Task Force pca screening recommendations 29 , an information sheet about pca screening (Appendix a), and the Task Force pca screening recommendations 1 .Approximately 1 week after receiving the e-mail message, participants completed a 60-minute, one-on-one telephone interview to assess patient barriers and facilitators to following the Task Force pca screening recommendations.They were told that the purpose of the interview was to discuss the Task Force recommendations.A female research assistant trained in conducting qualitative interviews facilitated the interviews using a semi-structured guide (Appendix b), which was informed by the Theoretical Domains Framework (tdf), a metaframework of 14 behaviour change constructs 24,30 .No other individuals were present during the interviews.The interviewer was involved in Task Force knowledge translation activities and was familiar with the pca screening guideline.She was not known to the participants before the study.Informed consent was obtained verbally.All interviews were audio-recorded and transcribed, and the interviewer made field notes.Participants did not take part in repeat interviews or review their transcripts.

Outcomes and Data Analysis
Interview transcripts were coded in NVivo (version 11: QSR International, Melbourne, Australia) independently by two research assistants using a double-coded thematic analysis approach 31 .First, one research assistant reviewed two transcripts to identify themes and develop a thematic framework and coding tree that was built around the barriers and facilitators to following the screening recommendations (regardless of tdf domain).Next, both research assistants used the framework to code 20% of the transcripts.Interrater reliability was calculated, and discrepancies (Kappa coefficients < 0.60) were resolved through discussion between the two research assistants.Conceptual changes were made to the coding framework as needed.For example, as more data became available, additional codes were created to accurately capture emerging themes.One research assistant used the updated framework to code the remaining transcripts.That research assistant then reviewed the codes and developed a list of patient barriers and facilitators to following the Task Force's pca screening recommendations.
To understand the underlying reasons why patients might or might not follow the Task Force's pca screening recommendations, the patient barriers and facilitators were mapped to the tdf 24 .To identify behaviour change mechanisms associated with the barriers and facilitators, the barriers and facilitators were mapped to the Capabilities, Opportunities, and Motivation Behaviour-Based Theory of Change 25 .Participants did not receive the coding or mapping results.

Sample Size
We aimed to recruit 10 participants.To achieve saturation of themes, 6-12 participants are recommended for one-onone interviews 32 .

Phase 2: PEM Co-creation
This report of phase 2 is consistent with the coreq guidelines 28 .

Recruitment
Participants were recruited using the same procedure and eligibility criteria used in phase 1.

Procedure
Participants received the same background materials used in phase 1 and a written consent form.They then completed in-person meeting activities and pem prototype review tasks (described in the subsections that follow) that were based on established participatory design methods 14,15,33,34 .The activities were not audio-or video-recorded, and the meeting facilitators did not take field notes.

In-Person Co-creation Meeting:
Approximately 1 week after receiving the background materials, participants attended a 1-day, in-person pem co-creation meeting at St. Michael's Hospital in Toronto, Ontario, with the chair of the Task Force's Prostate Cancer Screening Working Group and the Task Force's pem developer.The meeting was facilitated by 3 female research assistants (including NYB and DB) who were trained in conducting focus groups.All were involved in Task Force knowledge translation activities, familiar with the pca screening guideline, and not known to the participants before the study.To make small-group co-creation activities feasible, participants were randomly assigned to 1 of 2 small groups, each of which included either the Working Group chair or the pem developer.At meeting onset, participants received an overview of the project goals, the meeting purpose (to co-create a pem), the Task Force pca screening recommendations, factors that influence behaviour change, and the barriers and facilitators identified in phase 1.The next few subsections summarize the in-person meeting and follow-up activities.Appendix c and Figure 2 describe the complete methods.

Activity 1-Brainstorm PEM Key Messages:
Following established participatory design methods 14,15,33,34 , participants used the nominal group technique to brainstorm key messages for the pem 35 .The nominal group technique is a structured group decision-making process in which participants independently generate ideas, share their ideas with the group, and then discuss and rate the ideas generated.In activity 1, participants generated key messages for inclusion in the pem to address the barriers and facilitators identified in phase 1.Through discussion, each small group identified their top 7 key messages, which were shared during a subsequent large-group discussion.Participants then used an interactive voting strategy to independently rate the 14 key messages on a 7-point Likert-type scale ranging from 1 [not at all important (to include in the pem)] to 7 [very important (to include in the pem)].The 7 key messages with the highest mean ratings were shared and discussed with the participants.
Activity 2-Design the PEM (Round 1): Participants used the nominal group technique to design the pem 35 .They first used the top 7 key messages from activity 1 to independently design a pem prototype, which was shared with their small group.Each small group then created 2 prototypes, which were discussed by the large group.Using the same approach as in activity 1, participants rated each prototype on a 7-point Likert scale from 1 (strongly dislike) to 7 (strongly like).The mean ratings were shared and discussed with the participants.Activity 3-Design the PEM (Round 2): Small-group participants designed a final pem prototype either by modifying one of their activity 2 prototypes or by creating a new version.The large group then discussed the prototypes designed by each group and rated them on the scale used in activity 2. The mean ratings were shared and discussed with participants.Because of a technical error, data for Activity 3 were not recorded.
Post-Meeting PEM Prototype Review: After the meeting, the pem developer created electronic versions of the two activity 3 pem prototypes.Participants used the online collaboration platform Conceptboard (Digital Republic Media Group, Halle, Germany) to provide feedback about each prototype.Specifically, they rated each prototype on a 7-point scale ranging from 1 (strongly dislike) to 7 (strongly like) and provided comments.The pem developer used the feedback to create a final version of the co-created pem (Figure 1).

Engagement Experience Survey:
The final co-created pem was shared with the participants, and they completed a 15item online survey [Qualtrics, Provo, UT, U.S.A. (https:// www.qualtrics.com)] about their engagement experience [Moore A. Personal communication].Participants rated each item using a 7-point scale ranging from 1 (no extent) to 7 (very large extent).Reminders were sent by e-mail at 7 and 14 days.

Outcomes and Data Analysis
We assessed attendee perceptions of the pem key messages and prototypes by calculating the mean and interquartile range for each key message and prototype rating during activities 1-3 and the post-meeting review.We conducted a content analysis of open-ended comments from the post-meeting review by the participants.We assessed the engagement experience of the participants by calculating the mean and interquartile range for each engagement experience item.

Sample Size
To facilitate participation in participatory design and co-creation research, participant sample sizes are small (for example, 4-16 participants) 33,34,36 .We aimed to recruit 8-10 participants.

Phase 3: PEM Evaluation
This report of phase 3 is consistent with the consort (Consolidated Standards of Reporting Trials) statement and the consort extension for trials of nonpharmacologic interventions 37,38 .

Study Design
In October 2017, we conducted a parallel-group randomized controlled trial to compare the effectiveness of two different pems: one co-created with patients, and another developed by experts.We registered the trial with http:// ClinicalTrials.gov/(NCT03222466).

Study Population
Eligible participants were those who met the eligibility criteria used in phases 1 and 2. During a 3-week period from 6 October 2017 to 27 October 2017, we recruited participants through AskingCanadians, an online research community [Delvinia Technology Inc., Toronto, ON (http://www.askingcanadians.com)].Members of that community who matched the demographics of our target population received an e-mail invitation from AskingCanadians requesting their participation in the study.Individuals who responded to the invitation were directed to a survey software platform developed by St. Michael's Hospital where they were asked to complete the screening survey used in phases 1 and 2. Participants who completed the screening survey and who met eligibility criteria were given an informed consent document and directed to the main online survey, which was administered using the same survey software platform.Participants received reward points from either AskingCanadians or one of several retailers.

Intervention
Co-created PEM: Participants allocated to the intervention group viewed an electronic version of the pem that was co-created in phase 2. They viewed the pem in the online survey after completing a series of baseline measures (described in a later subsection).Participants were permitted to view the pem for as long as they wished before continuing with the survey.

Expert-Created PEM:
Participants allocated to the control group viewed an electronic version of a pca screening pem that had been created by experts in 2014 for the Task Force 39 .Briefly, clinicians and the guideline working group identified key messages.The same pem developer who developed the co-created pem then created a prototype, which underwent usability testing by patients and clinicians using established methods 9 .Participants viewed the existing pem in the online survey after completing a series of measures (described in a later subsection); they were permitted to view it for as long as they wished.

Randomization
When a participant entered the main survey, computerized block randomization (48 blocks with a block size of 12) was used to randomly assign that participant to either the intervention or control group, with allocation concealment.Participants were then automatically directed to the version of the main survey that corresponded to their group assignment.The study team and research assistants were blinded to treatment allocation.

Outcomes
At the main online survey, participants completed these outcome measures: n Primary outcomes n Decisional conflict Decisional conf lict with respect to pca screening was assessed using the 16-item valid and reliable Decisional Conf lict Scale (dcs) and the 4-item valid and reliable sure (Sure of myself, Understand information, Riskbenefit ratio, Encouragement) screening test for decisional conflict before and after the participant had viewed the assigned pem 40,41 .The dcs ratings are analyzed by summing the responses to the 16 items, dividing the sum by 16, and multiplying the result by 25 to create a continuous score ranging from 0 to 100.The higher the score, the greater the decisional conflict.Scores greater than 37.5 are associated with decisional delay and uncertainty 40 .In the sure test, participants receive a score of 1 if they respond "yes" (which indicates certainty) to all 4 items.They receive a score of 0 if they respond "no" to any item 41 .n Intention to be screened Intention to be screened for pca was assessed before and after the participant viewed the assigned pem.Participants rated their agreement with the statement "I plan to get screened for pca within the next 12 months" on a 5-point Likert-type scale ranging from 1 (strongly disagree) to 5 (strongly agree).Higher ratings on the intention scale indicate greater self-reported intention to be screened.n Secondary outcomes n Knowledge Knowledge of pca screening was assessed before and after the participant had viewed the assigned pem.The 7 true-or-false questions that were posed had been developed by the Task Force Prostate Cancer Screening Working Group and the project steering committee (Table i).
n Screening preference Preference related to pca screening was assessed before and after the participant had viewed the assigned pem.This multiplechoice question asked whether participants preferred to be screened for pca, preferred not to be screened, or were unsure of their preference.n PEM usability Usability of the pem was assessed using the 10-item valid and reliable System Usability Scale (sus) 42 .Participants completed the scale after they had completed the post-test measures of the outcomes already described.Following the sus manual, we converted participant responses to a 0-to-100 sus score; higher scores indicate higher usability 42 .
n PEM preference The pem preferred by the participant was identified by showing both pems in a randomized order at study end and by asking the participant to select the preferred version.Participants completed this task after rating the assigned pem's usability.

Sample Size
A sample size calculation revealed that we would need 352 participants (176 in each group) to detect a 0.3 difference between the groups in one of the primary outcomes (decisional conflict according to the dcs) with 80% power at a 0.05 level of significance.Assuming 20% attrition, the total number of participants required was 422.

Data Analysis
Decisional Conflict: We used analysis of covariance, controlling for pre-test dcs scores, to analyze between-group differences in post-test dcs scores.We used a repeatedmeasures analysis of variance with a Greenhouse-Geisser correction to assess within-group differences in pre-test to post-test scores.
Between groups, we used chi-square tests to assess post-test differences for each sure item and the overall sure score.Within groups, we used a McNemar test to assess pre-test to post-test differences for each sure item and the overall sure score.
Intention to Be Screened: Between groups, we used analysis of covariance, controlling for pre-test screening intention, to assess post-test differences in screening intention.Within each group, we used a repeated-measures analysis of variance to assess pre-test to post-test differences in screening intention.

Knowledge:
We coded knowledge test items as "correct" or "incorrect."Between groups, we used chi-square tests to assess differences in post-test responses for each knowledge question and in the combined knowledge score.Within groups, we used a McNemar test to assess pre-test to post-test differences in correct responses to each question.We used chi-square tests to assess pre-test to post-test differences in the total number of questions that participants answered correctly.
Screening Preference: Between the pem groups, we used a chi-square test to assess post-test differences in screening preferences.Within each pem group, we used symmetry and marginal homogeneity tests to assess pre-test to posttest differences.

PEM Usability:
We used a one-way analysis of variance to assess the difference in the scores for the two pems.

PEM Preference:
We computed frequencies for participants who chose the co-created pem compared with the existing pem as their preferred material.We used a chisquare test to assess differences in preferences between the two pem groups.

Phase 2: PEM Co-creation
Of the 27 people who responded to the recruitment announcement, 9 completed the screening survey and were eligible to participate; the remaining 18 either did not complete the screening survey or were ineligible.All 9 patient participants completed the in-person meeting activities, 7 completed the post-meeting pem prototype review on Conceptboard, and 6 completed the engagement experience survey.Most participants were 40-54 years of age (56%, n = 5).Table ii summarizes the demographic information for this group.

In-Person Co-creation Meeting and Post-Meeting Review
Based on their ratings, meeting attendees indicated that it was most important to include information about pca screening facts and the Task Force pca screening recommendations in the pem.Tables iii and iv show the participant ratings of the pem key messages and prototypes in activities 1-2 and the post-meeting review ratings.Table v summarizes the comments about the post-meeting review prototype.Table vi outlines the key differences between the two pems.

Engagement Experience Survey
Ratings by the participants revealed that they had a positive engagement experience (means ≥ 5.17 on a 7-point scale, Table vii).

Phase 3: PEM Evaluation
Between 6 October 2017 and 27 October 2017, 2010 people were sent an invitation to participate.Of those 2010 people, 574 completed the screening survey and were eligible for randomization; the remaining 1436 people either did not complete the screening survey or were ineligible to participate.Of the 574 eligible participants, 287 were randomized to the intervention group [230 (80%) completed the study and were analyzed] and 287, to the control group [223 (78%) completed the study and were analyzed, Figure 3].Most participants were 55-69 years of age (59%, n = 268) and had a college or bachelor's degree or higher (78%, n = 354).Table ii summarizes demographic information for the participants.

Decisional Conflict
The mean difference in the post-test dcs score between the intervention and control groups was not statistically significant [mean difference: 0.37 ± 1.23; p = 0.76; 95% confidence interval (ci): -2.05 to 2.79].No difference between the intervention and control groups in the total post-test sure scores was evident [odds ratio (or): 0.75; 95% ci: 0.52 to 1.08].However, within each group, significant pre-test to post-test differences for both outcomes were observed (Tables viii and ix).

Intention to Be Screened
The mean difference in post-test screening intention between the intervention and control groups was not statistically significant (mean difference: 0.09 ± 0.08; p = 0.24; 95% ci: -0.06 to 0.24).However, within each group, significant pre-test to post-test differences were observed (Table x).

Knowledge
No significant difference between the intervention and control groups in the post-test total knowledge scores was evident (or: 1.10; 95% ci: 0.94 to 1.29).However, within each group, significant pre-test to post-test differences were observed (Table xi).

Screening Preference
After pem exposure, the intervention and control participants did not differ significantly in their pca screening preferences [chi-square (2) = 0.23; p = 0.89; or: 0.94; 95% ci: 0.74 to 1.20].However, within each group, significant pre-test to post-test differences were observed (Table xii).

PEM Usability
The mean difference in the sus score between the two pems was statistically significant, (mean difference: 3.38 ± 1.39; 95% ci: 0.66 to 6.11; d = 0.22).The mean sus rating for the co-created pem (63.27 ± 14.84) was statistically higher than that for the existing pem (59.89 ± 14.70, p = 0.02).Trust in organization that provides information (for example, "Task Force is independent") 5.50 5.00-6.00 Trust in anecdotal evidence (for example, "I got screened and got harmed") 5.40

DISCUSSION
Researchers, clinicians, and funders have increasingly emphasized the importance of engaging patients in guideline development and dissemination 12,16 -18 .We compared the effectiveness of a pca screening pem that was co-created with patients and one that was developed by experts (namely content, communication, and design experts).Co-creation focused on the goal of having patients collaborate and be empowered in the research process 43 .
Patient advice and recommendations were incorporated at each level, and some patients were involved as leaders and part of the research team to ensure that they had decisionmaking authority during concept development.Our findings showed that, although the co-created pem had a higher usability score and was preferred to the expert-created pem, no difference was evident in decisional conflict or screening intention after participants had viewed either the cocreated or the expert-created pem.Similarly, no differences in patient screening preferences or knowledge were observed.Those findings are likely the result of both pems producing similar changes in decisional conflict, knowledge, screening intention, and preferences with respect to pca screening that were consistent with evidence-based screening recommendations 1,2 .Thus, a lthough cocreation might yield patient resources that have an effect on screening-related decisional conflict, intention, knowledge, and preferences, the effect might not be greater than the effect achieved by pems developed primarily by experts.To what extent do you believe that your ideas were heard during the engagement process?6.00 6.00-6.00 To what extent did you feel comfortable contributing your ideas to the engagement process?5.67 5.25-6.00 Did organizers take your contributions to the engagement process seriously?6.00 6.00-6.00 To what extent do you believe that your input will influence final decisions that underlie the engagement process?5.50 5.

25-6.00
To what extent do you believe that your values and preferences will be included in the final health advice from this process?5.17

5.00-5.75
To what extent were you able to clearly express your viewpoints?5.83 5.00-6.75 How neutral in their opinions (regarding topics) were the organizers during the engagement process?5.50 5.00-6.00Did all participants have equal opportunity to participate in discussions?6.17 6.00-6.75 How clearly did you understand your role in the process?6.00 6.00-6.00 To what extent was information made available to you either prior to or during the engagement process so as to participate knowledgeably in the process?To what extent were the ideas contained in the information material easy to understand? 5.50 5.00-5.75 How clearly did you understand what was expected of you during the engagement process?6.00 6.00-6.00 How clearly did you understand what the goals of the engagement process were?6.17 6.00-6.00 To what extent would you follow health advice from the Canadian Task Force on Preventive Health Care (if it related to your health condition)?
6.50 6.00-7.00 To what extent would you advise others to follow health advice from the Canadian Task Force on Preventive Health Care (if it related to their health condition)?
Interestingly, both groups in the trial showed a preference for the pem that they had viewed last.Overall, when creating patient resources related to cancer screening, pem developers might want to choose the development method that best suits their goals and available resources.

Limitations
We note a few limitations of the present study.First, participants in phases 1-3 were all men 40 years of age and older who were highly educated and living in Canada.The co-creation process might have yielded different results if we had engaged patients from another demographic group, including those with lower health literacy or a different geographic location.Although the phase 1 and 2 sample sizes were typical of the number of patients engaged in qualitative research and participatory design initiatives 33,34,36 , they were relatively small.Thus, the barriers that the participants identified and the pem prototypes that they created might not reflect the needs of the broader pca screening population.Second, patients in phase 2 co-created the pem by completing a specific set of activities and did not receive extensive training in the pem content area.We based the co-creation activities on established participatory design methods 33,34,36 and gave participants basic resources concerning the pem content area so that they could contribute from the perspective of a lay patient.We might have obtained different results if we had used a different co-creation method.Third, phase 2 participants might have withheld some of their ideas during the inperson meeting because the pem developer and the Task Force Prostate Cancer Screening Working Group Chair were present.However, in the engagement survey, participants indicated that they felt relatively comfortable contributing their ideas during the co-creation process.Fourth, we did not control for testing of multiple primary outcomes in phase 3.However, given the null between-group results, that lack of controls did not influence our conclusions.Fifth, because we did not conduct a cost analysis of the resources required to produce each pem, we cannot draw conclusions about the potential economic impact of the two pem development methods.The relative resource implications of the two methods should be examined in future.Future studies testing co-creation of pems should focus on engaging patients with varying health literacy levels.Moreover, the present study focused on men, given that they were the target for the pca screening guideline.Future research could include other relevant populations, including women and children.It will also be critical to include economic analyses of the development of these tools.

CONCLUSIONS
We compared the effectiveness of pems about pca screening-one being co-created by patients and one having been developed by experts-with respect to decisional conflict  and intention to be screened on the part of patients.Both pems affected decisional conflict and changed screening intention and preferences to be more aligned with screening recommendations.Both also increased knowledge about some screening facts.The effects of the co-created pem and the pem developed primarily by experts were similar.When developing patient resources about cancer screening, researchers and health care organizations might want to choose the pem development method that best fits with their goals and resources.

FIGURE 1
FIGURE 1 Phase 2 final co-created patient education material.

FIGURE 2
FIGURE 2 Study flow diagram.
This project was funded by the Knowledge Translation Research Network.The study was also conducted with the support of the Ontario Institute for Cancer Research and Cancer Care Ontario through funding provided by the Government of Ontario.The Ontario Institute for Cancer Research and Cancer Care Ontario have a mandate for research dissemination and implementation to optimize cancer care delivery.Their funding allowed us to test an important question identified from the dissemination and implementation literature.The results will inform not just dissemination of the guideline in the present project, but also other cancer screening and prevention guidelines.Moreover, the connection with others who were funded through the Knowledge Translation Research Network allowed for sharing of experiences, furthering research impact.This funding mechanism is an excellent example of how the principles of integrated knowledge translation (specifically co-creation) can be implemented and tested efficiently in a research project.

TABLE I Prostate cancer screening knowledge Please indicate whether each question below is true or false. Answer
Treatment for prostate cancer can cause undesirable short-and long-term problems for some men.These problems may include additional surgeries, erectile dysfunction, and urinary incontinence.True 6. Screening for prostate cancer can cause both benefits and harms.True 7. A prostate cancer screening test will diagnose prostate cancer.False Current Oncology, Vol. 26, No. 2, April 2019 © 2019 Multimed Inc.

Phase 1: Qualitative Interviews Of
29people who responded to the recruitment announcement, 10 completed the screening survey and were eligible to participate; the remaining 19 either did not complete the screening survey or were ineligible to participate.Most participants were 40-69 years of age (80%, n = 8).Table ii summarizes the participant demographic information.We identified 62 barriers and facilitators to following the pca screening recommendations.Those barriers and facilitators mapped to 12 tdf domains and 5 components of the Capabilities, Opportunities, and Motivation Behaviour-Based Theory of Change (Appendix d).

TABLE II
Demographic characteristics of the participants, by phase a Collected only in phase 3.

TABLE III
Ratings of the patient education material key messages from 10 participants Values include ratings made by the Task Force Prostate Cancer Screening Working Group chair.IQR = interquartile range; Task Force = Canadian Task Force on Preventive Health Care; PSA = prostate-specific antigen.
a Expressed as first-third quartile.

TABLE IV
Ratings of the patient education material prototypes presented during phase 2, activity 2, and the post-meeting review a Interquartile range expressed as first-third quartile.Activity 2 values include ratings given by the Task Force Prostate Cancer Screening Working Group chair and PEM developer.b Digital Republic Media Group, Halle, Germany.

TABLE V
Comments from the phase 2 post-meeting review of the patient education material n Design and graphics are attractive n Well-organized n Headline and graphics are engaging n Graphics are engaging n Clear and easy to read Negative n Text is too small n Too wordy n Too cluttered n Not as attractive as follow-up prototype A n Some graphics are too large and waste space n Do not like graphic of prostate gland Suggestions n Use a larger font n Simplify the title n Include the Task Force logo n Place Task Force recommendations closer to the key messages n Add a background graphic n Remove graphic of prostate gland n Clarify what "Task Force" means Task Force = Canadian Task Force on Preventive Health Care.Current Oncology, Vol. 26, No. 2, April 2019 © 2019 Multimed Inc.

TABLE VI
Key differences between the co-created patient education material (PEM) and the existing PEM n Starts with basic facts about prostate cancer n Starts with recommendations from the CTFPHC n Removed the 1000-person diagram to include three key messages n Includes a 1000-person diagram with seven key messages n Objective is to answer commonly asked questions n Objective is to provide recommendations from the CTFPHC n Includes an introduction to the CTFPHC n Does not include an introduction to the CTFPHC

TABLE VII
Ratings given to the phase 2 engagement experience survey by 6 respondents

TABLE X
Phase 3 screening intention scores from 453 participants

TABLE XI
Phase 3 knowledge scores from 453 participants