Skip Navigation Archive: U.S. Department of Health and Human Services U.S. Department of Health and Human Services
Archive: Agency for Healthcare Research Quality www.ahrq.gov
AHRQ Home—Live Site | Archive Home | Site Map
Archival print banner

This information is for reference purposes only. It was current when produced and may now be outdated. Archive material is no longer maintained, and some links may not work. Persons with disabilities having difficulty accessing this information should contact us at: https://info.ahrq.gov. Let us know the nature of the problem, the Web address of what you want, and your contact information.

Please go to www.ahrq.gov for current information.

Evaluation of ARRA Comparative Effectiveness Research Dissemination Contract Efforts

Appendix O: Clinician Survey Results



Table 1. Awareness of AHRQ, EHC Program, and the Eisenberg Center

Agency, Program, or Product Clinician Type
Physician Physician Assistant Nurse Practitioner Total
Freq. Percent Freq. Percent Freq. Percent Freq. Percent
AHRQ
Aware 164 35 139 25.1 289 53.4 592 37.9
   Mostly / Very familiar 42 9.0 18 3.2 90 16.6 150 9.6
   Somewhat familiar 122 26.0 121 21.8 199 36.8 442 28.3
Unaware 305 65 415 74.9 252 46.6 972 62.1
   Have heard the name but not familiar 169 36.0 225 40.6 191 35.3 585 37.4
   Not at all familiar / never heard of it 136 29.0 190 34.3 61 11.3 387 24.7
Total 469 100 554 100 541 100 1564 100
EHC Program
Aware 51 11 45 8.1 94 17.5 190 12.2
   Mostly/ Very familiar 4 0.9 2 0.4 7 1.3 13 0.8
   Somewhat familiar 47 10.1 43 7.7 87 16.2 177 11.4
Unaware 414 89 511 91.9 443 82.5 1368 87.8
   Have heard the name but not familiar 146 31.4 197 35.4 221 41.2 564 36.2
   Not at all familiar / never heard of it 268 57.6 314 56.5 222 41.3 804 51.6
Total 465 100 556 100 537 100 1558 100
Eisenberg Center
Aware 7 1.5 3 0.5 7 1.3 17 1.1
   Mostly/ Very familiar 0 0 1 0.2 0 0 1 0.1
   Somewhat familiar 7 1.5 2 0.4 7 1.3 16 1
Unaware 462 98.5 555 99.5 536 98.7 1553 98.9
   Have heard the name but not familiar 36 7.7 33 5.9 40 7.4 109 6.9
   Not at all familiar / never heard of it 426 90.8 522 93.5 496 91.3 1444 92
Total 469 100 558 100 543 100 1570 100



Table 2. CER Knowledge Score by Clinician Type

Statement Reflects Principles and Methods of CER Clinician Type
Physician Physician Assistant Nurse Practitioner Total
Freq. Percent Freq. Percent Freq. Percent Freq. Percent
CER Knowledge Score
Mean 5.36   4.83   5.45   5.23 5.36
Standard Deviation 2.72   2.56   2.40   2.57 2.72
N 244   233   269   746 244
19a. Compares effectiveness and risks of established and emerging treatments
Yes 190 78.2 174 75.3 216 80.6 580 78.2
No 7 2.9 6 2.6 8 3 21 2.8
Not Sure 46 18.9 51 22.1 44 16.4 141 19
Total 243 100 231 100 268 100 742 100
19b. Addresses treatments for common chronic medical conditions
Yes 166 68.3 156 67.2 196 74.2 518 70.1
No 8 3.3 8 3.4 13 4.9 29 3.9
Not Sure 69 28.4 68 29.3 55 20.8 192 26
Total 243 100 232 100 264 100 739 100
19c. Includes reviews of existing scientific literature
Yes 188 77.4 174 75.3 208 77.6 570 76.8
No 4 1.6 2 0.9 6 2.2 12 1.6
Not Sure 51 21 55 23.8 54 20.1 160 21.6
Total 243 100 231 100 268 100 742 100
19d. Includes new studies based on analyses of health care databases
Yes 142 58.7 108 47 143 53.8 393 53.5
No 9 3.7 14 6.1 12 4.5 35 4.7
Not Sure 91 37.6 108 47 111 41.7 310 42
Total 242 100 230 100 266 100 738 100
19e. Includes new studies testing efficacy of new treatments/technologies
Yes 136 56.2 112 48.5 155 58.1 4.3 54.5
No 22 9.1 22 9.5 19 7.1 63 8.5
Not Sure 84 34.7 97 42 93 34.8 274 37
Total 242 100 231 100 267 100 740 100
19f. Is conducted by pharmaceutical companies and medical device manufacturers
Yes 41 16.9 34 14.7 41 15.6 116 15.8
No 63 26 50 21.6 64 24.3 177 24
Not Sure 138 57 147 63.6 158 60.1 443 60.2
Total 242 100 231 100 263 100 736 100
19g. Intended to support informed decisionmaking
Yes 190 78.2 171 75 219 82 580 78.6
No 5 2.1 3 1.3 6 2.2 14 1.9
Not Sure 48 19.8 54 23.7 42 15.7 144 19.5
Total 243 100 228 100 267 100 738 10
19h. Addresses treatments for acute medical conditions
Yes 137 56.6 106 46.7 141 53.8 384 52.5
No 18 7.4 17 7.5 24 9.2 59 8.1
Not Sure 87 36 104 45.8 97 37 288 39.4
Total 242 100 227 100 262 100 731 100
19i. Identifies areas of clinical uncertainty and gaps in scientific literature
Yes 116 48.1 90 39.5 133 50.4 339 46.2
No 27 11.2 15 6.6 17 6.4 59 8
Not Sure 98 40.7 123 53.9 114 43.2 335 45.7
Total 241 100 228 100 264 100 733 100
19j. Intended to assist in shared decisionmaking between clinicians and patients
Yes 179 73.4 140 61.1 199 75.1 518 70.2
No 7 2.9 9 3.9 7 2.6 23 3.1
Not Sure 58 23.8 80 34.9 59 22.3 197 26.7
Total 244 100 229 100 265 100 738 100
19k. Provides specific clinical practice recommendations for medical conditions
Yes 106 44 95 41.7 123 46.4 324 44.1
No 35 14.5 23 10.1 44 16.6 102 13.9
Not Sure 100 41.5 110 48.2 98 37 308 42
Total 241 100 228 100 265 100 734 100



Table 3. EHC Program Knowledge Score by Clinician Type

Statement Describes the EHC Program Clinician Type
Physician Physician Assistant Nurse Practitioner Total
Freq. Percent Freq. Percent Freq. Percent Freq. Percent
EHC Program Knowledge Score
Mean 6.02   6.07   6.61   6.32 6.02
Standard Deviation 3.70   3.13   2.48   3.00 3.70
N 49   44   90   183 49
26a. Is co-sponsored by private health care and medical technology firms
Yes 8 16.3 10 23.3 15 16.7 33 18.1
No 10 20.4 12 30.2 28 31.1 51 28
Not Sure 31 63.3 20 46.5 47 52.2 98 53.8
Total 49 100 43 100 90 100 182 100
26b. Funds and conducts comparative effectiveness research in the U.S.
Yes 35 72.9 40 90.9 76 84.4 151 83
No 1 2.1 0 0 1 1.1 2 1.1
Not Sure 12 25 4 9.1 13 14.4 29 15.9
Total 48 100 44 100 90 100 182 100
26c. Funds the development of new treatments
Yes 10 20.4 9 20.9 33 36.7 52 28.6
No 23 46.9 13 30.2 27 30 63 34.6
Not Sure 16 32.7 21 48.8 30 33.3 67 36.8
Total 49 100 43 100 90 100 182 100
26d. Screens all sponsored researchers for conflicts of interest
Yes 25 51 26 60.5 63 70 114 62.6
No 2 4.1 0 0 1 1.1 3 1.6
Not Sure 22 44.9 17 39.5 26 28.9 65 35.7
Total 49 100 43 100 90 100 182 100
26e. All reports are posted for public comment
Yes 25 52.1 20 46.5 47 52.2 92 50.8
No 3 6.3 3 7 4 4.4 10 5.5
Not Sure 20 41.7 20 46.5 39 43.3 79 43.6
Total 48 100 43 100 90 100 181 100
26f. All reports are peer reviewed
Yes 29 61.7 27 62.8 60 68.2 116 65.2
No 3 6.4 1 2.3 1 1.1 5 2.8
Not Sure 15 31.9 15 34.9 27 30.7 57 32
Total 47 100 43 100 88 100 178 100
26g. Is sponsored by the Agency for Healthcare Research and Quality (AHRQ)
Yes 39 83 33 75 79 87.8 151 83.4
No 0 0 2 4.5 1 1.1 3 1.7
Not Sure 8 17 9 20.5 10 11.1 27 14.9
Total 47 100 44 100 90 100 181 100
26h. Open for public participation
Yes 22 46.8 16 38.1 38 42.7 76 42.7
No 2 4.3 4 9.5 8 9 14 7.9
Not Sure 23 48.9 22 52.4 43 48.3 88 49.4
Total 47 100 42 100 89 100 178 100
26i. Uses transparent and clearly documented processes
Yes 32 69.6 25 59.5 66 73.3 123 69.1
No 2 4.3 2 4.8 3 3.3 7 3.9
Not Sure 12 26.1 15 35.7 21 23.3 48 27
Total 46 100 42 100 90 100 178 100
26j. Includes clinicians as a target audience for research results
Yes 33 67.3 35 79.5 68 75.6 136 74.3
No 2 4.1 0 0 7 7.8 9 4.9
Not Sure 14 28.6 9 20.5 15 16.7 38 20.8
Total 49 100 44 100 90 100 183 100
26k. Includes consumers/patients as a target audience for research results
Yes 26 56.5 23 53.5 59 65.6 108 60.3
No 2 4.3 2 4.7 6 6.7 10 5.6
Not Sure 18 39.1 18 41.9 25 27.8 61 34.1
Total 46 100 43 100 90 100 179 100
26l. Includes policymakers as a target audience for research results
Yes 22 46.8 22 51.2 43 47.8 87 48.3
No 1 2.1 3 7 10 11.1 14 7.8
Not Sure 24 51.1 18 41.9 37 41.1 79 43.9
Total 47 100 43 100 90 100 180 100



Table 4. Perceived Benefits of CER by Clinician Type

Comparative effectiveness research... Clinician Type
Physician Physician Assistant Nurse Practitioner Total
Freq. Percent Freq. Percent Freq. Percent Freq. Percent
CER Knowledge Score
Mean 0.54   0.52   0.61   0.56 0.54
Standard Deviation 0.60   0.46   0.52   0.53 0.60
N 241   234   268   743 241
20a. Is neutral and unbiased
Strongly disagree 4 1.7 2 0.9 2 0.8 8 1.1
Disagree 12 5 13 5.6 18 6.8 43 5.8
Neither agree nor disagree 106 44.4 113 48.7 117 44.2 336 45.7
Agree 102 42.7 92 39.7 107 40.4 301 40.9
Strongly agree 15 6.3 12 5.2 21 7.9 48 6.5
Total 239 100 232 100 265 100 736 100
20b. Is scientifically rigorous
Strongly disagree 6 2.5 2 0.9 1 0.4 9 1.2
Disagree 11 4.6 8 3.4 9 3.4 28 3.8
Neither agree nor disagree 89 37.2 107 46.1 100 37.9 296 40.3
Agree 117 49 100 43.1 129 48.9 346 47.1
Strongly agree 16 6.7 15 6.5 25 9.5 56 7.6
Total 239 100 232 100 264 100 735 100
20c. Provides findings that are descriptive, not prescriptive
Strongly disagree 6 2.5 1 0.4 2 0.8 9 1.2
Disagree 10 4.2 6 2.6 7 2.7 23 3.1
Neither agree nor disagree 97 40.9 119 51.3 107 40.5 323 44.1
Agree 114 48.1 97 41.8 130 49.2 341 46.5
Strongly agree 10 4.2 9 3.9 18 6.8 37 5
Total 237 100 232 100 264 100 733 100
20d. Provides objective info about drugs, medical equipment, and treatments
Strongly disagree 5 2.1 2 0.9 2 0.8 9 1.2
Disagree 8 3.3 5 2.1 8 3 21 2.8
Neither agree nor disagree 74 30.8 87 37.3 98 37 259 35.1
Agree 134 55.8 129 55.4 134 50.6 397 53.8
Strongly agree 19 7.9 10 4.3 23 8.7 52 7
Total 240 100 233 100 265 100 738 100
20e. Provides findings that support informed decisionmaking
Strongly disagree 8 3.3 1 0.4 2 0.8 11 1.5
Disagree 1 0.4 0 0 1 0.4 2 0.3
Neither agree nor disagree 54 22.4 71 30.6 64 24.1 189 25.6
Agree 145 60.2 141 60.8 162 60.9 448 60.6
Strongly agree 33 13.7 19 8.2 37 13.9 89 12
Total 241 100 232 100 266 100 739 100
20f. Highlights current evidence about effectiveness, risks, and side effects
Strongly disagree 7 2.9 1 0.4 2 0.7 10 1.3
Disagree 3 1.2 0 0 3 1.1 6 0.8
Neither agree nor disagree 57 23.7 69 29.5 69 25.8 195 26.3
Agree 140 58.1 146 62.4 151 56.6 437 58.9
Strongly agree 34 14.1 18 7.7 42 15.7 94 12.7
Total 241 100 234 100 267 100 742 100
20g. Identifies areas of clinical uncertainty and gaps in scientific literature
Strongly disagree 6 2.5 1 0.4 2 0.8 9 1.2
Disagree 14 5.9 13 5.6 14 5.3 41 5.6
Neither agree nor disagree 91 38.1 127 54.5 117 44.3 335 45.5
Agree 106 44.4 84 36.1 109 41.3 299 40.6
Strongly agree 22 9.2 8 3.4 22 8.3 52 7.1
Total 239 100 233 100 264 100 736 100
20h. Includes confidence ratings on evidence in reports, products, and materials
Strongly disagree 6 2.5 1 0.4 3 1.1 10 1.4
Disagree 12 5.1 9 3.9 17 6.4 38 5.2
Neither agree nor disagree 138 58.2 147 63.4 164 61.9 449 61.2
Agree 70 29.5 69 29.7 71 26.8 210 28.6
Strongly agree 11 4.6 6 2.6 10 3.8 27 3.7
Total 237 100 232 100 265 100 734 100
20i. Helps me deliver better health care to my patients
Strongly disagree 7 2.9 2 0.9 2 0.8 11 1.5
Disagree 5 2.1 3 1.3 3 1.1 11 1.5
Neither agree nor disagree 91 37.8 97 41.6 96 36.1 284 38.4
Agree 122 50.6 113 48.5 133 50 368 49.7
Strongly agree 16 6.6 18 7.7 32 12 66 8.9
Total 241 100 233 100 266 100 740 100
20j. In general, medical decisions based on CER lead to better patient outcomes
Strongly disagree 7 2.9 2 0.9 1 0.4 10 1.3
Disagree 6 2.5 5 2.1 4 1.5 15 2
Neither agree nor disagree 116 48.3 112 47.9 106 39.7 334 45.1
Agree 95 39.6 100 42.7 123 46.1 318 42.9
Strongly agree 16 6.7 15 6.4 33 12.4 64 8.6
Total 240 100 234 100 267 100 741 100
20k. Medical decisions based on CER are more cost effective in the long run
Strongly disagree 6 2.5 4 1.7 1 0.4 11 1.5
Disagree 11 4.6 9 3.9 14 5.3 34 4.6
Neither agree nor disagree 132 55 141 60.5 157 59.2 430 58.3
Agree 76 31.7 70 30 74 27.9 220 29.8
Strongly agree 15 6.3 9 3.9 19 7.2 43 5.8
Total 240 100 233 100 265 100 738 100
20l. Leads to shared decisionmaking between clinicians and individual patients
Strongly disagree 7 2.9 2 0.9 1 0.4 10 1.3
Disagree 8 3.3 2 0.9 8 3 18 2.4
Neither agree nor disagree 90 37.5 100 42.7 85 31.8 275 37.1
Agree 121 50.4 118 50.4 148 55.4 387 52.2
Strongly agree 14 5.8 12 5.1 25 9.4 51 6.9
Total 240 100 234 100 267 100 740 100



Table 5. General Attitudes toward Use of CER in Clinical Decisionmaking by Clinician Type

Comparative effectiveness research... Clinician Type
Physician Physician Assistant Nurse Practitioner Total
Freq. Percent Freq. Percent Freq. Percent Freq. Percent
Mean 3.74   3.63   3.80   3.73 3.74
Standard Deviation 0.58   0.58   0.59   0.59 0.58
N 245   227   259   731 245
21.1. Beneficial / Not beneficial
+1 Not beneficial 0 0 0 0 0 0 0 0
+2 9 3.7 3 1.3 6 2.3 18 2.5
+3 46 18.8 56 24.7 44 17 146 20
+4 110 44.9 109 48 117 45.2 336 46
+5 Beneficial 80 32.7 59 26 92 35.5 231 31.6
Total 245 100 227 100 259 100 731 100
21.2. Not Helpful / Helpful
+1 Not helpful 3 1.2 3 1.3 1 0.4 7 1
+2 7 2.9 6 2.7 9 3.5 22 3
+3 46 18.8 50 22.3 42 16.4 138 19
+4 113 46.1 104 46.4 103 40.2 320 44.1
+5 Helpful 76 31 61 27.2 101 39.5 238 32.8
Total 245 100 224 100 256 100 725 100
21.3. Easy to Understand/Hard to Understand
+1 Hard to understand 2 0.8 6 2.7 3 1.2 11 1.5
+2 16 6.6 28 12.4 19 7.4 63 8.7
+3 126 51.9 134 59.6 131 51 391 53.9
+4 79 32.5 42 18.7 84 32.7 205 28.3
+5 Easy to understand 20 8.2 15 6.7 20 7.8 55 7.6
Total 243 100 225 100 257 100 725 100
21.4. Objective/Biased
+1 Biased 2 0.8 3 1.3 2 0.8 7 1
+2 18 7.4 13 5.8 13 5.1 44 6.1
+3 92 37.7 108 48.2 109 42.7 309 42.7
+4 97 39.8 70 31.3 87 34.1 254 35.1
+5 Objective 35 14.3 30 13.4 44 17.3 109 15.1
Total 244 100 224 100 255 100 723 100
21.5. Not Credible / Credible
+1 Not credible 2 0.8 1 0.5 2 0.8 5 0.7
+2 8 3.3 4 1.8 8 3.1 20 2.8
+3 67 27.5 84 37.8 61 23.9 212 29.4
+4 122 50 91 41 122 47.8 335 46.5
+5 Credible 45 18.4 42 18.9 62 24.3 149 20.7
Total 244 100 222 100 255 100 721 100
21.6. Trustworthy / Untrustworthy
+1 Untrustworthy 4 1.6 3 1.3 5 2 12 1.7
+2 33 13.6 27 11.9 39 15.3 99 13.7
+3 88 36.2 104 46 89 34.9 281 38.8
+4 88 36.2 68 30.1 82 32.2 238 32.9
+5 Trustworthy 30 12.3 24 10.6 40 15.7 94 13
Total 243 100 226 100 255 100 724 100
21.7. Not Valuable / Valuable
+1 Not valuable 1 0.4 2 0.9 1 0.4 4 0.6
+2 7 2.9 2 0.9 9 3.5 18 2.5
+3 70 28.7 85 37.8 61 23.9 216 29.8
+4 128 52.5 117 52 130 51 375 51.8
+5 Extremely valuable 38 15.6 19 8.4 54 21.2 111 15.3
Total 244 100 225 100 255 100 724 100



Table 6. Interest in Learning about CER and EHC Program by Clinician Type

Interest in Learning about… Clinician Type
Physician Physician Assistant Nurse Practitioner Total
Freq. Percent Freq. Percent Freq. Percent Freq. Percent
CER
Not at all interested 21 4.5 23 4.2 11 2 55 3.5
Not very interested 49 10.5 47 8.5 32 5.9 128 8.2
Somewhat interested 152 32.5 218 39.6 160 29.7 530 34.1
Interested 157 33.5 180 32.7 205 38.1 542 34.8
Very interested 89 19 82 14.9 130 24.2 301 19.3
Total 468 100 550 100 538 100 1556 100
EHC Program
Not at all interested 45 3.3 97.8 1 0.5 2.2 46 3
Not very interested 111 8.1 93.3 8 4.2 6.7 119 7.7
Somewhat interested 459 33.6 90.4 49 25.9 9.6 508 32.7
Interested 489 35.8 86.7 75 39.7 13.3 564 36.3
Very interested 261 19.1 82.3 56 29.6 17.7 317 20.4
Total 1365 100 87.8 189 100 12.2 1554 100



Return to Contents

Proceed to Next Section

Page last reviewed October 2013
Page originally created December 2014
Internet Citation: Evaluation of ARRA Comparative Effectiveness Research Dissemination Contract Efforts. Content last reviewed October 2013. Agency for Healthcare Research and Quality, Rockville, MD. https://archive.ahrq.gov/research/findings/final-reports/arracer/arracer-apo.html

The information on this page is archived and provided for reference purposes only.

 
AHRQ Advancing Excellence in Health Care