Evaluation of ARRA Comparative Effectiveness Research Dissemination Contract Efforts

This section presents the key results from the longitudinal analyses of the clinician survey data from waves 1 and 2. The results are organized according to the four main outcomes: (1) awareness, (2) knowledge and understanding, (3) attitudes/perceived benefits, and (4) behavior/use. For each outcome variable that we analyzed, we tested whether there was a statistically significant increase between survey waves (wave 2 minus wave 1) at the p<0.05 level using a one-sided test and a 95 percent confidence interval.

The subsections below provide focused, streamlined summaries and exhibits of the results. Each subsection begins with a summary table presenting the results the tested variables. Following the summary table is a discussion of each variable. More detailed information on the analysis results for each outcome variable can be found in Appendix Q. Additional variables not described in this section are also included in Appendix Q. These variables showed statistically insignificance results and include the perceived benefits scales and use of EHC Program clinician products and consumer summaries.

6.1 Clinician Level of Awareness

6.1.1 Summary Table of Clinician Awareness Longitudinal Findings

Exhibit 40 presents summary information for each of the variables tested and presented in this subsection.

Exhibit 40. Summary Table of Clinician Awareness Longitudinal Findings

* Statistically significant at p<0.05 level.

6.1.2 Clinician Awareness Longitudinal Findings by Variable

Clinicians' aided awareness of CER increased over the course of the two survey administrations, although the increase was not statistically significant (p=0.15). As shown in Exhibit 41, at the time of the first survey administration, 18 percent of clinicians reported aided awareness of CER (n=1,623); aided awareness was 20 percent at the time of the second survey (n=1,480).

Exhibit 41. Difference in Clinician Respondents' Aided Awareness of CER from Wave 1 to Wave 2

Clinicians reported a statistically significant increase in awareness of AHRQ from wave 1 to wave 2. As shown in Exhibit 42, at the time of the first survey administration 33 percent of clinicians reported awareness of AHRQ (n=1,669); 38 percent reported awareness during the second survey (n=1,564). This increase was significant at a 95 percent confidence level (p=0.001).

Exhibit 42. Difference in Clinician Respondents' Aided Awareness of AHRQ from Wave 1 to Wave 2

As presented in Exhibit 43, clinicians also reported a statistically significant increase in awareness of the EHC Program. Eight percent of clinicians reported awareness of the EHC Program during the first survey (n=1,657), while 12 percent reported awareness during the second survey (n=1,558). This increase was significant at a 95 percent confidence level (p=0.0002).

Exhibit 43. Difference in Clinician Respondents' Aided Awareness of the EHC Program from Wave 1 to Wave 2

The awareness of PCOR among clinicians increased between wave 1 and wave 2 (p=0.0771) although the results were not statistically significant. In wave 1, the percentage of clinicians indicating awareness of PCOR was 46 percent; and 49 percent indicated awareness in wave 2 (Exhibit 44).

Exhibit 44. Difference in Clinician Respondents' Aided Awareness of PCOR from Wave 1 to Wave 2

Return to Contents

6.2 Clinician Level of Knowledge and Understanding

6.2.1 Summary Table of Clinician Knowledge and Understanding Longitudinal Findings

Exhibit 45 presents summary information for each of the variables tested and presented in this subsection.

Exhibit 45. Summary Table of Clinician Knowledge and Understanding Longitudinal Findings

6.2.2 Clinician Knowledge and Understanding Longitudinal Findings by Variable

Clinicians reported a slight decrease in the average CER Knowledge Scale from wave 1 to wave 2, although the change was not statistically significant (p=0.866). As shown in Exhibit 46, the average score in wave 1 was 5.37 (n=731); the average score decreased to 5.22 in wave 2 (n=746).

Exhibit 46. Difference in Clinician Respondents' CER Knowledge Scale from Wave 1 to Wave 2

Clinicians also reported a slight decrease in the average EHC Program Knowledge Scale from wave 1 to wave 2, although the change was not statistically significant (p=0.587). As shown in Exhibit 47, the average score in wave 1 was 6.39 (n=134); the average score decreased to 6.32 in wave 2 (n=183).

Exhibit 47. Difference in Clinician Respondents' EHC Program Knowledge Scale from Wave 1 to Wave 2

Return to Contents

6.3 Clinician Attitudes and Perceived Benefits

6.3.1 Summary Table of Clinician Attitudes and Perceived Benefits Longitudinal Findings

Exhibit 48 presents summary information for each of the variables tested and presented in this subsection.

Exhibit 48. Summary Table of Clinician Attitudes and Perceived Benefits Longitudinal Findings

6.3.2 Clinician Attitudes and Perceived Benefits Longitudinal Findings by Variable

Interest in learning more about CER among clinician respondents increased over time, although the change was not significant (p=0.371). As shown in Exhibit 49, during the first survey, clinicians' average level of interest in learning more about CER was 3.57 (n=1,659); during wave 2, the average level was 3.58 (n=1,556).

Exhibit 49. Difference in Clinician Respondents' Interest in Learning More about CER from Wave 1 to Wave 2

Similarly, interest in learning more about the EHC Program among clinician respondents increased over time, although the change was not significant (p=0.220). As shown in Exhibit 50, during the first survey, clinicians' average level of interest in learning more about the EHC Program reached 3.61 (n=1,675); during wave 2, the average level increased to 3.63 (n=1,569).

Exhibit 50. Difference in Clinician Respondents' Interest in Learning More about the EHC Program from Wave 1 to Wave 2

Return to Contents

6.4 Clinician Level of Behavior Change and Use of CER

6.4.1 Summary Table of Clinician Behavior Change and Use Longitudinal Findings

Exhibit 51 presents summary information for each of the variables tested and presented in this subsection.

Exhibit 51. Summary Table of Clinician Behavior Change and Use Longitudinal Findings

* Statistically significant at p<0.05 level.

6.4.2 Clinician Behavior Change and Use Longitudinal Findings by Variable

Of those who had heard of the EHC Program Web site, clinicians reported a statistically significant increase in likelihood of ever visiting the EHC Program Web site over the course of the two survey administrations. As shown in Exhibit 52, 28 percent of surveyed clinicians reported that they had previously visited the EHC Program Web site in wave 1 (n=291). In wave 2, 41 percent reported visiting the Web site (n=252). This increase was significant at a 95 percent confidence level (p=0.0005).

Exhibit 52. Difference in Clinician Respondents Who have Visited the EHC Program Web Site from Wave 1 to Wave 2

Clinicians reported a slight increase in their intention to use EHC Program clinician products in the near future, although the change was not statistically significant (p=0.484). During wave 1, fifty percent of clinicians reported that they will probably or definitely use EHC Program products in the next year (n=1,667); clinicians' reported intention to use EHC Program products increased by 0.1 percentage point in wave 2 (n=1563) (Exhibit 53).

Exhibit 53. Difference in Clinician Respondents' Intention to Use EHC Program Products from Wave 1 to Wave 2

Return to Contents

Proceed to Next Section