Appendix BB. FY 2004-2005 PART Summaries

Program Assessment Rating Tool Evaluations

---

For the FY 2006 President's budget, the Office of Management and Budget (OMB) picked several programs at each agency across the Federal government to review. These performance assessments were developed using the program assessment rating tool (PART).

The PARTs are a series of questions designed to provide a consistent approach to rating programs across the Federal Government. PARTs are diagnostic tools that rely on professional judgment to assess and evaluate programs across a wide range of issues related to performance.

Data Collection and Dissemination / Patient Safety / Pharmaceutical Outcomes / Translating Research Into Practice

---

Program: Data Collection and Dissemination

Agency: Department of Health and Human Services
Bureau: Agency for Healthcare Research and Quality

Key Performance Measures	Year	Target	Actual
Long-term Measure: Number of months after the date of completion of the Medical Expenditure Panel Survey data will be available (New measure)	1997		19-27
	2008	12
Long-term Measure: Number of organizations that will use Healthcare Cost and Utilization Project databases, products or tools to improve statewide health care quality for their constituencies (New measure, baseline under development)	2010	5

Rating: Moderately Effective

Program Type: Research and Development.

Last Assessed: 2 years ago.

Recommended Followup Actions	Status
Propose an increase of $5 million above 2003 Budget to support AHRQ's efforts to ensure continued collection and availability of natural health care cost, use, and quality data.	Completed
AHRQ has begun to address management deficiencies by adopting performance-based contracts that require superior performance toward achieving established goals.	Action taken, but not completed
Collect performance data on the new measures.	Action taken, but not completed

Program Funding Level (in millions of dollars)

2004 Actual	2005 Estimate	2006 Estimate
65	65	63

Update on Followup Actions:

AHRQ is currently in the process of developing annual measures that will demonstrate this program's progress towards achieving its long-term goals.

Top of Page

Program: Patient Safety

Agency: Department of Health and Human Services
Bureau: Agency for Healthcare Research and Quality

Key Performance Measures	Year	Target	Actual
Long-term Measure: Number of medical errors identified while decreasing the number of severe errors occurring	2005	Est Stds	Est Stds
	2010	0.9	0.9
	2006	Monitor	Monitor
Long-term Measure: Percent of hospitals reporting on adverse events as standard practice	2010	5
Annual Measure: Number of hospitals that have successfully deployed hospital practices.	2003	PSI/5 implement
	2004	15 State/Org
	2005	+15 State/Org
	2006	+15 State/Org	+15 State/Org

Rating: Adequate

Program Type: Research and Development Competitive Grant

Last Assessed: 1 year ago.

Recommended Followup Actions	Status
Continue to urge AHRQ to request reports from grantees on research findings and the potential to replicate good models across the country.	Action taken, but not completed
Monitor AHRQ's progress toward developing baselines for newly developed long-term and annual performance goals.	Action taken, but not completed

Program Funding Level (in millions of dollars)

2004 Actual	2005 Estimate	2006 Estimate
80	84	84

Update on Followup Actions:

AHRQ is currently in the process of developing additional annual measures that will demonstrate this program's progress towards achieving its long-term goals.

Top of Page

Program: Pharmaceutical Outcomes

Agency: Department of Health and Human Services
Bureau: Agency for Healthcare Research and Quality

• Purpose: 80%
• Planning: 70%
• Management: 80%
• Results/Accountability: 67%

Key Performance Measures	Year	Target	Actual
Long-term Measure: Reduce congestive heart failure hospital readmission rates during the first six months.	2000	Baseline	38%
	2014	20%
	2006	36%
	2010	28%
Long-term Measure: Reduce hospitalizations for upper DI bleeding in those ages 65-85.	2000	Baseline	55/10,000
	2014	45/10,000
	2006	53/10,000
	2010	49/10,000
Long-term Measure: Decrease prescriptions of antibiotics for children between ages 1 and 14.	2001	Baseline	.56/year
	2014	.42/year
	2006	.50/year
	2010	.46/year

Rating: Moderately Effective

Program Type: Research and Development, Block/Formula Grant

Program Summary:

The Pharmaceutical outcomes Portfolio (POP), through their Centers for Education and Research on Therapeutics (CERTS), conducts state-of-the-art clinical and laboratory research to inform clinical practitioners and policy makers about both the uses and risks of new drugs and drug combinations, biological products, and devices as well as of mechanisms to improve their safe and effective use.

The assessment found that:

• The program possesses a clear and unique purpose and is well designed to conduct and evaluate research on new drugs and health products and provide those findings to clinicians and policy makers so that these products best serve the public's health.
• The program has developed new long-term outcome goals that are directly linked to performance measures that support the long-term goals for the program.
• The agency regularly collects timely and credible performance information by requiring every awardee to provide progress reports to Program Officers on a regular basis.
• The program has not demonstrated how funding, policy or legislative decisions impact its expected performance nor does it explain why a particular funding level or performance result is the most appropriate.
• AHRQ does not conduct periodic comparisons of the potential benefits of its pharmaceutical outcomes research with those of NIH that have similar goals.

In response to these findings, the Administration will:

1. Tie together the Pharmaceutical Outcomes performance with the budgetary resources it has requested.
2. Update baselines and targets for annual performance measures that continue to be developed and realized.

Program Funding Level (in millions of dollars)

2004 Actual	2005 Estimate	2006 Estimate
13	27	26

Top of Page

Program: Translating Research Into Practice

Agency: Department of Health and Human Services
Bureau: Agency for Healthcare Research and Quality

Key Performance Measures	Year	Target	Actual
Long-term Measure: Rate of hospitalizations for pediatric asthma in persons under age 18 (Modified existing measure)	2000	38%	38%
	2005		28%
	2010	105,613	37%
	2006		36%
Long-term Measure: Number of immunization- preventable pneumonia hospital admissions of persons aged 65 and older (Modified existing measure)	2000	550/100K	550/100K
	2005		1.8% drop
	2010	520,441	1.8% drop
	2006		1.8% drop
Long-term Measure: Number of immunization-preventable influenza hospital admissions of persons aged 65 and older (Modified existing measure)	2000	0.56	0.56
	2005		2% drop
	2010	11,570	2% drop
	2006		2% drop

Rating: Adequate

Program Type: Research and Development.

Last Assessed: 2 years ago

Recommended Followup Actions	Status
Maintain funding at the 2003 budget level to ensure continued efforts to go beyond collecting data to actually changing provider behavior and thus improving health outcomes.	Completed
The program is addressing its management deficiencies and will begin better integrating its planning and budget decisionmaking processes.	Action taken, but not completed

Program Funding Level (in millions of dollars)

2004 Actual	2005 Estimate	2006 Estimate
8	6	1

Top of Page

Return to Congressional Justification: Program Assessment Rating Tool
Return to Exhibits
Proceed to Exhibit CC