Data Source and Validation

1.2.2

MEPS

Reviewed by AHRQ modeling, socio-economic research, survey operations and statistical staff for accuracy and validity

1.2.3

MEPS

Reviewed by AHRQ modeling, socio-economic research, survey operations and statistical staff for accuracy and validity

1.2.4

MEPS Web site

Data published on Web site

1.3.5

HCUP/PSIs

Ongoing HCUP/PSI validation activities (HCUP and QI Project Officers use established methodology to check data)

1.3.6

Office of the National Coordinator (ONC) Annual Survey of Health IT Adoption

ONC and their contractor uses established methodology to check their data.

1.3.8

Report to Congress and subsequent Notice of Proposed Rulemaking

This is a factual statement supported by the work products of the partnership.

1.3.9

Certification Commission for Healthcare Information Technology (CCHIT)

CCHIT Certification Criteria states the criteria for the measure.

1.3.15

HCUP database

HCUP Project Officer monitors the number of partners and reports by identifying the new data added to the existing baseline.

1.3.16

MEPS Web site

Data published on Web site

1.3.18

MEPS Web site

Monthly meetings with contractor, careful monitoring of field progress and instrument design, quality control procedures including benchmarking with other national data sources.

1.3.19

MEPS Web site

Data published on Web site

1.3.20

MEPS data:� List of ongoing projects

Publications

1.3.21

MEPS Web site

Monthly meetings with contractor, careful monitoring of field progress and instrument design, quality control procedures including benchmarking with other national data sources.

1.3.22

HCUP database

HCUP and QI Project Officers work with Project Contractors to monitor the field and collect specific information to validate the organizations use and outcomes.�

1.3.23

CAHPS® database

National CAHPS® Benchmarking Database

Prior to placing survey and related reporting products in the public domain a rigorous development, testing and vetting process with stakeholders is followed.

Survey results are analyzed to assess internal consistency, construct validity and power to discriminate among measured providers.

1.3.24

NHQR

Data is validated annually by federal public release data sources including NHQR/NHDR.� Data are analyzed, synthesized and reported using established methodology.

1.3.25

Survey

Prior to implementing a survey, a rigorous development, testing and vetting process with stakeholders will be followed

1.3.26

Survey

Prior to implementing a survey, a rigorous development, testing and vetting process with stakeholders will be followed

1.3.27

Data contained in applications for Chartered Value Exchanges

Reviewed by AHRQ and contractor for validity

1.3.28

AHRQ records

Review of AHRQ records

1.3.29

HCUPnet

Data published on HCUPnet Web site and verified by HCUP Project Officers

1.3.30

Battelle (QI contractor) tracking

AHRQ QI Project Officers use established methodology to check data

1.3.31

Tools tracked by contractor

AHRQ Project Officer oversees contractor work

1.3.32

MEPS

Monthly meetings with contractor, careful monitoring of field progress and instrument design, data abstraction, quality control procedures including benchmarking with other national data sources

1.3.33

MEPS

Reviewed by AHRQ modeling, Socio-economic research and statistical staff for accuracy and validity

1.3.34

MEPS

Reviewed by AHRQ modeling, socio-economic research, survey operations and statistical staff for accuracy and validity

1.3.35

MEPS

Data published on Web site

1.3.36

AHRQ has a contract to develop this data source.� TBD.

AHRQ staff will follow established methodology.

1.3.37

Survey to be completed every 3 years (contract TBD)

Survey contractor will develop methods to validate survey data

1.3.38

Surveys/case studies

AHRQ staff (OCKT) and evaluation contractor (TBD) to develop methods to validate survey data and conduct case studies

1.3.39

PSOs (and the privacy center contractor that builds the NSPD)

The privacy center contractor monitors the number of reports in the NPSD that is submitted through the PSOs

1.3.40

PSOs listed by HHS Secretary

PSOs listed by HHS Secretary

1.3.41

AHRQ FOAS, grant awards, and contract records

AHRQ staff (i.e., project officers, portfolio leads, grants management and contracts staff) monitor project completion and dissemination of results

2.3.4

NHQR/NHDR

Data is validated annually by federal public release data sources including NHQR/NHDR.� Data are analyzed, synthesized and reported using established methodology.

2.3.5

The data source is dependent on the prioritized service(s) and could include national sources such as the NHQR/NHDR and/or internal Prevention/CM databases

TBD based on the prioritized services(s).

2.3.6

Internal Prevention/CM planning documents

Reviewed by Prevention/CM Portfolio staff and AHRQ Senior Leadership Team

4.4.1

MEPS

The MEPS family of surveys includes a Medical Provider Survey and a Pharmacy Verification Survey to allow data validation studies in addition to serving as the primary source of medical expenditure data for the survey.� The MEPS survey has been cleared by the Office of Management and Budget (OMB) and meets OMB standards for adequate response rates, and timely release of public use data files.

4.4.2

HCUP

HCUP and QI Project Officers use established methodology to check data.

4.4.3

HCUP

HCUP and QI Project Officers use established methodology to check data.

4.4.4

HCUP

HCUP and QI Project Officers use established methodology to check data.

4.4.5

Effective Health Care Program database

Effective Health Care Program staff will develop and document a methodology that will be used annually to check data

5.1.1

Departmental quarterly updates on President's Management Agenda (PMA)

As the beta site for the Department's Performance Management Appraisal Program (PMAP), AHRQ was required to complete the Performance Appraisal Assessment Tool (PAAT).� Out of 100 total points possible, the Agency scored an 87 which, according to OPM, is considered as having "effectiveness characteristics present"—the highest level possible under this rating system.

5.1.2

Departmental quarterly updates on PMA; UFMS, IMPAC II, and Payment Management System

SAS 70 Reviews, A-123 reviews, and A-133 audits

5.1.3

Departmental quarterly updates on PMA

PMA compliance and complies with Departmental standards

5.1.4

Departmental quarterly updates on PMA

PMA compliance and complies with Departmental standards

5.1.5

Departmental quarterly updates on PMA

PMA compliance and complies with Departmental standards

5.1.6

Departmental quarterly updates on PMA

PMA compliance and complies with Departmental standards; AHRQ logic models and Portfolio plans

By 2014, antibiotic inappropriate use in children between the ages of one and fourteen should be such that use is reduced from 0.56 prescriptions per year to 0.42 per child (25%)

4.4.1

By 2014, reduce congestive heart failure readmission rates during the first six months from 38% to 20% in those between 65 and 85 years of age.

4.4.2