This is the accessible text file for GAO report number GAO-06-117 
entitled 'Nursing Homes: Despite Increased Oversight, Challenges Remain 
in Ensuring High-Quality Care and Resident Safety' which was released 
on January 17, 2006. 

This text file was formatted by the U.S. Government Accountability 
Office (GAO) to be accessible to users with visual impairments, as part 
of a longer term project to improve GAO products' accessibility. Every 
attempt has been made to maintain the structural and data integrity of 
the original printed product. Accessibility features, such as text 
descriptions of tables, consecutively numbered footnotes placed at the 
end of the file, and the text of agency comment letters, are provided 
but may not exactly duplicate the presentation or format of the printed 
version. The portable document format (PDF) file is an exact electronic 
replica of the printed version. We welcome your feedback. Please E-mail 
your comments regarding the contents or accessibility features of this 
document to Webmaster@gao.gov. 

This is a work of the U.S. government and is not subject to copyright 
protection in the United States. It may be reproduced and distributed 
in its entirety without further permission from GAO. Because this work 
may contain copyrighted images or other material, permission from the 
copyright holder may be necessary if you wish to reproduce this 
material separately. 

Report to Congressional Requesters: 

United States Government Accountability Office: 

GAO: 

December 2005: 

Nursing Homes: 

Despite Increased Oversight, Challenges Remain in Ensuring High-Quality 
Care and Resident Safety: 

GAO-06-117: 

GAO Highlights: 

Highlights of GAO-06-117, a report to congressional requesters: 

Why GAO Did This Study: 

Since 1998, GAO has issued numerous reports on nursing home quality and 
safety that identified significant weaknesses in federal and state 
oversight. Under contract with the Centers for Medicare & Medicaid 
Services (CMS), states conduct annual nursing home inspections, known 
as surveys, to assess compliance with federal quality and safety 
requirements. States also investigate complaints filed by family 
members or others in between annual surveys. When state surveys find 
serious deficiencies, CMS may impose sanctions to encourage compliance 
with federal requirements. 

GAO was asked to assess CMS’s progress since 1998 in addressing 
oversight weaknesses. GAO (1) reviewed the trends in nursing home 
quality from 1999 through January 2005, (2) evaluated the extent to 
which CMS’s initiatives have addressed survey and oversight problems 
identified by GAO and CMS, and (3) identified key challenges to 
continued progress in ensuring resident health and safety. 

GAO reviewed federal data on the results of state nursing home surveys 
and federal surveys assessing state performance; conducted additional 
analyses in five states with large numbers of nursing homes; reviewed 
the status of its prior recommendations; and identified key workforce 
and workload issues confronting CMS and states. 

What GAO Found: 

CMS’s nursing home survey data show a significant decline in the 
proportion of nursing homes with serious quality problems since 1999, 
but this trend masks two important and continuing issues: inconsistency 
in how states conduct surveys and understatement of serious quality 
problems. Inconsistency in states’ surveys is demonstrated by wide 
interstate variability in the proportion of homes found to have serious 
deficiencies—for example, about 6 percent in one state and about 54 
percent in another. Continued understatement of serious deficiencies is 
shown by the increase in discrepancies between federal and state 
surveys of the same homes from 2002 through 2004, despite an overall 
decline in such discrepancies from October 1998 through December 2004. 
In five large states that had a significant decline in serious 
deficiencies, federal surveyors concluded that from 8 percent to 33 
percent of the comparative surveys identified serious deficiencies that 
state surveyors had missed. This finding is consistent with earlier GAO 
work showing that state surveyors missed serious care problems. These 
two issues underscore the importance of CMS initiatives to improve the 
consistency and rigor of nursing home surveys. 

CMS has addressed many survey and oversight shortcomings, but it is 
still developing or has not yet implemented several key initiatives, 
particularly those intended to improve the consistency of the survey 
process. Key steps CMS has taken include (1) revising the survey 
methodology, (2) issuing states additional guidance to strengthen 
complaint investigations, (3) implementing immediate sanctions for 
homes cited for repeat serious violations, and (4) strengthening 
oversight by conducting assessments of state survey activities. Some 
CMS initiatives, however, either have shortcomings impairing their 
effectiveness or have not effectively targeted problems GAO and CMS 
identified. For example, CMS has not fully addressed issues with the 
accuracy and reliability of the data underlying consumer information 
published on its Web site. 

The key challenges CMS, states, and nursing homes face in their efforts 
to further improve nursing home quality and safety include (1) the cost 
to older homes to be retrofit with automatic sprinklers to help reduce 
the loss of life in the event of a fire, (2) continuing problems with 
hiring and retaining qualified surveyors, and (3) an expanded workload 
due to increased oversight, identification of additional initiatives 
that compete for staff and financial resources, and growth in the 
number of Medicare and Medicaid providers. Despite CMS’s increased 
nursing home oversight, its continued attention and commitment are 
warranted in order to maintain the momentum of its efforts to date and 
to better ensure high-quality care and safety for nursing home 
residents. 

CMS generally concurred with the report’s findings. CMS noted several 
areas of progress in nursing home quality and identified remaining 
challenges to conducting nursing home survey and oversight activities. 

What GAO Recommends: 

www.gao.gov/cgi-bin/getrpt?GAO-06-117. 

To view the full product, including the scope and methodology, click on 
the link above. For more information, contact Kathryn G. Allen, (202) 
512-7118, allenk@gao.gov. 

[End of section] 

Contents: 

Letter: 

Results In Brief: 

Background: 

Available Data Show Significant Overall Decrease in Serious Quality 
Problems but Indicate Continued Inconsistency and Understatement in 
State Findings: 

CMS Has Addressed Many Shortcomings in Survey and Oversight Activities, 
but Work Continues on Some Key Initiatives: 

Resource and Workload Issues Pose Key Challenges to Further Improving 
Nursing Home Quality and Safety: 

Concluding Observations: 

Agency and State Comments and Our Evaluation: 

Appendix I: Prior GAO Recommendations, Related CMS Initiatives, and 
Implementation Status: 

Appendix II: Percentage of Nursing Homes Cited for Actual Harm or 
Immediate Jeopardy during Standard Surveys: 

Appendix III: Percentage of Homes Surveyed Within 15 Days of the 1-Year 
Anniversary of Prior Survey: 

Appendix IV: Percentage of State Nursing Home Surveyors with 2-Years' 
Experience or Less, 2002 and 2005: 

Appendix V: Comments from the Centers for Medicare & Medicaid Services: 

Appendix VI: GAO Contact and Staff Acknowledgments: 

Related GAO Products: 

Tables: 

Table 1: Scope and Severity of Deficiencies Identified During Nursing 
Home Surveys: 

Table 2: Percentage of Nursing Homes Identified as Having Serious 
Deficiencies during State Nursing Home Surveys, July 2003 through 
January 2005: 

Table 3: Federal Comparative Surveys in Five States that Identified 
Serious Deficiencies Missed by State Surveys and the Number of Missed 
Deficiencies, March 2002 through December 2004: 

Table 4: Nursing Home Surveys: CMS Initiatives and Implementation 
Status: 

Table 5: Percentage of Predictable Current Nursing Home Surveys, as of 
April 2002 and July 2005: 

Table 6: Complaint Investigations: CMS Initiatives and Implementation 
Status: 

Table 7: Enforcement: CMS Initiatives and Implementation Status: 

Table 8: Oversight: CMS Initiatives and Implementation Status: 

Table 9: Percentage of Surveyors with 2 Years' Experience or Less, as 
of July 2005: 

Table 10: Implementation Status of CMS's Initiatives Responding to 
GAO's Nursing Home Quality and Safety Recommendations, July 1998 
through November 2004: 

Table 11: Percentage of Nursing Homes Cited for Actual Harm or 
Immediate Jeopardy, by State: 

Table 12: Percentage of Nursing Homes with Predictable Surveys, April 
2002 and June 2005: 

Figures: 

Figure 1: Percentage of Nursing Homes Nationwide with Serious 
Deficiencies, January 1999 through January 2005: 

Figure 2: Percentage of Federal Comparative Surveys That Noted Serious 
Deficiencies Not Identified in State Surveys: 

Abbreviations: 

AHFSA: Association of Health Facility Survey Agencies: 

ASPEN; Automated Survey Processing Environment: 

AST: ASPEN Scheduling and Tracking: 

CMS; Centers for Medicare & Medicaid Services: 

HHS: Department of Health and Human Services: 

MDS: minimum data set: 

MFCU: Medicaid Fraud Control Unit: 

NFPA: National Fire Protection Association: 

OSCAR: On-Line Survey, Certification, and Reporting system: 

QIO: Quality Improvement Organization: 

QIS: Quality Indicator Survey: 

RN: registered nurse: 

United States Government Accountability Office: 

Washington, DC 20548: 

December 28, 2005: 

The Honorable Charles E. Grassley: Chairman: 
Committee on Finance: 
United States Senate: 

The Honorable Herb Kohl: 
Ranking Minority Member: 
Special Committee on Aging: 
United States Senate: 

Numerous congressional hearings since July 1998 have focused attention 
on the need to improve the care and safety of the nation's 1.5 million 
nursing home residents, a highly vulnerable population of elderly and 
disabled individuals for whom remaining at home is no longer feasible. 
Many nursing home residents require help with feeding, toileting, 
grooming, or other routine activities of daily living; are cognitively 
impaired; or have chronic health care conditions such as heart disease. 
Some individuals with chronic conditions are long-term residents of 
nursing homes, while others enter nursing homes for a short period, 
such as after a hospitalization. With the aging of the baby boom 
generation, the number of individuals needing nursing home care is 
expected to increase in size dramatically. Combined Medicare and 
Medicaid payments for nursing home services were about $65 billion in 
2003, including a federal share of about $43 billion.[Footnote 1] 

In a series of reports, we have identified significant weaknesses in 
federal and state activities designed to detect and correct quality and 
safety problems at nursing homes.[Footnote 2] Our key findings included 
the following: 

* A small but unacceptable proportion of nursing homes repeatedly 
caused actual harm to residents, such as worsening pressure sores or 
untreated weight loss, or placed residents at risk of death or serious 
injury. 

* The results of state inspections, known as surveys, understated the 
extent of serious quality-of-care and fire safety problems, reflecting 
weaknesses in the survey methodology and an inconsistent application of 
federal standards. 

* Serious complaints by residents, family members, or staff alleging 
harm to residents remained uninvestigated for weeks or months, and 
delays in the reporting of abuse allegations compromised the quality of 
available evidence, hindering investigations. 

* When serious deficiencies were identified, federal and state 
enforcement policies did not ensure that the deficiencies were 
addressed and remained corrected. 

* Federal mechanisms for overseeing state monitoring of nursing home 
quality and safety were limited in their scope and effectiveness. 

The Centers for Medicare & Medicaid Services (CMS)--the federal agency 
responsible for managing the Medicare and Medicaid programs, as well as 
overseeing compliance with federal nursing home standards--announced a 
set of initiatives intended to address many of the weaknesses we 
identified in July 1998 as well as needed improvements CMS identified 
in its own self-assessment.[Footnote 3] Over time, CMS has refined and 
expanded these initiatives, including launching a Web site--Nursing 
Home Compare--that has progressively increased the data available to 
the public about the care provided by nursing homes.[Footnote 4] You 
asked us to review the progress made by CMS since 1998 in addressing 
quality and safety problems in the nation's nursing homes. In response 
to your request, we (1) reviewed the trends in nursing home quality by 
analyzing nursing home survey results, (2) evaluated the extent to 
which CMS's initiatives have addressed survey and oversight 
shortcomings identified by us and CMS, and (3) identified key remaining 
challenges to continued progress in ensuring resident health and 
safety. 

To assess trends in nursing home quality, we analyzed data from the 
federal On-Line Survey, Certification, and Reporting system (OSCAR), 
which compiles the results of state nursing home surveys; we focused on 
trend data since CMS announced its nursing home initiatives. We have 
used OSCAR data since 1997 to track trends in the proportion of homes 
found to have harmed residents or placed them at risk of immediate 
jeopardy. To better understand the trends identified through our OSCAR 
analysis, we evaluated the results of federal comparative surveys for 
all states for the period March 2002 through December 2004 and compared 
the results for two other time periods--October 1998 through May 2000 
and June 2000 through February 2002. Federal comparative surveys are 
conducted at nursing homes recently surveyed by the state to assess the 
adequacy of the state surveys. We judgmentally selected five large 
states--California, Florida, New York, Ohio, and Texas--for additional 
analysis based on the change in the proportion of homes cited with 
serious deficiencies, geographic representation, and the number of 
nursing homes. These five states account for almost 30 percent of the 
nation's nursing homes.[Footnote 5] CMS officials generally recognize 
OSCAR data to be reliable. We have used OSCAR data in prior work to 
examine nursing home quality issues and we updated certain data for 
this report. Throughout the course of our work, we discussed our 
analysis of OSCAR data with CMS officials at both the central office 
and the regional offices to ensure that the data accurately reflected 
state nursing home survey activities. We determined that these data 
were accurate for our purposes. 

To evaluate the extent to which survey and oversight shortcomings we 
identified had been addressed by CMS's initiatives, we reviewed the 
status of our recommendations, and updated our understanding of the 
initiatives by analyzing relevant documentation and discussing their 
implementation status with CMS officials (see app. I). We also 
discussed with CMS officials the initiatives implemented as a result of 
CMS's self-assessment of needed improvements. We focused on four areas: 
surveys, complaints, enforcement, and oversight. We discussed the 
preliminary findings from our OSCAR data trend analysis with CMS and 
state survey agency officials. To assess the remaining challenges to 
continued improvement of nursing home oversight, we identified through 
interviews with CMS and state survey agency officials key workforce and 
workload issues that confront states and CMS in protecting the health 
and safety of nursing home residents. We also contacted officials at 
the Association of Health Facility Survey Agencies (AHFSA) to update 
information on surveyor turnover and retention issues. We conducted our 
review from May through December 2005 in accordance with generally 
accepted government auditing standards. 

Results in Brief: 

CMS's nursing home survey data show a significant decrease in the 
proportion of nursing homes with serious quality problems, from about 
29 percent in 1999 to about 16 percent by January 2005, but this trend 
masks two important and continuing issues: inconsistency among state 
surveyors in conducting surveys and understatement by state surveyors 
of serious deficiencies. Inconsistency in states' surveys is 
demonstrated by CMS data that reveal continued wide interstate 
variability in the proportion of homes found to have serious 
deficiencies. For example, in the most recent time period, one state 
found such deficiencies in about 6 percent of homes, whereas another 
state found them in about 54 percent of homes. We previously reported 
that confusion about the definition of actual harm contributed to 
inconsistency and understatement in state surveys. In addition, state 
surveyors continue to understate serious deficiencies, as shown by the 
larger number of serious deficiencies identified in federal comparative 
surveys than in state surveys of the same homes. Although federal 
comparative surveys since October 1998 show an overall decline in the 
proportion that identify serious deficiencies not identified by state 
surveys, data for the two most recent periods show an increase in such 
discrepancies, from 22 percent to 28 percent of comparative surveys. In 
the five large states we reviewed, federal surveyors concluded that the 
state surveyors had missed serious deficiencies in from 8 percent to 33 
percent of comparative surveys--that is, these deficiencies existed and 
should have been identified at the time of the state survey. The 
federal surveyors' assessment is consistent with our July 2003 
findings: a sample of deficiencies demonstrated considerable 
understatement of quality-of-care problems such as serious, avoidable 
pressure sores. The continuing evidence of inconsistency in survey 
results among states and understated deficiencies underscores the 
importance of CMS's initiatives to improve the consistency and rigor of 
nursing home surveys. 

CMS has addressed many of the shortcomings we identified in nursing 
home survey and oversight activities, but several important initiatives 
have not yet been implemented, such as those intended to make state 
surveys more consistent across states and to reduce the understatement 
of deficiencies. Important steps CMS has taken include (1) revising the 
survey methodology, (2) issuing states additional guidance to 
strengthen complaint investigations, (3) implementing immediate 
sanctions for homes cited for repeat serious violations, and (4) 
strengthening oversight by conducting assessments of state survey 
activities. In addition, CMS has undertaken initiatives of its own. For 
example, it has made important information available to the public on 
nursing home quality through its Nursing Home Compare Web site and has 
contracted with independent quality organizations to work with nursing 
homes to improve quality. Although CMS has addressed many weaknesses in 
survey and oversight processes, other initiatives either have not 
effectively targeted the problems identified or have shortcomings that 
impair their effectiveness. For example, CMS has not fully addressed 
issues with the accuracy and reliability of the data underlying 
consumer information published on its Web site. 

CMS, states, and nursing homes face a number of key resource and 
workload challenges in their efforts to further improve nursing home 
quality and safety. CMS is moving to require older nursing homes to 
install sprinkler systems, a proven life-saving device, but 
implementation could be delayed because of concerns about the cost of 
the retrofit to these homes. CMS indicated that it plans to ask for 
public comment about the length of the phase-in period rather than 
proposing one itself. States are continuing to experience problems in 
hiring and retaining qualified surveyors, a factor that survey agency 
officials believe contributes to inconsistency and understatement in 
the citation of serious deficiencies. State survey agencies attributed 
high turnover and recruiting difficulties to the lack of competitive 
salaries for registered nurses (RN), who are a major component of 
states' surveyor workforce, and intense competition from hospitals and 
other providers because of the RN shortage. Increased nursing home 
oversight has strained both CMS and state survey agency resources, 
resulting in delays for some key initiatives. For example, CMS has 
undertaken time-consuming state survey agency performance reviews and 
significantly increased the number of federal comparative surveys 
performed. In addition, state survey agency workloads have grown as a 
result of initiatives that require the prompt investigation of 
complaints alleging resident harm and the need to conduct on-site 
revisits at nursing homes to ensure that serious problems actually have 
been corrected. However, the increased number of quality and safety 
initiatives has required CMS to establish priorities, with some 
initiatives taking precedence over others. For example, CMS attached a 
high priority to including quality indicator data on its public Web 
site and implemented this initiative promptly, while the revision of 
the survey process has encountered delays due to higher priorities. 
Continued attention and commitment to improving nursing home oversight 
are essential to maintaining the momentum built by CMS's 
accomplishments to date and thus better ensuring quality care and 
safety for nursing home residents. 

In commenting on a draft of this report, CMS generally concurred with 
our findings, describing the progress it has made in several areas and 
agreeing that challenges remain. CMS also indicated that while it 
remained concerned about understatement, it did not believe that 
understatement was worsening. CMS described the ongoing challenges it 
faces and the steps it will take to address them. In commenting on the 
section of the draft report focused on trends in nursing home quality, 
the states we reviewed commented on the actions they have taken to 
improve nursing home survey quality and the challenges they face in 
conducting nursing home survey and oversight activities. 

Background: 

Oversight of nursing homes is a shared federal-state responsibility. 
Based on statutory requirements, CMS defines standards that nursing 
homes must meet to participate in the Medicare and Medicaid programs 
and contracts with states to assess whether homes meet these standards 
through annual surveys and complaint investigations. A range of 
statutorily defined sanctions is available to CMS and the states to 
help ensure that homes maintain compliance with federal quality 
requirements. CMS also is responsible for monitoring the adequacy of 
state survey activities.[Footnote 6] 

Standard Surveys and Complaint Investigations: 

Every nursing home receiving Medicare or Medicaid payment must undergo 
a standard survey not less than once every 15 months, and the statewide 
average interval for these surveys must not exceed 12 months.[Footnote 
7] During a standard survey, separate teams of surveyors conduct a 
comprehensive assessment of federal quality-of-care and fire safety 
requirements. In contrast, complaint investigations generally focus on 
a specific allegation regarding resident care or safety. 

The quality-of-care component of a survey focuses on determining 
whether (1) the care and services provided meet the assessed needs of 
the residents and (2) the home is providing adequate quality care, 
including preventing avoidable pressure sores, weight loss, and 
accidents. Nursing homes that participate in Medicare and Medicaid are 
required to periodically assess residents' care needs in 17 areas, such 
as mood and behavior, physical functioning, and skin conditions, in 
order to develop an appropriate plan of care. Such resident assessment 
data are known as the minimum data set (MDS). To assess the care 
provided by a nursing home, surveyors select a sample of residents and 
(1) review data derived from the residents' MDS assessments and medical 
records; (2) interview nursing home staff, residents, and family 
members; and (3) observe care provided to residents during the course 
of the survey. CMS establishes specific investigative protocols for 
state survey teams--generally consisting of RNs, social workers, 
dieticians, and other specialists--to use in conducting surveys. These 
procedural instructions are intended to make the on-site surveys 
thorough and consistent across states. 

The fire safety component of a survey focuses on a home's compliance 
with federal standards for health care facilities.[Footnote 8] The fire 
safety standards cover 18 categories ranging from building construction 
to furnishings. Examples of specific requirements include the use of 
fire-or smoke-resistant construction materials, the installation and 
testing of fire alarms and smoke detectors, and the development and 
routine testing of a fire emergency plan. Most states use fire safety 
specialists within the same department as the state survey agency to 
conduct fire safety inspections, but about one-third of states contract 
with their state fire marshal's office. 

Complaint investigations provide an opportunity for state surveyors to 
intervene promptly if problems arise between standard surveys. 
Complaints may be filed against a home by a resident, the resident's 
family, or a nursing home employee either verbally, via a complaint 
hotline, or in writing. Surveyors generally follow state procedures 
when investigating complaints but must comply with certain federal 
guidelines and time frames. In cases involving resident abuse, such as 
pushing, slapping, beating, or otherwise assaulting a resident by 
individuals to whom their care has been entrusted, state survey 
agencies may notify state or local law enforcement agencies that can 
initiate criminal investigations. States must maintain a registry of 
qualified nurse aides, the primary caregivers in nursing homes, that 
includes any findings that an aide has been responsible for abuse, 
neglect, or theft of a resident's property. The inclusion of such a 
finding constitutes a ban on nursing home employment. 

Deficiencies identified during either standard surveys or complaint 
investigations are classified in 1 of 12 categories according to their 
scope (i.e., the number of residents potentially or actually affected) 
and their severity. An A-level deficiency is the least serious and is 
isolated in scope, while an L-level deficiency is the most serious and 
is considered to be widespread in the nursing home (see table 1). 
States are required to enter information about surveys and complaint 
investigations, including the scope and severity of deficiencies 
identified, in CMS's OSCAR database. 

Table 1: Scope and Severity of Deficiencies Identified During Nursing 
Home Surveys: 

Severity: Immediate jeopardy[A]; 
Scope: Isolated: J; 
Scope: Pattern: K; 
Scope: Widespread: L. 

Severity: Actual harm; 
Scope: Isolated: G; 
Scope: Pattern: H; 
Scope: Widespread: I. 

Severity: Potential for more than minimal harm; Scope: Isolated: D; 
Scope: Pattern: E; 
Scope: Widespread: F. 

Severity: Potential for minimal harm[B]; Scope: Isolated: A; 
Scope: Pattern: B; 
Scope: Widespread: C. 

Source: CMS. 

[A] Actual or potential for death/serious injury. 

[B] Nursing home is considered to be in "substantial compliance." 

[End of table] 

Enforcement Policy: 

Ensuring that documented deficiencies are corrected is a shared federal-
state responsibility. CMS imposes sanctions on homes with Medicare or 
dual Medicare and Medicaid certification on the basis of state 
referrals. CMS normally accepts a state's recommendation for sanctions 
but can modify it. The scope and severity of a deficiency determine the 
applicable sanctions, which can involve, among other things, requiring 
training for staff providing care to residents, imposing money fines, 
denying the home Medicare and Medicaid payments for new admissions, and 
terminating the home from participation in these programs. States are 
responsible for enforcing standards in homes with Medicaid-only 
certification--about 14 percent of homes. They may use the federal 
sanctions or rely on their own state licensure authority and nursing 
home sanctions. 

Oversight: 

CMS is responsible for overseeing each state survey agency's 
performance in ensuring quality of care in nursing homes participating 
in Medicare or Medicaid. Its primary oversight tools are statutorily 
required federal monitoring surveys conducted annually in at least 5 
percent of the state-surveyed Medicare and Medicaid nursing homes in 
each state and annual state performance reviews. Federal monitoring 
surveys can be either comparative or observational. A comparative 
survey involves a federal survey team conducting a complete, 
independent survey of a home within 2 months of the completion of a 
state's survey in order to compare and contrast the findings. In an 
observational survey, one or more federal surveyors accompany a state 
survey team to a nursing home to observe the team's performance. 
Roughly 81 percent of the approximately 800 federal monitoring surveys 
are observational. Performance reviews examine state survey agency 
compliance with seven standards: (1) timeliness of the survey, (2) 
documentation of survey results, (3) quality of state agency 
investigations and decision making, (4) timeliness of adverse action 
procedures, (5) budget analysis, (6) timeliness and quality of 
complaint investigations, and (7) timeliness and accuracy of data 
entry. 

Available Data Show Significant Overall Decrease in Serious Quality 
Problems but Indicate Continued Inconsistency and Understatement in 
State Findings: 

CMS's nursing home survey data show a significant decrease in serious 
quality problems in recent years, but other information indicates that 
this trend masks two important and continuing issues: inconsistency in 
how states conduct surveys and understatement of serious quality 
problems. OSCAR data continue to show wide interstate variability in 
the proportion of homes found to have serious deficiencies, suggesting 
inconsistency in states' interpretation and application of federal 
regulations. We previously reported that confusion about the definition 
of actual harm contributed to inconsistency and understatement in state 
surveys. Moreover, although federal comparative surveys conducted from 
October 1998 through December 2004 showed a decline in the proportion 
of serious deficiencies that were not identified by state surveys, this 
overall trend masks a more recent increase from 2002 through 2004 in 
federally identified understatement of serious deficiencies. In five 
large states we examined with a significant decline in the proportion 
of homes found to have harmed residents, federal comparative surveys 
found that a significant proportion of state surveys had missed serious 
deficiencies, that is, state surveyors either failed to cite the 
deficiencies altogether or cited them at too low a level of scope and 
severity. 

From January 1999 through January 2005, the proportion of nursing homes 
nationwide with actual harm or immediate jeopardy deficiencies declined 
from about 29 percent to about 16 percent. Figure 1 shows the 
proportion of homes nationwide with these deficiencies for four 
consecutive time periods from January 1999 through January 
2005.[Footnote 9] During the 6-year time period, 41 states had a 
decline in serious deficiencies ranging from about 5 to about 36 
percentage points (see app. II). 

Figure 1: Percentage of Nursing Homes Nationwide with Serious 
Deficiencies, January 1999 through January 2005: 

[See PDF for image] 

[End of figure] 

The nationwide data show a decline in nursing homes cited for serious 
deficiencies; however, the data obscure the continued significant 
interstate variation in the proportion of homes with serious 
deficiencies, which suggests inconsistency in how states conduct 
surveys. Table 2 shows that while 10 states identified serious 
deficiencies in less than 10 percent of the homes surveyed, 15 states 
found similar deficiencies in more than 20 percent of homes surveyed 
from July 2003 through January 2005. For example, during that period 
California identified actual harm and immediate jeopardy deficiencies 
in about 6 percent of the state's nursing homes, while Connecticut 
found such deficiencies in approximately 54 percent of its facilities. 
Since January 1999, the proportion of homes with serious deficiencies 
had declined nearly 23 percentage points in California but increased by 
about 6 percentage points in Connecticut. 

Table 2: Percentage of Nursing Homes Identified as Having Serious 
Deficiencies during State Nursing Home Surveys, July 2003 through 
January 2005: 

Percentage of homes with serious deficiencies: More than 20 percent; 
Number of states: 15. 

Percentage of homes with serious deficiencies: 10 percent to 20 
percent; Number of states: 26. 

Percentage of homes with serious deficiencies: Less than 10 percent; 
Number of states: 10. 

Source: GAO analysis of OSCAR data. 

[End of table] 

We discussed the decline in serious deficiencies in the five large 
states we examined with state survey agency officials and officials 
from the responsible CMS regional offices. Officials in four of the 
five states believed that there had been some improvement in nursing 
home quality. CMS regional office officials, however, were concerned 
about the magnitude of the decline in serious deficiencies in two 
states--Texas and California. The Texas state survey agency noted both 
some improvement in quality as well as a significant number of 
inexperienced surveyors who it believed were hesitant in citing actual 
harm. The San Francisco regional office and state survey agency 
officials acknowledged that confusion by state surveyors as to what 
constituted actual harm had contributed to the decline in California. 
The regional office staff discussed this issue with California survey 
agency officials and believed that training combined with the CMS 
inquiries might have contributed to a recent increase in actual harm 
deficiency citations. 

The overall decline in the proportion of federal comparative surveys 
nationwide that noted serious deficiencies not identified by state 
surveyors across the three time periods we examined masks a reversal of 
this trend in the most recent time period analyzed, suggesting ongoing 
understatement of deficiencies. The time periods analyzed were October 
1998 through May 2000, June 2000 through February 2002, and March 2002 
through December 2004. From October 1998 through February 2002, the 
proportion of federal comparative surveys nationwide that noted serious 
deficiencies that were not identified by state surveyors declined from 
34 percent to 22 percent (see fig. 2). However, federal surveys 
conducted from March 2002 through December 2004 that found serious 
deficiencies not identified by state surveyors increased from 22 
percent to 28 percent. In addition, our work in the five states we 
examined demonstrates continued understatement by state surveyors of 
serious deficiencies that cause actual harm or immediate jeopardy. 

Figure 2: Percentage of Federal Comparative Surveys That Noted Serious 
Deficiencies Not Identified in State Surveys: 

[See PDF for image] 

[End of figure] 

Because some serious deficiencies found by federal, but not state, 
surveyors may not have existed at the time of the state 
survey,[Footnote 10] CMS requires its regional offices to specifically 
identify on worksheets which deficiencies state surveyors had missed 
during the state survey. We analyzed CMS regional office worksheets for 
73 comparative surveys in five large states--California, Florida, New 
York, Ohio, and Texas--with a significant decline in serious 
deficiencies from January 1999 through January 2005.[Footnote 11] 
Overall, 18 percent of these federal comparative surveys identified at 
least one serious deficiency missed by state surveyors, ranging from a 
low of 8 percent in Ohio to a high of 33 percent in Florida (see table 
3). Table 3 also shows that in comparative surveys noting serious 
deficiencies that state surveyors missed, from one to seven serious 
deficiencies were missed. Federal surveyors' findings of understatement 
of serious deficiencies are consistent with our own work. Our July 2003 
report analyzed state surveys of homes with a history of harming 
residents but whose most current survey identified quality-of-care 
problems at below the level of harm; we concluded that about 40 percent 
of the 76 homes we analyzed had harmed residents, including instances 
of severe weight loss; multiple falls resulting in broken bones and 
other injuries; and serious, avoidable pressure sores. Similarly, our 
November 2004 report on Arkansas nursing home deaths found numerous 
instances of serious, understated quality-of-care problems. 

Table 3: Federal Comparative Surveys in Five States that Identified 
Serious Deficiencies Missed by State Surveys and the Number of Missed 
Deficiencies, March 2002 through December 2004: 

State: California; 
Number of federal comparative surveys conducted: 23; Federal 
comparative surveys that found missed serious deficiencies: Number: 4; 
Federal comparative surveys that found missed serious deficiencies: 
Percentage: 17; Total number of serious deficiencies missed: 6[B]. 

State: Florida; 
Number of federal comparative surveys conducted: 12; Federal 
comparative surveys that found missed serious deficiencies: Number: 4; 
Federal comparative surveys that found missed serious deficiencies: 
Percentage: 33; Total number of serious deficiencies missed: 7[B]. 

State: New York; 
Number of federal comparative surveys conducted: 11; Federal 
comparative surveys that found missed serious deficiencies: Number: 
2[A]; Federal comparative surveys that found missed serious 
deficiencies: Percentage: 18[A]; Total number of serious deficiencies 
missed: 6[B]. 

State: Ohio; 
Number of federal comparative surveys conducted: 12; Federal 
comparative surveys that found missed serious deficiencies: Number: 1; 
Federal comparative surveys that found missed serious deficiencies: 
Percentage: 8; Total number of serious deficiencies missed: 1. 

State: Texas; 
Number of federal comparative surveys conducted: 15; Federal 
comparative surveys that found missed serious deficiencies: Number: 2; 
Federal comparative surveys that found missed serious deficiencies: 
Percentage: 13; Total number of serious deficiencies missed: 5. 

State: Total; 
Number of federal comparative surveys conducted: 73; Federal 
comparative surveys that found missed serious deficiencies: Number: 13; 
Federal comparative surveys that found missed serious deficiencies: 
Percentage: 18; Total number of serious deficiencies missed: 25. 

Source: GAO analysis of federal comparative surveys conducted from 
March 2002 through December 2004. 

[A] On one comparative survey, federal surveyors did not provide 
information on whether any of the deficiencies they identified existed 
at the time of the state survey; therefore, this number may be 
understated. 

[B] The number of serious missed deficiencies could be higher because 
federal surveyors sometimes did not indicate whether they believed that 
a serious deficiency they cited had existed at the time of the state 
survey and therefore was missed by state surveyors. 

[End of table] 

Our prior reports identified five factors that we believe contribute to 
inconsistency and the understatement of deficiencies by state 
surveyors: (1) weaknesses in CMS's survey methodology; (2) confusion 
about the definition of actual harm; (3) predictability of surveys, 
which allows homes to conceal problems if they so desire; (4) 
inadequate quality assurance processes at the state level to help 
detect understatement in the scope and severity of deficiencies; and 
(5) inexperienced state surveyors due to retention problems. CMS has 
initiatives under way to revise the survey methodology and address the 
confusion about what constitutes harm, and it has taken some steps to 
reduce survey predictability. However, CMS did not implement the 
recommendation in our July 2003 report to strengthen the ability of 
state quality assurance processes to detect understatement. While it 
agreed with the intent of our recommendation, CMS indicated that its 
state performance standards initiative already incorporated this 
concept. The status of these initiatives and state workforce issues are 
discussed in the following section. 

CMS Has Addressed Many Shortcomings in Survey and Oversight Activities, 
but Work Continues on Some Key Initiatives: 

CMS has addressed many shortcomings in nursing home survey and 
oversight activities both in response to our recommendations and as a 
result of its own assessment of needed improvements, but it is still 
working on key initiatives that have not yet been implemented.[Footnote 
12] Appendix I provides a complete listing of our previous 
recommendations and the implementation status of CMS initiatives taken 
in response. Examples of CMS's initiatives to address shortcomings 
include (1) revising the survey methodology, (2) issuing states 
additional guidance to strengthen complaint investigations, (3) 
implementing immediate sanctions for homes cited for repeat serious 
violations, and (4) strengthening oversight by conducting assessments 
of state survey activities. CMS also has published information on its 
Web site about nursing home quality and has engaged independent quality 
organizations to work with nursing homes to improve quality.[Footnote 
13] Despite CMS's initiatives in four distinct areas--surveys, 
complaints, enforcement, and oversight--some initiatives either have 
not effectively targeted the problems we identified or have 
shortcomings that impair their effectiveness. 

Surveys: Key Initiatives Are under Development, but Most Have Not Yet 
Been Implemented: 

Several CMS initiatives are intended to address shortcomings in the 
survey process, but most of these initiatives are in the developmental 
stage and have not yet been implemented. In addition, despite CMS's 
efforts to make scheduling of surveys less predictable, many remain 
predictable. (See table 4). 

Table 4: Nursing Home Surveys: CMS Initiatives and Implementation 
Status: 

Initiative: Survey methodology: Revise to ensure that surveyors do not 
miss significant care problems; Status: In process. 

Initiative: Investigative protocols: Strengthen to ensure greater rigor 
in surveyors' on-site investigations of specific areas; Status: In 
process. 

Initiative: Definitions of actual harm and immediate jeopardy: Revise 
to promote increased interstate consistency in deficiency citations; 
Status: In process. 

Initiative: Additional survey initiatives: Implement initiatives to 
give surveyors a way to voice concerns and explore the use of 
photographic evidence to improve the survey process; Status: In 
process. 

Initiative: Survey predictability: Reduce to prevent nursing homes from 
potentially masking certain deficiencies if they so choose; Status: 
Selected initiatives implemented. 

Source: GAO analysis of CMS initiatives. 

[End of table] 

Survey Methodology: 

In response to our 1998 recommendation to improve the rigor of the 
survey methodology to help ensure that surveyors do not miss 
significant care problems, CMS took some interim steps and launched a 
longer-term initiative. As interim steps, CMS instructed state survey 
agencies in 1999 to (1) increase the sample of residents reviewed 
during surveys and (2) review available quality indicator information 
on the care provided to a home's residents before actually visiting the 
home. By using the quality indicators, which are essentially numeric 
warning signs of the prevalence of care problems, to select a 
preliminary sample of residents before the on-site review, surveyors 
are better prepared to target their surveys and to identify potential 
care problems.[Footnote 14] Surveyors augment the preliminary sample 
with additional resident cases once they arrive in the home. 

For the longer term, CMS awarded a contract in 1998 to revise the 
methodology used to survey nursing homes, and the agency plans to pilot 
this new methodology in the fall 2005. Under development for 7 years, 
the proposed two-stage, data-driven Quality Indicator Survey (QIS) is 
intended to systematically target potential problems at nursing homes. 
Its expanded sample should help surveyors better assess the scope of 
any deficiencies identified. In stage 1, a large resident sample will 
be drawn and relevant data from on-and off-site sources will be 
analyzed to develop a set of quality-of-care indicators, which will be 
compared to national benchmarks.[Footnote 15] Stage 2 will 
systematically investigate potential quality-of-care concerns 
identified in stage 1. In June 2005, CMS selected five states to pilot 
test the new survey methodology.[Footnote 16] The QIS pilot test will 
begin during the fall 2005, with a final evaluation of the pilot due in 
the fall 2006. The evaluation will examine the QIS's cost- 
effectiveness, focusing on the time and surveyor team size required 
under QIS compared to the current survey methodology, and on the QIS's 
impact on deficiency citations. In developing the QIS, CMS has 
attempted to prevent increases in the time required to complete 
surveys. Depending on evaluation findings and any subsequent 
streamlining of the QIS, national implementation could begin in mid- 
2007. 

Investigative Protocols: 

Since 2001, CMS has been developing surveyor investigative protocols to 
ensure greater rigor in on-site investigations of specific quality-of- 
care areas. We recommended in July 2003 that CMS finalize the 
development of these important protocols; however, CMS is still working 
on this initiative. In 2001, CMS hired a contractor to facilitate the 
convening of expert panels for the development and review of these 
protocols.[Footnote 17] In November 2004, more than 1 year later than 
scheduled, CMS implemented a protocol on pressure sores. Since then, 
CMS has implemented protocols in two other areas--incontinence and 
medical director qualifications and responsibilities. The protocols 
provide detailed interpretive guidelines and severity guidance. 
Protocols in seven more areas are under development, with an issuance 
target of fall 2005.[Footnote 18] 

Definitions of Actual Harm and Immediate Jeopardy: 

To promote increased consistency among states in deficiency citations, 
a work group of CMS central office, regional office, and state survey 
agency staff was convened in early 2005 to clarify the definitions of 
actual harm and immediate jeopardy. Our July 2003 report noted that 
confusion about the definitions contributed to the understatement of 
serious deficiencies. According to CMS, the 2005 draft revised 
definition of actual harm attempts to clarify the existing definition 
by eliminating confusing language and identifying indicators and 
examples of actual harm.[Footnote 19] The draft revised definition of 
immediate jeopardy is intended to provide additional guidance on 
documenting whether deficiencies are at the immediate jeopardy severity 
level, including criteria for identifying whether immediate jeopardy 
exists, and updates examples of immediate jeopardy. A CMS official 
indicated that the draft revised definition of immediate jeopardy 
stresses that action must be taken at once to prevent harm. As of 
August 2005, CMS had no target issuance date for the revised 
definitions. 

Additional Survey Initiatives: 

CMS is implementing two additional survey initiatives--developing 
guidance to ensure surveyors are able to report concerns to CMS 
regional offices and studying surveyors' use of photographic evidence. 

* To address anecdotal reports that surveyors are sometimes asked to 
overlook or downgrade survey findings, CMS has issued and is obtaining 
state comments on draft guidance to ensure that surveyors can cite 
survey findings without such inappropriate pressure. Currently, 
surveyors report concerns to the state survey agency. CMS officials 
indicated that the draft guidance tries to (1) establish a 
nonthreatening option for voicing concerns to CMS regional office staff 
without overburdening the regional offices with additional 
investigations and (2) give CMS a way to identify any patterns of 
problems. Implementation of this effort is anticipated in late 2005. 

* CMS also contracted for a study of the use of photographic evidence 
by surveyors to support survey findings. In our 2004 report on Arkansas 
nursing home deaths, we reported that photographs taken by coroners 
provided key evidence supporting neglect of nursing home residents and 
the existence of serious, avoidable care problems. The goal of CMS's 
study is to identify issues and develop training materials related to 
surveyors' use of photographic evidence. This study began in the summer 
2005, with final training materials to be issued in the summer 2006. 

Survey Predictability: 

In 1998, we reported that nursing homes could mask certain deficiencies 
if they chose to because of survey predictability. CMS responded by 
directing states to (1) avoid scheduling a home's survey for the same 
month of the year as the home's previous standard survey and (2) begin 
at least 10 percent of standard surveys outside the normal workday 
(either on weekends, early in the morning, or late in the 
evening).[Footnote 20] However, our current analysis showed that a 
significant proportion of state nursing home surveys remain 
predictable. We consider surveys to be predictable if they are 
conducted within 15 days of the anniversary of a home's prior 
survey.[Footnote 21] From 2002 to 2005, the proportion of predictable 
surveys increased from 13 percent to 14.5 percent (see app. III). 
Overall, 29 states had an increase in survey predictability. As shown 
in table 5, as of July 2005, from 10 percent to over 50 percent of 
current nursing home surveys in 35 states were conducted within 15 days 
of the anniversary of a home's last standard survey. CMS officials 
stated that avoiding surveys close to the 12-month anniversary of a 
home's prior survey, while meeting the requirements that surveys occur 
not less than once every 15 months and maintaining a statewide average 
interval of 12 months, could require increased funding because more 
surveys would need to be accomplished within the first 9 months after a 
survey.[Footnote 22] However, CMS noted that states are not currently 
funded to conduct surveys within the first 9 months after the previous 
survey. CMS officials also told us that CMS had introduced the ASPEN 
Scheduling and Tracking (AST) module for its central and regional 
offices and the states in February 2004 as a tool to reduce survey 
predictability; however, state officials we spoke with about AST were 
unfamiliar with its survey predictability features.[Footnote 23] 

Table 5: Percentage of Predictable Current Nursing Home Surveys, as of 
April 2002 and July 2005: 

Percentage of predictable surveys. 

More than 50 percent; 
Number of states: April 2002: 0; 
Number of states: July 2005: 1. 

25 percent to 50 percent; 
Number of states: April 2002: 5; 
Number of states: July 2005: 7. 

10 percent to 24 percent; 
Number of states: April 2002: 26; Number of states: July 2005: 27. 

Less than 10 percent; 
Number of states: April 2002: 20; Number of states: July 2005: 16. 

Source: GAO analysis of OSCAR data. 

Notes: "Predictable surveys" are defined as surveys conducted within 15 
days of the anniversary of homes' prior surveys. 

[End of table] 

Complaint Investigations: CMS Has Strengthened State Guidance and 
Oversight and Is Continuing to Address Problems Involving Allegations 
of Abuse: 

CMS has completed certain initiatives to ensure that quality problems 
found during complaint investigations are promptly addressed and has 
taken steps to address weaknesses in the notification and investigation 
of abuse in nursing homes. CMS is continuing work on (1) ensuring state 
compliance with federal nurse aide registry requirements and (2) 
assessing the effectiveness of conducting employee background checks. 
(See table 6). 

Table 6: Complaint Investigations: CMS Initiatives and Implementation 
Status: 

Initiative: Complaint guidance: Issue additional guidance to states to 
strengthen complaint investigations, including allegations of abuse; 
Status: Selected initiatives implemented. 

Initiative: Complaint oversight: Enhance federal oversight of state 
complaint investigations, including allegations of abuse; Status: In 
process. 

Source: GAO analysis of CMS initiatives. 

[End of table] 

Complaint Guidance: 

CMS guidance issued since 1999 has helped to strengthen state 
procedures for investigating complaints. In 1999, we reported that 
complaints alleging that nursing home residents were being harmed were 
not being investigated for weeks or months in several states and 
recommended that CMS develop additional standards for the prompt 
investigation of serious complaints alleging situations that may harm 
residents but are categorized as less than immediate jeopardy. CMS 
promptly instructed states to investigate complaints alleging harm to a 
resident within 10 workdays of receiving the complaint and later 
specified that investigations of these complaints be conducted on-site 
at the nursing home.[Footnote 24] During 1999, CMS developed and issued 
guidance intended to help states identify complaints that allege harm 
to residents. Also in 1999, CMS hired a contractor to study and 
recommend improvements to state complaint practices. CMS used the 
findings of this study to develop more detailed guidance for states to 
help improve the effectiveness of complaint investigations. In 2004, 
CMS issued this guidance to states, which further clarified the 1999 
instructions on identifying actual harm. 

In March 2002, we recommended that CMS ensure that state survey 
agencies immediately notify local law enforcement agencies or Medicaid 
Fraud Control Units (MFCU) of allegations or confirmed complaints of 
abuse.[Footnote 25] In response, CMS issued a March 2002 letter to CMS 
regional offices and state survey agencies clarifying its policies on 
abuse reporting time frames, requirements for reporting to local law 
enforcement and/or the MFCU, displaying complaint telephone numbers, 
and citing abuse on surveys. CMS issued additional guidance in December 
2004 clarifying nursing home reporting requirements and definitions for 
alleged violations, including mistreatment, neglect, abuse, injuries of 
unknown source, and misappropriation of resident property. CMS has not, 
however, implemented our March 2002 recommendation to accelerate the 
agency's campaign to increase public awareness of nursing home abuse 
through the development and distribution of posters that are to be 
prominently displayed in nursing homes, and other materials.[Footnote 
26] 

Complaint Oversight: 

CMS has taken three important steps to improve its oversight of state 
complaint investigations, including allegations of abuse. First, it 
required in its annual state performance review, which was established 
in fiscal year 2001 and fully implemented in fiscal year 2002, that 
federal surveyors review a sample of complaints in each state to 
determine whether states properly categorize complaints (i.e., 
determine how quickly they should be investigated), investigate 
complaints within the time specified, and properly include the results 
of investigations in CMS's database. Our March 1999 report on 
complaints had recommended that CMS strengthen its oversight in these 
areas. During its 2004 review of state performance, CMS identified 5 
states that did not meet the standard for properly categorizing 
complaints and 13 states that did not conduct timely investigations of 
all complaints alleging immediate jeopardy to residents; however, 11 of 
the 13 states missed the requirement by a small margin.[Footnote 27] 
States failing state performance review standards are asked to submit a 
corrective action plan to CMS. 

Second, in January 2004, CMS implemented a new national automated 
complaint tracking system, the ASPEN Complaints and Incidents Tracking 
System. Our March 1999 report on enforcement noted that the lack of a 
national complaint reporting system hindered CMS's and states' ability 
to adequately track the status of complaint investigations as well as 
CMS's ability to maintain a full compliance history on each nursing 
home. To address these concerns, we recommended the development of a 
better management information system. One goal of CMS's new management 
information system is to standardize reported complaints so that 
analysis can be conducted across all states. This system is intended to 
provide CMS with an effective tool for overseeing and managing state 
complaint investigations.[Footnote 28] 

Third, in November 2004, CMS requested state survey agency directors to 
self-assess their states' compliance with federal requirements for 
maintaining and operating nurse aide registries, to which states are 
required to report substantiated findings of abuse, neglect, or theft 
of nursing home residents' property by nurse aides. CMS has not issued 
a formal report of findings from the state self-assessment, but CMS 
officials noted that as a result of resource constraints some states 
reported having difficulty maintaining compliance with certain federal 
requirements, such as (1) timely entry by state survey staff of 
information in nurse aide registries and (2) state notification to 
nursing homes employing nurse aides found guilty of abuse at another 
facility. In our March 2002 report, we recommended that CMS shorten the 
state survey agencies' time frames for determining whether to include 
findings of abuse in the nurse aide registry. Annotations to nurse aide 
registries are made after final determinations that abuse occurred, 
which entail completion of the state's investigation as well as 
adjudication of any appeals.[Footnote 29] Until the final 
determination, residents may continue to be exposed to aides who are 
allegedly abusive. CMS noted that while most of the time frames are 
defined in regulation, it can review the time frames when regulatory 
changes are considered. No changes to the regulations had been made as 
of August 2005. 

As part of its third effort, CMS also is conducting a Background Check 
Pilot Program. Our March 2002 report recommended an assessment of state 
policies and practices for complying with federal requirements 
prohibiting employment of individuals convicted of abusing nursing home 
residents. The pilot program will test the effectiveness of state and 
national fingerprint-based background checks on employees of long-term 
care facilities, including nursing homes.[Footnote 30] Pilot programs 
in seven states--Alaska, Idaho, Illinois, Michigan, Nevada, New Mexico, 
and Wisconsin--will be phased in from fall 2005 through September 2007. 
An independent evaluation is planned. 

Enforcement: CMS Has Strengthened the Potential Deterrent Effect of 
Sanctions and Has Other Initiatives Under Way: 

CMS significantly strengthened the potential deterrent effect of 
enforcement actions by requiring immediate sanctions for homes found to 
have a pattern of harming residents. Moreover, CMS continues to develop 
new policies and to clarify existing ones in order to strengthen 
enforcement activities and encourage nursing home compliance with 
federal requirements. (See table 7). 

Table 7: Enforcement: CMS Initiatives and Implementation Status: 

Initiative: Immediate sanctions policy: Eliminate grace periods for 
homes cited for repeat serious violations; Status: Fully implemented. 

Initiative: Additional enforcement policy issues: Address weaknesses in 
policies, the appeals process, and enforcement tracking; Status: 
Selected initiatives implemented. 

Initiative: Special Focus Facility Program: Revise to include the most 
poorly performing homes and to strengthen enforcement; Status: Fully 
implemented. 

Initiative: Civil money penalties: Improve tracking and collection to 
make them a more effective enforcement tool; Status: In process. 

Initiative: Past noncompliance policy: Revise by clarifying key terms, 
increasing homes' accountability for past quality-of-care problems, and 
posting on the CMS Web site specific information about homes' past 
noncompliance; Status: In process. 

Source: GAO analysis of CMS initiatives. 

[End of table] 

Immediate Sanctions Policy: 

Responding to our July 1998 recommendation to eliminate grace periods 
for homes cited for repeat serious violations, CMS began a two-stage 
phase-in of a new enforcement policy. In the first stage, effective 
September 1998, CMS required states to refer for immediate sanction 
homes found to have a pattern of harming residents or of exposing them 
to actual harm or potential death or serious injury (H-level 
deficiencies and above on CMS's scope and severity grid). Effective 
January 2000, CMS expanded this policy, requiring referral of homes 
found to have harmed one or a small number of residents (G-level 
deficiencies) on successive standard surveys.[Footnote 31] In response 
to our 2003 finding that states failed to refer a substantial number of 
homes that met the criteria for the immediate sanctions, CMS initiated 
oversight of state compliance with this policy. To conduct this 
oversight, CMS analyzed deficiency data for 2000 through 2003 to 
identify potential instances of homes that should have been but were 
not referred for immediate sanctions. In ongoing work, we are assessing 
the impact and implementation of the immediate sanctions policy. 

Additional Enforcement Policy Issues: 

Based on recommendations in our July 1998 report and our March 1999 
report on enforcement, CMS has addressed weaknesses in its policies in 
three areas: nursing homes' correction of deficiencies, the nursing 
home appeals process, and the enforcement data tracking system. 

* CMS now requires on-site follow-up, referred to as a revisit, of 
homes with substandard quality of care or actual harm or higher-level 
deficiencies until the state verifies correction of each deficiency 
cited.[Footnote 32] Our 1998 report found that CMS's policy of allowing 
nursing homes to self-report resumed compliance was sometimes 
inappropriately applied to homes with deficiencies in the immediate 
jeopardy category or that were found to have substandard quality of 
care. We recommended that CMS require that for homes with recurring 
serious violations, state surveyors substantiate resumed compliance by 
means of an on-site revisit. CMS also has issued additional guidance on 
the "reasonable assurance period" during which terminated homes must 
demonstrate that they have corrected the deficiencies that led to their 
terminations.[Footnote 33] This guidance provided additional examples 
of reasonable assurance decisions. 

* CMS and the Department of Health and Human Services (HHS) requested 
and received funding and staffing increases for the HHS Departmental 
Appeals Board in fiscal years 1999 and 2000 to address our March 1999 
finding that the growing backlog of appeals hampered the effectiveness 
of civil money penalties by delaying their collection. The Board is 
responsible for adjudicating the appeals. By August 2003, the backlog 
of appeals of civil money penalties had been significantly reduced. 

* CMS implemented the automated ASPEN Enforcement Manager on October 1, 
2004, to facilitate tracking of enforcement actions. Prior to 
implementing this system, CMS had no centralized system for tracking or 
managing federal and state enforcement actions.[Footnote 34] The ASPEN 
Enforcement Manager is intended to provide real-time entry and tracking 
of enforcement actions, issue monitoring alerts, generate enforcement 
letters, and facilitate analysis of enforcement patterns. CMS expects 
that ASPEN Enforcement Manager data will enable states, CMS regional 
offices, and the CMS central office to more easily track and evaluate 
nursing home performance and compliance status as well as respond to 
emerging issues. In ongoing work, we are assessing whether data from 
the ASPEN Enforcement Manager can be used to analyze nursing homes' 
deficiency and enforcement histories.[Footnote 35] 

Special Focus Facility Program: 

In December 2004, CMS revised the method for selecting nursing homes 
for the Special Focus Facility Program to ensure that the most poorly 
performing homes were included in the program and to strengthen 
enforcement for those nursing homes with an ongoing pattern of 
substandard care.[Footnote 36] For this program, first initiated in 
January 1999, states were directed to select two nursing homes to be 
special focus facilities, conduct two standard surveys each year in the 
special focus facilities, and submit monthly status reports on the 
selected homes. The revised guidance directs states to select, from an 
expanded list of facilities, a minimum of up to six nursing homes, 
depending on the number of nursing homes in the state; the revised 
guidance gives states the option to select more than the 
minimum.[Footnote 37] States are also given the flexibility to remove 
from the list homes that have made significant improvements. 
Enforcement authority over special focus facilities has been 
strengthened so that while homes are in the Special Focus Facility 
Program, immediate sanctions must be imposed if homes fail to 
significantly improve performance from one survey to the next; 
termination from participation in Medicare and Medicaid is required for 
homes with no significant improvement in 18 months and three surveys. 

Civil Money Penalties: 

In April 2004, CMS launched a Civil Money Penalty Improvement Project 
to improve its ability to track and collect civil money penalties in an 
effort to make them a more effective enforcement tool. CMS mapped out 
the current process for tracking and collecting civil money penalties 
to identify weaknesses and developed draft guidance with detailed 
policies and procedures for addressing areas identified as needing 
improvement, with a target release date of fall 2005. Also planned are 
enhancements to the Civil Money Penalty Tracking System, CMS's 
information system for civil money penalties. The enhancements are 
intended to streamline the system, improve its reporting capabilities, 
and improve its compatibility with the enforcement monitoring system. 
The system's changes are planned to occur through 2005 and 2006. 

Also in 2004, CMS, in conjunction with various state survey agencies, 
began developing a civil money penalty grid--an optional guideline for 
use by states and CMS regional offices to help ensure greater 
consistency across states in the amounts of civil money penalties 
recommended. The grid is expected to provide ranges for minimum civil 
money penalties for deficiencies, while allowing for flexibility to 
adjust the penalties on the basis of factors such as the severity of an 
identified deficiency, the care areas in which deficiencies were cited, 
and past history of noncompliance.[Footnote 38] The target issuance 
date for a draft grid was August 2005. 

Past Noncompliance Policy: 

In October 2005, CMS issued a revised past noncompliance policy that 
(1) clarifies how to address recently identified past deficiencies, (2) 
further defines "past noncompliance," (3) eliminates the use of the 
term "egregious," and (4) clarifies the methods for determining whether 
past noncompliance has been corrected. Past noncompliance occurs when a 
current survey reveals no deficiencies but determines that an egregious 
violation of federal standards occurred in the past and was not 
identified during an earlier survey.[Footnote 39] In November 2004, we 
reported that CMS's past noncompliance policy was ambiguous. The policy 
did not define what constituted an egregious violation or relate 
egregious violations to its scope and severity grid. Moreover, the 
policy did not hold homes accountable for negligence associated with 
resident deaths unless current residents are experiencing the same 
quality-of-care problems and it obscures the nature of care problems. 
CMS's revised policy responds to our recommendation and holds homes 
accountable for all past noncompliance resulting in harm to residents. 
We also recommended that past noncompliance citations identify the 
specific nature of the care problem in the OSCAR database and on the 
Nursing Home Compare Web site. In 2007, CMS plans to enhance the 
information on the Nursing Home Compare Web site to include the 
specific nature of the past noncompliance. According to CMS officials, 
the delay is related to the implementation of higher priority 
initiatives by the agency. Currently, the Web site only indicates 
whether there were instances of past noncompliance and does not 
identify the nature of the care deficiency. 

Oversight: Intensity and Scope of Federal Efforts Has Increased 
Significantly, but Work Remains: 

CMS has significantly improved the intensity and scope of its oversight 
activities and has made significant improvements both in its data 
systems and in its analysis and use of the data it collects on survey 
activities. The effectiveness of several of these oversight 
initiatives, however, is uneven, and more work remains to be done. (See 
table 8). 

Table 8: Oversight: CMS Initiatives and Implementation Status: 

Initiatives: Federal comparative surveys: Increase number to intensify 
oversight; Status: Fully implemented. 

Initiatives: Smoke detectors: Require them in nursing homes without 
sprinklers to strengthen fire safety; Status: Fully implemented. 

Initiatives: Assessments of state survey activities: Review state 
survey agencies' compliance with federal standards; Status: Selected 
initiatives implemented. 

Initiatives: Data systems and analysis: Upgrade to improve tracking and 
oversight of state survey activities; Status: In process. 

Initiatives: Sharing data: Share quality data with the public to help 
drive quality improvement; Status: Selected initiatives implemented. 

Initiatives: Quality Improvement Organizations: Use Quality Improvement 
Organizations to help nursing homes improve the quality of care; 
Status: In process. 

Initiatives: Coordination and dissemination of best practices: Initiate 
activities to improve nursing home oversight; Status: In process. 

Source: GAO analysis of CMS initiatives. 

[End of table] 

Federal Comparative Surveys: 

In response to recommendations in our November 1999 and July 2004 
reports, CMS has (1) significantly increased the number of federal 
comparative surveys both for quality of care and fire safety and (2) 
decreased the time between the end of the state survey and the start of 
the federal survey for quality-of-care comparative surveys, allowing 
CMS to better distinguish between serious problems missed by state 
surveyors and changes in a home that occurred after the state survey. 
We found earlier that CMS was making negligible use of comparative 
surveys, its most effective tool for assessing a state survey agency's 
ability to identify serious quality-of-care and fire safety 
deficiencies in a nursing home, to fulfill its 5 percent monitoring 
mandate.[Footnote 40] Only 21 quality-of-care comparative surveys were 
conducted from November 1996 through October 1998. Our 2004 fire safety 
report found that CMS had conducted only 40 fire safety comparative 
surveys in fiscal year 2003, ranging from 4 in some states to none in 
others. 

Since 2001, CMS has required its regional offices to complete at least 
two quality-of-care comparative surveys per state per year, but federal 
surveyors have been exceeding this minimum threshold.[Footnote 41] 
During the period March 1, 2002, through December 31, 2004, CMS 
completed 424 comparative surveys, about 140 per year. In addition, the 
average elapsed time between state and comparative surveys has 
decreased from 33 calendar days for the 64 comparative surveys we 
reviewed in 1999 to 26 calendar days for the 424 surveys completed 
through 2004. 

CMS planned to further increase the number of comparative surveys by 
contracting in the fall of 2003 for 170 quality-of-care comparative 
surveys in addition to those conducted by federal surveyors. However, 
an increase in the number of quality-of-care comparative surveys is 
unlikely because of delays in contractor readiness and the addition of 
fire safety comparative surveys to the contract. CMS had expected to 
have a sufficient number of contract surveyors trained and available to 
start surveys by the winter of 2005, but it took longer than 
anticipated to train the new surveyors. In addition, CMS modified the 
contract to include fire safety comparative surveys. In fiscal year 
2005, the contractor conducted 34 quality-of-care comparative surveys 
and 250 fire safety comparative surveys. Together, the contractor and 
CMS regional offices conducted a total of 859 fire safety comparative 
surveys in fiscal year 2005. CMS also is using the contract surveyors 
to augment federal survey teams. According to CMS, it will use contract 
funds carried over from earlier years to conduct quality-of-care 
comparative surveys during fiscal year 2006, and will only use fiscal 
year 2006 funds to conduct fire safety comparative surveys. 

Smoke Detectors in Homes without Sprinklers: 

In response to a recommendation in our July 2004 report to strengthen 
fire safety standards, CMS published an interim final rule in March 
2005 requiring nonsprinklered nursing homes to install battery-powered 
smoke detectors in resident rooms and common areas, including resident 
dining, activity, and meeting rooms. Previously, federal standards 
required smoke detectors in (1) corridors or resident rooms only in 
homes built after 1981 and (2) nonsprinklered resident rooms containing 
furniture brought from the resident's home. We reported that the lack 
of smoke detectors in resident rooms may delay staff response and fire 
department notification, which in turn may increase the number of 
nursing home fire-related fatalities. CMS will begin surveying nursing 
homes' compliance with the new requirement in May 2006. 

Assessments of State Survey Activities: 

In October 2000, CMS regional offices began conducting on-site state 
performance reviews to assess compliance with federal 
standards.[Footnote 42] Previously, CMS permitted states to evaluate 
and report on their own performance against a number of standards, a 
technique that essentially allowed states to write their own report 
cards because CMS did not independently validate information provided 
by the states. In fiscal year 2005, CMS began to tie funding increases 
for state survey agencies to one of the seven performance standards-- 
the timely conduct of standard surveys--time frames that are 
established in federal statute. 

Nevertheless, in our current analysis of the standard that is intended 
to measure the supportability of survey findings, we found that three 
key issues we identified in July 2003 still exist. First, distinctions 
in state performance were hard to identify because, while some states 
have consistently met the standard for documentation of deficiencies, 
federal comparative surveys completed during essentially the same time 
frame found that surveyors in these states frequently missed serious 
deficiencies. Second, CMS regional offices were inconsistent in 
conducting state performance reviews. For fiscal year 2004, five states 
nationwide did not meet this standard, but three of the five states 
were in one CMS region. Third, the standard for assessing the 
supportability of deficiencies is composed of 11 elements that mix 
major and minor issues.[Footnote 43] Although CMS has simplified the 
standard for assessing the supportability of deficiencies, we believe 
that many of the elements reviewed remain essentially administrative in 
nature rather than substantive.[Footnote 44] Of the elements that make 
up the standard, only 2 assess the appropriateness of the cited scope 
and severity; the remaining elements assess such issues as how the 
deficiency is written, including avoiding the use of the passive voice. 
We do not believe that this standard is sufficiently focused on 
identifying understatement. 

CMS did not implement our July 2003 recommendation that it require 
states to review a sample of deficiencies cited at or below the level 
of actual harm in order to detect understatement because, according to 
CMS, the state performance review of the supportability of deficiencies 
already accomplished this objective. In discussing our current findings 
regarding the standard intended to measure the supportability of survey 
findings, CMS officials agreed that (1) measuring the quality of state 
surveys, one goal of reviewing the supportability of deficiencies, was 
particularly challenging because there is no one agreed-upon way to 
measure quality; and (2) some standards are complex, contributing to 
consistency problems. 

In developing this report, we also noted two additional problems with 
the state performance reviews that were not previously reported. First, 
in its fiscal year 2004 review, CMS began combining state performance 
review results across the different provider types, such as nursing 
homes and home health agencies, for which states have oversight 
responsibility. For example, CMS calculates one overall state score on 
the supportability of deficiencies across provider types, rather than 
issuing provider-specific scores. One CMS region suggested that because 
nursing homes are generally surveyed by a unique pool of surveyors, 
combining results in this manner limits the usefulness of the feedback 
to state survey agencies. Second, CMS provides feedback to states 
regarding their performance each year, but it does not publicly report 
the results. Doing so would appear to be consistent with CMS's stated 
philosophy of sharing information with the public to help improve 
nursing home quality. 

Data Systems and Analysis: 

CMS has pursued important upgrades in the system used to track the 
results of state survey activities and has increased its analysis of 
OSCAR and other data to improve oversight by CMS central and regional 
offices and state survey agencies. Examples include the following: 

* In 2000, CMS began to produce 19 periodic reports to monitor both 
state and regional office performance.[Footnote 45] Some reports, such 
as survey timeliness, are used during state performance reviews, while 
others are intended to help identify problems or inconsistencies in 
state survey activities and the need for intervention. 

* In 2001, 2002, and 2005 CMS published a "Nursing Home Data 
Compendium," which includes detailed tables and figures on nursing 
homes, resident demographics, resident clinical characteristics, and 
survey results. 

* In 2004, CMS commissioned a series of "White Papers" on topics 
ranging from enforcement to resource issues. The goal was to stimulate 
discussion among key stakeholders and generate ideas for "next steps" 
to help mitigate problems. The reports, authored by CMS and state 
survey agency staff, relied on data analysis from OSCAR and other CMS 
databases. 

* In 2004, CMS prepared an internal study on enforcement trends since 
the imposition of the immediate sanctions policy using data from the 
Enforcement Tracking System. 

* In 2005, CMS unveiled a Web site for use by regional offices and 
state survey agencies that generates a series of standard reports 
through a software program called Providing Data Quickly; this software 
permits easier access to the data contained in OSCAR. One such report 
identifies homes that have repeatedly harmed residents and meet the 
criteria for imposition of immediate sanctions. 

CMS indicated that it is continuing to make progress in redesigning the 
OSCAR system. In our March 1999 report on enforcement, we recommended 
that the agency develop an improved management information system that 
would help it to track the status and history of deficiencies, 
integrate the results of complaint investigations, and monitor 
enforcement actions. Although the target implementation date for the 
redesigned system has slipped from 2005 to 2008, depending on competing 
priorities and available funding, CMS has implemented two key 
components of the redesigned system--a complaint tracking system and a 
system to track the status of enforcement actions. Both systems are 
intended to provide CMS with critical management capabilities that it 
previously lacked. 

Sharing Data with the Public: 

Using market forces to help drive quality improvement is an important 
CMS objective behind sharing data with the public on nursing home 
quality. Since CMS launched Nursing Home Compare in 1998, the agency 
has progressively expanded the information available on this Web site. 
In addition to data on the deficiencies identified during standard 
surveys, the Web site now includes data on the results of complaint 
investigations, information on nursing home staffing levels, and 
quality indicators, such as the percentage of residents with pressure 
sores. However, CMS continues to address ongoing problems with the 
accuracy and reliability of the underlying data, such as the MDS, 
quality indicators, and nurse staffing levels. 

In February 2002, we concluded that CMS efforts to ensure the accuracy 
of the underlying MDS data[Footnote 46] used to calculate the quality 
indicators (1) relied too much on off-site review activities by its 
contractor and (2) anticipated on-site reviews in only 10 percent of 
its data accuracy assessments, representing fewer than 200 of the 
nation's nursing homes.[Footnote 47] CMS did not concur with our 
recommendation that it reorient its review program to complement 
ongoing state MDS accuracy efforts as a more effective and efficient 
way to ensure MDS data accuracy.[Footnote 48] CMS commented that its 
efforts already provided adequate oversight of state activities and 
complemented state efforts. In April 2005, CMS ended work under its 
data assessment and verification contract because of cost concerns, but 
signed a new contract in September 2005 that focuses on on-site reviews 
of MDS accuracy.[Footnote 49] According to CMS officials, the on-site 
reviews were more effective in identifying discrepancies because the 
reviewers were able to find more information on-site that conflicted 
with the nursing homes' assessments.[Footnote 50] 

In November 2002, CMS began reporting on its Web site quality indicator 
data for each nursing home nationwide that participates in Medicare and 
Medicaid, even though our October 2002 report concluded that such 
reporting was premature given serious questions about the sufficiency 
of CMS efforts to validate the quality indicators and improve the 
accuracy of the underlying data.[Footnote 51] CMS disagreed with our 
recommendation to postpone its scheduled November 2002 public reporting 
of the data until these problems were addressed. Since 2002, however, 
CMS has taken steps to address the questions we raised about the 
validity of quality indicators. For example, CMS dropped certain 
quality indicators that it found were not sufficiently reliable for 
public reporting, such as the facility-adjusted profile prevalence of 
pressure sores. In addition, CMS worked with the National Quality Forum 
to address measurement problems with the pressure sore quality 
indicator by developing separate indicators for short-and long-term 
nursing home residents; these new indicators were added to the Web site 
in January 2004.[Footnote 52] A weight loss quality indicator also was 
developed and added to the Web site in November 2004. Our October 2002 
report had noted the potential for consumer confusion in interpreting 
and using quality indicator data. CMS conducted consumer testing of new 
language and displays on Nursing Home Compare during the summer of 
2004. 

Although nursing home staffing data have been available on the Nursing 
Home Compare Web site since June 2000, a CMS official told us that the 
agency has been aware of problems with these self-reported data since 
the late 1990s.[Footnote 53] This official stressed that, despite 
problems, they were the only available data on nursing home staffing. 
Examples of erroneously reported data include facilities with no nurse 
staffing hours or hours equal to thousands of residents per day. In 
addition, the staffing data do not address important issues such as 
turnover or retention.[Footnote 54] As a temporary fix, CMS developed 
edits that examine staffing ratios to determine whether any facility 
falls above or below certain thresholds and, effective July 2005, 
temporarily excluded the questionable staffing data from Nursing Home 
Compare until they can be corrected or confirmed. To address this 
issue, CMS is considering a proposal for a new system that relies on 
nursing home payroll data. If approved, such a system could take 3 to 4 
years to implement because of the need to solicit and consider public 
comment and to develop software to transmit the staffing data. 

Quality Improvement Organizations: 

CMS's initiative to include quality indicator data on its Nursing Home 
Compare Web site also established a new role for Quality Improvement 
Organizations (QIO) with regard to nursing homes. From 2002 through 
2005, QIOs worked intensively with at least 10 percent of nursing homes 
in each state to improve quality.[Footnote 55] Although we have not 
evaluated QIO nursing home quality improvement activities, CMS's 
preliminary analyses indicate that the QIO program has helped to reduce 
the use of daily physical restraints, increased management and 
treatment of pain, and reduced the incidence of delirium among post- 
acute-care residents. However, less progress has been made in 
decreasing the prevalence of pressure sores, according to CMS's 
analyses. In August 2004, the QIO and state survey agency in 18 states 
launched a new pilot program. Working together, they identified from 
one to five nursing homes per state that had significant quality 
problems. The QIO then worked with these homes to help them redesign 
their clinical practices. According to CMS, the results of this pilot 
indicated that these historically "troubled" nursing homes had 
dramatically improved their clinical quality and decreased their 
quality-of-care survey deficiencies.[Footnote 56] In 2005, the QIOs' 
role with nursing homes was extended for an additional 3 years, and 
QIOs will continue to focus on statewide improvement in four areas-- 
pressure sores, physical restraints, pain management, and depression. 
In addition, QIOs will help nursing homes set individual targets for 
quality improvement, implement and document process-related clinical 
care, and assist in the development of a more resident-focused care 
model. QIO expenditures on nursing home quality improvement for the 
period of August 2002 through July 2008 are expected to total about 
$216 million. 

Coordination and Dissemination of Best Practices: 

CMS has taken certain actions to maximize the experience and resources 
of state survey agencies as well as the CMS central and regional 
offices to improve nursing home oversight. Specifically, in 2004, CMS 
convened an internal Long-Term Care Task Force and charged it with 
providing guidance on and coordinating long-term care efforts within 
CMS and included representation across the agency's divisions and the 
regional offices. Also in 2004, CMS began an effort to collect and 
disseminate nursing home survey and certification best practices 
developed by professional associations, universities, and federal 
agencies.[Footnote 57] Through the best practices effort, CMS plans to 
share successful strategies used by states and regional offices in a 
broad range of issues affecting survey and certification of nursing 
homes, such as surveyor recruitment and complaint intake. A contractor 
will identify, research, and document best practices, which CMS plans 
to post on its Web site. One of the issues the best practices effort 
will address is surveyor recruitment initiatives underway in states. As 
of August 2005, these best practices had not been published on the CMS 
Web site. 

Resource and Workload Issues Pose Key Challenges to Further Improving 
Nursing Home Quality and Safety: 

CMS, states, and nursing homes face a number of key challenges in their 
efforts to further improve nursing home quality and safety, including 
(1) the cost of retrofitting older nursing homes with automatic 
sprinklers, a potentially costly requirement that has a demonstrated 
ability to prevent deaths in the event of a fire; (2) continuing 
problems in hiring and retaining qualified surveyors, a factor that 
states indicated can contribute to variability in the citation of 
serious deficiencies; and (3) an increasing federal and state survey 
workload due to increased oversight, the identification over time of 
additional initiatives, and growth in the number of Medicare and 
Medicaid providers that must be surveyed, including expected growth in 
nursing homes. The increased workload has created competition for both 
staff and financial resources and required the establishment of 
priorities, which may have contributed to delays in developing and 
implementing several key quality initiatives, such as the 
implementation of a more rigorous survey methodology. 

Cost Could Delay Retrofitting of Older Nursing Homes with Sprinklers: 

Although the substantial loss of life in two 2003 nursing home fires 
could have been reduced or eliminated by the presence of properly 
functioning automatic sprinkler systems, cost has been an impediment to 
CMS's requiring them for all homes nationwide. Newly constructed homes 
must incorporate sprinkler systems; however, older homes constructed 
with noncombustible materials that have a certain minimum ability to 
resist fire are not required to install sprinklers. We previously 
reported that cost has been a barrier to requiring sprinklers for all 
older nursing homes. In July 2005, the National Fire Protection 
Association (NFPA) voted to require retrofitting of older homes with 
sprinklers, a requirement that will become a part of the 2006 edition 
of the NFPA code. Anticipating this action, CMS indicated that it has 
been developing a notice of proposed rule making, the first step in 
adopting the NFPA requirement for all homes that serve Medicare and 
Medicaid beneficiaries. A CMS official stated that the agency plans to 
issue the notice in March 2006 and after reviewing public comments, it 
will publish a final version of the rule and stipulate an effective 
date for homes to come into compliance.[Footnote 58] 

One issue that remains unresolved is how much time older homes will be 
given to install sprinklers. As we reported in 2004, industry officials 
believe that a transition period must be considered for homes to come 
into compliance and to determine how to pay for the cost of installing 
sprinklers.[Footnote 59] Rather than proposing a phase-in period, the 
proposed rule will request input on how much time homes should be given 
to come into compliance with the requirement. According to CMS, a 
longer phase-in period could help alleviate concerns about the cost of 
retrofitting homes with sprinklers. Based on our recommendation, CMS 
collected data on the sprinkler status of homes nationwide and found 
that about 21 percent of nursing homes are unsprinklered or partially 
sprinklered.[Footnote 60] Although CMS has not completed its cost 
analysis, the agency believes that the costs associated with the 
retrofit will be less than the industry's $1 billion estimate. 

States Continue to Have Problems in Hiring and Retaining Surveyors: 

The hiring and retention of surveyors, particularly RNs, remains a 
major, frequently discussed issue among state survey agency directors, 
according to an AHFSA official, the association that represents state 
survey agency directors. In July 2003, we reported that the limited 
experience level of state surveyors because of a high turnover rate was 
a contributing factor to (1) variability in citing actual harm or 
higher-level deficiencies and (2) understatement of such deficiencies. 
In more than half of the 42 states that responded to our inquiry, from 
30 percent to more than 50 percent of surveyors had 2 years' experience 
or less, as of July 2002. Twenty-five states responded to our request 
for updated information on surveyor workforce issues as of July 2005. 

Of 23 states that provided data in both 2002 and 2005, 13 reported an 
improvement in 2005 (i.e., a decline in the proportion of inexperienced 
surveyors); 9 indicated that the situation had worsened (e.g., an 
increase in the proportion of inexperienced surveyors); and 1 state 
reported no change (see app. IV). As of July 2005, however, 20 percent 
or more of surveyors in 20 of the 25 states had 2 years' experience or 
less (see table 9). Surveyor vacancy rates in the 25 states ranged from 
about 3 percent in Tennessee to 31 percent in Alabama and Florida; 
overall, 15 states had double-digit vacancy rates. Officials in 18 
states believed that inexperienced surveyors contributed to interstate 
variability in the citation of serious deficiencies. One state survey 
agency indicated that staff attrition resulted in a workforce of less 
experienced surveyors who demonstrated a hesitance to cite actual harm 
and contributed to understatement. State survey agency officials in 
several states, however, suggested that the problem for less- 
experienced surveyors was not identifying harm but rather investigating 
and documenting the circumstances that led to the harm, including 
facility culpability, a skill that surveyors develop as they gain more 
experience.[Footnote 61] 

Table 9: Percentage of Surveyors with 2 Years' Experience or Less, as 
of July 2005: 

Percentage of surveyors with 2 years' experience or less: More than 50 
percent; Number of states: 5. 

Percentage of surveyors with 2 years' experience or less: More than 30 
percent to 50 percent; Number of states: 5. 

Percentage of surveyors with 2 years' experience or less: 20 percent to 
30 percent; Number of states: 10. 

Percentage of surveyors with 2 years' experience or less: 10 percent to 
less than 20 percent; Number of states: 5. 

Source: AHFSA data from 25 states. 

[End of table] 

Because state survey agency salaries are rarely competitive with the 
private sector, state survey agencies told us that it is difficult to 
retain surveyors and to fill vacancies. RNs, a major component of 
states' surveyor workforce, are in high demand and short supply, 
according to AHFSA. Furthermore, 9 states responding to our July 2005 
inquiry indicated that state civil service requirements can make it 
more difficult to fill vacancies. Several of the 9 states characterized 
the hiring process as either cumbersome or time-consuming, or both, and 
1 state noted that the process takes close to 9 months. Two states 
reported that they had to select candidates to interview from a 
certified list. One of the states indicated that the certified list 
often contained unqualified applicants, while the other state noted 
that some of the applicants were not the "best fit." Of the 25 states, 
21 indicated that they had implemented initiatives to help retain 
surveyors. The most popular retention strategies were to increase 
starting salaries and to implement flexible surveyor work schedules. 
For example, New York instituted a locality pay differential for New 
York City. While 5 of the 25 states indicated that they had a state- 
imposed hiring freeze, 1 state reported that budget pressures prevented 
it from taking steps to improve retention rates.[Footnote 62] A 
continuing problem cited by AHFSA is that federal funds are distributed 
late in the fiscal year, which does not tie into state budget cycles 
for approving additional positions. This problem may be particularly 
acute in the 5 states that reported having a hiring freeze. 

Workload Issues and Competing Priorities Pose Challenges for CMS and 
States: 

CMS and states have experienced increased survey workloads due to the 
greater intensity of nursing home oversight, the increasing number of 
initiatives, and growth in the number of Medicare and Medicaid 
providers requiring oversight. This workload growth required the 
prioritization of initiatives that, in some cases, has resulted in 
implementation delays for some key initiatives. The consensus-building 
process necessary to bring initiatives to fruition also has contributed 
to some delays. The initiatives likely will continue to compete for 
priority with other CMS programs, posing a challenge for efforts to 
further improve nursing home quality and safety. 

Increased Workload Has Contributed to Delays: 

Greater nursing home oversight has increased demand on both CMS and 
state survey agency resources, causing delays for some key initiatives. 
CMS's increased workload is evident in the labor-intensive state 
performance reviews. Since their introduction in October 2000, the 
reviews have been gradually expanded from nursing homes to several 
other Medicare and Medicaid providers, such as home health agencies and 
hospitals. CMS also has significantly increased the number of federal 
quality-of-care and fire safety comparative surveys. Such surveys are 
more labor-intensive than the alternative type of federal monitoring 
surveys, known as observational surveys, because they require an entire 
federal survey team rather than a smaller number of federal surveyors. 
The agency also has committed considerable resources to developing new 
data systems for complaints and enforcement actions while 
simultaneously increasing its use of available data to further improve 
federal and state oversight. Despite the increased workload, CMS 
implemented survey staff reductions of 5 percent in regional offices 
and 3 percent in its central office in January 2004. As of August 2005, 
these staff reductions have remained in effect. 

As state survey agency workloads grew with the implementation of the 
initiatives, they also experienced resource pressures. States are now 
required to conduct on-site revisits to ensure serious deficiencies 
have been corrected, investigate complaints alleging actual harm on- 
site and do so more promptly, and initiate off-hour standard surveys. 
Thus, surveyors' presence in nursing homes has increased and surveyors' 
work hours have effectively been expanded to weekends, evenings, and 
early mornings. The requirement to impose immediate sanctions on homes 
that repeatedly harm residents also has had a workload impact because 
in the past a grace period allowed homes to correct deficiencies before 
the sanctions went into effect. The imposition of immediate sanctions 
requires states to track, which some states do manually, the homes that 
must be referred for immediate sanctions and requires CMS and states to 
act to impose recommended sanctions that in the past would have been 
rescinded because the homes could have corrected the deficiencies 
during a grace period. While states' budget pressures appear to be 
easing, many state survey agencies reported hiring freezes, staff 
vacancies, or high turnover as of July 2002 when all of these 
initiatives had already been fully implemented. 

The number of initiatives that CMS has implemented on its own has 
grown, further increasing its workload. For example, CMS added quality 
indicator data to its Nursing Home Compare Web site and has involved 
QIOs in helping nursing homes to improve quality of care. In addition, 
CMS created a task force to develop guidance intended to improve 
consistency across states in the imposition of civil money penalties. 

The number of nursing home initiatives simultaneously under development 
or being implemented as well as other CMS responsibilities, such as 
preparing to implement the new Medicare prescription drug benefit in 
January 2006, have necessitated the establishment of priorities and led 
to delays and queues.[Footnote 63] CMS assigned some initiatives, such 
as the development and public reporting of quality indicators, a high 
priority and implemented them swiftly despite issues related to their 
validity and the quality of the underlying data--problems that CMS is 
still working to address. In contrast, the revision of the survey 
process has encountered delays because of funding shortfalls and has 
been in process for 7 years. For example, initial testing of the new 
methodology in 2002 and 2003 was limited, even though CMS had already 
invested $4.7 million in its development from initiation in 1999 
through September 2003. A pilot test of the new methodology is 
scheduled to begin in the fall 2005; depending on the results of the 
testing, implementation could begin in mid-2007. Although CMS attaches 
a high priority to enhancing the information available to the public on 
nursing home quality and safety, adding information on past 
noncompliance and the fire safety status of nursing homes are in a 
queue behind the programming required to implement higher-priority 
projects. There is also a regulatory queue, with other, higher-priority 
regulations ahead of the notice of proposed rule making to require 
retrofitting of nursing homes with automatic sprinklers. 

Delays in implementing the nursing home initiatives are also 
attributable to CMS's need to be responsive to stakeholder input. 
Appropriately, CMS seeks input from various stakeholders such as 
states, regional offices, the nursing home industry, and resident 
advocates. For example, CMS sought input from experts in developing 
investigative protocols for surveyors. Due to this lengthy consultative 
process, combined with the prolonged delays stemming from internal 
disagreement over the structure of the process during the initial 
stages, CMS has only implemented two investigative protocols since 
2001. Likewise, implementation of the ASPEN Complaint Tracking System 
was delayed because during the system's pilot test, several states 
indicated their belief that their existing systems were superior and 
opposed the idea of either abandoning these systems or maintaining 
separate systems. 

Number of Providers Subject to Surveys Is Growing: 

Both the overall growth in providers and the anticipated growth in 
nursing homes pose additional workload challenges for CMS and states. 
In addition to nursing homes, CMS and states are responsible for 
surveys of other Medicare and Medicaid providers, such as home health 
agencies and hospitals. The number of these providers grew from 39,651 
in October 2000 to 45,375 in January 2005, approximately 14 
percent.[Footnote 64] While the number of nursing homes has decreased 
slightly during the same period, from 17,012 to 16,146, the rate of 
decline has slowed; and as the baby boom generation ages, increasing 
the number of elderly needing long-term care services, the number of 
nursing homes is expected to grow to meet the demand. In 2000, 35.1 
million people were aged 65 or older. This number is expected to grow 
to about 54.7 million by 2020. 

Nursing home survey activities consume the majority of state survey 
budgets and resources. Nursing homes make up about 31 percent of 
Medicare and Medicaid providers, but account for 73 percent of the 
federal budget for oversight of such providers.[Footnote 65] The 
funding for nursing home surveys is disproportionate because the time 
frames for standard nursing home surveys are statutory. For those 
survey requirements not in statute, CMS determines the survey time 
frames; these surveys are therefore a lower priority.[Footnote 66] Even 
among nursing home survey activities, however, annual standard surveys 
are considered a higher priority than complaint surveys or initial 
surveys for which the statute does not dictate specific time 
frames.[Footnote 67] CMS and state survey agency officials recognize 
that CMS may have shifted its focus and resources to nursing homes at 
the expense of adequate oversight of other providers serving Medicare 
and Medicaid beneficiaries, and some states contend that the focus on 
nursing home standard surveys has hampered their ability to investigate 
nursing home complaints within mandated time frames. For example, 
according to a California state survey agency official, California law 
mandates that all nursing home resident complaints, not just complaints 
alleging actual harm, be investigated within 10 days. Likewise, an 
official from the Pennsylvania state survey agency stated that in 
Pennsylvania, all complaints must be investigated within 48 hours. 
California survey agency officials have told us that a complaint 
alleging a care problem deserves a higher priority than a standard 
survey, which may or may not identify deficiencies. 

Key Nursing Home Initiatives Continue to Compete for Priority: 

According to CMS officials, key nursing home initiatives continue to 
compete for priority with other CMS projects. Examples of nursing home 
initiatives that have been affected include revision and testing of the 
new survey methodology, continued development of the investigative 
protocols that surveyors use to investigate care problems, and an 
increase in the number of quality-of-care comparative surveys. 

* Revised survey methodology. CMS officials have indicated that 
nationwide implementation of the revised survey methodology could be 
affected if its use requires additional survey time or a greater number 
of surveyors to conduct each survey. The pilot test of the new 
methodology, scheduled for 2005 and 2006, includes an examination of 
steps to streamline the revised process, if necessary. Cost 
considerations limited the pilot of the new methodology to fewer states 
than the 20 that volunteered. 

* Investigative protocols for quality-of-care problems. Only three sets 
of investigative protocols had been implemented as of November 2005, 
and it is unclear whether the contractor's assessment of the protocols' 
effectiveness can be completed before the contract ends in 2006. 
Furthermore, unless the contract for the investigative protocols is re- 
bid, CMS expects to return to the traditional revision process even 
though agency staff believe that the expert panel process used under 
the contract produced a high-quality product. 

* Federal comparative surveys. CMS hired a contractor in 2003 to 
further increase the number of federal quality-of-care comparative 
surveys, but dropped funding for quality-of-care comparative surveys 
from the fiscal year 2006 contract.[Footnote 68] The agency reallocated 
the funds to help state survey agencies meet the increased survey 
workload resulting from growth in the number of other Medicare 
providers. 

Concluding Observations: 

CMS has focused considerable attention since 1998 on addressing 
weaknesses in state and federal oversight activities in order to better 
care for and protect nursing home residents. The agency has implemented 
many important improvements in the areas of surveys, complaints, 
enforcement, and oversight, such as taking steps to address survey 
predictability, issuing additional guidance to ensure timely on-site 
investigations of complaints alleging harm to residents, implementing 
an immediate sanctions policy to eliminate grace periods for homes 
cited for repeat serious violations, and strengthening oversight by 
conducting assessments of state survey activities. However, some key 
activities are still in process. For example, CMS's effort to revise 
the survey methodology has been underway for 7 years. Given the pivotal 
role played by surveys in helping to ensure that nursing home residents 
receive high-quality care, the development and implementation of a more 
rigorous survey methodology is one of the most important contributions 
CMS can make to addressing oversight weaknesses. Certain other 
initiatives, such as sharing data with the public in an effort to use 
market forces to drive quality improvement, also remain in process. 
Since launching Nursing Home Compare in 1998, CMS has been aware of 
accuracy and reliability issues with the underlying data and began 
changing its approach to data integrity in 2005. The agency is working 
to address issues concerning data on nursing home staffing that 
compelled it to temporarily exclude questionable data from its Web site 
in July 2005 until its accuracy can be verified. Because consumers use 
these data to make decisions about nursing home care, ensuring the 
accuracy, reliability, and timeliness of nursing home quality data is 
critical. Even with CMS's increased efforts to improve nursing home 
quality, the agency's continued attention and commitment to these 
efforts is essential in order to maintain and build upon the momentum 
of its accomplishments to date. 

Agency and State Comments and Our Evaluation: 

We provided CMS a draft of this report for review. CMS generally 
concurred with our findings, noting that progress has been made in many 
areas such as surveys and complaint investigations, oversight 
activities, and citation of serious deficiencies, but that challenges 
remain. (CMS's comments are reproduced in app. V.) CMS also provided 
technical comments, which we included in the report as appropriate. We 
also provided the five states we contacted an opportunity to review the 
portion of the draft focused on trends in nursing home quality. 
California, Florida, Ohio, New York, and Texas provided written 
comments. California's comments focused on clarifying its experience 
seeking CMS guidance on the definition of actual harm, but did not 
state whether it agreed with our findings. Ohio commented that our 
report's findings related to continued inconsistency and understatement 
of serious deficiencies by state surveyors did not apply to its state 
survey agency. New York stated that including a more detailed 
description of states' efforts to improve nursing home quality would 
provide a more balanced view of the reasons for the decline in serious 
deficiencies. Florida and Texas generally concurred, but Texas did not 
provide specific comments. CMS and states' specific comments focused 
primarily on four issues: understatement of serious deficiencies, the 
definition of actual harm, data availability, and challenges to 
conducting nursing home survey and oversight activities. 

CMS commented that it remains concerned about the possible 
understatement or omission of serious deficiencies, but that it did not 
believe that understatement caused the decline in serious nursing home 
deficiencies or that understatement was worsening. CMS noted its 
efforts to work with states that fail to improve their ability to 
identify deficiencies such as withholding funding increases until 
corrective action plans are developed. Florida, New York, and Ohio 
similarly commented that efforts such as their states' quality 
improvement initiatives, regulatory changes to improve nursing home 
operations, and engagement of the provider community have contributed 
to the decline. 

CMS suggested that including the results of observational surveys in 
our analysis of the percentage of federal surveys that found serious 
deficiencies missed by states would show that the percentage remained 
relatively constant from 2002 to 2004 rather than increasing. As we 
noted in our 1999 report, however, comparative surveys are more 
effective than observational surveys in identifying serious 
deficiencies missed by state surveyors because they are the only 
oversight tool that provides an independent federal survey where 
results can be compared to those of the state. Observational surveys 
can serve as an effective training tool for state surveyors but, in our 
view, they do not accurately represent typical state surveyor 
performance due to the likelihood that state surveyors modify their 
performance when they are aware that they are being observed by federal 
surveyors. 

Florida and Ohio noted that in addition to comparative surveys, CMS 
conducted many observational surveys during the time period studied. 
Ohio disagreed that our analysis of federal comparative surveys 
suggests that nursing home surveyors in Ohio missed serious 
deficiencies, citing its combined performance ratings for observational 
and comparative surveys. New York commented that federal comparative 
surveys often do not include the same resident sample used in the state 
survey and that only looking at comparative surveys provides a narrow 
analysis of state survey quality. New York suggested a more detailed 
analysis of comparative survey data and consideration of state 
performance review results. We note that, in 2002, CMS directed federal 
surveyors to include at least 50 percent of the residents included in 
the state survey sample. We also acknowledge that CMS is conducting 
state performance reviews as part of its oversight of state survey 
activities, but note that the reviews have shortcomings as described in 
our July 2003 report. Florida noted that our analysis of federal 
comparative surveys that identified missed serious deficiencies is 
based on limited data. We acknowledge that our analysis is based on a 
small number of surveys, but note that it includes the full universe of 
comparative surveys conducted from March 2002 through December 2004 in 
the five states we reviewed. 

The range of comments from states reinforces the need for CMS to 
clarify the definition of actual harm, as it plans to do. California 
noted that while some of its state surveyors were confused about the 
definition of actual harm, after discussions with CMS from 1998 through 
2004, the survey agency and CMS are now in agreement on the definition 
of actual harm. New York stated that confusion about the definition of 
actual harm has been reduced. Ohio noted that its state surveyors are 
not confused by the definition of actual harm, but that states have not 
received clear and specific guidance from CMS. Florida agreed that 
clearer guidance would be useful. 

CMS indicated that it is taking steps to improve the reliability and 
accuracy of publicly reported data by identifying suspect data and 
posting more detailed information about past noncompliance. As we state 
in our report, we believe that consumers should have timely and 
accurate data to inform their decisions regarding nursing home care. 

CMS commented that the workload issues described in this report present 
challenges beyond those we have previously reported. CMS stated that 
continued constraint of resources could "likely cause some erosion of 
the gains already made" in the survey and oversight activities to date. 
To address the challenges it faces, CMS plans to increase efforts to 
improve productivity, determine the cost and value of policies, focus 
state performance standards on substantive issues, prioritize survey 
activities, coordinate with stakeholders, address increasing fuel 
costs, and enhance emergency preparedness. California, Florida, New 
York, and Ohio reiterated the staffing challenges they have experienced 
and the steps they have taken to address them, some of which are 
described in this report. Despite these efforts, California indicated 
that its staffing challenges have negatively impacted the investigative 
process. While we recognize the challenges CMS and states face, we 
continue to believe that maintaining the momentum developed over the 
last several years on key CMS initiatives, such as the development of 
the revised survey methodology (i.e., Quality Indicator Survey), is 
critical to addressing nursing home survey and oversight weaknesses. 

As arranged with your office, unless you publicly announce its contents 
earlier, we plan no further distribution of this report until 30 days 
after its issue date. At that time, we will send copies of this report 
to the Administrator of the Centers for Medicare & Medicaid Services 
and appropriate congressional committees. We also will make copies 
available at no charge on the GAO Web site at http://www.gao.gov. 

If you or your staff have any questions about this report, please 
contact me at (202) 512-7118 or allenk@gao.gov. Contact points for our 
Offices of Congressional Relations and Public Affairs may be found on 
the last page of this report. GAO staff who made major contributions to 
this report are listed in appendix VI. 

Kathryn G. Allen: 
Director, Health Care: 

[End of section] 

Appendix I: Prior GAO Recommendations, Related CMS Initiatives, and 
Implementation Status: 

Table 10 summarizes our recommendations from 14 reports on nursing home 
quality and safety, issued from July 1998 through November 2004; CMS's 
actions to address weaknesses we identified; and the implementation 
status of CMS's initiatives. The recommendations are grouped into four 
categories--surveys, complaints, enforcement, and oversight. If a 
report contained recommendations related to more than one category, the 
report appears more than once in the table. For each report, the first 
two numbers identify the year in which the report was issued. For 
example, HEHS-98-202 was released in 1998. The Related GAO Products 
section at the end of this report contains the full citation for each 
report. Of our 36 recommendations, CMS has fully implemented 13, 
implemented only parts of 3, is taking steps to implement 13, and 
declined to implement 7. 

Table 10: Implementation Status of CMS's Initiatives Responding to 
GAO's Nursing Home Quality and Safety Recommendations, July 1998 
through November 2004: 

Surveys: 

GAO report number: GAO/HEHS-98-202; GAO recommendation: 1. Stagger or 
otherwise vary the scheduling of standard surveys to effectively reduce 
the predictability of surveyors' visits. The variation could include 
segmenting the standard survey into more than one review throughout the 
12-to 15-month period, which would provide more opportunities for 
surveyors to observe problematic homes and initiate broader reviews 
when warranted; CMS initiative: CMS took several steps to reduce survey 
predictability, but some state surveys remain predictable; 
* In 1999, CMS instructed state survey agencies to (1) conduct 10 
percent of surveys on evenings and weekends, (2) vary the sequencing of 
surveys in a geographical area to avoid alerting other homes that the 
surveyors are in the area, (3) vary the scheduling of surveys by day of 
the week, and (4) avoid scheduling surveys for the same month as a 
home's prior survey; 
* In 2004, CMS provided states with an automated scheduling and 
tracking system (AST) to assist in scheduling surveys. CMS officials 
told us that AST can be used to address survey predictability. States 
appeared to be unaware of this feature and use of AST is optional; 
* CMS disagreed with and did not implement the recommendation to 
segment the standard survey into more than one review throughout the 12-
to 15-month period; Implementation status: Implemented only part of our 
recommendation and no further steps are planned. 

GAO recommendation: 2. Revise federal survey procedures to instruct 
surveyors to take stratified random samples of resident cases and 
review sufficient numbers and types of resident cases so that surveyors 
can better detect problems and assess their prevalence; CMS initiative: 
CMS has been developing a revised survey methodology since 1998. A 
pilot test of the new methodology is scheduled to begin in the fall of 
2005. Implementation could begin in mid-2007; Implementation status: 
Taking steps to implement our recommendation. 

GAO report number: GAO-03-561; 
GAO recommendation: 3. Finalize the development, testing, and 
implementation of a more rigorous survey methodology, including 
investigative protocols that provide guidance to surveyors in 
documenting deficiencies at the appropriate scope and severity level; 
CMS initiative: See CMS action in response to recommendation to revise 
federal survey procedures (recommendation #2 above); CMS began revising 
surveyors' investigative protocols in October 2000. Three protocols 
have been issued and several more are under development. In addition, 
CMS is clarifying the definitions of actual harm and immediate 
jeopardy; Implementation status: Taking steps to implement our 
recommendation. 

GAO recommendation: 4. Require states to have a quality assurance 
process that includes, at a minimum, a review of a sample of survey 
reports below the level of actual harm to assess the appropriateness of 
the scope and severity cited and to help reduce instances of 
understated quality-of-care problems; CMS initiative: CMS has no plans 
to implement this recommendation, indicating that regular workload and 
priorities take precedence over it; Implementation status: Did not 
implement our recommendation. 

GAO report number: GAO-05-78; 
GAO recommendation: 5. Hold homes accountable for all past 
noncompliance resulting in harm to residents, not just care problems 
deemed to be egregious, and develop an approach for citing such past 
noncompliance in a manner that clearly identifies the specific nature 
of the care problem both in the OSCAR database and on CMS's Nursing 
Home Compare Web site; CMS initiative: CMS revised its definition of 
past noncompliance. CMS plans to add the specific nature of the care 
problem to its Web site, but programming required for the Medicare 
prescription drug benefit has delayed implementation; Implementation 
status: Taking steps to implement our recommendation. 

Complaints: 

GAO report number: GAO/HEHS-99-80; GAO recommendation: 6. Develop 
additional standards for the prompt investigation of serious complaints 
alleging situations that may harm residents but are categorized as less 
than immediate jeopardy. These standards should include maximum 
allowable time frames for investigating serious complaints and for 
complaints that may be deferred until the next scheduled annual survey. 
States may continue to set priority levels and time frames that are 
more stringent than these federal standards; CMS initiative: In October 
1999, CMS issued a policy letter stating that complaints alleging harm 
must be investigated within 10 days; In January 2004, CMS provided 
detailed direction and guidance to states for managing complaint 
investigations for numerous types of providers, including nursing 
homes; In June 2004, CMS made available updated guidance on the 
Internet that consolidates complaint investigation procedures for 
numerous types of providers; Implementation status: Fully implemented 
our recommendation. 

GAO recommendation: 7. Strengthen federal oversight of state complaint 
investigations, including monitoring states' practices regarding 
priority-setting, on-site investigation, and timely reporting of 
serious health and safety complaints; CMS initiative: In 2000, CMS 
began requiring its regional offices to perform yearly assessments of 
states' complaint investigations as part of annual state performance 
reviews; Implementation status: Fully implemented our recommendation. 

GAO report number: GAO-03-561; 
GAO recommendation: 8. Finalize the development of guidance to states 
for their complaint investigation processes and ensure that it 
addresses key weaknesses, including the prioritization of complaints 
for investigation, particularly those alleging harm to residents; the 
handling of facility self-reported incidents; and the use of 
appropriate complaint investigation practices; CMS initiative: In 
January 2004, CMS provided detailed direction and guidance to states 
for managing complaint investigations for numerous types of providers, 
including nursing homes; In June 2004, CMS made available updated 
guidance on the Internet that consolidates complaint investigation 
procedures for numerous types of providers; Implementation status: 
Fully implemented our recommendation. 

GAO report number: GAO-02-312; 
GAO recommendation: 9. Ensure that state survey agencies immediately 
notify local law enforcement agencies or Medicaid Fraud Control Units 
when nursing homes report allegations of resident physical or sexual 
abuse or when the survey agency has confirmed complaints of alleged 
abuse; CMS initiative: In 2002, CMS issued a memo to the regional 
offices and state survey agencies emphasizing its policy for preventing 
abuse in nursing homes and for promptly reporting it to the appropriate 
agencies when it occurs; In 2004, CMS informed GAO that it continues to 
hold discussions with the Department of Justice and with the HHS Office 
of General Counsel about CMS's authority to require, and potential 
effectiveness of requiring, state survey agencies to immediately notify 
local law enforcement of suspected physical and sexual abuse; 
Implementation status: Taking steps to implement our recommendation. 

GAO recommendation: 10. Accelerate the agency's education campaign on 
reporting nursing home abuse by (1) distributing its new poster with 
clearly displayed complaint telephone numbers and (2) requiring state 
survey agencies to ensure that these numbers are prominently listed in 
local telephone directories; CMS initiative: CMS developed a poster, 
but it is not yet released, pending approval by the Secretary of HHS; 
In 2002, CMS released a memorandum to regional offices and state 
agencies that addresses displaying complaint telephone numbers. CMS 
asked all state agencies to review how their telephone number is listed 
in the local directory and asked them to ensure that their complaint 
telephone numbers are prominently listed; Implementation status: Taking 
steps to implement our recommendation. 

GAO recommendation: 11. Systematically assess state policies and 
practices for complying with the federal requirement to prohibit 
employment of individuals convicted of abusing nursing home residents 
and, if necessary, develop more specific guidance to ensure compliance; 
CMS initiative: CMS is conducting a Background Check Pilot Program in 
several states, as required by the Medicare Prescription Drug, 
Improvement, and Modernization Act of 2003. The pilot is expected to 
run through September 2007, followed by an evaluation of the results; 
Implementation status: Taking steps to implement our recommendation. 

GAO recommendation: 12. Clarify the definition of abuse and otherwise 
ensure that states apply that definition consistently and 
appropriately; CMS initiative: In 2002, CMS released a memorandum to 
its regional offices and state survey agency directors clarifying its 
definition of abuse and instructing them to report suspected abuse to 
law enforcement authorities and, if appropriate, to the state's 
Medicaid Fraud Control Unit.[A]; Implementation status: Fully 
implemented our recommendation. 

GAO recommendation: 13. Shorten the state survey agencies' time frames 
for determining whether to include findings of abuse in nurse aide 
registry files; CMS initiative: CMS informed GAO that the regulations 
do not specify time frames that states must follow in substantiating 
abuse, but agreed to review this matter when the agency considers 
changes to the regulations. CMS did not indicate when this would be 
done; Implementation status: Taking steps to implement our 
recommendation. 

Enforcement: 

GAO report number: GAO/HEHS-98-202; GAO recommendation: 14. Require 
that for problem homes with recurring serious violations, state 
surveyors substantiate, by means of an on-site revisit, every report to 
CMS of a home's resumed compliance status; CMS initiative: In 1998, CMS 
issued guidance to regional offices and state survey agencies 
strengthening its revisit policy by requiring on-site revisits until 
all serious deficiencies are corrected. Homes are no longer permitted 
to self-report resumed compliance; Implementation status: Fully 
implemented our recommendation. 

GAO recommendation: 15. Eliminate the grace period for homes cited for 
repeated serious violations and impose sanctions promptly, as permitted 
under existing regulations; CMS initiative: CMS phased in 
implementation of its "double G" policy from September 1998 through 
January 2000; Implementation status: Fully implemented our 
recommendation. 

GAO report number: GAO/HEHS-99-46; GAO recommendation: 16. Improve the 
effectiveness of civil money penalties: the Administrator should 
continue to take those steps necessary to shorten the delay in 
adjudicating appeals, including monitoring progress made in reducing 
the backlog of appeals; CMS initiative: As requested by HHS, Congress 
approved increased funding and staffing levels for the Departmental 
Appeals Board in fiscal years 1999 and 2000; Implementation status: 
Fully implemented our recommendation. 

GAO recommendation: 17. Strengthen the use and effect of termination: 
* Continue Medicare and Medicaid payments beyond the termination date 
only if the home and state Medicaid agency are making reasonable 
efforts to transfer residents to other homes or alternative modes of 
care; CMS initiative: CMS conducted a study and concluded that it was 
not practical to establish rules to address this problem; 
Implementation status: Implemented only part of our recommendation and 
no further steps are planned. 

GAO recommendation: 
* Ensure that reasonable assurance periods associated with reinstating 
terminated homes are of sufficient duration to effectively demonstrate 
that the reason for termination has been resolved and will not recur; 
CMS initiative: CMS added examples to the reasonable assurance guidance 
in 2000, but declined to lengthen the reasonable assurance period. 

GAO recommendation: 
* Strengthen the use and effect of termination: Revise existing 
policies so that the pretermination history of a home is considered in 
taking a subsequent enforcement action; CMS initiative: In 2000, CMS 
revised its guidance so that pretermination history of a home is 
considered in taking subsequent enforcement actions. 

GAO recommendation: 18. Improve the referral process: The Administrator 
should revise CMS guidance so that states refer homes to CMS for 
possible sanction (such as civil money penalties) if they have been 
cited for a deficiency that contributed to a resident's death; CMS 
initiative: In 2000, CMS revised its guidance to require states to 
refer homes for possible sanction if they had been cited for a 
deficiency that contributed to a resident's death; Implementation 
status: Fully implemented our recommendation. 

Oversight: 

GAO report number: GAO/HEHS-99-46; GAO recommendation: 19. Develop 
better management information systems. The Administrator should enhance 
OSCAR or develop some other information system that can be used by both 
by the states and CMS to integrate the results of complaint 
investigations, track the status and history of deficiencies, and 
monitor enforcement actions; CMS initiative: CMS has implemented new 
national enforcement and complaint tracking systems but does not 
anticipate completing its replacement of the OSCAR data system until 
2008; Implementation status: Taking steps to implement our 
recommendation. 

GAO report number: GAO/HEHS-99-80; GAO recommendation: 20. Require that 
the substantiated results of complaint investigations be included in 
federal data systems or be accessible by federal officials; CMS 
initiative: In January 2004, CMS's new ASPEN Complaint Tracking system 
was implemented nationwide; Implementation status: Fully implemented 
our recommendation. 

GAO report number: GAO/HEHS-00-6; GAO recommendation: 21. Improve the 
scope and rigor of CMS's oversight process: Implementation status: 
Fully implemented our recommendation. 

GAO recommendation: 
* Increase the proportion of federal monitoring surveys conducted as 
comparative surveys to ensure that a sufficient number are completed in 
each state to assess whether the state appropriately identifies serious 
deficiencies; CMS initiative: CMS has significantly increased the 
number of quality-of-care comparative surveys. In fiscal year 2006, 
however, the agency will no longer contract for additional quality-of-
care comparative surveys because of funding constraints. 

GAO recommendation: 
* Ensure that comparative surveys are initiated closer to the time the 
state agency completes the home's annual standard survey; CMS 
initiative: To better ensure that conditions in a nursing home have not 
changed since the state survey, CMS regional offices have reduced the 
average time between the state survey and the initiation of a federal 
comparative survey from 33 days in 1999 to 26 days by 2004. 

GAO recommendation: 
* Require regions to provide more timely written feedback to the states 
after the completion of federal monitoring surveys; CMS initiative: CMS 
instructed the regions to report the results of federal monitoring 
surveys to states on a monthly basis. 

GAO recommendation: 
* Improve the data system for observational surveys so that it is an 
effective management tool for CMS to properly assess the findings of 
observational surveys; CMS initiative: CMS developed a separate 
database accessible to all regional offices that includes the results 
of observational surveys. Beginning in fiscal year 2002, CMS added data 
on the results of comparative surveys. 

GAO recommendation: 22. Improve the consistency in how CMS holds state 
survey agencies accountable by standardizing procedures for selecting 
state surveys and conducting federal monitoring surveys: 

GAO recommendation: 
* Ensure that the regions target surveys for review that will provide a 
comprehensive assessment of state surveyor performance; CMS initiative: 
CMS did not implement our recommendation to select individual state 
surveys for federal review in a manner that ensures its regional 
offices observe as many state surveyors as possible. 

GAO recommendation: 
* Require federal surveyors to include as many of the same residents as 
possible in their comparative survey sample as the state included in 
its sample (where CMS surveyors have determined that the state sample 
selection process was appropriate); CMS initiative: In October 2002, 
CMS instructed federal surveyors to select at least half of those 
residents selected by the state surveyors for their resident sample. 
Implementation status: Implemented only part of our recommendation and 
no further steps are planned. 

GAO recommendation: 23. Further explore the feasibility of appropriate 
alternative remedies or sanctions for those states that prove unable or 
unwilling to meet CMS's performance standards; CMS initiative: In 
December 1999, CMS adopted new state sanctions. In fiscal year 2005, 
CMS began to tie survey agency funding increases to the timely conduct 
of standard surveys, a step that we believe offers a strong incentive 
for improved compliance; Implementation status: Fully implemented our 
recommendation. 

GAO report number: GAO/HEHS-02-279; GAO recommendation: 24. Review the 
adequacy of current state efforts to ensure the accuracy of minimum 
data set (MDS) data, and provide, where necessary, additional guidance, 
training, and technical assistance; CMS initiative: CMS disagreed with 
and did not implement this recommendation; Implementation status: Did 
not implement our recommendation. 

GAO recommendation: 25. Monitor the adequacy of state MDS accuracy 
activities on an ongoing basis, such as through the use of the 
established federal comparative survey process; CMS initiative: CMS 
disagreed with and did not implement this recommendation; 
Implementation status: Did not implement our recommendation. 

GAO recommendation: 26. Provide guidance to state agencies and nursing 
homes that sufficient evidentiary documentation to support the full MDS 
assessment be included in residents' medical records; CMS initiative: 
CMS disagreed with and did not implement this recommendation; 
Implementation status: Did not implement our recommendation. 

GAO report number: GAO-03-187; 
GAO recommendation: 27. Delay the implementation of nationwide 
reporting of quality indicators until there is greater assurance that 
the quality indicators are appropriate for public reporting--including 
the validity of the indicators selected and the use of an appropriate 
risk-adjustment methodology--based on input from the National Quality 
Forum and other experts and, if necessary, additional analysis and 
testing; CMS initiative: CMS disagreed with and did not implement this 
recommendation; Implementation status: Did not implement our 
recommendation. 

GAO recommendation: 28. Delay the implementation of nationwide 
reporting of quality indicators until a more thorough evaluation of the 
pilot is completed to help improve the initiative's effectiveness, 
including an assessment of the presentation of information on the Web 
site and the resources needed to assist consumers' use of the 
information; CMS initiative: CMS disagreed with and did not implement 
this recommendation; Implementation status: Did not implement our 
recommendation. 

GAO report number: GAO-03-561; 
GAO recommendation: 29. Further refine annual state performance reviews 
so that they (1) consistently distinguish between systemic problems and 
less serious issues regarding state performance, (2) analyze trends in 
the proportion of homes that harm residents, (3) assess state 
compliance with the immediate sanctions policy for homes with a pattern 
of harming residents, and (4) analyze the predictability of state 
surveys; CMS initiative: CMS did not implement this recommendation 
because it believes that the state performance standards take into 
account statutory and nonstatutory performance standards; 
Implementation status: Did not implement our recommendation. 

GAO report number: GAO-04-660; 
GAO recommendation: 30. Ensure that CMS regional offices fully comply 
with the statutory requirement to conduct annual federal monitoring 
surveys by including an assessment of the fire safety component of 
states' standard surveys, with an emphasis on unsprinklered homes; CMS 
initiative: CMS's evaluation of state surveyors' performance now 
routinely includes fire safety as part of the statutory requirement to 
annually conduct federal monitoring surveys in at least 5 percent of 
surveyed nursing homes in each state; Implementation status: Fully 
implemented our recommendation. 

GAO recommendation: 31. Ensure that data on sprinkler coverage in 
nursing homes are consistently obtained and reflected in the CMS 
database; CMS initiative: As nursing homes are surveyed, CMS is in the 
process of collecting consistent data on the sprinkler status of homes 
and entering these data into OSCAR; Implementation status: Taking steps 
to implement our recommendation. 

GAO recommendation: 32. Until sprinkler coverage data are routinely 
available in CMS's database, work with state survey agencies to 
identify the extent to which each nursing home is sprinklered or not 
sprinklered; CMS initiative: CMS has contacted state survey agencies 
and collected data on all but about 5 percent of nursing homes. These 
data will be verified during each home's next annual survey; 
Implementation status: Taking steps to implement our recommendation. 

GAO recommendation: 33. On an expedited basis, review all waivers and 
Fire Safety Evaluation System[B] assessments for homes that are not 
fully sprinklered to determine their appropriateness; CMS initiative: 
CMS expects to complete its reviews of Fire Safety Evaluation System 
Assessments by late 2005; Implementation status: Taking steps to 
implement our recommendation. 

GAO recommendation: 34. Make information on fire safety deficiencies 
available to the public via the Nursing Home Compare Web site, 
including information on whether a home has automatic sprinklers; CMS 
initiative: This information will not be available on the Nursing Home 
Compare Web site until 2007; Implementation status: Taking steps to 
implement our recommendation. 

GAO recommendation: 35. Work with the National Fire Protection 
Association to strengthen fire safety standards for unsprinklered 
nursing homes, such as requiring smoke detectors in resident rooms, 
exploring the feasibility of requiring sprinklers in all nursing homes, 
and developing a strategy for financing such requirements; CMS 
initiative: CMS has issued an interim final rule requiring the 
installation of smoke detectors by May 24, 2006. It anticipates issuing 
a notice of proposed rule making requiring older nursing homes to 
install sprinklers early in 2006 but will ask for comments on how much 
time homes should be given to come into compliance; Implementation 
status: Taking steps to implement our recommendation. 

GAO recommendation: 36. Ensure that thorough investigations are 
conducted following multiple-death nursing home fires so that fire 
safety standards can be reevaluated and modified where appropriate; CMS 
initiative: CMS developed and issued a standardized procedure to ensure 
that both state survey agencies and its own staff take appropriate 
action to investigate fires that result in serious injury or death; 
Implementation status: Fully implemented our recommendation. 

Source: GAO analysis of CMS's responses to our recommendations. 

[A] In 1999, CMS had required the use of an investigative protocol on 
abuse prohibition during every standard survey. The protocol's 
objective is to determine if the facility has developed and 
operationalized policies and procedures that prohibit abuse, neglect, 
involuntary seclusion, and misappropriation of resident property. 

[B] As an alternative to correcting or receiving a waiver for 
deficiencies identified on a standard survey, a home may undergo an 
assessment using the Fire Safety Evaluation System. The system provides 
a means for nursing homes to meet the fire safety objectives of CMS's 
standards without necessarily being in full compliance with every 
standard. 

[End of table] 

[End of section] 

Appendix II: Percentage of Nursing Homes Cited for Actual Harm or 
Immediate Jeopardy during Standard Surveys: 

In order to identify trends in the proportion of nursing homes cited 
with actual harm or immediate jeopardy deficiencies, we analyzed data 
from CMS's OSCAR database for four time periods: (1) January 1, 1999, 
through July 10, 2000; (2) July 11, 2000, through January 31, 2002; (3) 
February 1, 2002, through July 10, 2003; and (4) July 11, 2003, through 
January 31, 2005. Because surveys are conducted at least every 15 
months (with a required 12-month statewide average), it is possible 
that a home was surveyed twice in any time period. To avoid double 
counting of homes, we included only homes' most recent survey from each 
time period. 

Table 11: Percentage of Nursing Homes Cited for Actual Harm or 
Immediate Jeopardy, by State: 

State: 

State: District of Columbia; 
Number of homes surveyed, 7/03 - 1/05[A]: 21; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 10.0; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 33.3; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 38.1; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 33.3; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: 
23.3. 

State: Colorado; 
Number of homes surveyed, 7/03 - 1/05[A]: 218; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 15.4; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 26.2; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 21.7; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 24.3; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: 
8.9. 

State: Connecticut; 
Number of homes surveyed, 7/03 - 1/05[A]: 247; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 48.5; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 49.4; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 38.8; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 54.3; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: 
5.8. 

Change of less than 5 percentage points: 

State: South Carolina; 
Number of homes surveyed, 7/03 - 1/05[A]: 178; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 28.7; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 17.8; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 27.0; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 32.0; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: 
3.4. 

State: Oklahoma; 
Number of homes surveyed, 7/03 - 1/05[A]: 376; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 16.7; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 20.6; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 22.6; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 18.6; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: 
2.0. 

State: Vermont; 
Number of homes surveyed, 7/03 - 1/05[A]: 42; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 15.2; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 17.8; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 9.5; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 16.7; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: 1.4. 

State: Maine; 
Number of homes surveyed, 7/03 - 1/05[A]: 117; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 10.3; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 9.7; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 9.0; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 9.4; Percentage point difference[B] 1/1/99 
- 7/10/00 and 7/11/03 - 1/31/05: -0.9. 

State: West Virginia; 
Number of homes surveyed, 7/03 - 1/05[A]: 137; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 15.6; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 14.0; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 14.1; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 13.1; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: 
-2.5. 

State: Rhode Island; 
Number of homes surveyed, 7/03 - 1/05[A]: 86; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 12.1; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 10.1; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 2.4; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 9.3; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
2.8. 

State: Wisconsin; 
Number of homes surveyed, 7/03 - 1/05[A]: 413; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 14.0; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 7.1; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 9.1; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 10.2; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
3.8. 

State: Decrease of 5 percentage points or greater: 

State: Utah; 
Number of homes surveyed, 7/03 - 1/05[A]: 94; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 15.8; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 15.8; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 22.6; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 10.6; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: -5.2. 

State: Iowa; 
Number of homes surveyed, 7/03 - 1/05[A]: 492; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 19.3; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 9.9; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 7.7; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 14.0; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: -5.3. 

State: Georgia; 
Number of homes surveyed, 7/03 - 1/05[A]: 365; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 22.6; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 20.5; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 20.1; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 16.4; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: -6.1. 

State: Kansas; 
Number of homes surveyed, 7/03 - 1/05[A]: 380; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 37.1; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 29.0; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 24.9; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 30.5; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: -6.5. 

State: Tennessee; 
Number of homes surveyed, 7/03 - 1/05[A]: 340; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 26.0; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 16.7; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 19.7; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 19.1; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
6.9. 

State: New Mexico; 
Number of homes surveyed, 7/03 - 1/05[A]: 81; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 31.7; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 17.1; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 16.2; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 24.7; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
7.0. 

State: South Dakota; 
Number of homes surveyed, 7/03 - 1/05[A]: 113; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 24.1; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 30.7; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 24.8; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 16.8; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
7.3. 

State: Hawaii; 
Number of homes surveyed, 7/03 - 1/05[A]: 45; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 25.5; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 15.2; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 12.8; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 17.8; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: -7.8. 

State: Maryland; 
Number of homes surveyed, 7/03 - 1/05[A]: 239; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 25.6; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 20.2; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 14.6; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 17.6; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
8.0. 

State: North Dakota; 
Number of homes surveyed, 7/03 - 1/05[A]: 83; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 21.3; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 28.4; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 11.9; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 13.3; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
8.1. 

State: Missouri; 
Number of homes surveyed, 7/03 - 1/05[A]: 550; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 22.3; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 10.2; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 13.6; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 13.8; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
8.4. 

State: Nebraska; 
Number of homes surveyed, 7/03 - 1/05[A]: 238; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 26.0; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 18.9; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 19.6; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 16.4; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
9.6. 

State: Louisiana; 
Number of homes surveyed, 7/03 - 1/05[A]: 332; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 19.9; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 23.4; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 18.0; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 10.2; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
9.7. 

State: Virginia; 
Number of homes surveyed, 7/03 - 1/05[A]: 287; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 19.9; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 11.6; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 13.4; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 9.8; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
10.1. 

State: Pennsylvania; 
Number of homes surveyed, 7/03 - 1/05[A]: 729; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 32.2; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 11.6; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 14.4; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 20.6; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
11.7. 

State: Nevada; 
Number of homes surveyed, 7/03 - 1/05[A]: 43; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 32.7; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 9.8; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 6.7; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 20.9; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: -11.8. 

State: Illinois; 
Number of homes surveyed, 7/03 - 1/05[A]: 833; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 29.3; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 15.4; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 15.3; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 16.2; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
13.1. 

State: Nation; 
Number of homes surveyed, 7/03 - 1/05[A]: 16,463; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 29.3; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 20.5; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 17.1; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 15.5; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
13.8. 

State: Texas; 
Number of homes surveyed, 7/03 - 1/05[A]: 1,185; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 26.9; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 25.5; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 18.5; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 12.7; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
14.3. 

State: New Jersey; 
Number of homes surveyed, 7/03 - 1/05[A]: 363; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 24.5; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 22.4; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 12.7; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 9.6; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
14.9. 

State: Mississippi; 
Number of homes surveyed, 7/03 - 1/05[A]: 209; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 33.2; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 19.6; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 14.4; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 18.2; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
15.0. 

State: Florida; 
Number of homes surveyed, 7/03 - 1/05[A]: 694; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 20.8; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 20.1; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 9.8; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 5.5; Percentage point difference[B] 1/1/99 
- 7/10/00 and 7/11/03 - 1/31/05: -15.4. 

State: New Hampshire; 
Number of homes surveyed, 7/03 - 1/05[A]: 83; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 37.3; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 21.5; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 21.7; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 21.7; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: 
-15.7. 

State: Massachusetts; 
Number of homes surveyed, 7/03 - 1/05[A]: 468; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 33.0; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 22.9; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 22.5; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 16.9; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: 
-16.1. 

State: Arkansas; 
Number of homes surveyed, 7/03 - 1/05[A]: 254; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 37.7; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 27.3; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 15.8; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 20.5; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
17.3. 

State: Ohio; 
Number of homes surveyed, 7/03 - 1/05[A]: 1,009; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 29.0; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 23.7; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 21.8; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 11.6; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
17.4. 

State: Idaho; 
Number of homes surveyed, 7/03 - 1/05[A]: 80; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 54.2; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 31.0; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 38.3; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 36.3; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: -18.0. 

State: Minnesota; 
Number of homes surveyed, 7/03 - 1/05[A]: 414; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 31.7; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 18.8; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 17.1; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 12.3; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
19.3. 

State: Kentucky; 
Number of homes surveyed, 7/03 - 1/05[A]: 296; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 28.8; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 25.2; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 25.0; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 9.5; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
19.4. 

State: Michigan; 
Number of homes surveyed, 7/03 - 1/05[A]: 433; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 42.1; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 24.7; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 30.0; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 22.6; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
19.5. 

State: Montana; 
Number of homes surveyed, 7/03 - 1/05[A]: 101; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 37.5; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 25.2; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 16.0; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 17.8; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: -19.7. 

State: Alaska; 
Number of homes surveyed, 7/03 - 1/05[A]: 14; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 20.0; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 33.3; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 0.0; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 0.0; Percentage point difference[B] 1/1/99 
- 7/10/00 and 7/11/03 - 1/31/05: -20.0. 

State: North Carolina; 
Number of homes surveyed, 7/03 - 1/05[A]: 425; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 40.8; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 30.1; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 24.0; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 20.2; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: 
-20.6. 

State: California; 
Number of homes surveyed, 7/03 - 1/05[A]: 1,325; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 29.1; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 9.3; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 3.4; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 6.3; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
22.8. 

State: Alabama; 
Number of homes surveyed, 7/03 - 1/05[A]: 229; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 42.2; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 18.4; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 12.6; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 19.2; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: -23.0. 

State: New York; 
Number of homes surveyed, 7/03 - 1/05[A]: 666; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 32.2; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 32.3; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 20.0; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 9.2; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
23.0. 

State: Indiana; 
Number of homes surveyed, 7/03 - 1/05[A]: 523; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 45.3; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 26.2; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 17.4; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 21.4; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: -23.8. 

State: Arizona; 
Number of homes surveyed, 7/03 - 1/05[A]: 134; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 33.8; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 8.8; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 3.6; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 8.2; Percentage point difference[B] 1/1/99 
- 7/10/00 and 7/11/03 - 1/31/05: -25.6. 

State: Washington; 
Number of homes surveyed, 7/03 - 1/05[A]: 257; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 54.1; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 38.5; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 36.6; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 26.5; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
27.7. 

State: Wyoming; 
Number of homes surveyed, 7/03 - 1/05[A]: 39; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 43.9; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 22.5; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 26.3; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 12.8; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: -31.1. 

State: Oregon; 
Number of homes surveyed, 7/03 - 1/05[A]: 141; Percentage of homes 
cited for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 47.5; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 33.6; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 
- 7/10/03: 14.4; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/03 - 1/31/05: 14.2; Percentage point difference[B] 1/1/99 - 
7/10/00 and 7/11/03 - 1/31/05: -33.3. 

State: Delaware; 
Number of homes surveyed, 7/03 - 1/05[A]: 42; Percentage of homes cited 
for actual harm or immediate jeopardy: 1/1/99 - 7/10/00: 52.4; 
Percentage of homes cited for actual harm or immediate jeopardy: 
7/11/00 - 1/31/02: 14.3; Percentage of homes cited for actual harm or 
immediate jeopardy: 2/1/02 - 7/10/03: 4.8; Percentage of homes cited 
for actual harm or immediate jeopardy: 7/11/03 - 1/31/05: 16.7; 
Percentage point difference[B] 1/1/99 - 7/10/00 and 7/11/03 - 1/31/05: -
35.7. 

Source: GAO analysis of OSCAR data. 

Note: The first two time periods reflect data in OSCAR as of June 24, 
2002. The last two time periods reflect OSCAR data as of July 10, 2003, 
and April 13, 2005, respectively. The term states includes the 50 
states and the District of Columbia. 

[A] These data illustrate the significant variation in the number of 
nursing homes across states. 

[B] Differences are based on numbers before rounding. 

[End of table] 

[End of section] 

Appendix III: Percentage of Homes Surveyed Within 15 Days of the 1-Year 
Anniversary of Prior Survey: 

In order to determine the predictability of nursing home surveys, we 
analyzed data from CMS's OSCAR database for a home's current survey as 
of April 9, 2002, and as of July 8, 2005 (see table 12). We considered 
surveys to be predictable if homes were surveyed within 15 days of the 
1-year anniversary of their prior survey. 

Table 12: Percentage of Nursing Homes with Predictable Surveys, April 
2002 and June 2005: 

More than 50 percent: 

State: North Dakota; 
Number of homes[A]: 83; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 28.2; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 51.8; Percentage point 
difference, 4/9/02 and 7/8/05: 23.6. 

More than 25 percent to 50 percent: 

State: District of Columbia; 
Number of homes[A]: 20; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 15.0; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 40.0; Percentage point 
difference, 4/9/02 and 7/8/05: 25.0. 

State: Iowa; 
Number of homes[A]: 439; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 31.1; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 35.8; Percentage point 
difference, 4/9/02 and 7/8/05: 4.7. 

State: Kansas; 
Number of homes[A]: 357; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 13.6; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 29.1; Percentage point 
difference, 4/9/02 and 7/8/05: 15.5. 

State: Oregon; 
Number of homes[A]: 138; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 14.1; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 28.3; Percentage point 
difference, 4/9/02 and 7/8/05: 14.2. 

State: California; 
Number of homes[A]: 1,287; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 9.5; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 27.8; Percentage point 
difference, 4/9/02 and 7/8/05: 18.3. 

State: Nebraska; 
Number of homes[A]: 221; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 3.1; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 27.6; Percentage point 
difference, 4/9/02 and 7/8/05: 24.5. 

State: Maryland; 
Number of homes[A]: 236; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 20.7; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 27.5; Percentage point 
difference, 4/9/02 and 7/8/05: 6.8. 

10 percent to 25 percent: 

State: Virginia; 
Number of homes[A]: 270; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 30.5; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 20.4; Percentage point 
difference, 4/9/02 and 7/8/05: -10.1. 

State: North Carolina; 
Number of homes[A]: 418; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 13.9; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 19.1; Percentage point 
difference, 4/9/02 and 7/8/05: 5.2. 

State: Wisconsin; 
Number of homes[A]: 396; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 19.6; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 18.7; Percentage point 
difference, 4/9/02 and 7/8/05: -0.9. 

State: New Jersey; 
Number of homes[A]: 354; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 18.7; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 18.4; Percentage point 
difference, 4/9/02 and 7/8/05: -0.3. 

State: Michigan; 
Number of homes[A]: 428; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 8.8; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 17.1; Percentage point 
difference, 4/9/02 and 7/8/05: 8.3. 

State: Alabama; 
Number of homes[A]: 227; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 5.8; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 16.7; Percentage point 
difference, 4/9/02 and 7/8/05: 10.9. 

State: Delaware; 
Number of homes[A]: 42; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 31.0; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 16.7; Percentage point 
difference, 4/9/02 and 7/8/05: -14.3. 

State: Texas; 
Number of homes[A]: 1,111; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 15.7; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 16.7; Percentage point 
difference, 4/9/02 and 7/8/05: 1.0. 

State: Indiana; 
Number of homes[A]: 502; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 14.4; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 16.3; Percentage point 
difference, 4/9/02 and 7/8/05: 1.9. 

State: Massachusetts; 
Number of homes[A]: 461; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 17.3; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 16.3; Percentage point 
difference, 4/9/02 and 7/8/05: -1.0. 

State: Wyoming; 
Number of homes[A]: 39; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 10.3; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 15.4; Percentage point 
difference, 4/9/02 and 7/8/05: 5.1. 

State: Colorado; 
Number of homes[A]: 213; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 9.0; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 15.0; Percentage point 
difference, 4/9/02 and 7/8/05: 6.0. 

State: Kentucky; 
Number of homes[A]: 294; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 10.6; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 15.0; Percentage point 
difference, 4/9/02 and 7/8/05: 4.4. 

State: Nation; 
Number of homes[A]: 15,827; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 13.0; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 14.5; Percentage point 
difference, 4/9/02 and 7/8/05: 1.5. 

State: Alaska; 
Number of homes[A]: 14; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 6.7; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 14.3; Percentage point 
difference, 4/9/02 and 7/8/05: 7.6. 

State: Rhode Island; 
Number of homes[A]: 92; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 12.5; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 13.0; Percentage point 
difference, 4/9/02 and 7/8/05: 0.5. 

State: Montana; 
Number of homes[A]: 100; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 8.7; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 13.0; Percentage point 
difference, 4/9/02 and 7/8/05: 4.3. 

State: New Mexico; 
Number of homes[A]: 78; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 13.8; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 12.8; Percentage point 
difference, 4/9/02 and 7/8/05: -1.0. 

State: Pennsylvania; 
Number of homes[A]: 721; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 24.0; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 12.8; Percentage point 
difference, 4/9/02 and 7/8/05: -11.2. 

State: Washington; 
Number of homes[A]: 246; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 22.4; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 12.6; Percentage point 
difference, 4/9/02 and 7/8/05: -9.8. 

State: Vermont; 
Number of homes[A]: 41; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 11.6; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 12.2; Percentage point 
difference, 4/9/02 and 7/8/05: 0.6. 

State: Missouri; 
Number of homes[A]: 509; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 11.9; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 12.0; Percentage point 
difference, 4/9/02 and 7/8/05: 0.1. 

State: New Hampshire; 
Number of homes[A]: 81; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 12.0; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 11.1; Percentage point 
difference, 4/9/02 and 7/8/05: -0.9. 

State: New York; 
Number of homes[A]: 659; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 14.8; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 11.1; Percentage point 
difference, 4/9/02 and 7/8/05: -3.7. 

State: South Dakota; 
Number of homes[A]: 109; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 18.9; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 11.0; Percentage point 
difference, 4/9/02 and 7/8/05: -7.9. 

State: Florida; 
Number of homes[A]: 685; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 9.3; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 10.4; Percentage point 
difference, 4/9/02 and 7/8/05: 1.1. 

State: Illinois; 
Number of homes[A]: 792; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 9.7; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 10.4; Percentage point 
difference, 4/9/02 and 7/8/05: 0.7. 

State: Maine; 
Number of homes[A]: 116; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 8.3; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 10.3; Percentage point 
difference, 4/9/02 and 7/8/05: 2.0. 

Less than 10 percent: 

State: Georgia; 
Number of homes[A]: 359; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 0.6; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 7.2; Percentage point 
difference, 4/9/02 and 7/8/05: 6.6. 

State: Nevada; 
Number of homes[A]: 43; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 24.4; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 7.0; Percentage point 
difference, 4/9/02 and 7/8/05: -17.4. 

State: Hawaii; 
Number of homes[A]: 45; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 13.6; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 6.7; Percentage point 
difference, 4/9/02 and 7/8/05: -6.9. 

State: Idaho; 
Number of homes[A]: 80; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 4.8; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 6.3; Percentage point 
difference, 4/9/02 and 7/8/05: 1.5. 

State: South Carolina; 
Number of homes[A]: 176; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 6.9; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 6.3; Percentage point 
difference, 4/9/02 and 7/8/05: -0.6. 

State: Arizona; 
Number of homes[A]: 133; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 21.0; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 6.0; Percentage point 
difference, 4/9/02 and 7/8/05: -15.0. 

State: Louisiana; 
Number of homes[A]: 288; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 19.0; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 5.9; Percentage point 
difference, 4/9/02 and 7/8/05: -13.1. 

State: Tennessee; 
Number of homes[A]: 326; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 6.2; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 5.2; Percentage point 
difference, 4/9/02 and 7/8/05: -1.0. 

State: Minnesota; 
Number of homes[A]: 408; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 4.4; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 4.7; Percentage point 
difference, 4/9/02 and 7/8/05: 0.3. 

State: West Virginia; 
Number of homes[A]: 129; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 8.7; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 3.9; Percentage point 
difference, 4/9/02 and 7/8/05: -4.8. 

State: Arkansas; 
Number of homes[A]: 235; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 27.6; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 3.8; Percentage point 
difference, 4/9/02 and 7/8/05: -23.8. 

State: Utah; 
Number of homes[A]: 87; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 1.1; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 3.4; Percentage point 
difference, 4/9/02 and 7/8/05: 2.3. 

State: Connecticut; 
Number of homes[A]: 245; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 15.8; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 2.9; Percentage point 
difference, 4/9/02 and 7/8/05: -12.9. 

State: Ohio; 
Number of homes[A]: 960; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 3.0; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 2.2; Percentage point 
difference, 4/9/02 and 7/8/05: -0.8. 

State: Mississippi; 
Number of homes[A]: 201; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 2.1; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 2.0; Percentage point 
difference, 4/9/02 and 7/8/05: -0.1. 

State: Oklahoma; 
Number of homes[A]: 333; 
Percentage of homes surveyed within 15 days of 1-year anniversary of 
prior survey: 4/9/02: 0.6; Percentage of homes surveyed within 15 days 
of 1-year anniversary of prior survey: 7/8/05: 1.8; Percentage point 
difference, 4/9/02 and 7/8/05: 1.2. 

Source: GAO analysis of OSCAR data. 

Note: The term states includes the 50 states and the District of 
Columbia. 

[A] Represents the number of nursing homes with a prior and a current 
survey as of July 8, 2005. 

[End of table] 

[End of section] 

Appendix IV: Percentage of State Nursing Home Surveyors with 2-Years' 
Experience or Less, 2002 and 2005: 

Increase: 

State: Arizona; 
2002: 20; 
2005: 53; 
Percentage point change: 33. 

State: Colorado; 
2002: 24; 
2005: 53; 
Percentage point change: 29. 

State: Alaska; 
2002: 29; 
2005: 57; 
Percentage point change: 28. 

State: Illinois; 
2002: 5; 
2005: 25; 
Percentage point change: 20. 

State: Rhode Island; 
2002: 9; 
2005: 23; 
Percentage point change: 14. 

State: North Carolina; 
2002: 33; 
2005: 44; 
Percentage point change: 11. 

State: Ohio; 
2002: 17; 
2005: 21; 
Percentage point change: 4. 

State: Virginia; 
2002: 21; 
2005: 25; 
Percentage point change: 4. 

State: Florida; 
2002: 55; 
2005: 57; 
Percentage point change: 2. 

State: Arkansas; 
2002: 33; 
2005: 33; 
Percentage point change: 0. 

Decrease: 

State: Indiana; 
2002: 20; 
2005: 18; 
Percentage point change: -2. 

State: New Jersey; 
2002: 30; 
2005: 26; 
Percentage point change: -4. 

State: Oregon; 
2002: 34; 
2005: 29; 
Percentage point change: -5. 

State: Texas; 
2002: 32; 
2005: 26; 
Percentage point change: -6. 

State: Wisconsin; 
2002: 25; 
2005: 19; 
Percentage point change: -6. 

State: Nebraska; 
2002: 29; 
2005: 20; 
Percentage point change: -9. 

State: Alabama; 
2002: 48; 
2005: 38; 
Percentage point change: -10. 

State: Georgia; 
2002: 51; 
2005: 35; 
Percentage point change: -16. 

State: Tennessee; 
2002: 45; 
2005: 28; 
Percentage point change: -17. 

State: New York; 
2002: 40; 
2005: 18; 
Percentage point change: -22. 

State: Washington; 
2002: 54; 
2005: 26; 
Percentage point change: -28. 

State: Louisiana; 
2002: 48; 
2005: 19; 
Percentage point change: -29. 

State: Maryland; 
2002: 70; 
2005: 14; 
Percentage point change: -56. 

State: South Carolina; 
2002: [A]; 
2005: 52; 
Percentage point change: N/A. 

State: Vermont; 
2002: [A]; 
2005: 38; 
Percentage point change: N/A. 

Source: State survey agency responses to July 2002 GAO questions, and 
updates obtained from AHFSA in July 2005. 

Note: The term states includes the 50 states and the District of 
Columbia. 

[A] This state did not respond to our 2002 questions about surveyor 
experience. 

[End of table] 

[End of section] 

Appendix V: Comments from the Centers for Medicare & Medicaid Services: 

DEPARTMENT OF HEALTH & HUMAN SERVICES: Centers for Medicare & Medicaid 
Services: Administrator: 
Washington, DC 20201: 

NOV 25 2005: 

TO: Kathryn G. Allen: 
Director, Health Care: 

FROM: (Signed by) Mark B. McClellan, M.D., Ph.D.: Administrator: 

SUBJECT: GAO Draft Report: "Despite Increased Oversight, Challenges 
Remain in Ensuring High-Quality Care and Resident Safety," GAO-06-117: 

The title to this GAO report succinctly expresses a dual message with 
which we fully concur: there has been significant improvement in 
federal oversight of nursing homes, while important challenges remain. 
We appreciate the considerable time and expertise the GAO has invested 
in identifying key oversight challenges and in contributing, from 1998 
through 2005, ideas that helped strengthen the federal and state 
quality assurance systems for the nation's nursing homes. 

We also appreciate the opportunity to comment on a few important 
indicators of progress, such as improved frequency of nursing home 
surveys (99.4% surveyed within the previous 15 months), a 45% increase 
in complaints investigated, more fire-safety protections and oversight, 
fewer serious deficiencies in nursing homes overall, and at least a 17% 
decline in serious deficiencies missed by state survey agencies (from 
1999-2004). We conclude with observations about future challenges. 

Improvements in Oversight: 

Improvement in nursing home oversight is illustrated by the progress 
toward 100% completion of full nursing home surveys at least once every 
15 months (from 96.3 in 1999 to 99.4% in 2004). This graph portrays the 
consistent march toward 100% fulfillment of our commitment to ensure 
that all nursing homes have an objective, on-site review every 15 
months. 

% NH Surveys Completed Every 15 Months: 

[See PDF for image] 

[End of figure] 

Prompt and effective investigation of resident complaints has been 
another key focus of our improvement effort in recent years. 

From 1999 to 2004 the number of completed complaint investigations 
increased from 32,422 to 47,124. This 45 increase in completed 
complaint investigations is shown in the following graph. The graph 
illustrates both stronger performance and added commitment to be as 
responsive as possible to nursing home residents and their families. 

# Complaint Surveys, 1999-2004: 

[See PDF for image] 

[End of figure] 

Fire-safety assumed a higher priority after the nursing home fires in 
Tennessee and Connecticut in 2003. Those fires indicated that the 
downward trend toward fewer fires might not continue without added 
impetus. Through greater oversight, in 2004 we identified about 7,800 
more fire-safety deficiencies compared with 2003 (a 20% increase). 

Most recently, in 2005 we promulgated a new rule that required all 
nursing homes to have smoke detectors in unsprinklered areas, including 
hallways and residents' rooms. We also increased by 17-fold (from 41 to 
732) the number of CMS validation surveys ("comparative life-safety 
code surveys") in which we check on the adequacy of each state's fire-
safety inspections. 

Fire Safety-# Cited Deficiencies 2001-2004: 

[See PDF for image] 

[End of figure] 

A new "State Performance Standards System (SPSS)" has been expanded and 
strengthened each year since it was initially piloted in 2000. We 
initiated a "Special Focus Facility (SFF)" regimen in which surveyors 
visit more frequently those nursing homes that are judged to be most at 
risk of quality breakdowns. When SFF nursing homes improve, those homes 
are removed from the list. SFF nursing homes that do not show 
improvement have a higher chance of being terminated from the Medicare 
and Medicaid program under the new protocols. In 2005 we expanded the 
number of such nursing homes by 30% and strengthened the enforcement 
consequences for nursing homes that fail to improve significantly. 

Critical improvements in the information and tracking system used by 
surveyors will increase the effectiveness of surveys and remedial 
action. The "Aspen Complaint Tracking System (ACTS)" was implemented in 
FY 2004. It provides an automated medium in which to record and track 
the progress of every federally-required complaint investigation. The 
"Aspen Enforcement Manager (AEM)," was implemented in FY 2005. The 
system will improve the application and management of enforcement 
actions (e.g., denial of payment, state monitoring, directed plans of 
correction, civil money penalties, temporary management, termination). 

The CMS Web site ("Nursing Home Compare") provides consumers, families, 
and others with key information about every nursing home. It includes 
quality measure data, as well as deficiencies identified through the 
survey process. The "Nursing Home Compare" website remains one of the 
most frequently-used CMS Web sites, with over 1.6 million page-views by 
the public each year. We continue to take steps to make publicly 
reported data as reliable and accurate as possible under current 
authority. For example, this year CMS instituted back-end edits of 
staffing data to help identify suspect data. We return such suspect 
data to the state survey agencies for confirmation or correction. We 
are further improving consumer information on the CMS website by 
posting information about past non-compliance. A finding of past non- 
compliance occurs when a nursing home was out of compliance with 
federal requirements but corrected the problem prior to the most recent 
survey or complaint investigation. The new information will identify 
the specific deficiencies that gave rise to the past non-compliance. 

Through the Quality Improvement Organizations (QIOs) we have made a 
strong investment in providing technical assistance to help nursing 
homes improve their care. Beginning August 2005 all QIOs are charged 
with working with nursing homes to achieve progress in four areas: 
pressure sores, physical restraints, pain management, and depression. 
We also inaugurated a "Collaborative Focus Facility CFF" initiative in 
which state survey agencies refer (for QIO assistance) certain nursing 
homes judged to have significant and persistent quality challenges. 
Results from the first (pilot) year of the CFF are quite promising: the 
42 nursing homes agreeing to work with their QIO (in 18 states) 
successfully reduced their prevalence of pressure ulcers in high risk 
residents by almost 20%, reduced the use of daily restraints by 27%, 
and reduced the incidence of "serious survey deficiencies" (see 
paragraph below) by 24%. Building on the success of the pilot program, 
the CFF will be expanded with the new QIO 8th scope of work contract 
that began in August 2005. 

Percentage of Nursing Homes Nationwide with Serious Deficiencies, 
January 1999 through January 2005: 

[See PDF for image] 

[End of figure] 

Oversight and regulatory improvements documented in the GAO report have 
contributed to an improved quality picture for the nation's nursing 
homes. For example, Figure 1 in the GAO report shows a consistent 
decline in the percentage of nursing homes nationwide with serious 5.0 
deficiencies. [NOTE 1] 

NOTE: 

[1] "Serious deficiencies" in this context means deficiencies in which 
there is actual harm to one or more residents. The decrease occurred 
despite an increase in monitoring for fire-safety code violations. 

While noting the overall decrease in nursing home deficiencies 
nationwide, GAO expressed concern that state survey agencies sometimes 
understate the seriousness of deficiencies, or fail to cite them at 
all. We also remain concerned about possible understatement or omission 
of serious deficiencies by state survey agencies. But we do not believe 
that the trend of fewer deficiencies in nursing homes is due to this 
problem. That is, we do not believe that the understatement is 
worsening. 

In its report, the GAO seeks to address the question of whether state 
survey agencies are getting better or worse in identifying 
deficiencies. It does so by comparing CMS findings with state agency 
findings. CMS conducts two types of "validation surveys" to check on 
the accuracy of state surveys. The first, a "comparative" validation 
survey, involves a CMS survey team conducting a full survey within 60 
days after the state survey. The second type of validation survey is 
"observational." In an observational validation one or more federal 
surveyors accompany the state team. The federal surveyors observe both 
(a) conditions in the nursing home and (b) the state team's survey 
process. The two types of validation surveys offer different 
advantages, so CMS uses both. 

In the GAO analysis, the data are restricted to the "comparative 
validation" surveys. The comparatives represent 15-20% of the 
validation checks that CMS conducts to assess the adequacy of the state 
surveys. The remaining 80-85% are "observational validation surveys." 

Comparison of GAO and CMS Percentages of Federal Surveys with Serious 
Deficiencies' Not Identified in State Surveys: 

[See PDF for image] 

[End of figure] 

The graph on the right first shows the GAO data line (taken from Figure 
2 in the GAO report). It shows the percentage of deficiencies missed by 
state surveyors but identified by federal surveyors. The data line runs 
from 34% in 1999 and declines to 28% in 2004. While GAO acknowledges 
that there is a trend showing fewer deficiencies missed by state 
surveyors, GAO calls our attention to the increase between 2002 and 
2004. We believe the increase between 2002 and 2004 is an artifact of 
the limited data used. 

To investigate the trend when all the data are used, CMS added (to the 
GAO graph above) a second line showing the trend from 2002-2004 when 
both "comparative" and "observational" validation surveys are used. The 
second line shows that the percentage of serious deficiencies missed by 
state surveys (when we use all the data) is remaining relatively 
constant (moving from 23% to 24% from 2002-2004), rather than 
worsening. 

Some states are improving in their ability to identify deficiencies, 
while some other states are failing to improve. We are increasingly 
focused on those states whose performance is not up to par. In fact, 
for one of the five states selected by GAO as indicative of the 
problem, we withheld $1.6 million from the state's 2005 Medicare survey 
budget until an appropriate corrective action plan was developed. 
Future CMS actions will promote further resolution in those states that 
appear to be missing a significant number of deficiencies identified by 
federal surveyors. 

Consistency in how States conduct surveys is also being addressed 
through improved training for surveyors and the development of an 
improved survey process. The new "Quality Improvement Survey (QIS)" is 
being pilot-tested and evaluated in 2006. The system uses quality data 
to highlight, in advance, the areas in which there are more likely to 
be quality problems in a particular nursing home. The survey process is 
loaded onto a tablet personal computer to improve productivity and to 
augment the amount of information readily available to the surveyor on- 
site. The QIS offers a standardized approach designed to increase 
surveyor consistency and effectiveness. 

Adopting a Comprehensive Approach: 

A new, internal Long Term Care (LTC) Task Force was initiated in 
December 2004 to coordinate nursing home improvement efforts throughout 
CMS. It functions as a subcommittee to the Administrator's Quality. 
Council. The LTC Task Force published a 2005 Nursing Home Action Plan 
in December 2004. The Nursing Home Action Plan summarizes our 
comprehensive strategy and consists of 32 separate initiatives in four 
inter-related and coordinated approaches. It describes in detail CMS 
commitments to improving quality in nursing homes. A copy of the 
Nursing Home Action Plan can be found at 
http://www.cms.hhs.gov/qualityy/nhgi/NHActionPlan.pdf. The Action Plan 
organized CMS actions into four "pillars of progress:" 

Consumer Awareness and Action: Providing consumers and families with 
more information to enable them to use both the federal survey system 
and the power of the marketplace more effectively. Enhanced assurance 
that complaints will be investigated by federal or state surveyors, 
more information on the CMS website (NH Compare), development of 
enhanced public reporting on pressure ulcers, and the early stages of 
developing a staffing measure are examples. 

Standards, Survey and Certification: Additional quality standards 
(e.g., for fire safety), increased monitoring and follow-through by 
surveyors are examples. 

Technical Assistance: The new QIO contract, for example, augments the 
technical assistance being provided to nursing homes. 

Partnering: Quality is best assured when all parts and all actors in 
the health care system collaborate to fulfill the common goal. In 
particular, we greatly strengthened the coordination between state 
survey agencies and the QIOs. For example, when CMS strengthened the 
survey agencies' "Special Focus Facility (SFF)" effort, we inaugurated 
a companion "Collaborative Focus Facility (CFF) " initiative with the 
QIOs. In the "CFF" initiative, state survey agencies refer for QIO 
assistance certain nursing homes judged to have significant quality 
challenges. The success of this pilot has led to a national rollout in 
the latest contract with the QIOs. Each QIO will be required to work 
with a subset of these poor performing nursing homes as part of their 
contract. 

In 2006 we expect to pilot test, via a demonstration, an additional 
area of endeavor: making the payment system more sensitive to 
variations in quality. Known by various phrases (e.g., "value-based 
purchasing" or "pay for performance"), the theory is that we ought to 
use and coordinate all available means to carry forward the quality 
mandate. The payment system is an important leverage point by which 
quality may be promoted. The 2006 Nursing Home Action Plan is under 
development now. It will include a plan for value-based purchasing 
demonstration, making a total of five (5) "pillars of progress" in the 
Action Plan. 

While the progress from 1998-2005 documented by the GAO is comprised 
predominantly of improvements in the survey and certification process, 
we believe that future progress will require even more alignment of all 
parts of the health care system, and improvements in every aspect. 

Challenges: 

As the GAO noted, the total number of providers that participate in 
Medicare and/or Medicaid is increasing. This trend enlarges the overall 
survey and certification workload for both state and CMS regional 
offices. Providers subject to survey & certification include not only 
nursing homes, but hospitals, home health agencies, dialysis 
facilities, hospices, intermediate care facilities for the mentally 
retarded (ICFs-MR), ambulatory surgical centers, and others. This graph 
illustrates the total cumulative effect of increased numbers of all 
types of regulated providers. 

Medicare S&C Total Facilities FY 2000-2007: 

[See PDF for image] 

[End of figure] 

The combination of (a) more providers and (b) fewer resources poses a 
significant challenge that will exceed many of the issues upon which 
the GAO has focused in the past. 

We expect resources to be significantly constrained for some time. In 
2005, for example, Medicare funding appropriated by Congress for survey 
and certification was $11.7 million below the President's budget 
request. State budgets (for Medicaid surveys) remain very limited. And 
as the GAO well observed, state survey agencies continue to struggle 
from the effects of state hiring freezes and the difficulties in 
recruiting and retaining professional staff. 

These trends could likely cause some erosion of the gains already made, 
particularly the gains from increased survey frequency and the 45% 
increase in complaints investigated (2004 compared with 1999). As the 
GAO noted, we also recently increased CMS oversight of states through 
more comparative health surveys (which the GAO has recommended). The 
improvement was accomplished partly through a national contractor. As a 
result of the 2005 budget limitations, however, the contract that 
helped increase the number of nursing home comparative health surveys 
will no longer be supported. More states have resorted to bundling 
complaint investigations together so as to investigate multiple 
complaints in one visit. Such bundling will affect the timeliness of 
the complaint investigations, as well as the total number conducted. 
Implementation of the new "Quality Improvement Survey (QIS)" will be 
much slower than we desired due to the cost implications of new 
computers needed in most states, as well as the training challenge. 
Survey predictability will possibly increase since it is so directly 
connected with funding. The adequacy of surveyor training will be 
severely challenged. As we seek to preserve nursing home oversight 
within resource constraints, there will be some trade-offs to make with 
surveys for other types of regulated providers, such as hospitals, 
hospices, ambulatory surgical centers, dialysis facilities, and home 
health agencies. The frequency of surveys and complaint investigations 
for such non-long term care providers will likely decrease. 

To counteract some of these forces we are redoubling efforts to 
increase productivity. We will reexamine CMS policies with a determine 
the value added compared with the cost. We will enlarge the scope of 
the state performance standards and seek to focus as much as possible 
on substantive issues. We will continue to prioritize survey activities 
and coordinate with other actors in the health care system to promote 
the best possible outcomes. Fuel efficiency improvement must be another 
focal point. Survey agencies represent one of the larger transportation-
dependent agencies in state and federal governments. The recent 20-60% 
increase in the cost of fuel creates a diversion of resources away from 
other important functions. Increases in fuel economy, improved on-site 
transportation planning, and strategic investments will be vital. 

The future will require that we respond to new challenges as well as 
those previously identified. Enhanced emergency preparedness is one 
such imperative. Recent experiences from Hurricanes Katrina and Rita 
point to the need for more robust preparedness planning. Such planning 
must more effectively take into account the type of community-wide 
health care crisis that occurs when all major types of interdependent 
health care providers (e.g. hospitals, nursing homes, home health 
agencies) are all simultaneously and severely affected by a common 
cascade of adverse events. 

We greatly appreciate the comprehensive approach represented in this 
GAO report. Greater challenges ahead require a keen sense of priorities 
among the competing activities and enhancements that are theoretically 
possible while working within the available programmatic resources. 
Together with our own Nursing Home Action Plan posted on our website, 
the GAO report offers an excellent overview of many of the initiatives 
underway. 

[End of section] 

Appendix VI: GAO Contact and Staff Acknowledgments: 

GAO Contact: 

Kathryn G. Allen, (202) 512-7118 or allenk@gao.gov: 

Acknowledgments: 

In addition to the contact named above, Walter Ochinko, Assistant 
Director; Jack Brennan; Joanne Jee; Elizabeth T. Morrison; and Christal 
Stone made key contributions to this report. 

[End of section] 

Related GAO Products: 

Nursing Home Deaths: Arkansas Coroner Referrals Confirm Weaknesses in 
State and Federal Oversight of Quality of Care. GAO-05-78. Washington, 
D.C.: November 12, 2004. 

Nursing Home Fire Safety: Recent Fires Highlight Weaknesses in Federal 
Standards and Oversight. GAO-04-660. Washington D.C.: July 16, 2004. 

Nursing Home Quality: Prevalence of Serious Problems, While Declining, 
Reinforces Importance of Enhanced Oversight. GAO-03-561. Washington, 
D.C.: July 15, 2003. 

Nursing Homes: Public Reporting of Quality Indicators Has Merit, but 
National Implementation Is Premature. GAO-03-187. Washington, D.C.: 
October 31, 2002. 

Nursing Homes: Quality of Care More Related to Staffing than Spending. 
GAO-02-431R. Washington, D.C.: June 13, 2002. 

Nursing Homes: More Can Be Done to Protect Residents from Abuse. GAO- 
02-312. Washington, D.C.: March 1, 2002. 

Nursing Homes: Federal Efforts to Monitor Resident Assessment Data 
Should Complement State Activities. GAO-02-279. Washington, D.C.: 
February 15, 2002. 

Nursing Homes: Sustained Efforts Are Essential to Realize Potential of 
the Quality Initiatives. GAO/HEHS-00-197. Washington, D.C.: September 
28, 2000. 

Nursing Home Care: Enhanced HCFA Oversight of State Programs Would 
Better Ensure Quality. GAO/HEHS-00-6. Washington, D.C.: November 4, 
1999. 

Nursing Home Oversight: Industry Examples Do Not Demonstrate That 
Regulatory Actions Were Unreasonable. GAO/HEHS-99-154R. Washington, 
D.C.: August 13, 1999. 

Nursing Homes: Proposal to Enhance Oversight of Poorly Performing Homes 
Has Merit. GAO/HEHS-99-157. Washington, D.C.: June 30, 1999. 

Nursing Homes: Complaint Investigation Processes Often Inadequate to 
Protect Residents. GAO/HEHS-99-80. Washington, D.C.: March 22, 1999. 

Nursing Homes: Additional Steps Needed to Strengthen Enforcement of 
Federal Quality Standards. GAO/HEHS-99-46. Washington, D.C.: March 18, 
1999. 

California Nursing Homes: Care Problems Persist Despite Federal and 
State Oversight. GAO/HEHS-98-202. Washington, D.C.: July 27, 1998. 

FOOTNOTES 

[1] Medicare is the federal health care program for elderly and 
disabled people. In addition to other health and long-term care 
services, Medicare covers up to 100 days of nursing home care following 
a hospital stay. Medicaid is the joint federal-state health care 
financing program for certain categories of low-income individuals. 
Medicaid also pays for long-term care services, including nursing home 
care. Data for 2003 are the most recent data available. 

[2] See Related GAO Products at the end of this report. 

[3] Prior to July 2001, CMS was known as the Health Care Financing 
Administration. Throughout this report, we refer to the agency as CMS, 
even when describing initiatives taken prior to its name change. 

[4] http://www.medicare.gov/NHCompare/home.asp. 

[5] In this report, we use the term "states" to include the 50 states 
and the District of Columbia. 

[6] In addition to nursing homes, CMS and state survey agencies are 
responsible for oversight of other Medicare and Medicaid providers such 
as home health agencies, intermediate care facilities for the mentally 
retarded, accredited and nonaccredited hospitals, end-stage renal 
dialysis facilities, ambulatory surgical centers, rural health clinics, 
outpatient physical therapy centers, hospices, portable x-ray 
suppliers, comprehensive outpatient rehabilitation facilities, and 
Community Mental Health Centers. 

[7] CMS generally interprets these requirements to permit a statewide 
average interval of 12.9 months and a maximum interval of 15.9 months 
for each home. 

[8] CMS requires nursing homes to meet applicable provisions of the 
fire safety standards developed by the National Fire Protection 
Association (NFPA), of which CMS is a member. NFPA is a nonprofit 
membership organization that develops and advocates scientifically 
based consensus standards on fire, building, and electrical safety. 

[9] In the time period prior to CMS's implementation of its quality 
initiatives (January 1, 1997, through June 30, 1998), the proportion of 
homes nationwide with actual harm or higher-level deficiencies was 27.7 
percent. However, this report focuses on trend data following CMS's 
July 1998 announcement of the initiatives. In our September 2000 report 
on CMS's quality initiatives, we compared trends in nursing home 
deficiency citations for two time periods--one before (January 1, 1997, 
through June 30, 1998) and one after (January 1, 1999, through July 10, 
2000) the implementation of the nursing home initiatives. Since our 
2000 report, we have updated this trend analysis for three time 
periods: July 11, 2000, through January 31, 2002; February 1, 2002, 
through July 10, 2003; and July 11, 2003, through January 31, 2005. 

[10] For example, a deficiency noted in a federal survey could involve 
a resident who was not in the nursing home at the time of the state 
survey but was admitted between the state and the federal surveys. 

[11] The decline in serious deficiencies ranged from a low of 14.3 
percentage points in Texas to a high of 23 percentage points in 
California and New York (see app. II). 

[12] CMS has independently identified shortcomings in areas such as 
survey processes and consumer information and has developed initiatives 
to address these problems. 

[13] Under contract with CMS, 39 Quality Improvement Organizations 
(QIO) (formerly known as Peer Review Organizations) help to ensure the 
quality of care delivered to Medicare beneficiaries in each state. 
Prior to 2002, QIO's work focused on care delivered in acute care 
settings such as hospitals. 

[14] Quality indicators, the result of a CMS-funded contract, are based 
on nursing home resident assessment information--MDS--which is data on 
each resident that homes are required to report periodically to CMS. 
Quality indicators are derived from nursing homes' assessments of 
residents and are used to rank a facility in 24 areas compared with 
other nursing homes in the state. 

[15] On-site sources include observations, interviews, and records 
review. An example of an off-site data source is the MDS. 

[16] The pilot states are California, Connecticut, Kansas, Louisiana, 
and Ohio. 

[17] Prior to this contract, surveyor protocols were developed by CMS, 
with comments from stakeholder groups, but the development process did 
not include an expert panel. 

[18] Investigative protocols are being developed for accidents and 
supervision, quality assurance, resident activities programs, 
psychosocial severity, safe food handling/nutrition, pharmacy 
services/unnecessary drugs, and end-of-life/pain management issues. 

[19] For example, a CMS official informed us that the language, 
"limited consequences to the resident," which is used in the current 
definition of actual harm, confused states because it was vague and 
that states formed their own interpretations of the language. The draft 
revised definition eliminates this language. 

[20] CMS disagreed with a portion of our predictability recommendation 
that suggested segmenting the standard survey into more than one review 
to provide more opportunities for surveyors to observe problematic 
homes. CMS disagreed because of concerns that segmenting the survey 
would reduce the effectiveness and increase the cost of surveys. 

[21] CMS instructed the states to avoid, if possible, scheduling a 
home's survey for the same month as the one in which the home's 
previous standard survey was conducted. 

[22] According to CMS, states consider 9 months to 15 months from the 
last standard survey as the window for completing standard surveys 
because it yields a 12-month average. CMS and states acknowledged that 
states sometimes fall behind in conducting surveys and homes are not 
surveyed until near or after the 15-month time frame. Thus, to maintain 
an average survey interval of 12 months, more surveys would need to 
occur within 9 months of the last standard survey. 

[23] ASPEN stands for the Automated Survey Processing Environment. 
ASPEN is used by CMS central office, regional offices, and state survey 
agencies for tracking surveys and survey findings. ASPEN comprises 
multiple modules such as the ASPEN Enforcement Manager and the ASPEN 
Complaints and Incidents Tracking System. 

[24] Prior to this new requirement, federal guidelines required only 
that complaints alleging immediate jeopardy to residents be 
investigated within 2 workdays. For all other complaints, states could 
establish their own investigative time frame. 

[25] MFCUs have authority to investigate the physical and sexual abuse 
of nursing home residents, in addition to investigating fraud and abuse 
in the Medicaid program. Typically, MFCUs are an investigative 
component of the state's Office of the Attorney General but may be 
located in other agencies, such as the state police, instead. Forty- 
eight states have a MFCU. 

[26] In 2002, CMS informed us that the posters were developed, but have 
not yet been printed or distributed. According to a CMS official, the 
agency's focus on higher-priority activities has contributed to the 
delay. 

[27] Results for 2005 were not available at the time we conducted our 
work for this report. 

[28] We did not evaluate the effectiveness of the complaint tracking 
system. 

[29] CMS requires state survey agencies to investigate allegations of 
nursing home resident abuse, which can be submitted by residents, 
family members, friends, physicians, and nursing home staff, within 2 
days of learning of the allegation, but does not impose a deadline for 
completing the investigation. After the state survey agency has made an 
initial determination, the nurse aide may request an appeal within 30 
days. Hearings may not be held for several months, and decisions are 
not always immediate. 

[30] The Background Check Pilot Program was mandated by Section 307 of 
the Medicare Prescription Drug, Improvement, and Modernization Act of 
2003 (Pub. L. No. 108-173, 117 Stat. 2066, 2257.) CMS issued grant 
solicitation letters to states in July 2004 and made grants in January 
2005. 

[31] States are now required to deny a grace period to homes that are 
assessed one or more deficiencies at the actual harm level or above (G 
through L on CMS's scope and severity grid) in each of two successive 
surveys within a survey cycle. A survey cycle is two successive 
standard surveys and any intervening survey, such as a complaint 
investigation. 

[32] Substandard quality of care is defined as deficiencies cited at 
the F level of scope and severity in certain care areas--quality of 
life, quality of care, and resident behavior and facility practices. 

[33] Before readmitting a terminated nursing home to Medicare, CMS 
requires the home to address the situation that led to termination and 
provide reasonable assurance that it will not recur. To give this 
assurance, a home is required to have two surveys not more than 6 
months apart, each of which shows the problem to be corrected. The 
reasonable assurance period is the time between these two surveys. 

[34] From 2000 to 2004, CMS used a nationwide summary of the 10 
regional office enforcement databases known as the Long Term Care 
Enforcement Tracking System. 

[35] We did not evaluate the performance of the ASPEN Enforcement 
Manager for this report. 

[36] In the Special Focus Facility Program, state survey agencies 
conduct enhanced monitoring of nursing homes with histories of 
providing poor care. 

[37] The revised special focus facility selection methodology addressed 
criticisms about the original state selection process from state survey 
agencies, including that the process did not account for state size or 
number of nursing homes, and used insufficient performance data in 
selecting homes. Alaska is not required to select special focus 
facilities. 

[38] CMS's guidance to states describes the factors to be considered 
when determining the amount of a civil money penalty. 

[39] The assumption is that the nursing home identified and corrected 
this earlier care problem. 

[40] CMS is statutorily required to conduct federal monitoring surveys 
in at least 5 percent of the surveyed nursing homes in each state each 
year, with a minimum of 5 facilities in each state. As of January 2005, 
there were 16,146 nursing homes, which would require 807 federal 
monitoring surveys. Until 1992, all federal monitoring surveys were 
comparative. In part because comparative surveys were resource 
intensive, CMS began to rely more heavily on observational surveys, 
which require a smaller number of federal surveyors. 

[41] During fiscal years 1999 and 2000, CMS required a minimum of one 
comparative survey to be completed yearly in the 20 states having fewer 
than 200 nursing homes, two in the 24 states that had from 200 to 599 
homes, and three in the 7 states that had 600 or more homes. 

[42] Since fiscal year 2001, CMS has expanded the scope of state 
performance reviews to include seven additional Medicare and Medicaid 
providers, such as hospitals and renal dialysis facilities, in addition 
to nursing homes. 

[43] The 11 elements are (1) the citation has the full regulatory 
reference; (2) evidence supports determination of noncompliance at the 
cited regulation; (3) each deficient practice statement clearly 
summarizes the provider/supplier failure(s) and quantifies a relevant 
extent; (4) the scope accurately reflects the evidence and the 
residents who are, or may be, affected by the deficient practice; (5) 
the severity rating in nursing homes or the condition, standard, or 
element level cited reflects the evidence and the actual and/or 
potential outcomes to beneficiaries; (6) each person referred to is 
uniquely identified; (7) the observations, interviews, and record 
reviews support the deficient practice statement and illustrate the 
entity's noncompliance; (8) descriptions of observation of 
provider/supplier practice include date, time, duration, and location; 
(9) descriptions of interviews include dates and times and who was 
interviewed; (10) record review includes date of entry and exact title 
of record, and verifies lack of additional records with a knowledgeable 
person; and (11) evidence is written in plain language that is clear, 
concise, and easily understood. 

[44] CMS was unable to score the standard in fiscal year 2001 because 
the standard was too complicated. The standard consisted of 33 elements 
in fiscal year 2001 but was reduced to 7 elements for the subsequent 2 
fiscal years. In fiscal year 2004, the number of elements was increased 
to 11. 

[45] Examples include reports on pending nursing home terminations 
(weekly), data entry timeliness (quarterly), tallies of state surveys 
that find homes deficiency-free (semiannually), and analyses of the 
most frequently cited deficiencies by states (annually). 

[46] The MDS, which is prepared periodically for each nursing home 
resident, contributes to multiple functions, including establishing 
patient care plans, assisting with quality oversight, and setting 
nursing home payments that account for variation in resident care 
needs. 

[47] This limited on-site presence was also inconsistent with a 
recommendation in a 2001 report CMS commissioned regarding the benefits 
of on-site reviews in detecting MDS accuracy problems and with the view 
of 9 of the 10 states with separate MDS review programs that an on-site 
presence at a significant number of their nursing homes is central to 
their review efforts. 

[48] Such a shift in focus would include (1) taking full advantage of 
the periodic on-site visits already conducted at every nursing home 
nationwide through its routine survey process; (2) ensuring that the 
federal MDS review process is designed and sufficient to consistently 
assess the performance of all states' reviews for MDS accuracy; and (3) 
providing additional guidance, training, and other technical assistance 
to states as needed to facilitate their efforts. 

[49] Although the focus of the prior data assessment and verification 
contract was MDS accuracy reviews, the contract also included an 
examination of issues of interest to other CMS components that 
sponsored the contract. For example, the contractor examined facility 
assessment data on Medicare beneficiaries who received home health 
services. 

[50] While on-site, the contractor had access to a broader range of 
information gleaned from observation, interviews with residents and 
staff, and reassessments of residents. During the 3-1/2 years of the 
data assessment and verification contract, 69 on-site reviews were 
completed, less than the 200 anticipated in 2001 and less than the 
revised goal of 100 on-site reviews. According to the contractor's 
report, the highest discrepancy rates identified during the 69 on-site 
reviews of 617 assessments included the number of medications (50 
percent discrepancy rate) and pain management (10 percent discrepancy 
rate). 

[51] The November 2002 roll-out of quality indicator data included a 
combined total of 10 chronic care and post-acute-care quality 
indicators. Chronic care quality indicators included decline in 
activities of daily living, pressure sores (with facility-level 
adjustment), pressure sores (without facility-level adjustment), 
inadequate pain management, physical restraints used daily, and 
infections. Post-acute-care quality indicators included failure to 
improve and manage delirium (with facility-level adjustment), failure 
to improve and manage delirium (without facility-level adjustment), 
inadequate pain management, improvement in walking, and 
rehospitalizations. 

[52] The National Quality Forum is a nonprofit organization created to 
develop and implement a national strategy for health care quality 
measurement and reporting. It has broad participation from government 
and private entities as well as all sectors of the health care 
industry. 

[53] The Web site reports the nursing staff hours per resident per day 
and certified nurse aides per resident per day. 

[54] The National Quality Forum has discussed expanding staffing data 
to include these and other issues such as use of nonnursing staff to 
provide care, use of part-time and contract nurses, and the tenure of 
the director of nursing and the administrator. 

[55] In smaller states, QIOs worked with at least 10 nursing homes. 

[56] An evaluation of the pilot program reported on the results of the 
pilot program; however, the evaluation was conducted by the same QIO 
responsible for facilitating the pilot program. 

[57] Best practices have been collected from organizations including 
the American Medical Directors Association, University of Iowa 
Geriatric Nursing Center, Association of Rehabilitation Nurses, 
American Diabetes Association, National Kidney and Urologic Diseases 
Information Clearinghouse, Feinberg School of Medicine (Northwestern 
University), American Academy of Neurology, American Society of 
Consultant Pharmacists, United Ostomy Association, and the Centers for 
Disease Control and Prevention. 

[58] To update federal fire safety standards, CMS issues notice and 
solicits comments on the proposed new standards in the Federal 
Register, reviews public comments, and publishes a final version of the 
standards with an effective date. This process of adopting NFPA's 2000 
standards in 2003 took CMS about 16 months. 

[59] After the 2003 nursing home fire in Hartford, Connecticut, the 
state passed a law requiring all nursing homes to install sprinklers 
not later than July 1, 2005 (Conn. Spec. Acts 03-3, §92.) In 2005, the 
state extended the effective date to July 31, 2006 (Conn. Pub. Acts 05- 
187.) Florida enacted a law in June 2005 that requires nursing homes in 
the state to be protected with automatic sprinklers by December 31, 
2010. A loan guarantee program would be available in Florida because of 
concern about the cost impact of retrofitting on homes (Fla. Laws Ch. 
2005-234). 

[60] This includes about 1 percent of homes whose sprinkler status is 
unknown. 

[61] According to CMS and state officials, the first year for a new 
surveyor is essentially a training period with low productivity. It 
takes as long as 3 years for a surveyor to gain sufficient knowledge, 
experience, and confidence to perform the job well. 

[62] As a result of the recession that began in 2001, states 
experienced growing budget pressures and experienced significant budget 
shortfalls from fiscal years 2003 through 2005. Although budget 
pressures diminished at the end of fiscal year 2004, many states 
projected budget shortfalls in fiscal year 2005. 

[63] The Medicare Prescription Drug, Improvement, and Modernization Act 
of 2003 created the new Medicare prescription drug benefit, which will 
offer Medicare beneficiaries outpatient prescription drug coverage 
(Pub. L. No. 108-173, §101, 117 Stat. 2066, 2071-2152 (adding §§ 1860D- 
1-1860D-42 to the Social Security Act, codified at 42 U.S.C. §§ 1395w- 
101-1395w-152)). On January 28, 2005, CMS issued the final regulations 
implementing the Medicare prescription drug benefit. 

[64] This increase includes a substantial increase in the number of end-
stage renal disease facilities and ambulatory surgical centers. 

[65] The federal government funds 100 percent of costs associated with 
certifying that nursing homes meet Medicare requirements and 75 percent 
of the costs associated with Medicaid standards. 

[66] The time frames for home health agency surveys are also 
established by statute. 

[67] CMS has identified four priority tiers for ranking state workload. 
CMS's guidance to states for formulating budgets puts standard surveys 
in Tier I, the highest tier, and puts complaints and initial surveys in 
Tiers II and III, respectively. 

[68] As stated earlier, CMS set aside some fiscal year 2006 funds for 
conducting fire safety comparative surveys. 

GAO's Mission: 

The Government Accountability Office, the investigative arm of 
Congress, exists to support Congress in meeting its constitutional 
responsibilities and to help improve the performance and accountability 
of the federal government for the American people. GAO examines the use 
of public funds; evaluates federal programs and policies; and provides 
analyses, recommendations, and other assistance to help Congress make 
informed oversight, policy, and funding decisions. GAO's commitment to 
good government is reflected in its core values of accountability, 
integrity, and reliability. 

Obtaining Copies of GAO Reports and Testimony: 

The fastest and easiest way to obtain copies of GAO documents at no 
cost is through the Internet. GAO's Web site (www.gao.gov ) contains 
abstracts and full-text files of current reports and testimony and an 
expanding archive of older products. The Web site features a search 
engine to help you locate documents using key words and phrases. You 
can print these documents in their entirety, including charts and other 
graphics. 

Each day, GAO issues a list of newly released reports, testimony, and 
correspondence. GAO posts this list, known as "Today's Reports," on its 
Web site daily. The list contains links to the full-text document 
files. To have GAO e-mail this list to you every afternoon, go to 
www.gao.gov and select "Subscribe to e-mail alerts" under the "Order 
GAO Products" heading. 

Order by Mail or Phone: 

The first copy of each printed report is free. Additional copies are $2 
each. A check or money order should be made out to the Superintendent 
of Documents. GAO also accepts VISA and Mastercard. Orders for 100 or 
more copies mailed to a single address are discounted 25 percent. 
Orders should be sent to: 

U.S. Government Accountability Office 

441 G Street NW, Room LM 

Washington, D.C. 20548: 

To order by Phone: 

Voice: (202) 512-6000: 

TDD: (202) 512-2537: 

Fax: (202) 512-6061: 

To Report Fraud, Waste, and Abuse in Federal Programs: 

Contact: 

Web site: www.gao.gov/fraudnet/fraudnet.htm 

E-mail: fraudnet@gao.gov 

Automated answering system: (800) 424-5454 or (202) 512-7470: 

Public Affairs: 

Jeff Nelligan, managing director, 

NelliganJ@gao.gov 

(202) 512-4800 

U.S. Government Accountability Office, 

441 G Street NW, Room 7149 

Washington, D.C. 20548: