Skip to main content

Workplace Safety and Health: Further Steps by OSHA Would Enhance Monitoring of Enforcement and Effectiveness

GAO-13-61 Published: Jan 24, 2013. Publicly Released: Feb 25, 2013.
Jump To:
Skip to Highlights

Highlights

What GAO Found

The Department of Labor's Occupational Safety and Health Administration (OSHA) provides more frequent monitoring and more consistent guidance for its federal enforcement activities than for state enforcement activities. More specifically, OSHA regional officials review performance reports on federal activities at least every other week but review reports on state-run program activities quarterly. In addition, OSHA's guidance for audits of its regional and area offices is more consistent than the guidance for its audits of state-run programs. Guidance for audits of its offices requires that regional offices conduct a comprehensive audit with on-site review of inspection case files at least once every 4 years and other audits focused on more specific activities in all other years. In contrast, guidance for regional office audits of state-run programs changes from year to year and does not include a regular schedule for comprehensive audits with on-site case file reviews. While the frequency of OSHA's monitoring of state-run programs is necessarily different because of the independent enforcement authority of participating states, OSHA's lack of consistent guidance for audits of these state-run programs may allow enforcement deficiencies to go undetected, increasing the risk of worker injuries, illnesses, or death. In addition, there is little participation by OSHA's national office in comprehensive audits of its regional offices despite a 2010 directive to do so. As a result, OSHA cannot ensure that the results of regional audits are impartial.

OSHA is taking steps to better assess the effectiveness of both its federal enforcement efforts and of state enforcement efforts, but it is often not clear how these steps will help OSHA demonstrate what efforts result in better outcomes for workers, such as reduced worker injuries, illnesses, and fatalities. For example, OSHA recently revised some of the measures it uses to assess staterun programs by adding acceptable ranges of performance. However, the revised measures still largely focus on outputs--such as the average number of violations per inspection--rather than outcomes. OSHA is also conducting studies to examine the results of specific enforcement activities, including one designed, in part, to evaluate the effect of OSHA providing additional educational support to employers. While tracking progress in meeting performance goals-- such as the annual number of conducted inspections--is useful, the lack of focus on outcomes makes it difficult for OSHA to determine which specific enforcement activities are most effective or to convince states to implement changes designed to improve outcomes. For example, only two state-run programs raised their penalty amounts in fiscal year 2011 as recommended by OSHA; state-run program representatives stated that OSHA lacked evidence to show that higher penalties are more effective in deterring future employer violations. OSHA also does not use data already in hand to assess the effectiveness of federal and state enforcement efforts. For example, OSHA does not use data from its annual audits of its regional and area offices or of state-run programs to inform its planning or share information across regions. Additionally, OSHA annually collects data on activities conducted under emphasis programs that focus on national safety and health issues, but it does not evaluate these data to determine whether these programs are responsible for desired outcomes.

Why GAO Did This Study

OSHA is responsible for overseeing occupational safety and health for more than 130 million workers. In about half the states, OSHA sets and enforces compliance with safety and health standards. The remaining states set and enforce their own standards under OSHA-approved plans. In fiscal year 2010, OSHA strengthened its monitoring of staterun programs following a dozen worker deaths in one of those states. Questions have since been raised about how closely OSHA monitors its own enforcement efforts. GAO examined 1) how OSHA's monitoring of its own and state enforcement efforts compares, and 2) recent steps OSHA has taken to evaluate the effectiveness of federal and state enforcement efforts. GAO reviewed OSHA's monitoring policies and procedures and relevant federal laws and regulations; analyzed federal and state audits; visited three OSHA regional offices; and interviewed OSHA officials and other experts.

Recommendations

GAO recommends that OSHA standardize guidance for its audit practices, include outcomes in its assessments of its enforcement initiatives, better use data from its audits, and ensure national office participation in audits. OSHA generally agreed with the recommendations but expressed concern about overuse of outcomes to assess effectiveness. GAO continues to believe the recommendations are valid as discussed later in the report.

Recommendations for Executive Action

Agency Affected Recommendation Status
Department of Labor In order to improve OSHA's assessments of its effectiveness and its monitoring of federal and state enforcement efforts, the Secretary of Labor should direct the Assistant Secretary of Labor for Occupational Safety and Health to consistently incorporate outcomes in its assessments of enforcement activities.
Closed – Not Implemented
The Department of Labor's Occupational Safety and Health Administration (DOL/OSHA) has worked with the DOL's Office of the Assistant Secretary for Policy on a study to measure recidivism rates of business establishments that have been inspected by OSHA. The study evaluated the effectiveness of its site specific targeting program through outcome measures. The final report was released in May 2016 and found no statistically significant impacts from the program. There may or may not be impacts that were smaller than the estimated confidence intervals used by the study. OSHA plans to proceed with additional evaluations of its programs and use evidence gathered from outside evaluations that provide evidence that OSHA's enforcement activities result in lower injury rates and a lower number of injury claims and/or lost workdays. However, as of September 2017, OSHA has not incorporated the outcomes identified from these or other studies into its assessments of federal and state enforcement activities on a consistent basis.
Department of Labor In order to improve OSHA's assessments of its effectiveness and its monitoring of federal and state enforcement efforts, the Secretary of Labor should direct the Assistant Secretary of Labor for Occupational Safety and Health to annually analyze the results of its Management Accountability Program (MAP) and Federal Annual Monitoring and Evaluation (FAME) audits to identify and address systemic problems and leading practices.
Closed – Implemented
In fiscal year 2013, OSHA implemented new processes to track and analyze the results of its Management Accountability Program (MAP) audits and provide an annual management report on audit findings and recommendations to OSHA senior managers and executives. In March 2015, OSHA created the Office of Audit (OOA), which will evaluate and look to strengthen MAP audit processes for tracking, analyzing, and communicating audit information to enhance agency programs and operations. OSHA also plans to continue analyzing input from the Federal Annual Monitoring and Evaluation (FAME) reports and its revised State Plan Policies and Procedures Manual (SP3M) effective September 2015, which formally incorporates a case file review database within the FAME process. Effective April 2016, OSHA implemented a new process to track, review, and analyze MAP audit reports.
Department of Labor In order to improve OSHA's assessments of its effectiveness and its monitoring of federal and state enforcement efforts, the Secretary of Labor should direct the Assistant Secretary of Labor for Occupational Safety and Health to ensure that OSHA national staff participate in regional office comprehensive audits to enhance independence in accordance with OSHA's MAP 2010 directive.
Closed – Implemented
In December 2013, national office staff from OSHA's Directorate of Evaluation and Analysis (DEA) led an audit of the Dallas and Philadelphia regional offices. DEA staff participated in audits of both locations. OSHA also plans for national office staff to lead an audit of the Kansas City Regional Office.
Department of Labor In order to improve OSHA's assessments of its effectiveness and its monitoring of federal and state enforcement efforts, the Secretary of Labor should direct the Assistant Secretary of Labor for Occupational Safety and Health to provide consistent guidance for scheduling state Enhanced Federal Annual Monitoring and Evaluation (EFAME) audits to ensure that they are conducted on a regular basis and include mandatory on-site case file reviews.
Closed – Implemented
OSHA revised its State Plan Policies and Procedures Manual (SP3M) effective September 2015. The updated manual establishes a biennial Federal Annual Monitoring and Evaluation (FAME) schedule that includes mandatory case file review every other year.

Full Report

GAO Contacts

Topics

Auditing standardsInspectionMonitoringOccupational health and safety programsOccupational safetyPerformance managementPerformance measuresSafety regulationSafety standardsState programsOccupational health standardsData collection