Federal Statistical System: Agencies Can Make Greater Use of Existing Data, but Continued Progress Is Needed on Access and Quality Issues
Highlights
What GAO Found
The Office of Management and Budget (OMB), agencies, and interagency statistical committees have distinct roles in identifying opportunities to improve federal information collection efforts. OMB exercises several authorities that promote the system’s efficiency, including overseeing and approving agency information collections. The website Reginfo.gov provides the public with information, such as cost and burden, on collections that OMB reviews, though GAO’s review identified some discrepancies in selected items. OMB periodically issues guidance to agencies on complying with federal requirements for information collections, but this guidance generally does not prescribe specific actions to take. GAO’s analysis of agencies’ documentation of active surveys indicated that 77 percent included detailed descriptions of efforts to identify duplication, while those that did not tended to be for collections that are unlikely to duplicate existing information; and 75 percent reported actions beyond those required by statute to solicit external input. OMB, through enhanced guidance, could promote additional awareness of options agencies can take to identify duplication and solicit input. Interagency committees, which primarily draw members from the 13 agencies that have statistics as their primary focus, are particularly important in helping ensure collaboration. The committees have numerous projects underway aimed at addressing key challenges facing the statistical system. However, mechanisms for disseminating information about their work are not comprehensive or up-to-date. Though member agencies are the most-likely customers of the committees’ products, making information about committee work and priorities more accessible could benefit other agencies, academics, and the general public. It could also benefit committee members by providing a central repository for information.
Administrative data have greater potential to supplement rather than replace survey data. Agencies currently combine the two data sources in four key ways to cost-effectively increase efficiency and quality. Specifically, agencies use administrative data to: (1) link to survey data to create new data products; (2) supplement surveys’ sample frames; (3) compare to survey data to improve accuracy and design of surveys; and (4) combine with survey data to create, or model, estimates. However, expanding the use of administrative data faces key constraints related to the access and quality of the data. While agencies and committees are taking steps to address these constraints and facilitate the process through which agencies work together to share data, individual tools may not be sufficient. A more-comprehensive framework for use by all agencies involved in data-sharing decisions that includes key questions to consider when evaluating potential use of administrative data could make the decision process more consistent and transparent.
ACS, an ongoing monthly survey that provides information about the nation’s communities, offers agencies important opportunities to increase the efficiency and reduce the costs of their surveys, but its current design limits the extent to which agencies can utilize some of these opportunities. Uses that do not affect ACS design or the survey’s respondents, such as using ACS estimates to inform survey design or evaluate other surveys’ results, have widespread potential. However, more-intensive uses, such as adding content or supplemental surveys to the ACS, currently have limited potential.
Why GAO Did This Study
As demand for more and better information increases, rising costs and other challenges require that the federal statistical system identify efficiencies. To explore opportunities to improve cost-effectiveness, GAO was asked to (1) review how the Office of Management and Budget (OMB) and agencies improve information collections, (2) evaluate opportunities and constraints for agencies to use administrative data (information collected as part of the administration of a program or held by private companies) with surveys, and (3) assess the benefits and constraints of surveys making greater use of the Census Bureau’s American Community Survey (ACS) data and resources. GAO focused on collections administered to households and individuals, analyzed statutory and agency documents, did five case studies of surveys, reviewed documentation of representative samples of active surveys, and interviewed agency officials and experts.
Recommendations
GAO recommends that OMB take several actions to improve the broader efficiency of the federal statistical system, including implementing additional quality-control procedures for selected website data, enhancing awareness of ways to meet information collection requirements, better disseminating information on interagency committees, and developing comprehensive guidance for agencies to use when considering data sharing. OMB generally agreed with all of GAO’s recommendations.
Recommendations for Executive Action
Agency Affected | Recommendation | Status |
---|---|---|
Office of Management and Budget | In order to maintain progress in maximizing the efficiency of existing data sources, and to improve the broader efficiency of the federal statistical system and improve communication among agencies and others, the Director of OMB, in consultation with the Chief Statistician, should work with the ICSP, when OMB next updates guidance on agency survey and statistical information collection and dissemination methods, to include additional details on actions agencies can take to meet requirements to identify duplication, to consult with persons outside of the agency, and address other requirements as appropriate. |
OMB agreed with this recommendation and reported that the Interagency Council on Statistical Policy was developing plans to establish a website that would support agency Statistical Officials, a position required in the Evidence-Based Policymaking Act of 2018, and that the website would help to address this recommendation. As of July 2024, the website has not yet been established.
|
Office of Management and Budget | In order to maintain progress in maximizing the efficiency of existing data sources, and to improve the broader efficiency of the federal statistical system and improve communication among agencies and others, the Director of OMB, in consultation with the Chief Statistician, should work with the ICSP to create new methods or enhance existing methods to improve the dissemination of information and resources produced by interagency statistical committees. For example, such enhancements could include increasing the timeliness and availability of information on websites to better capture the full range of products and identify committee priorities. |
In September 2020, the Federal Committee on Statistical Methodology published "A Framework for Data Quality," which OMB staff had earlier stated would address this recommendation. The framework provides a common foundation upon which federal agencies can make decisions about the management of data products, which will increase efficiency and usefulness of federal data collection by facilitating data dissemination and use.
|
Office of Management and Budget | In order to maintain progress in maximizing the efficiency of existing data sources, and to increase the reliability of the information presented on the Reginfo.gov website and in OMB's internal system, the Director of OMB, in consultation with the Chief Statistician, should work with the ICSP to implement quality-control procedures designed to identify and remedy any differences between cost and burden information provided on the website and in the related supporting statement documentation that underlies this information. |
As of July 2024 OMB has not taken action to implement this recommendation. OMB noted that because it publishes cost and burden information in Federal Register notices, PRA statements, and on RegInfo.gov, the public is able to identify discrepancies and bring them to OMB's attention. We continue to believe that the responsibility for identifying these discrepancies should belong to OMB and not the public.
|
Office of Management and Budget | In order to maintain progress in maximizing the efficiency of existing data sources, and to accelerate progress in sharing administrative data for statistical purposes, where appropriate, the Director of OMB, in consultation with the Chief Statistician, should work with the ICSP to develop comprehensive guidance for both statistical agencies and agencies that hold administrative data to use when evaluating and negotiating data sharing, such guidance should include key questions focused on issues such as statutory authority, confidentiality, cost, and usefulness in order to ensure agencies consider all relevant factors and the broader interest of the federal government. |
OMB concurred with our recommendation. In response, in February 2014 the OMB Director issued Memorandum M-14-06, Guidance for Providing and Using Administrative Data for Statistical Purposes, which implements the recommendation. To encourage the greater use of administrative data for statistical purposes, M-14-06 provides agencies with guidance for addressing the legal, policy, and operational issues that exist with respect to using administrative data for statistical purposes.
|