2010 Census: Data Collection Operations Were Generally Completed as Planned, but Long-standing Challenges Suggest Need for Fundamental Reforms
Highlights
Although the U.S. Census Bureau (Bureau) generally completed the field data collection phase of the 2010 Census consistent with its operational plans, at $13 billion, 2010 was the costliest census in the nation's history. Moving forward, it will be important to both refine existing operations as well as to reexamine the fundamental approach to the census to better address long-standing issues such as securing participation and escalating costs. As requested, this report reviews (1) the conduct of nonresponse follow-up (NRFU), where enumerators collect data from households that did not return their census forms, (2) the implementation of other field operations critical to a complete count, and (3) potential reexamination areas that could help produce a more cost-effective 2020 Census. The report is based on GAO's analysis of Bureau data and documents, surveys of local census office managers, and field observations.
Nationally, the Bureau was well positioned to implement NRFU and subsequent field operations. The Bureau achieved a mail response rate of 63 percent, which was within its expectations, and recruited nearly 3.8 million total applicants for census jobs, which was 104 percent of its staffing goal. Moreover, the Bureau completed NRFU under budget, reportedly spending $1.59 billion on the operation, about $660 million (29 percent) less than the Bureau initially estimated. Most of the Bureau's local census offices (LCO) also completed NRFU ahead of the 10-week allotted time frame. Despite these operational successes, the Bureau encountered some notable challenges. For example, the pace of NRFU may have fostered a culture that tended to emphasize speed over quality, as those LCOs with higher percentages of less-complete questionnaires were more likely to have completed NRFU in 53 days or less (the average time LCOs took to complete NRFU). The Bureau also had to overcome issues with critical information technology (IT) systems. For example, performance problems with the IT system used to manage NRFU led to processing backlogs. Although the Bureau developed workarounds for the issue, it hindered the Bureau's ability to fully implement quality-assurance procedures as planned. The Bureau generally completed other follow-up operations designed to improve the accuracy of the data consistent with its plans. One of these activities was the vacant/delete check (VDC), where enumerators verified housing units thought to be vacant or nonexistent. The Bureau completed VDC two days ahead of schedule, but encountered duplicate addresses on the address list used for the operation, which could indicate a more systemic problem with the quality of the Bureau's address list. While it will be important to refine existing census-taking activities--many of which have been in place since 1970--results of prior censuses point to the fact that simply improving current methods will not bring about the reforms needed to control costs and maintain accuracy. The cost of conducting the census has, on average, doubled each decade since 1970. At the same time, because of demographic and attitudinal trends, securing a complete count has become an increasing challenge. As a result, a fundamental reexamination of the nation's approach to the census will be needed for a more cost-effective enumeration in 2020. Potential focus areas include new data collection methods; the tenure of the Census Director; and ensuring the Bureau's approaches to human-capital management, knowledge sharing, and other internal functions are aligned toward delivering more cost-effective outcomes. The Bureau recognizes that fundamental changes are needed and has already taken some important first steps, including developing a strategic plan. To help ensure the Bureau's efforts stay on track and to avoid problems it had in planning for prior censuses, it will be important for the Bureau to issue a comprehensive operational plan that includes performance goals, milestones, cost estimates, and other critical information that could be updated regularly. GAO recommends that the Census Director refine NRFU and other field follow-up efforts by, among other things, emphasizing quality as much as speed during NRFU and by incorporating best practices in its IT acquisition-management policy. To help ensure reform efforts stay on track, the Bureau should develop an operational plan that integrates performance, budget, and other information. The Department of Commerce generally agreed with GAO's findings and recommendations.
Recommendations
Recommendations for Executive Action
Agency Affected | Recommendation | Status |
---|---|---|
U.S. Census Bureau | To help enhance the Census Bureau's performance and accountability, improve the transparency of the planning process, gauge whether the Bureau is on-track toward a more cost-effective 2020 Census, and foster greater public dialog about the census, the Bureau should develop an operational plan or road map for 2020 that integrates performance, budget, methodological, schedule, and other information that would be updated as needed and posted on the Bureau's Web site and other social media outlets, and develop a mechanism that allows for and harnesses input from census stakeholders and individuals. |
In 2010 we reported that the 2010 Census was the costliest census in the nation's history. Our report discussed the importance of the refinement of existing operations and a reexamination of the fundamental approach to the census to better address long-standing issues. We recommended that the Bureau should develop an operational plan or road map for the 2020 Census that integrates performance, budget, methodology, schedule, and other information that would be updated as needed and posted on the Bureau's website and other social media outlets. We also recommended that the Bureau develop a mechanism that allows for and harnesses input from census stakeholders and individuals. In response to these recommendations, in August 2015 the Bureau provided us with a copy of the operational plan. Information about the operational plan, its content, including cost, key decisions, research, milestones, and schedule for development was presented in January 2015 to stakeholders at the 2020 Census Program Management Review (PMR) and an email address was set up for stakeholders to provide feedback on the plan.
|
U.S. Census Bureau | To refine its approach to recruiting, the Census Bureau should evaluate current economic factors that are associated with and predictive of employee interest in census work, such as national and regional unemployment levels, and use these available data to determine the potential temporary workforce pool and adjust its recruiting approach. |
In December 2010 we reported that the Bureau recruited 5 times the number of people that needed to be trained to ensure an ample pool of candidates. However, this approach led to over recruiting in some locations and associated administrative costs. We recommended the Bureau refine its approach to recruiting and evaluate current economic factors that are associated with and predictive of employee interest in census work, such as national and regional unemployment levels, and use these available data to determine the potential temporary workforce pool and adjust its recruiting approach. The Bureau agreed with our recommendation and for 2020 census tested a new recruiting approach. Specifically, the 2016 census test used unemployment data and 2010 Census data to determine a base recruiting goal at both the Los Angeles and Houston 2016 census test sites. In Los Angeles, for example, the Bureau used data to decrease the base recruiting goal by about 30 percent due to anticipated recruiting success. This approach should help the Bureau better predict and refine its recruiting goals.
|
U.S. Census Bureau | To help ensure that the Census Bureau's procedures for NRFU result in the collection of high-quality data, the Bureau's procedures for the timely completion of NRFU should emphasize the collection of high-quality data and proper enumeration techniques as much as speed. |
During the research and testing phase for the 2020 Census, the Bureau has multiple efforts designed to improve the quality of data collection. These include evaluations, assessments, and quality profiles to measure the effectiveness and impact on data quality of the 2010 Census operations, and multiple research and testing projects which include components focused on improving data quality during field operations. Based on research they are developing procedures to ensure the collection of high-quality NRFU data. For example, the Improving Quality Control Team is researching methods to predict falsification at the enumerator level as well as, developing procedures to monitor LCOs and detect LCO-wide procedural violations and incidents of falsification.
|
U.S. Census Bureau | To improve the fingerprinting process of temporary workers, the Census Bureau should revise or modify training so that field staff are provided with numerous practice opportunities for collecting fingerprints prior to each operation. |
We reported that census workers needed more experience fingerprinting and recommended that numerous opportunities be given to workers prior to each operation. The Bureau concurred that fingerprinting needed to be improved for the 2020 Census. Given the issues that were raised in our report concerning fingerprinting combined with a fewer local census office for 2020, the Bureau in the 2015 Census test in AZ, took a different approach and collaborated with USPS to fingerprint employees. In June 2015, Bureau officials indicated that having experienced workers to fingerprint employees for the 2020 census, as we noted in our report, would be a challenge and that, given the success of fingerprinting at the USPS, the Bureau is now coordinating with USPS to have them assist with fingerprinting for the 2020 Census.
|
U.S. Census Bureau | To ensure that the Census Bureau improves its ability to manage future IT acquisitions, the Bureau should immediately establish and enforce a system-acquisition management policy that incorporates best practices in system- and software-acquisition management. |
Consistent with our recommendation, in December 2012 the Bureau's Enterprise System Development Lifecycle (SDLC) 2.0 was approved by the Census IT Project Review Governance Board. This plan includes the agile software development model. As a result, the SDLC should be more applicable and able to better guide a variety of software development projects at the bureau.
|
U.S. Census Bureau | To help ensure the Census Bureau compiles an accurate address list for VDC operations in 2020, the Bureau should research how duplicate addresses were inadvertently included in the VDC workload. |
The Census Bureau concurred with this recommendation, and as part of its research and testing of vacant housing units during the 2015 Census Test, the Bureau used administrative records. Given the success of using administrative records to identify vacant housing units, the Bureau has decided to eliminate the vacant delete check operation and rely on administrative records.
|