Decennial Census: Bureau Should Assess Significant Data Collection Challenges as It Undertakes Planning for 2030
Fast Facts
COVID-19 delayed some field data collection for the 2020 Census. Yet, the Bureau was able to meet its mid-October deadline for following up with more than 99% of households that hadn't responded.
Some challenges to operations included:
- Natural disasters and other access problems in some local areas—e.g., hurricanes that hit Louisiana
- Pandemic-related closures of some group quarters like skilled nursing facilities—making it harder to send Census workers in to count residents
We recommended that the Bureau evaluate lessons learned from the 2020 Census data collection and incorporate them into 2030 Census planning.
Highlights
What GAO Found
In March 2020, the Census Bureau (Bureau) delayed the start of field data collection because of COVID-19 safety, and then revised several operational timelines in response to the pandemic and Department of Commerce (Commerce) decisions. Nationally the Bureau reported completing more than 99 percent of nonresponse follow-up cases (households that have not responded to the census) by October 15, 2020. The Bureau attributes the use of technology as among the reasons it completed the work by this date.
The Bureau, however, had lower completion percentages ranging between 94 and 99 for 10 local geographic areas, in part because of natural disasters and COVID-19. For example, according to the Bureau, in Shreveport, Louisiana, short-term closures stemming from the hurricane impacted data collection for 82,863 housing units. As a mitigation strategy, the Bureau shifted the Shreveport operation to telephone enumeration and brought in more than 1,200 enumerators from travel teams. Despite these efforts, the Bureau was unable to complete 22,588 cases in Shreveport before data collection ended. For these cases the Bureau will need to rely on alternate methods including imputation, which draws data from similar nearby households to determine whether a housing unit exists, whether it is occupied, and, if so, by how many people.
In addition to the challenges brought on by natural disasters, the Bureau encountered other difficulties during nonresponse follow-up, such as, the inability of supervisors to reassign open cases in a timely fashion. GAO found that census field supervisors did not have the authority to reassign cases and had to wait for the field manager to make those reassignments. Bureau officials told GAO it would consider the reassignment of cases as it moves towards planning for the 2030 Census.
To monitor nonresponse follow-up, the Bureau used quality control procedures, such as real-time monitoring of enumerator activities by supervisors and training assessments. However, GAO found the Bureau did not have proper controls in place, allowing some enumerators to work without having passed the required training assessment. The Bureau agreed that additional controls were necessary.
The Bureau planned to count individuals living in group quarters, such as skilled-nursing and correctional facilities, between April 2, 2020, and June 5, 2020, but revised those dates to July 1, 2020, through September 3, 2020. The pandemic made it difficult to count group quarters. For example, Bureau staff found it challenging to locate a point of contact at some group quarters because facilities were closed due to the pandemic. Bureau officials told us that in December 2020 they decided to re-contact more than 24,000 out of approximately 272,000 group quarter facilities to collect data, and that imputation would be used to count individuals at the remaining facilities still reporting a zero population count.
The Bureau is updating plans to assess operations and identify resulting lessons learned from the 2020 Census. As part of its planning for 2030, it will be important for the Bureau to assess the impact of the 2020 late design changes and the operations' challenges that arose.
Why GAO Did This Study
The 2020 Census was conducted under extraordinary circumstances. In response to the COVID-19 pandemic and related Commerce decisions, the Bureau made a series of late changes to the design of the census. As GAO previously reported, these changes introduced risks to the quality of data that the Bureau provides for congressional apportionment and redistricting purposes.
GAO was asked to review the Bureau's implementation of the 2020 Census. This report assesses the Bureau's implementation of the: (1) nonresponse follow-up operation, (2) group quarters enumeration, and (3) plans to assess those operations. To address these objectives, GAO conducted a series of surveys of all 248 census offices during the collection of data for those operations. GAO also monitored the cost and progress of operations and interviewed census field supervisors for each operation.
Recommendations
GAO is recommending that the Bureau inform 2030 Census planning by evaluating the effects of major operational changes made during data collection and challenges encountered for nonresponse follow-up and group quarters enumerations. In its comments, the Department of Commerce agreed with GAO's findings and recommendation. The Bureau also provided technical comments, which GAO incorporated as appropriate.
Recommendations for Executive Action
| Agency Affected | Recommendation | Status |
|---|---|---|
| Department of Commerce |
Priority Rec.
The Secretary of Commerce and the Director of the U.S. Census Bureau should, to inform 2030 planning, evaluate how major operational changes in response to data collection challenges affected the quality and completeness of nonresponse follow-up and group quarters enumerations. At a minimum, this evaluation should address: (1) late design changes; (2) procedures for accessing multi-unit buildings; (3) the process for reassigning cases; (4) supervisory alerts used to manage enumerators; (5) quality control over training assessments; and (6) the eResponse option for group quarter data collection. (Recommendation 1) |
Commerce agreed and has taken the necessary steps to implement this recommendation. Specifically, the Census Bureau provided us with relevant documents for evaluating data collection challenges identified in our report that were encountered during the nonresponse follow-up and group quarters operations. In March 2023 and December 2023, the Bureau provided us with the nonresponse follow-up (public) and group quarters (not public) operational assessments, respectively. The reports provide lessons learned for (1) late design changes; (2) access to multi-unit buildings; (3) the reassignment of cases; (4) supervisory alerts used to manage enumerators; and (5) the eResponse option for group quarters data collection. Moreover, the assessment reports include census recommendations for future operations, such as, leveraging advances in technology to monitor enumeration data quality in near real-time. Regarding quality control over training assessments, in December 2023, the Bureau provided us with its 2030 Census field infrastructure business process model for training field staff which lays out its 2030 approach to ensuring training assessments of workers are conducted before work assignments are made. Having evaluated data collection challenges from the 2020 Census, the Bureau can begin to incorporate lessons learned and thus, better ensure the quality and completeness of future data collections.
|