Additional Actions Needed to Assess DHS's Data and Improve Planning for a Biometric Air Exit Program
GAO-13-683: Published: Jul 30, 2013. Publicly Released: Jul 30, 2013.
What GAO Found
Since April 2011, the Department of Homeland Security (DHS) has taken action to address a backlog of potential overstay records that GAO previously identified. Specifically, DHS reviewed such records to identify national security and public safety threats, but unmatched arrival records--those without corresponding departure records--remain in DHS's system. GAO had previously reported that, as of January 2011, DHS had a backlog of 1.6 million unmatched arrival records that had not been reviewed through automated or manual processes. DHS tracks arrivals and departures and closes records for individuals with matching arrival and departure records. Unmatched arrival records indicate that the individual is a potential overstay. In 2011, DHS reviewed this backlog of 1.6 million records, closed about 863,000 records, and removed them from the backlog. As new unmatched arrival records have accrued, DHS has continued to review all of these new records for national security and public safety concerns. As of June 2013, DHS's unmatched arrival records totaled more than 1 million.
DHS has actions completed and under way to improve data on potential overstays and report overstay rates, but the effect of these improvements is not yet known. Further, DHS continues to face challenges in reporting reliable overstay rates. DHS has streamlined connections among databases used to identify potential overstays. However, these improvements do not address some underlying data quality issues, such as missing land departure data. Federal law requires DHS to report overstay estimates, but DHS or its predecessor has not regularly done so since 1994. In April 2011, GAO reported that DHS officials said that they have not reported overstay rates because DHS has not had sufficient confidence in the quality of its overstay data. In February 2013, the Secretary of Homeland Security testified that DHS plans to report overstay rates by December 2013. However, DHS has not assessed or documented improvements in the reliability of data used to develop overstay estimates, in accordance with federal internal control standards. Without such a documented assessment to ensure the reliability of these data, decision makers would not have the information needed to use these data for policy-making purposes.
Developing and implementing a biometric exit capability to collect biometric data, such as fingerprints, which is required by federal law, has been a long-standing challenge for DHS. In May 2012, DHS internally reported recommendations to support the planning for a biometric exit capability at airports--DHS's priority for biometric exit capabilities--that could also be implemented at seaports in the future; however, as of June 2013, DHS's planning did not address a biometric exit capability at land ports of entry. DHS officials stated that the department's goal is to develop information and report to Congress about the benefits and costs of biometric air exit options before the fiscal year 2016 budget cycle. Standard practices for project management state that time frames should be documented as part of the planning process; however, DHS has a high-level plan for a biometric air exit capability, and it does not clearly define the steps, time frames, and milestones needed to develop and implement an evaluation framework, as recommended in DHS's May 2012 report. Without robust planning that includes time frames and milestones, DHS does not have reasonable assurance that it will meet its time frame for developing and implementing an evaluation framework.
Why GAO Did This Study
Each year, millions of visitors come to the United States legally on a temporary basis either with or without a visa. Overstays are individuals who were admitted legally on a temporary basis but then overstayed their authorized periods of admission. DHS has primary responsibility for identifying and taking enforcement action to address overstays. In April 2011, GAO reported on DHS's actions to identify and address overstays and made recommendations to strengthen these processes. DHS concurred and has taken or is taking steps to address them. DHS has also reported taking further actions to address overstays.
GAO was asked to review DHS's progress since April 2011. This report addresses (1) DHS's efforts to review its records to identify potential overstays, (2) the extent to which DHS's changes in its systems or processes have improved data on potential overstays and DHS's ability to report overstay rates, and (3) the extent to which DHS has made progress toward establishing a biometric exit system. GAO analyzed DHS overstay data and documents-- such as those related to the overstay identification processes and biometric exit plans--and interviewed relevant DHS officials.
What GAO Recommends
GAO recommends that DHS assess and document the reliability of its data, and establish time frames and milestones for a biometric air exit evaluation framework. DHS concurred with the recommendations.
Recommendations for Executive Action
Status: Closed - Implemented
Comments: DHS has tasked U.S. Customs and Border Protection (CBP) as the lead agency for a working group composed of DHS components with responsibility for collecting, recording, and analyzing entry and exit data. In January 2016, DHS issued an Entry/Exit Overstay Report that provides data on departures and overstays, by country, for foreign visitors who were admitted to the United States though air and sea ports of entry and were expected to depart in fiscal year 2015. Consistent with our recommendation, in the report, DHS notes which data were used to compile the overstay estimates in the report and identifies limitations with other data sources. For example, the report notes that there are limitations in collecting departure data in the land environment and thus DHS did not include data on departure or overstay information for travelers who entered the United States through a land port of entry. CBP also provided us with documentation of the agency's efforts to assess the integrity of overstay data. On the basis of our analysis of this documentation, as well as interviews with CBP and other department officials, we determined that DHS documented the reliability of the data used to develop overstay estimates in its January 2016 report, as well as limitations in these data. Therefore, we are closing this recommendation, as implemented.
Recommendation: To help improve confidence in the quality of overstay data that DHS plans to report in December 2013 in accordance with statutory reporting requirements, the Secretary of Homeland Security should direct relevant DHS components to assess and document the extent to which the reliability of the data used to develop any overstay estimates has improved and any remaining limitations in how the data can be used.
Agency Affected: Department of Homeland Security
Comments: We reported in July 2013 that DHS planned to finalize goals and objectives for a biometric air exit system before developing an evaluation framework to determine how to evaluate the benefits and costs of a biometric air exit system and compare it with a biographic exit system. In March 2014, DHS took initial steps to address our recommendation by finalizing these goals and objectives. In November 2014, CBP provided GAO with a copy of its draft evaluation framework, which CBP expects to finalize in late 2015, prior to beginning field testing. The draft evaluation framework includes preliminary information about how DHS will evaluate different air exit options, but as of November 2014, the draft framework has limited information regarding time frames and milestones for assessing biometric exit options. In June 2015, CBP provided GAO with additional information about metrics for measuring performance and effectiveness that CBP plans to incorporate in the evaluation framework. In October 2015, CBP officials stated that they are collecting information related to these metrics and engaging in additional planning and analysis, including the planned development of a Concept of Operations and a Plan to Execute, that CBP plans to have completed by June 30, 2016. To fully address this recommendation, DHS should finalize its evaluation framework, including time frames and milestones for assessing biometric air exit options.
Recommendation: To provide reasonable assurance of when DHS will be able provide an assessment of the benefits and costs of biometric air exit options to Congress, the Secretary of Homeland Security should establish time frames and milestones for developing and implementing an evaluation framework to be used in conducting the department's assessment of biometric air exit options.
Agency Affected: Department of Homeland Security