Screening Partnership Program: TSA Can Benefit from Improved Cost Estimates
Highlights
What GAO Found
Based on an analysis of TSA's cost estimating practices and methodology developed in 2013 against best practices, TSA's cost estimates have some strengths, but also have limitations in four general characteristics needed to reflect a high-quality and reliable cost estimate. TSA's cost estimating practices reflect certain strengths, including a revised cost estimating methodology that provides sufficient details for TSA staff to develop and document cost estimates. However, limitations in each of the four characteristics of a high quality cost estimate (comprehensive, well-documented, accurate, and credible) prevent TSA's estimates from being reliable. For example, TSA's cost estimates are not fully comprehensive because they include only the costs incurred by TSA to perform screening at an airport and not the total costs incurred by the federal government such as retirement benefits and insurance. Further, TSA's estimates are not regularly updated to reflect changes to the program that could affect costs and do not include an analysis that addresses the uncertainty inherent in cost estimates. A methodology that is more closely aligned with best practices for cost estimation can provide more reliable information.
While multiple congressional committees have sought improved information on the cost effectiveness of the SPP to oversee the program, TSA has not reported cost comparisons between federal and private screening at SPP airports to policy makers. Since 2013, TSA has prepared comprehensive annual reports that include, among other things, a comparison of actual private costs with estimated federal costs. According to TSA officials, they have not shared these reports with Congress because they are developed for internal use. Although TSA has no standing requirement to report this information, doing so (such as on an annual basis), can better position policy makers to assess and understand the effectiveness of the SPP program and its effects on federal costs.
TSA limits its selection of contractors to those who propose costs less than or equal to TSA's estimated costs to perform the same services. However, once it has awarded a contract, TSA does not continually monitor the value of the contract relative to its estimated costs throughout the contract period. TSA also does not update its estimated costs to account for changes during the contract period that affect the estimates. TSA has determined that it will not consider a contractor's proposal to perform screening at an airport if the proposed cost exceeds TSA's estimated costs to perform screening services at an airport, and will only further evaluate those proposals that are less than or equal to TSA's estimated costs. However, over the contract period, the value of the contract may increase or decrease due to modifications that address changes to the work. For example, if an airport opens a new terminal, the contract might be modified to accommodate the need to hire additional staff. Some of these changes may also affect TSA's estimated costs for performing the services provided in the contract. Therefore, continually monitoring how contract values compare to TSA's estimated costs, and ensuring the cost estimates are updated to correspond to major changes in the program or contract, would provide program officials and policymakers with more accurate information about the relative costs of operating airports with federal and private screeners.
Why GAO Did This Study
The Transportation Security Administration (TSA) screens approximately 1.8 million passengers and their property at our nation's airports every day to ensure, among other things, that persons do not carry prohibited items into airport boarding areas or on flights. In 2004, TSA created the Screening Partnership Program (SPP), allowing TSA-regulated airports to apply to have screening of passengers and property performed by private contractors. TSA develops cost estimates to determine what its costs would be to perform screening services at SPP airports. These estimates provide a basis of comparison for program and procurement decisions.
GAO was asked to review the SPP. This report addresses: (1) the extent to which TSA developed and reported reliable cost estimates for providing screening services at SPP airports; and (2) how TSA uses cost estimates in selecting SPP contractors and the extent to which TSA monitors contract values relative to its cost estimates. GAO compared TSA's cost estimates to best practices for developing federal cost estimates, analyzed selection and monitoring in the 13 contracts in which estimates were used, and interviewed TSA and contractor officials.
Recommendations
GAO recommends that TSA: (1) revise it's 2013 cost estimating methodology to conform to best practices; (2) provide cost comparisons to Congress on a regular basis; and (3) compare and update estimates when major changes to contract values occur. TSA concurred with the recommendations.
Recommendations for Executive Action
| Agency Affected | Recommendation | Status |
|---|---|---|
| Transportation Security Administration | To ensure that TSA is developing reliable cost estimates to inform its internal processes and external policy decisions and to ensure that TSA is better positioned to re-compete and award SPP contracts as existing contracts at an SPP airport near expiration, the TSA Administrator should ensure that the 2013 cost estimating methodology used to compare screening costs at SPP and non-SPP airports is revised to more fully conform to leading cost estimating best practices. |
The Transportation Security Administration (TSA) has revised the cost estimating methodology used to compare the screening costs of airports at which screening is provided by contractors under the Screening Partnership Program (SPP) with estimated costs of screening by TSA to more fully conform to leading cost estimating best practices. In November 2015, we reported that TSA's cost estimates had limitations in four general characteristics (comprehensive, well-documented, accurate, and credible) needed to reflect a high-quality and reliable cost estimate according to GAO's cost estimating best practices. In August 2016, TSA updated its methodology and standards for estimating and comparing TSA screening costs to more fully align with GAO's cost estimating best practices. Specifically, TSA made improvements in each of the areas in our November 2015 report in which the standards of a high-quality and reliable cost estimate were not fully met. Based on an assessment of the revised cost estimating methodology document, if followed, the improved methodology should result in reliable cost estimates.
|
| Transportation Security Administration | To ensure that TSA is developing reliable cost estimates to inform its internal processes and external policy decisions and to ensure that TSA is better positioned to re-compete and award SPP contracts as existing contracts at an SPP airport near expiration, the TSA Administrator should provide cost comparisons that conform to leading cost estimating best practices to Congress on a regular basis. |
The Transportation Security Administration (TSA) has included regularly providing cost comparisons to Congress in its revised cost estimating methodology for the Screening Partnership Program (SPP). In November 2015, we reported that, while multiple congressional committees had sought improved information on the cost effectiveness of the SPP to oversee the program, TSA had not reported cost comparisons between federal and private screening at airports to policy makers. In May 2016, TSA informed us that cost comparisons developed using the revised methodology would be provided to Congress no later than the end of June of each year and in August 2016, TSA confirmed that the cost comparisons had been provided for that year. To ensure that the practice is continued, TSA's August 2016 revised cost estimation standards and methodology document includes instructions that TSA will provide the cost comparisons in an annual briefing to Congress that will take place no later than the end of June each year.
|
| Transportation Security Administration | To ensure that TSA is developing reliable cost estimates to inform its internal processes and external policy decisions and to ensure that TSA is better positioned to re-compete and award SPP contracts as existing contracts at an SPP airport near expiration, the TSA Administrator should continually monitor how contract values compare to TSA's estimated costs and, in doing so, update its cost estimates when changes to the program or the contract may result in a major change to contract values to ensure the comparison is current and accurate. |
The Transportation Security Administration (TSA) has revised its cost estimating methodology for the Screening Partnership Program (SPP) to include a process to update its estimates over time to reflect how changes that affect contractor costs would affect TSA's estimated costs. Specifically, TSA's estimates will be updated on an annual basis to reflect changes at an airport such as new regular flights that increase the level of work required to screen passengers. In such a case, TSA will estimate the staff, supplies, and other costs that would have been necessary had the airport still been federally screened and add that to its estimate. TSA noted that this process will allow it to monitor and update the estimate in relation to actual contract costs over time to ensure the airport actually remains cost efficient.
|