Aviation Certification: FAA Should Evaluate Effectiveness of the International Validation Process
Fast Facts
U.S. manufacturers export billions of dollars' worth of airplanes and other aviation products each year. Exported products require safety approvals from both the exporting and the importing country.
Manufacturers told us it's hard to predict how long other countries will take to approve their products. They also said countries are requesting more data and extending timelines, and the Federal Aviation Administration is short-staffed—affecting how much it can help companies.
FAA could find ways to help make safety validations more predictable if it evaluates whether the whole process is effective. We recommended it do so.
Highlights
What GAO Found
U.S. companies export billions of dollars' worth of aviation products, such as airplanes and engines, each year. These products require safety approval from both the Federal Aviation Administration (FAA) and the importing countries' civil aviation authorities (CAA). Bilateral agreements between the U.S. and countries representing the five largest aviation export markets aim to facilitate these approvals through acceptance or validation of each other's product certifications. The approval processes laid out in the implementing procedures for these agreements vary depending on the product's type and complexity. For example, CAA's conduct detailed technical validations for higher risk products with new designs or technologies. These validations can involve extensive review of product designs and other information for the CAA to assess compliance with its own country's regulations and safety and environmental standards.
Five Largest Export Markets for U.S. Aviation Products, 2019-2021
Note: Percentages reflect portion of U.S. total aviation exports. The European Union figure excludes the United Kingdom due to its exit from the European Union in 2020.
The fourteen stakeholders GAO interviewed reported that in recent years, validation time frames have become unpredictable as CAAs have requested more data from aviation manufacturers. Stakeholders cited contributing factors, including CAAs' decreased trust in FAA's certifications after the Boeing 737 MAX 8 accidents in 2018 and 2019. They said that receiving FAA's support—including resolving disputes with other countries' CAAs—can also be challenging due to limited FAA staffing and resources.
FAA recently began collecting and using more detailed information to improve its management of international validations, such as tracking the number of active validations by country. However, FAA has not evaluated the effectiveness of the validations process as a whole. FAA officials said they are beginning to develop an approach for assessing the process, including identifying performance goals and needed data. However, FAA has not yet identified specific steps or a time frame for developing the approach. Assessing the validations process could help FAA identify improvements that might lead to increased predictability in the process and improved accountability to bilateral agreements.
Why GAO Did This Study
For many years, the U.S. has entered into bilateral agreements with certain other countries to facilitate acceptance of each other's certifications of aviation products. However, U.S. companies continue to report experiencing difficulties in obtaining approvals of their products in other countries.
GAO was asked to review the approvals process for U.S. aviation products. This report (1) describes the processes that FAA and CAAs in the most significant export markets for U.S. aviation products use to approve each other's product certifications, (2) examines validation challenges stakeholders identified, and (3) evaluates how FAA ensures that the international validations process is effective. GAO selected five international markets based on the number of validations and reviewed selected bilateral agreements and implementation procedures, FAA data, and FAA's validation policies and guidance. GAO also interviewed 14 aviation industry stakeholders and CAA officials from three countries.
Recommendations
GAO is making four recommendations, including that FAA (1) establish quantifiable goals for the international validations process; (2) identify quality information and performance metrics to track progress towards those goals; (3) use that information to assess results and inform decisions about any needed improvements to the process; and (4) establish a time frame and action plan for these efforts. FAA agreed with the recommendations.
Recommendations for Executive Action
Agency Affected | Recommendation | Status |
---|---|---|
Federal Aviation Administration | The Administrator of FAA should establish quantifiable goals for the international validations process. (Recommendation 1) |
In its May 2024 180-day letter, DOT concurred with this recommendation and said FAA plans to establish the appropriate quantifiable goals for the international validation process. FAA also plans to develop and publish the goals and measures by September 30, 2024. GAO will monitor and report on FAA's efforts regarding this recommendation.
|
Federal Aviation Administration | The Administrator of FAA should identify the quality information and performance metrics the agency needs to track progress toward the goals it identifies for the international validations process and how it will collect that information, which may include changes to agency data systems or dashboards. (Recommendation 2) |
In its May 2024 180-day letter, DOT concurred with this recommendation and said FAA has identified the quality information needed to establish performance metrics to track progress towards the performance goals. FAA continues to enhance its international validation dashboards, develop guidance materials, and provide outreach to staff responsible for validations projects. FAA has also identified the additional process, data, and working tracking systems updates needed to gather and track the information for validation projects. FAA plans to establish performance metrics for all validation types. Finally, FAA plans to develop additional guidance material is planned by September 30, 2024, and upgrade its work tracking systems by April 30, 2025. GAO will monitor and report on FAA's efforts regarding this recommendation.
|
Federal Aviation Administration | The Administrator of FAA should use the information FAA collects to assess the results of and inform decisions about any needed improvements to the international validations process. (Recommendation 3) |
In its May 2024 180-day letter, DOT concurred with this recommendation and said FAA's international performance goals will be used to assess the functioning of the international validation processes. The goals, metrics, and information collected will be used to inform changes to the FAA's international validation process. Improvements will be focused on reducing delays, improving predictability, and reducing duplication of the validation process. FAA plans to complete these assessments and the identification of improvements by September30, 2025. GAO will monitor and report on FAA's efforts regarding this recommendation.
|
Federal Aviation Administration | The Administrator of FAA should establish a time frame and develop an action plan for FAA's efforts to develop its approach for assessing the international validations process. (Recommendation 4) |
In its May 2024 180-day letter, DOT concurred with this recommendation and said FAA plans to establish an action plan and timeframes for the performance assessment of the international validation process. FAA also plans to utilize existing data and information, industry metrics, and the information FAA gathers through ongoing bilateral engagements on validation programs for these assessments as the FAA develops additional data and upgrades work tracking systems. These inputs are expected to enable FAA to systematically assess and refine performance management for the international validations process in the near term. Finally, FAA plans to develop an action plan by December 31, 2024. GAO will monitor and report on FAA's efforts regarding this recommendation.
|