This is the accessible text file for GAO report number GAO-12-525T entitled 'Joint Strike Fighter: Restructuring Added Resources and Reduced Risk, but Concurrency Is Still a Major Concern' which was released on March 20, 2012. This text file was formatted by the U.S. Government Accountability Office (GAO) to be accessible to users with visual impairments, as part of a longer term project to improve GAO products' accessibility. Every attempt has been made to maintain the structural and data integrity of the original printed product. Accessibility features, such as text descriptions of tables, consecutively numbered footnotes placed at the end of the file, and the text of agency comment letters, are provided but may not exactly duplicate the presentation or format of the printed version. The portable document format (PDF) file is an exact electronic replica of the printed version. We welcome your feedback. Please E-mail your comments regarding the contents or accessibility features of this document to Webmaster@gao.gov. This is a work of the U.S. government and is not subject to copyright protection in the United States. It may be reproduced and distributed in its entirety without further permission from GAO. Because this work may contain copyrighted images or other material, permission from the copyright holder may be necessary if you wish to reproduce this material separately. United States Government Accountability Office: GAO: Testimony: Before the Subcommittee on Tactical Air and Land Forces, Committee on Armed Services, House of Representatives: For Release on Delivery: Expected at 3:00 p.m. EDT: Tuesday, March 20, 2012: Joint Strike Fighter: Restructuring Added Resources and Reduced Risk, but Concurrency Is Still a Major Concern: Statement of Michael J. Sullivan, Director: Acquisition and Sourcing Management: GAO-12-525T: GAO Highlights: Highlights of GAO-12-525T, a testimony before the Subcommittee on Tactical Air and Land Forces Committee on Armed Services, House of Representatives. Why GAO Did This Study: The F-35 Lightning II, also known as the JSF, is DOD’s most costly and ambitious aircraft acquisition, seeking to simultaneously develop and field three aircraft variants for the Air Force, Navy, Marine Corps, and eight international partners. The JSF is critical to DOD’s long- term recapitalization plans as it is intended to replace hundreds of legacy aircraft. Total U.S. investment in the JSF is nearing $400 billion to develop and procure 2,457 aircraft over several decades and will require a long-term, sustained funding commitment. In 2010, DOD began to extensively restructure the program to address relatively poor cost, schedule, and performance outcomes. This testimony draws on GAO’s extensive body of work on the JSF, including preliminary results from the current annual review mandated in the National Defense Authorization Act for Fiscal Year 2010. This testimony discusses (1) program costs, schedule changes, and affordability issues, (2) performance testing results, software, and technical risks, and (3) procurement contract cost performance, concurrency impacts, manufacturing results, and design changes. GAO’s work included analyses of a wide range of program documents and interviews with defense and contractor officials. What GAO Found: What GAO Found Joint Strike Fighter (JSF) restructuring continues into a third year, adding to cost and schedule. Since June 2010, the total cost estimate increased about $15 billion, $5 billion for development and $10 billion for procurement. There will likely be additional changes when the Department of Defense (DOD) approves a new program baseline, expected soon. Compared to the current approved baseline from 2007, total costs have increased about $119 billion, full-rate production has been delayed 5 years, and initial operational capability dates are now unsettled because of program uncertainties. While the total number of aircraft the U. S. plans to buy has not changed, DOD has for 3 straight years reduced near-term procurement quantities, deferring aircraft and costs to future years. Since 2002, the program has reduced aircraft procurement quantities through 2017 by three-fourths, from 1,591 to 365. As the program continues to experience cost growth and delays, projected annual funding needs are unprecedented, averaging more than $13 billion a year through 2035. Most of the instability in the program has been and continues to be the result of highly concurrent development, testing, and production. Overall performance in 2011 was mixed as the program achieved 6 of 11 primary objectives. Developmental flight testing gained momentum and is about one-fifth complete with the most challenging tasks still ahead. The program can expect more changes to aircraft design and manufacturing processes. Performance of the short takeoff and vertical landing variant improved this year and its “probation” period to fix deficiencies was ended early, even though several fixes are temporary and untested. Management and development of the more than 24 million lines of software code continue to be of concern and late software releases have delayed testing and training. Development of the critical mission systems that give the JSF its core combat capabilities remains behind schedule and risky. To date, only 4 percent of the mission system requirements for full capability has been verified. Testing of a fully integrated JSF aircraft is now expected in 2015 at the earliest. Deficiencies with the helmet mounted display, integral to mission systems functionality and concepts of operation, are most problematic. DOD is funding a less-capable alternate helmet as a back-up. The autonomic logistics information system, a key ground system for improving aircraft availability and lowering support costs, is not yet fully developed. Cost overruns on the first four annual procurement contracts total more than $1 billion and aircraft deliveries are on average more than one year late. Officials said the government’s share of the cost growth is $672 million; this adds about $11 million on average to the price of each of the 63 aircraft under those contracts. In addition to the overruns, the government also incurred an estimated $373 million in retrofit costs on produced aircraft to correct deficiencies discovered in testing. The manufacturing process is still absorbing a higher than expected number of engineering changes resulting from flight testing, which makes it difficult to achieve efficient production rates. Until engineering changes are reduced, there are risks of additional cost overruns and retrofit costs. The program now estimates that the number of changes will persist at elevated levels through 2019. Even with the substantial reductions in near-term procurement quantities, DOD is still investing billions of dollars on hundreds of aircraft while flight testing has years to go. What GAO Recommends: GAO has made prior recommendations to help reduce risk and improve outcomes, which DOD has implemented to varying degrees. GAO’s forthcoming report will address these in detail along with potential new recommendations. View [hyperlink, http://www.gao.gov/products/GAO-12-525T]. For more information, contact Michael J. Sullivan at (202) 512-4841 or sullivanm@gao.gov. [End of section] Chairman Bartlett, Ranking Member Reyes, and Members of the Subcommittee: Thank you for the opportunity to discuss our work on the F-35 Lightning II, also known as the Joint Strike Fighter (JSF). The JSF is the Department of Defense's (DOD) most costly and ambitious aircraft acquisition, seeking to simultaneously develop and field three aircraft variants for the Air Force, Navy, Marine Corps, and eight international partners. The JSF is critical to DOD's long-term recapitalization plans as it is intended to replace hundreds of legacy fighters and strike aircraft. Total U.S. investment in the JSF will be substantial--approaching $400 billion to develop and acquire 2,457 aircraft over the next few decades--and will require a long-term sustained funding commitment. Over the last 2 years, the JSF program has been extensively restructured to address relatively poor cost, schedule, and performance outcomes. We have reported on JSF issues for a number of years.[Footnote 1] A recurring theme in our body of work since 2005 has been a concern about the substantial concurrency, or overlap, of JSF development, test, and production activities and the heightened risk it poses to achieving good program outcomes. The effects of concurrency became apparent in 2011 as the JSF program incurred an estimated $373 million in additional costs to retrofit already-built aircraft to correct deficiencies discovered during testing. Our prior reports have also made numerous recommendations for reducing risks and improving chances for successful outcomes. DOD has agreed with and taken actions on these recommendations to varying degrees. More detail on the status of these prior recommendations will be provided in our forthcoming report. In April 2011, we reported that the department's restructuring actions should lead to more achievable and predictable outcomes, albeit at higher costs and with extended times to test and deliver capabilities to the warfighter.[Footnote 2] The report also identified continuing issues concerning affordability risks (both for acquiring JSF aircraft and supporting them over the life-cycle), delays in software development, a continued high rate of design changes, and immature manufacturing processes. This testimony is largely based on preliminary results from our latest review. The National Defense Authorization Act for Fiscal Year 2010 [Footnote 3] requires GAO to review the JSF program annually for 6 years. We plan to issue our detailed report in April to incorporate new baseline cost and schedule data. My testimony will address (1) program cost and schedule changes and their implications on affordability; (2) performance testing results and technical risks; and (3) contract cost performance, concurrency impacts, and design and manufacturing maturity. To conduct this work, we reviewed program status reports, manufacturing data, contracts, test plans and performance, and internal DOD analyses. We evaluated restructuring actions and impacts, tracked cost and schedule changes, and identified factors driving the changes. We discussed program results to date and future plans with officials from the Office of the Secretary of Defense (OSD), JSF program office, military services, other defense offices, and contractors. We toured aircraft and engine manufacturing plants, obtained production and supply performance indicators, and discussed improvements underway with contractors. We discussed the information used to prepare this testimony with DOD officials and included their comments as appropriate. We conducted this performance audit from June 2011 to March 2012 in accordance with generally accepted government auditing standards. Those standards required that we plan and perform the audit to obtain sufficient, appropriate evidence to provide a reasonable basis for our findings and conclusions based on our audit objectives. We believe that evidence obtained provides a reasonable basis for our findings and conclusions based on our audit objectives. Restructuring Reduces Near Term Risk, but Long Term Affordability Is Challenging: JSF restructuring continued throughout 2011 and into 2012 with additional costs and extended schedules incurred for key activities and decisions. The Department's actions have helped reduce near term risks by lowering annual procurement quantities and allowing more time for flight testing. The Department is expected to soon approve a new acquisition program baseline that will likely make further changes in cost and schedule. This decision, critical for program management and oversight, has been delayed several times and it has now been 2 years since the Department announced that the JSF program had breached the critical cost growth statutory thresholds[Footnote 4] and that a new baseline would be established. Table 1 tracks historical changes in cost, schedule, and quantities since the start of development (2001), a major redesign (2004), a new baseline following the program's Nunn- McCurdy breach of the significant cost growth statutory threshold (2007), initial restructuring actions after the second Nunn-McCurdy breach (2010), and an interim DOD cost estimate (2011). Table 1: JSF Program Cost and Quantity Estimates over Time: Expected quantities: Development quantities; October 2001 (system development start): 14; December 2003 (2004 replan): 14; March 2007 (approved baseline): 15; June 2010 (Nunn-McCurdy): 4; June 2011 (interim DOD estimate): 14. Expected quantities: Procurement quantities (U.S. only); October 2001 (system development start): 2,852; December 2003 (2004 replan): 2,443; March 2007 (approved baseline): 2,443; June 2010 (Nunn-McCurdy): 2,443; June 2011 (interim DOD estimate): 2,443. Total quantities: October 2001 (system development start): 2,866; December 2003 (2004 replan): 2,457; March 2007 (approved baseline): 2,458; June 2010 (Nunn-McCurdy): 2,457; June 2011 (interim DOD estimate): 2,457. Cost estimates (then-year dollars in billions): Development; October 2001 (system development start): $34.4 billion; December 2003 (2004 replan): $44.8 billion; March 2007 (approved baseline): $44.8 billion; June 2010 (Nunn-McCurdy): $51.8 billion; June 2011 (interim DOD estimate): $56.6 billion. Procurement; October 2001 (system development start): $196.6 billion; December 2003 (2004 replan): $199.8 billion; March 2007 (approved baseline): $231.7 billion; June 2010 (Nunn-McCurdy): $325.1 billion; June 2011 (interim DOD estimate): $335.6 billion. Military construction; October 2001 (system development start): $2.0 billion; December 2003 (2004 replan): $0.2 billion; March 2007 (approved baseline): $2.0 billion; June 2010 (Nunn-McCurdy): $5.6 billion; June 2011 (interim DOD estimate): $4.9 billion. Total program acquisition; October 2001 (system development start): $233.0 billion; December 2003 (2004 replan): $244.8 billion; March 2007 (approved baseline): $278.5 billion; June 2010 (Nunn-McCurdy): $382.5 billion; June 2011 (interim DOD estimate): $397.1 billion. Unit cost estimates (then-year dollars in millions): Program acquisition; October 2001 (system development start): $81 million; December 2003 (2004 replan): $100 million; March 2007 (approved baseline): $113 million; June 2010 (Nunn-McCurdy): $156 million; June 2011 (interim DOD estimate): $162 million. Average procurement; October 2001 (system development start): $69 million; December 2003 (2004 replan): $82 million; March 2007 (approved baseline): $95 million; June 2010 (Nunn-McCurdy): $133 million; June 2011 (interim DOD estimate): $137 million. Estimated delivery and production dates: First production aircraft delivery; October 2001 (system development start): 2008; December 2003 (2004 replan): 2009; March 2007 (approved baseline): 2010; June 2010 (Nunn-McCurdy): 2010; June 2011 (interim DOD estimate): 2011. Initial operational capability; October 2001 (system development start): 2010-2012; December 2003 (2004 replan): 2012-2013; March 2007 (approved baseline): 2012-2015; June 2010 (Nunn-McCurdy): TBD; June 2011 (interim DOD estimate): TBD. Full-rate production; October 2001 (system development start): 2012; December 2003 (2004 replan): 2013; March 2007 (approved baseline): 2013; June 2010 (Nunn-McCurdy): 2016; June 2011 (interim DOD estimate): 2018. Source: GAO analysis of DOD data. [End of table] The interim total program cost estimate increased about $15 billion since the June 2010 estimate included in the Nunn-McCurdy certification, about $5 billion for development and $10 billion for procurement. Compared to the current approved baseline set in 2007, total costs have increased about $119 billion, unit procurement costs have risen more than 40 percent, and the start of full-rate production has been delayed 5 years. The department anticipates releasing its new cost and schedule estimates within the next few weeks. Department officials have indicated that the new figures will not be significantly different from the June 2011 interim estimate. Initial operational capability dates for the Air Force, Navy and Marine Corps-- the critical dates when the warfighter expects the capability promised by the acquisition program to be available--have been delayed over time and are now unsettled. Until greater clarity is provided on the program's path forward, the military services are likely to wait to commit to new initial operational capability dates. Concerned about concurrency risks, in February 2012, DOD reduced planned procurement quantities through fiscal year 2017 by 179 aircraft. This marked the third time in 3 years that near-term quantities were cut; combined with other changes since 2008, total JSF procurement quantity has been reduced by 410 aircraft through fiscal year 2017. Since the department still plans to eventually acquire the full complement of U.S. aircraft--2,443 procurement jets--the procurement costs, fielding schedules, and support requirements for the deferred aircraft will be incurred in future years beyond 2017. Figure 1 shows how planned quantities in the near-term have steadily declined over time. With the latest reduction, the program now plans to procure a total of 365 aircraft through 2017, about one-fourth of the 1,591 aircraft expected in the 2002 plan. Figure 1: Changes in Procurement Plans over Time: [Refer to PDF for image: multiple line graph] Fiscal year: 2006; 2002 plan: 10. Fiscal year: 2007; 2002 plan: 22; 2005 plan: 5; 2008 plan: 2; 2011 plan: 2; 2012 plan: 2. Fiscal year: 2008; 2002 plan: 49; 2005 plan: 18; 2008 plan: 12; 2011 plan: 12; 2012 plan: 12. Fiscal year: 2009; 2002 plan: 82; 2005 plan: 47; 2008 plan: 16; 2011 plan: 14; 2012 plan: 14. Fiscal year: 2010; 2002 plan: 108; 2005 plan: 56; 2008 plan: 30; 2011 plan: 30; 2012 plan: 30. Fiscal year: 2011; 2002 plan: 156; 2005 plan: 64; 2008 plan: 43; 2011 plan: 32; 2012 plan: 32. Fiscal year: 2012; 2002 plan: 194; 2005 plan: 101; 2008 plan: 82; 2011 plan: 32; 2012 plan: 31. Fiscal year: 2013; 2002 plan: 194; 2005 plan: 133; 2008 plan: 90; 2011 plan: 42; 2012 plan: 29. Fiscal year: 2014; 2002 plan: 194; 2005 plan: 158; 2008 plan: 110; 2011 plan: 62; 2012 plan: 29. Fiscal year: 2015; 2002 plan: 194; 2005 plan: 160; 2008 plan: 130; 2011 plan: 81; 2012 plan: 44. Fiscal year: 2016; 2002 plan: 194; 2005 plan: 160; 2008 plan: 130; 2011 plan: 108; 2012 plan: 66. Fiscal year: 2017; 2002 plan: 194; 2005 plan: 160; 2008 plan: 130; 2011 plan: 130; 2012 plan: 76. Cumulative quantities: 2002 plan: 1,599; 2005 plan: 1,062; 2008 plan: 775; 2011 plan: 545; 2012 plan: 365. Source: GAO analysis of DOD data. [End of figure] Slowing down procurement plans reduces concurrency risks to a degree, but overall program affordability--both in terms of the investment costs to acquire the JSF and the continuing costs to operate and maintain it over the life-cycle--remains a major risk. The long-stated intent that the JSF program would deliver an affordable, highly common fifth generation aircraft that could be acquired in large numbers could be in question. As the JSF program moves forward, unprecedented levels of funding will be required during a period of more constrained defense funding expectations overall. As shown in figure 2, the JSF annual funding requirements average more than $13 billion through 2035, and approach $16 billion annually for an extended period. The Air Force alone needs to budget from $8 to $11 billion per year from fiscal year 2016 through 2035 for procurement.[Footnote 5] At the same time, the Air Force is committed to other big-dollar projects such as the KC-46 tanker and a new bomber program. Figure 2: JSF Budgeted Development and Procurement Funding Requirements: [Refer to PDF for image: stacked vertical bar graph] Fiscal year: 2012; Air Force development: $1.4 billion; Air Force procurement: $3.8 billion; Navy development: $1.3 billion; Navy Procurement: $3.1 billion. Fiscal year: 2013; Air Force development: $1.2 billion; Air Force procurement: $4.1 billion; Navy development: $1.4 billion; Navy Procurement: $3.8 billion. Fiscal year: 2014; Air Force development: $0.9 billion; Air Force procurement: $5.6 billion; Navy development: $1.3 billion; Navy Procurement: $4.2 billion. Fiscal year: 2015; Air Force development: $0.6 billion; Air Force procurement: $6.5 billion; Navy development: $1.1 billion; Navy Procurement: $5.3 billion. Fiscal year: 2016; Air Force development: $0.4 billion; Air Force procurement: $8.5 billion Navy development: $0.9 billion; Navy Procurement: $5.8 billion. Fiscal year: 2017; Air Force procurement: $9.1 billion; Navy Procurement: $7.5 billion. Fiscal year: 2018; Air Force procurement: $8.6 billion; Navy Procurement: $7.0 billion. Fiscal year: 2019; Air Force procurement: $8.5 billion; Navy Procurement: $6.8 billion. Fiscal year: 2020; Air Force procurement: $8.6 billion; Navy Procurement: $6.9 billion. Fiscal year: 2021; Air Force procurement: $8.9 billion; Navy Procurement: $6.9 billion. Fiscal year: 2022; Air Force procurement: $9.0 billion; Navy Procurement: $6.8 billion. Fiscal year: 2023; Air Force procurement: $9.1 billion; Navy Procurement: $6.7 billion. Fiscal year: 2024; Air Force procurement: $9.3 billion; Navy Procurement: $6.7 billion. Fiscal year: 2025; Air Force procurement: $9.4 billion; Navy Procurement: $6.7 billion. Fiscal year: 2026; Air Force procurement: $9.4 billion; Navy Procurement: $6.2 billion. Fiscal year: 2027; Air Force procurement: $9.8 billion; Navy Procurement: $2.5 billion. Fiscal year: 2028; Air Force procurement: $10.0 billion. Fiscal year: 2029; Air Force procurement: $10.1 billion. Fiscal year: 2030; Air Force procurement: $10.1 billion. Fiscal year: 2031; Air Force procurement: $10.2 billion. Fiscal year: 2032; Air Force procurement: $10.5 billion. Fiscal year: 2033; Air Force procurement: $10.8 billion. Fiscal year: 2034; Air Force procurement: $10.9 billion. Fiscal year: 2035; Air Force procurement: $9.2 billion. Source: GAO analysis of JSF Selected Acquisition Report (December 2010). [End of figure] Mixed Performance in 2011 Affected by Concurrency and Technical Risks: Much of the instability in the JSF program has been and continues to be the result of highly concurrent development, testing, and production activities. During 2011, overall performance was mixed as the program achieved 6 of 11 primary objectives for the year. Developmental flight testing has recently gained momentum, but has a long road ahead with testing of the most complex software and advanced capabilities still in the future. JSF software development is one of the largest and most complex projects in DOD history, providing essential capability, but software has grown in size and complexity, and is taking longer to complete than expected. Developing, testing, and integrating software, mission systems, and logistics systems are critical for demonstrating the operational effectiveness and suitability of a fully integrated, capable aircraft and pose significant technical risks moving forward. Program Performance against 2011 Objectives and Test Plans Was Mixed: The JSF program achieved 6 of 11 primary objectives it established for 2011. Five of the objectives were specific test and training actions tied to contractual expectations and award fees, according to program officials. The other 6 objectives were associated with cost, schedule, contract negotiations, and sustainment. The program successfully met 2 important test objectives: the Marine Corps' short takeoff and vertical landing (STOVL) variant accomplished sea trials and the Navy's carrier variant (CV) completed static structural testing. Two other test objectives were not met: the carrier variant did not demonstrate shipboard suitability because of problems with the tail hook, which requires redesign, and software was not released to flight test on time. The program also successfully completed objectives related to sustainment design reviews, schedule data, manufacturing processes, and cost control, but did not meet a training deadline or complete contract negotiations. Development flight testing sustained momentum begun in 2010 and met or exceeded most objectives in its modified test plan for 2011. The program accomplished 972 test flights in 2011, more than double the flights in 2010. Flight test points[Footnote 6] accomplished exceeded the plan, overall as shown in figure 3. The flight test points accomplished on the Air Force's conventional takeoff and landing (CTOL) variant were less than planned, due to operating limitations and aircraft reliability. Figure 3: 2011 JSF Flight Test Points Progress: [Refer to PDF for image: horizontal bar graph] CTOL flight sciences: Planned for 2011: 2,052; Accomplished on 2011: 1,864. STOVL flight sciences: Planned for 2011: 2,272; Accomplished on 2011: 2,322. CV flight sciences: Planned for 2011: 1,109; Accomplished on 2011: 1,426. Mission systems: Planned for 2011: 823; Accomplished on 2011: 1,052. Source: GAO analysis of DOD data. [End of figure] Even with the progress made in 2011, most development flight testing, including the most challenging, still lies ahead. Through 2011, the flight test program had completed 21 percent of the nearly 60,000 planned flight test points estimated for the entire program.[Footnote 7] Program officials reported that flight tests to date have largely demonstrated air worthiness, flying qualities, speed, altitude, and maneuvering performance requirements. According to JSF test officials, the more complex testing such as low altitude flight operations, weapons and mission systems integration, and high angle of attack has yet to be done for any variant and may result in new discoveries. Initial development flight tests of a fully integrated, capable JSF aircraft to demonstrate full mission systems capabilities, weapons delivery, and autonomic logistics is now expected in 2015 at the earliest. This will be critical for verifying that the JSF aircraft will work as intended and for demonstrating that the design is not likely to need costly changes. Like other major weapon system acquisitions, the JSF will be susceptible to discovering costly problems later in development when the more complex software and advanced capabilities are integrated and flight tested. With most development flight testing still to go, the program can expect more changes to aircraft design and continued alterations of manufacturing processes. STOVL Issues and Its Probation Period: The STOVL variant performed better than expected in flight tests during 2011. It increased flight test rates and STOVL-specific mode testing, surpassing planned test point progress for the year. Following reliability problems and performance issues, the Secretary of Defense in January 2011 had placed the STOVL on "probation" for two years, citing technical issues unique to the variant that would add to the aircraft's cost and weight. The probation limited the U.S. STOVL procurement to three aircraft in fiscal year 2011 and six aircraft in fiscal year 2012 and decoupled STOVL testing from CV and CTOL testing so as not to delay those variants. While no specific exit criteria was defined, the two year probation was expected to provide enough time to address STOVL-specific technical issues, engineer solutions, and assess their impact. In January 2012, the Secretary of Defense lifted the STOVL probation after one year, citing improved performance and completion of the initial sea trials as a basis for the decision. The Department concluded that STOVL development, test, and product maturity is now comparable to the other two variants. While several technical issues have been addressed and some potential solutions engineered, assessing whether the deficiencies are resolved is ongoing and, in some cases, will not be known for years. According to the program office, two of the five specific problems cited are considered to be fixed while the other three have temporary fixes in place. The Director, Operational Test and Evaluation reported that significant work remains to verify and incorporate modifications to correct known STOVL deficiencies and prepare the system for operational use. Until the proposed technical solutions have been fully tested and demonstrated, it cannot be determined if the technical problems have been resolved. Software and Mission Systems Represent Significant Risks: Software providing essential JSF capability has grown in size and complexity, and is taking longer to complete than expected. Late releases of software have delayed testing and training, and added costs. Software defects, low productivity, and concurrent development of successive blocks have created inefficiencies, taking longer to fix defects and delaying the demonstration of critical capabilities. The program has modified the software development and integration schedule several times, in each instance lengthening the time needed to complete work. In attempting to maintain schedule, the program has deferred some capabilities to later blocks. Deferring tasks to later phases of development adds more pressure and costs to future efforts and likely increases the probability of defects being realized later in the program, when the more complex capabilities in these later blocks are already expected to be a substantial technical challenge. The lines of code necessary for the JSF's capabilities have now grown to over 24 million--9.5 million on board the aircraft. By comparison, JSF has about 3 times more on-board software lines of code than the F- 22A Raptor and 6 times more than the F/A-18 E/F Super Hornet. This has added work and increased the overall complexity of the effort. The software on-board the aircraft and needed for operations has grown 37 percent since the critical design review in 2005. While software growth appears to be moderating, contractor officials report that almost half of the on-board software has yet to complete integration and test--typically the most challenging phase of software development. JSF software growth is not much different than other recent defense acquisitions which have experienced from 30 to 100 percent growth in software code over time. However, the sheer number of lines of code for the JSF makes the growth a notable cost and schedule challenge. JSF's mission systems[Footnote 8] and logistics systems are critical to realizing the operational and support capabilities expected by the warfighter, but the hardware and software for these systems are immature and unproven at this time. Only 4 percent of mission systems requirements have been verified and significant learning and development remains before the program can demonstrate mature software and hardware. The program has experienced significant technical challenges developing and integrating mission and logistics systems software and hardware, including problems with the radar, integrated processor, communication and navigation equipment, and electronic warfare capabilities. * Problems with the helmet mounted display may pose the greatest risk. The helmet is integral to fusing and displaying sensor and weapons employment data, providing situational awareness, and reducing pilot workload. Helmet shortfalls-including night vision capability, display jitter (varying image), and latency (or delay) in transmitting data- could limit capability or change operational concepts. DOD is pursuing a dual path by funding a less-capable alternate helmet as a back-up; this development effort will cost more than $80 million. The selected helmet will not be integrated with the baseline aircraft until 2014 or later, increasing the risks of a major system redesign, retrofits of already built aircraft, or changes in concepts of operation. * The Autonomic Logistics Information System (ALIS) is a ground system essential to managing and streamlining logistics and maintenance functions and for controlling life-cycle operating and support costs. ALIS is also not mature and may require some design changes to address known deficiencies. ALIS is in limited operations at test and training sites and officials are evaluating proposed solutions. While additional development time and resources may resolve some deficiencies, several requirements are not going to be met given current schedules, according to the JSF test team report. Initial dedicated operational testing of a fully integrated JSF is tentatively scheduled to begin in 2017. Operational testing is important for evaluating the warfighting effectiveness and suitability of the JSF, and successfully completing initial operational testing is required to support the full rate production decision, now expected in 2019. Operational testers assessed progress of JSF development testing and its readiness for operational testing, and concluded that the program was not on track to meet operational effectiveness or suitability requirements. The test team's October 2011 report identified deficiencies with the helmet mounted display, night vision capability, aircraft handling characteristics, and shortfalls in maneuvering performance. The report also cited an inadequate logistics system for deployments, excessive time to repair and restore low observable features, low reliability, and poor maintainability performance. It also stated that the JSF will require substantial improvements in order to achieve sortie generation rates and life cycle cost requirements. Contract Overruns and Concurrency Costs Indicate the Program Has Not Yet Stabilized Design and Manufacturing: The program has not yet demonstrated a stable design and manufacturing processes capable of efficient production. Engineering changes are persisting at relatively high rates and additional changes will be needed as testing continues. Manufacturing processes and performance indicators show some progress, but performance on the first four low- rate initial production contracts has not been good. All four have experienced cost overruns and late aircraft deliveries. In addition, the government is also incurring substantial additional costs to retrofit produced aircraft to correct deficiencies discovered in testing. Until manufacturing processes are in control and engineering design changes resulting from information gained during developmental testing are reduced, there is risk of more cost growth. Actions the Department has taken to restructure the program have helped, but remaining concurrency between flight testing and production continues to put cost and schedule at risk. Even with the substantial reductions in near-term procurement quantities, DOD is still investing billions of dollars on hundreds of aircraft while flight testing has years to go. Cost Overruns and Delivery Delays Indicate Need to Further Mature the Manufacturing Process: As was the experience with building the development test aircraft, manufacturing the procurement aircraft is costing more and taking longer than planned. Cost overruns and delivery slips are two indicators that manufacturing processes, worker efficiency, quality control, and supplier performance are not yet sufficiently capable to handle the volume of work scheduled. Cost overruns on each of the first four annual procurement contracts are projected to total about $1 billion (see table 2). Table 2: Procurement Contract Costs as of November 2011: Contract: LRIP 1; Number of aircraft: 2; Contract cost at award: $511.7 million; Current contract cost estimate: $561.5 million; Cost increase: $49.8 million; Percent increase: 9.7%. Contract: LRIP 2; Number of aircraft: 12; Contract cost at award: $2.279 billion; Current contract cost estimate: $2.608 billion; Cost increase: $329.2 million; Percent increase: 14.4%. Contract: LRIP 3; Number of aircraft: 17; Contract cost at award: $3.154 billion; Current contract cost estimate: $3.570 billion; Cost increase: $415.3 million; Percent increase: 13.2%. Contract: LRIP 4; Number of aircraft: 32; Contract cost at award: $3.458 billion; Current contract cost estimate: $3.703 billion; Cost increase: $245.0 million; Percent increase: 7.1%. Contract: Total; Number of aircraft: 63; Contract cost at award: $9.403 billion; Current contract cost estimate: $10.442 billion; Cost increase: $1,039.3 million; Percent increase: 11.1%. Source: GAO analysis of DOD data. Note: LRIP is low-rate initial production. These are the first four annual procurements. [End of table] According to program documentation, through the cost sharing provisions in these contracts, the government's share of the total overrun is about $672 million. On average, the government is paying an additional $11 million for the 63 aircraft on under contract (58 are U.S. aircraft and 5 are for international partners). There is risk of additional cost overruns because all work is not completed. Defense officials reduced the buy quantity in the fifth annual procurement contract to help fund these cost overruns and additional retrofit costs to fix deficiencies discovered in testing. While Lockheed Martin, the prime contractor, is demonstrating somewhat better throughput capacity and showing improved performance indicators, the lingering effects of critical parts shortages, out of station work[Footnote 9], and quality issues continue to be key cost and schedule drivers on the first four production lots. Design modifications to address deficiencies discovered in testing, incorporation of bulkhead and wing process improvements, and production of the first carrier variant further impacted manufacturing during 2011. Lockheed had expected to deliver 30 procurement aircraft by the end of 2011 but delivered only nine procurement aircraft. Each was delivered more than 1 year late. The manufacturing effort still has thousands of aircraft planned for production over the next 25 years and the rate of production is expected to increase substantially starting in 2015. This will make it vital that the contractor achieve an efficient manufacturing process. Pratt & Whitney, the engine manufacturer, had delivered 42 production engines and 12 lift fans at the time of our review.[Footnote 10] Like the aircraft system, the propulsion system is still under development working to complete testing and fix deficiencies while concurrently delivering engines under the initial procurement contracts. The program office's estimated cost for the system development and demonstration of the engine has increased by 75 percent, from $4.8 billion to $8.4 billion, since the start of development. Engine deliveries continue to miss expected contract due dates but still met aircraft need dates because of longer slips in aircraft production. Supplier performance problems and design changes are driving cost increases and late engines. Lift fan system components and processes are driving the major share of cost and schedule problems. Going forward, Lockheed Martin's ability to manage its expanding global supplier network is fundamental to meeting production rates and throughput expectations. DOD's Independent Manufacturing Review Team earlier identified global supply chain management as the most critical challenge for meeting production expectations. The cooperative aspect of the supply chain provides both benefits and challenges. The international program structure is based on a complex set of relationships involving both government and industry from the United States and eight other countries. Overseas suppliers are playing a major and increasing role in JSF manufacturing and logistics. For example, center fuselage and wings will be manufactured by Turkish and Italian suppliers, respectively, as second sources. In addition to ongoing supplier challenges-parts shortages, failed parts, and late deliveries-incorporating international suppliers presents additional challenges. In addition, the program must deal with exchange rate fluctuations, disagreements over work shares, technology transfer concerns, different accounting methods, and transportation requirements that have already caused some delays. Also, suppliers have sometimes struggled to develop critical and complex parts while others have had problems with limited production capacity. Lockheed Martin has implemented a stricter supplier assessment program to help manage supplier performance. Testing and Production Overlap Increases Engineering Changes and Concurrency Costs: We and several defense offices cautioned the Department years ago about the risks posed by the extremely high degree of concurrency, or overlap, among the JSF development, testing, and production activities.[Footnote 11] To date, the Government has incurred an estimated $373 million in retrofit costs on already-built aircraft to correct deficiencies discovered in development testing. This is in addition to the $672 million for the government's share of contract cost overruns. The program office projects additional retrofit costs through lot 10, but at decreasing amounts. Questions about who will pay for additional retrofit costs under the planned fixed price contracts-the contractor or the government-and how much, have delayed final contract negotiations on the fifth lot. Producing aircraft before testing sufficiently demonstrates the design is mature increases the likelihood of future design changes, which drives cost growth, schedule delays, and manufacturing inefficiencies. Design changes needed in one JSF variant could also impact the other two variants, reducing efficiencies necessary to lower production and operational costs with common parts and manufacturing processes for the three variants. While the JSF program's engineering change traffic- the monthly volume of changes made to engineering drawings-is declining, it is still higher than expected for a program entering its sixth year of production. The total number of engineering drawings continues to grow due to design changes, discoveries during ground and flight testing, and other revisions to drawings. Figure 4 tracks design changes over time and shows that changes are expected to persist at an elevated pace through 2019. Figure 4: JSF Design Changes Over Time: [Refer to PDF for image: combined vertical bar and line graph] Year: 2006: Month: January; Number of design changes, 2007 plan: 264; Actual design changes through September 2011: 251; Month: February; Number of design changes, 2007 plan: 323; Actual design changes through September 2011: 283; Month: March; Number of design changes, 2007 plan: 341; Actual design changes through September 2011: 362; Month: April; Number of design changes, 2007 plan: 374; Actual design changes through September 2011: 281. Month: May; Number of design changes, 2007 plan: 403; Actual design changes through September 2011: 373. Month: June; Number of design changes, 2007 plan: 378; Actual design changes through September 2011: 447. Month: July; Number of design changes, 2007 plan: 411; Actual design changes through September 2011: 347. Month: August; Number of design changes, 2007 plan: 513; Actual design changes through September 2011: 520. Month: September; Number of design changes, 2007 plan: 575; Actual design changes through September 2011: 385. Month: October; Number of design changes, 2007 plan: 490; Actual design changes through September 2011: 515. Month: November; Number of design changes, 2007 plan: 495; Actual design changes through September 2011: 505. Month: December; Number of design changes, 2007 plan: 547; Actual design changes through September 2011: 378. Year: 2007: Month: January; Number of design changes, 2007 plan: 653; Actual design changes through September 2011: 620. Month: February; Number of design changes, 2007 plan: 579; Actual design changes through September 2011: 567. Month: March; Number of design changes, 2007 plan: 576; Actual design changes through September 2011: 598. Month: April; Number of design changes, 2007 plan: 595; Actual design changes through September 2011: 647. Month: May; Number of design changes, 2007 plan: 663; Actual design changes through September 2011: 697. Month: June; Number of design changes, 2007 plan: 702; Actual design changes through September 2011: 634. Month: July; Number of design changes, 2007 plan: 747; Actual design changes through September 2011: 681. Month: August; Number of design changes, 2007 plan: 797; Actual design changes through September 2011: 739. Month: September; Number of design changes, 2007 plan: 775; Actual design changes through September 2011: 744. Month: October; Number of design changes, 2007 plan: 730; Actual design changes through September 2011: 876. Month: November; Number of design changes, 2007 plan: 761; Actual design changes through September 2011: 678. Month: December; Number of design changes, 2007 plan: 814; Actual design changes through September 2011: 578. Year: 2008: Month: January; Number of design changes, 2007 plan: 853; Actual design changes through September 2011: 606. Month: February; Number of design changes, 2007 plan: 828; Actual design changes through September 2011: 594. Month: March; Number of design changes, 2007 plan: 759; Actual design changes through September 2011: 645. Month: April; Number of design changes, 2007 plan: 675; Actual design changes through September 2011: 560. Month: May; Number of design changes, 2007 plan: 624; Actual design changes through September 2011: 387. Month: June; Number of design changes, 2007 plan: 599; Actual design changes through September 2011: 459. Month: July; Number of design changes, 2007 plan: 606; Actual design changes through September 2011: 605. Month: August; Number of design changes, 2007 plan: 578; Actual design changes through September 2011: 590. Month: September; Number of design changes, 2007 plan: 477; Actual design changes through September 2011: 590. Month: October; Number of design changes, 2007 plan: 428; Actual design changes through September 2011: 621. Month: November; Number of design changes, 2007 plan: 422; Actual design changes through September 2011: 527. Month: December; Number of design changes, 2007 plan: 421; Actual design changes through September 2011: 508. Year: 2009: Month: January; Number of design changes, 2007 plan: 389; Actual design changes through September 2011: 573. Month: February; Number of design changes, 2007 plan: 394; Actual design changes through September 2011: 655. Month: March; Number of design changes, 2007 plan: 328; Actual design changes through September 2011: 716. Month: April; Number of design changes, 2007 plan: 346; Actual design changes through September 2011: 629. Month: May; Number of design changes, 2007 plan: 330; Actual design changes through September 2011: 522. Month: June; Number of design changes, 2007 plan: 306; Actual design changes through September 2011: 568. Month: July; Number of design changes, 2007 plan: 288; Actual design changes through September 2011: 493. Month: August; Number of design changes, 2007 plan: 291; Actual design changes through September 2011: 492. Month: September; Number of design changes, 2007 plan: 301; Actual design changes through September 2011: 482. Month: October; Number of design changes, 2007 plan: 282; Actual design changes through September 2011: 480. Month: November; Number of design changes, 2007 plan: 266; Actual design changes through September 2011: 415. Month: December; Number of design changes, 2007 plan: 259; Actual design changes through September 2011: 302. Year: 2010: Month: January; Number of design changes, 2007 plan: 260; Actual design changes through September 2011: 342. Month: February; Number of design changes, 2007 plan: 259; Actual design changes through September 2011: 323. Month: March; Number of design changes, 2007 plan: 270; Actual design changes through September 2011: 363. Month: April; Number of design changes, 2007 plan: 258; Actual design changes through September 2011: 376. Month: May; Number of design changes, 2007 plan: 253; Actual design changes through September 2011: 353. Month: June; Number of design changes, 2007 plan: 254; Actual design changes through September 2011: 356. Month: July; Number of design changes, 2007 plan: 257; Actual design changes through September 2011: 314. Month: August; Number of design changes, 2007 plan: 242; Actual design changes through September 2011: 302. Month: September; Number of design changes, 2007 plan: 244; Actual design changes through September 2011: 345. Month: October; Number of design changes, 2007 plan: 226; Actual design changes through September 2011: 271. Month: November; Number of design changes, 2007 plan: 216; Actual design changes through September 2011: 322. Month: December; Number of design changes, 2007 plan: 210; Actual design changes through September 2011: 250. Year: 2011: Month: January; Number of design changes, 2007 plan: 202; Actual design changes through September 2011: 276. Month: February; Number of design changes, 2007 plan: 193; Actual design changes through September 2011: 250. Month: March; Number of design changes, 2007 plan: 192; Actual design changes through September 2011: 314. Month: April; Number of design changes, 2007 plan: 178; Actual design changes through September 2011: 301. Month: May; Number of design changes, 2007 plan: 168; Actual design changes through September 2011: 298. Month: June; Number of design changes, 2007 plan: 155; Actual design changes through September 2011: 358. Month: July; Number of design changes, 2007 plan: 152; Actual design changes through September 2011: 281. Month: August; Number of design changes, 2007 plan: 145; Actual design changes through September 2011: 348. Month: September; Number of design changes, 2007 plan: 142; Actual design changes through September 2011: 301. Month: October; Number of design changes, 2007 plan: 142; Projected future design changes as of October 2011: 262; Actual design changes through September 2011: Month: November; Number of design changes, 2007 plan: 138; Projected future design changes as of October 2011: 256. Month: December; Number of design changes, 2007 plan: 138; Projected future design changes as of October 2011: 248. Year: 2012: Month: January; Number of design changes, 2007 plan: 144; Projected future design changes as of October 2011: 255. Month: February; Number of design changes, 2007 plan: 151; Projected future design changes as of October 2011: 251. Month: March; Number of design changes, 2007 plan: 137; Projected future design changes as of October 2011: 254. Month: April; Number of design changes, 2007 plan: 140; Projected future design changes as of October 2011: 251. Month: May; Number of design changes, 2007 plan: 137; Projected future design changes as of October 2011: 253. Month: June; Number of design changes, 2007 plan: 138; Projected future design changes as of October 2011: 249. Month: July; Number of design changes, 2007 plan: 140; Projected future design changes as of October 2011: 248. Month: August; Number of design changes, 2007 plan: 137; Projected future design changes as of October 2011: 248. Month: September; Number of design changes, 2007 plan: 129; Projected future design changes as of October 2011: 267. Month: October; Number of design changes, 2007 plan: 124; Projected future design changes as of October 2011: 251. Month: November; Number of design changes, 2007 plan: 121; Projected future design changes as of October 2011: 265. Month: December; Number of design changes, 2007 plan: 105; Projected future design changes as of October 2011: 245. Year: 2013: Month: January; Number of design changes, 2007 plan: 72; Projected future design changes as of October 2011: 243. Month: February; Number of design changes, 2007 plan: 63; Projected future design changes as of October 2011: 244. Month: March; Number of design changes, 2007 plan: 55; Projected future design changes as of October 2011: 240. Month: April; Number of design changes, 2007 plan: 38; Projected future design changes as of October 2011: 242. Month: May; Number of design changes, 2007 plan: 39; Projected future design changes as of October 2011: 224. Month: June; Number of design changes, 2007 plan: 38; Projected future design changes as of October 2011: 241. Month: July; Number of design changes, 2007 plan: 30; Projected future design changes as of October 2011: 235. Month: August; Number of design changes, 2007 plan: 30; Projected future design changes as of October 2011: 260. Month: September; Number of design changes, 2007 plan: Projected future design changes as of October 2011: 252. Month: October; Number of design changes, 2007 plan: 30; Projected future design changes as of October 2011: 273. Month: November; Number of design changes, 2007 plan: 30; Projected future design changes as of October 2011: 271. Month: December; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 279. Year: 2014: Month: January; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 281. Month: February; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 265. Month: March; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 257. Month: April; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 259. Month: May; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 255. Month: June; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 232. Month: July; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 228. Month: August; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 224. Month: September; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 210. Month: October; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 203. Month: November; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 187. Month: December; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 176. Year: 2015: Month: January; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 168. Month: February; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 175. Month: March; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 157. Month: April; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 154. Month: May; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 144. Month: June; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 134. Month: July; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 126. Month: August; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 120. Month: September; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 113. Month: October; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 109. Month: November; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 109. Month: December; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 109. Year: 2016: Month: January; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 112. Month: February; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 123. Month: March; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 132. Month: April; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 140. Month: May; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 147. Month: June; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 152. Month: July; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 154. Month: August; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 161. Month: September; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 163. Month: October; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 166. Month: November; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 174. Month: December; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 184. Year: 2017: Month: January; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 185. Month: February; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 189. Month: March; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 194. Month: April; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 196. Month: May; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 205. Month: June; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 208. Month: July; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 218. Month: August; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 223. Month: September; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 232. Month: October; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 232. Month: November; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 239. Month: December; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 243. Year: 2018: Month: January; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 248. Month: February; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 250. Month: March; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 249. Month: April; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 247. Month: May; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 247. Month: June; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 243. Month: July; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 243. Month: August; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 246. Month: September; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 248. Month: October; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 250. Month: November; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 249. Month: December; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 249. Year: 2019: Month: January; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 256. Month: February; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 260. Month: March; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 259. Month: April; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 262. Month: May; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 235. Month: June; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 211. Month: July; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 184. Month: August; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 156. Month: September; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 132. Month: October; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 108. Month: November; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 80. Month: December; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 55. Year: 2020: Month: January; Number of design changes, 2007 plan: 0; Projected future design changes as of October 2011: 31. Source: GAO analysis of DOD data. [End of figure] Defense officials have long acknowledged the substantial concurrency built into the JSF acquisition strategy, but until recently stated that risks were manageable. However, a recent high-level departmental review of JSF concurrency determined that the program is continuing to discover issues at a rate more typical of early design experience, questioning the assumed design maturity that supported the highly concurrent acquisition strategy.[Footnote 12] DOD's November 2011 report concluded that the "team assesses the current confidence in the design maturity of the F-35 to be lower than one would expect given the quantity of LRIP aircraft procurements planned and the potential cost of reworking these aircraft as new test discoveries are made. This lack of confidence, in conjunction with the concurrency driven consequences of the required fixes, supports serious reconsideration of procurement and production planning." The review identified substantial risk of needed modifications to already produced aircraft as the flight testing enters into more strenuous test activities. Already, as a result of problems found in less strenuous basic airworthiness testing, critical design modifications are being fed back through the production line. For example, the program will be cutting in aircraft modifications to address bulkhead cracks discovered during airframe ground testing and STOVL auxiliary inlet door durability issues. More critical test discoveries are likely as the program moves into the more demanding phases of testing. Restructuring actions by the Department since early 2010 have provided the JSF program with more achievable development and production goals, and has reduced, but not eliminated, risks of additional retrofit costs due to concurrency in current and future lots. The Department has progressively lowered the production ramp-up rate and cut near term procurement quantities; fewer aircraft procured while testing is still ongoing lowers the risk of having to modify already produced aircraft. However, even with the most recent reductions in quantities, the program will still procure a large number of aircraft before system development is complete and flight testing confirms that the aircraft design and performance meets warfighter requirements. Table 3 shows the current plan that will procure 365 aircraft for $69 billion by the end of planned developmental flight tests. Table 3: JSF Procurement Investments and Flight Test Progress: Cumulative procurement: Fiscal year: 2007: $0.8 billion; Fiscal year: 2008: $3.5 billion; Fiscal year: 2009: $7.1 billion; Fiscal year: 2010: $14.3 billion; Fiscal year: 2011: $21.3 billion; Fiscal year: 2012: $27.6 billion; Fiscal year: 2013: $33.8 billion; Fiscal year: 2014: $40.1 billion; Fiscal year: 2015: $47.9 billion; Fiscal year: 2016: $57.8 billion; Fiscal year: 2017: $69.0 billion. Cumulative aircraft procured: Fiscal year: 2007: 2; Fiscal year: 2008: 14; Fiscal year: 2009: 28; Fiscal year: 2010: 58; Fiscal year: 2011: 90; Fiscal year: 2012: 121; Fiscal year: 2013: 150; Fiscal year: 2014: 179; Fiscal year: 2015: 223; Fiscal year: 2016: 289; Fiscal year: 2017: 365. Percentage of total planned flight tests completed (estimated): Fiscal year: 2007: less than 1%; Fiscal year: 2008: less than 1%; Fiscal year: 2009: less than 1%; Fiscal year: 2010: 1%; Fiscal year: 2011: 5%; Fiscal year: 2012: 17%; Fiscal year: 2013: 32%; Fiscal year: 2014: 52%; Fiscal year: 2015: 72%; Fiscal year: 2016: 91%; Fiscal year: 2017: 100%. Source: GAO analysis of DOD budget and test plan data. Note: Advanced procurement funding from 2006 was incorporated into fiscal year 2007 total funding, as 2007 was the first year of aircraft procurement. Flight testing data reflect the percentage of the total flight test completed at the time of the planned investment decision, which is the beginning of the fiscal year. [End of table] Concluding Observations: Over the last 2 years, the JSF program has undergone extensive restructuring that places it on a more achievable course, albeit a lengthier and more expensive one. At the same time, the near-constant churn (change) in cost, schedule, and performance expectations has hampered oversight and insight into the program, in particular the ability to firmly assess progress and prospects for future success. Going forward, it will be imperative to bring stability to the program and provide a firm understanding of near-and far-term financial requirements so that all parties--the Congress, Defense Department, and international partners--can reasonably set priorities and make informed decisions amid a tough fiscal environment. The JSF remains the critical centerpiece of DOD's long-term tactical aircraft portfolio. System development of the aircraft and engine ongoing for over a decade, continue to experience significant challenges. The program's strategic framework, laden with concurrency, has proved to be problematic and ultimately, a very costly approach. DOD over the past year has identified substantial cost overruns attributed to relatively poor execution in production and specific concurrency-related inefficiencies. There is risk of future cost growth from test discoveries driving changes to design and manufacturing processes. Effectively managing software and the global supply chain is critical to improving program outcomes, increasing manufacturing throughput, and enabling future expansion of JSF procurement. Chairman Bartlett, Ranking Member Reyes, and members of the House Armed Services Committee, this completes my prepared statement. I would be pleased to respond to any questions you may have. We look forward to continuing to work with the Congress as we finalize our upcoming report with potential new recommendations that will address these issues in more detail. GAO Contacts and Acknowledgments: For further information on this statement, please contact Michael Sullivan at (202) 512-4841 or sullivanm@gao.gov. Contact points for our Office of Congressional Relations and Public Affairs may be found on the last page of this statement. Individuals making key contributions to this statement are Bruce Fairbairn, Charlie Shivers, LeAnna Parkey, W. Kendal Roberts, Sean Merrill, and Matt Lea. Related GAO Products: Joint Strike Fighter: Implications of Program Restructuring and Other Recent Developments on Key Aspects of DOD's Prior Alternate Engine Analyses. [hyperlink, http://www.gao.gov/products/GAO-11-903R]. Washington, D.C.: September 14, 2011. Joint Strike Fighter: Restructuring Places Program on Firmer Footing, but Progress Is Still Lagging. [hyperlink, http://www.gao.gov/products/GAO-11-677T]. Washington, D.C.: May 19, 2011. Joint Strike Fighter: Restructuring Places Program on Firmer Footing, but Progress Still Lags. [hyperlink, http://www.gao.gov/products/GAO-11-325]. Washington, D.C.: April 7, 2011. Joint Strike Fighter: Restructuring Should Improve Outcomes, but Progress Is Still Lagging Overall. [hyperlink, http://www.gao.gov/products/GAO-11-450T]. Washington, D.C.: March 15, 2011. Defense Management: DOD Needs to Monitor and Assess Corrective Actions Resulting from Its Corrosion Study of the F-35 Joint Strike Fighter. [hyperlink, http://www.gao.gov/products/GAO-11-171R]. Washington D.C.: December 16, 2010. Joint Strike Fighter: Assessment of DOD's Funding Projection for the F136 Alternate Engine. [hyperlink, http://www.gao.gov/products/GAO-10-1020R]. Washington, D.C.: September 15, 2010. Tactical Aircraft: DOD's Ability to Meet Future Requirements is Uncertain, with Key Analyses Needed to Inform Upcoming Investment Decisions. [hyperlink, http://www.gao.gov/products/GAO-10-789]. Washington, D.C.: July 29, 2010. Joint Strike Fighter: Significant Challenges and Decisions Ahead. [hyperlink, http://www.gao.gov/products/GAO-10-478T]. Washington, D.C.: March 24, 2010. Joint Strike Fighter: Additional Costs and Delays Risk Not Meeting Warfighter Requirements on Time. [hyperlink, http://www.gao.gov/products/GAO-10-382]. Washington, D.C.: March 19, 2010. Joint Strike Fighter: Significant Challenges Remain as DOD Restructures Program. [hyperlink, http://www.gao.gov/products/GAO-10-520T]. Washington, D.C.: March 11, 2010. Joint Strike Fighter: Strong Risk Management Essential as Program Enters Most Challenging Phase. [hyperlink, http://www.gao.gov/products/GAO-09-711T]. Washington, D.C.: May 20, 2009. Joint Strike Fighter: Accelerating Procurement before Completing Development Increases the Government's Financial Risk. [hyperlink, http://www.gao.gov/products/GAO-09-303]. Washington D.C.: March 12, 2009. Joint Strike Fighter: Impact of Recent Decisions on Program Risks. [hyperlink, http://www.gao.gov/products/GAO-08-569T]. Washington, D.C.: March 11, 2008. Joint Strike Fighter: Recent Decisions by DOD Add to Program Risks. [hyperlink, http://www.gao.gov/products/GAO-08-388]. Washington, D.C.: March 11, 2008. Tactical Aircraft: DOD Needs a Joint and Integrated Investment Strategy. [hyperlink, http://www.gao.gov/products/GAO-07-415]. Washington, D.C.: April 2, 2007. Defense Acquisitions: Analysis of Costs for the Joint Strike Fighter Engine Program. [hyperlink, http://www.gao.gov/products/GAO-07-656T]. Washington, D.C.: March 22, 2007. Joint Strike Fighter: Progress Made and Challenges Remain. [hyperlink, http://www.gao.gov/products/GAO-07-360]. Washington, D.C.: March 15, 2007. Tactical Aircraft: DOD's Cancellation of the Joint Strike Fighter Alternate Engine Program Was Not Based on a Comprehensive Analysis. [hyperlink, http://www.gao.gov/products/GAO-06-717R]. Washington, D.C.: May 22, 2006. Tactical Aircraft: Recapitalization Goals Are Not Supported by Knowledge-Based F-22A and JSF Business Cases. [hyperlink, http://www.gao.gov/products/GAO-06-487T]. Washington, D.C.: March 16, 2006. Joint Strike Fighter: DOD Plans to Enter Production before Testing Demonstrates Acceptable Performance. [hyperlink, http://www.gao.gov/products/GAO-06-356]. Washington, D.C.: March 15, 2006. Joint Strike Fighter: Management of the Technology Transfer Process. [hyperlink, http://www.gao.gov/products/GAO-06-364]. Washington, D.C.: March 14, 2006. Tactical Aircraft: F/A-22 and JSF Acquisition Plans and Implications for Tactical Aircraft Modernization. [hyperlink, http://www.gao.gov/products/GAO-05-519T]. Washington, D.C: April 6, 2005. Tactical Aircraft: Opportunity to Reduce Risks in the Joint Strike Fighter Program with Different Acquisition Strategy. [hyperlink, http://www.gao.gov/products/GAO-05-271]. Washington, D.C.: March 15, 2005. [End of section] Footnotes: [1] See related GAO products at the end of this statement. [2] GAO, Joint Strike Fighter: Restructuring Places Program on Firmer Footing, but Progress Still Lags, [hyperlink, http://www.gao.gov/products/GAO-11-325] (Washington, D.C.: Apr. 7, 2011). [3] Pub. L. No. 111-84 § 244 (2009). [4] Commonly referred to as Nunn-McCurdy, 10 U.S.C. § 2433 establishes the requirements for DOD to submit unit cost reports on major defense acquisition programs or designated major subprograms. Two measures are tracked against the current and original baseline estimates for a program: procurement unit cost (total procurement unit funds divided by the quantity of systems procured) and program acquisition unit cost (total funds for development, procurement, and system-specific military construction divided by the quantity of systems procured). If a program's procurement unit cost or acquisition unit cost increases by at least 25 percent over the current baseline estimate or at least 50 percent over the original baseline estimate, it constitutes a breach of the critical cost growth threshold. Programs are required to notify Congress if a Nunn-McCurdy breach is experienced. When a program experiences a Nunn-McCurdy breach of the critical cost growth threshold, DOD is required to take a number of steps, including reassessing the program and submitting a certification to Congress in order to continue the program, in accordance with 10 U.S.C. § 2433a. [5] This is based on information contained in the December 2010 Selected Acquisition Report. Updated funding information for the entire JSF acquisition life-cycle was not available at the time of this testimony. The new baseline information is expected to add to JSF total costs through completion and change the distribution of annual budget requirements, but still show very large budget demands over a long period of time. [6] Flight test points are specific, quantifiable objectives in flight plans that are needed to verify aircraft design and performance. [7] According to program officials, completion of a test point means that the test point has been flown and that flight engineers ruled that the point has met the need. Further analysis may be necessary for the test point to be closed out. [8] Mission systems provide combat effectiveness through next generation sensors with fused information from on-board and off-board systems (i.e., Electronic Warfare, Communication Navigation Identification, Electro-Optical Target System, Electro-Optical Distributed Aperture System, Radar, and Data Links). [9] Out of station work occurs when manufacturing steps are not completed at its designated work station and must be finished elsewhere later in production. This is highly inefficient, increasing labor hours, causing delays, and sometimes quality problems. [10] Note: The prime engine contractor has production contracts with the government and the engines are provided as government furnished equipment to the JSF prime contractor. [11] GAO, Joint Strike Fighter: DOD Plans to Enter Production before Testing Demonstrates Acceptable Performance, [hyperlink, http://www.gao.gov/products/GAO-06-356] (Washington, D.C.: Mar. 15, 2006) and GAO, Joint Strike Fighter: Progress Made and Challenges Remain, [hyperlink, http://www.gao.gov/products/GAO-07-360] (Washington, D.C.: Apr. 2, 2007). [12] F-35 Joint Strike Fighter Concurrency Quick Look Review, Office of the Under Secretary of Defense for Acquisition, Technology and Logistics, Nov. 29, 2011. [End of section] GAO’s Mission: The Government Accountability Office, the audit, evaluation, and investigative arm of Congress, exists to support Congress in meeting its constitutional responsibilities and to help improve the performance and accountability of the federal government for the American people. GAO examines the use of public funds; evaluates federal programs and policies; and provides analyses, recommendations, and other assistance to help Congress make informed oversight, policy, and funding decisions. GAO’s commitment to good government is reflected in its core values of accountability, integrity, and reliability. Obtaining Copies of GAO Reports and Testimony: The fastest and easiest way to obtain copies of GAO documents at no cost is through GAO’s website [hyperlink, http://www.gao.gov]. Each weekday afternoon, GAO posts on its website newly released reports, testimony, and correspondence. To have GAO e-mail you a list of newly posted products, go to [hyperlink, http://www.gao.gov] and select “E- mail Updates.” Order by Phone: The price of each GAO publication reflects GAO’s actual cost of production and distribution and depends on the number of pages in the publication and whether the publication is printed in color or black and white. Pricing and ordering information is posted on GAO’s website, [hyperlink, http://www.gao.gov/ordering.htm]. Place orders by calling (202) 512-6000, toll free (866) 801-7077, or TDD (202) 512-2537. Orders may be paid for using American Express, Discover Card, MasterCard, Visa, check, or money order. Call for additional information. Connect with GAO: Connect with GAO on facebook, flickr, twitter, and YouTube. Subscribe to our RSS Feeds or E mail Updates. Listen to our Podcasts. Visit GAO on the web at [hyperlink, http://www.gao.gov]. To Report Fraud, Waste, and Abuse in Federal Programs: Contact: Website: [hyperlink, http://www.gao.gov/fraudnet/fraudnet.htm]; E-mail: fraudnet@gao.gov; Automated answering system: (800) 424-5454 or (202) 512-7470. Congressional Relations: Katherine Siggerud, Managing Director, siggerudk@gao.gov, (202) 512-4400 U.S. Government Accountability Office, 441 G Street NW, Room 7125 Washington, DC 20548. Public Affairs: Chuck Young, Managing Director, youngc1@gao.gov, (202) 512-4800 U.S. Government Accountability Office, 441 G Street NW, Room 7149 Washington, DC 20548.