This is the accessible text file for GAO report number GAO-09-711T entitled 'Joint Strike Fighter: Strong Risk Management Essential as Program Enters Most Challenging Phase' which was released on May 20, 2009. This text file was formatted by the U.S. Government Accountability Office (GAO) to be accessible to users with visual impairments, as part of a longer term project to improve GAO products' accessibility. Every attempt has been made to maintain the structural and data integrity of the original printed product. Accessibility features, such as text descriptions of tables, consecutively numbered footnotes placed at the end of the file, and the text of agency comment letters, are provided but may not exactly duplicate the presentation or format of the printed version. The portable document format (PDF) file is an exact electronic replica of the printed version. We welcome your feedback. Please E-mail your comments regarding the contents or accessibility features of this document to Webmaster@gao.gov. This is a work of the U.S. government and is not subject to copyright protection in the United States. It may be reproduced and distributed in its entirety without further permission from GAO. Because this work may contain copyrighted images or other material, permission from the copyright holder may be necessary if you wish to reproduce this material separately. Testimony: Before the Subcommittee on Air and Land Forces, Committee on Armed Services, House of Representatives: United States Government Accountability Office: GAO: For Release on Delivery: Expected at 2::30 p.m. EDT: Wednesday, May 20, 2009: Joint Strike Fighter: Strong Risk Management Essential as Program Enters Most Challenging Phase: Statement of Michael Sullivan, Director: Acquisition and Sourcing Management: GAO-09-711T: GAO Highlights: Highlights of GAO-09-711T, a testimony before the Subcommittee on Air and Land Forces, Committee on Armed Services, House of Representatives. Why GAO Did This Study: The F-35 Joint Strike Fighter (JSF) program is the Department of Defense’s (DOD’s) most costly acquisition, seeking to simultaneously develop, produce, and field three aircraft variants for the Air Force, Navy, Marine Corps, and eight international partners. The total expected U.S. investment is now more than $300 billion to develop and procure 2,456 aircraft over the next 25 years. GAO’s most recent report in March of this year discussed increased development costs and schedule estimates, plans to accelerate procurement, manufacturing performance and delays, and development test strategy. A recurring theme in GAO’s work has been concern about what GAO believes is undue concurrency of development, test, and production activities and the heightened risks it poses to achieving good cost, schedule, and performance outcomes. This testimony discusses: * current JSF cost and schedule estimates; * engine development; * manufacturing performance; * contracting issues for procurement of aircraft; and; * test plans. This statement draws from GAO’s March 2009 report, updated to the extent possible with new budget data and a recently revised procurement profile directed by the Secretary of Defense. What GAO Found: JSF development will cost more and take longer to complete than reported to the Congress in April 2008, primarily because of contract cost overruns and extended time needed to complete flight testing. DOD is also significantly increasing annual procurement rates and plans to buy some aircraft sooner than reported last year. Total development costs are projected to increase between $2.4 billion and $7.4 billion and the schedule for completing system development extended from 1 to 3 years. The department has not asked for funding for the alternate engine program in the budgets since 2007 arguing that an alternate engine is not needed as a hedge against the failure of the main engine program and that the savings from competition would be small. Nonetheless, the Congress has added funding each year since then to sustain its development. Our prior analysis indicates that competitive pressures could yield enough savings to offset the costs of competition over the JSF program’s life. To date, the two contractors have spent over $8 billion on engine development—over $6 billion with the main engine contractor and over $2 billion with the second source contractor. Manufacturing of development test aircraft is taking more time, money, and effort than planned, but officials believe that they can still deliver the 9 remaining test aircraft by early 2010. The contractor has not yet demonstrated mature manufacturing processes, or an ability to produce at currently planned rates. It has taken steps to improve manufacturing; however, given the manufacturing challenges, DOD’s plan to increase procurement in the near term adds considerable risk and will be difficult to achieve. DOD is procuring a substantial number of JSF aircraft using cost reimbursement contracts. Cost reimbursement contracts place most of the risk on the buyer—DOD in this case—who is liable to pay more than budgeted should labor, material, or other incurred costs be more than expected when the contract was signed. JSF flight testing is still in its infancy and continues to experience flight testing delays. Nonetheless, DOD is making substantial investments before flight testing proves that the JSF will perform as expected. DOD may procure 273 aircraft costing an estimated $42 billion before completing flight testing. Table: Procurement Investments and Progress of Flight Testing: Cumulative procurement (billions of dollars): 2007: $0.9; 2008: $3.6; 2009: $6.9; 2010: $13.7; 2011: $20.6; 2012: $31.1; 2013: $41.9; 2014: $54.3. Cumulative aircraft procured: 2007: 2; 2008: 14; 2009: 28; 2010: 58; 2011: 101; 2012: 183; 2013: 273; 2014: 383. Percentage of flight test program completed: 2007: <1%; 2008: <1%; 2009: 2%; 2010: 9%; 2011: 34%; 2012: 62%; 2013: 88%; 2014: 100%. Source: GAO analysis of DOD data. [End of table] View [hyperlink, http://www.gao.gov/products/GAO-09-711T] or key components. For more information, contact Michael J. Sullivan at (202) 512-4841 or sullivanm@gao.gov. [End of section] Mr. Chairman and Members of the Subcommittee: I am very pleased to be here today to discuss the F-35 Joint Strike Fighter (JSF) program. The JSF is the Department of Defense's (DOD) most costly acquisition program, seeking to simultaneously develop, produce, and field three aircraft variants for the Air Force, Navy, Marine Corps, and eight international partners. The JSF is critical to our nation's plans for recapitalizing the tactical air forces and will require a long-term commitment to very large annual funding outlays. The total expected U.S. investment is now more than $300 billion to develop and procure 2,456 aircraft over the next 25 years. The JSF program is entering its most challenging phase as it plans to deliver test assets, significantly step up flight testing, begin verifying mission system capabilities, mature manufacturing processes, and quickly ramp up production of operational aircraft. GAO has issued 5 annual reports on the JSF. Our most recent report [Footnote 1] in March of this year discussed increased development costs and schedule, plans to accelerate procurement, manufacturing performance and delays, and the development test strategy. A recurring theme in our work has been concern about what we believe is undue concurrency of development, test, and production activities and the heightened risk it poses to achieving good cost, schedule, and performance outcomes. The department acknowledges the substantial concurrency and risk, but approves of it, hoping to replace aging legacy aircraft with this fifth generation strike aircraft as quickly and efficiently as possible. The department believes that the program is well managed, has the proper amount of oversight, and is well positioned to manage heightened risks and successfully accomplish this mission. Today, I will discuss (1) current JSF cost and schedule estimates; (2) issues concerning the alternate engine program; (3) manufacturing performance; (4) contracting issues for procurement of production aircraft; and (5) development test plans. This statement draws primarily from our March 2009 report, updated to the extent possible with new budget data and a recently revised procurement profile directed by the Secretary of Defense. Information about the alternate engine program comes largely from our testimony in 2008.[Footnote 2] This work was conducted in accordance with generally accepted government auditing standards. Those standards require that we plan and perform the audit to obtain sufficient, appropriate evidence to provide a reasonable basis for our findings and conclusions based on our audit objectives. We believe that the evidence obtained provides a reasonable basis for our findings and conclusions based on our audit objectives. More Money and Time Will Be Needed to Complete JSF Development, While DOD Plans to Accelerate Procurement: JSF development will cost more and take longer to complete than reported to the Congress in April 2008, primarily because of contract cost overruns and extended time needed to complete flight testing. DOD is also significantly increasing annual procurement rates and plans to buy some aircraft sooner than reported last year. The new plan will require increased annual procurement funding over the next 6 years, but officials did not assess its net effect on total program costs through completion of JSF acquisition. Total development costs are projected to increase between $2.4 billion and $7.4 billion and the schedule for completing system development to be extended from 1 to 3 years, according to estimates made in late 2008--one by the JSF Program Office and one by a joint team of Office of the Secretary of Defense (OSD), Air Force, and Navy officials. Cost overruns on both the aircraft and engine contracts, delays in manufacturing test aircraft, and a need for a longer, more robust flight test program were the primary cost drivers. The joint team's estimate is higher than the program office's because it included costs for the alternate engine program directed by the Congress and used more conservative assumptions based on current and legacy aircraft experiences. Table 1 compares these two estimates with the official program of record which was reported to the Congress in April 2008. Table 1: Estimated Cost and Schedule for System Development and Demonstration: Development costs to complete: 2007 program of record: $7.4 billion; JSF Program Office: $9.8 billion; Joint estimating team: $14.8 billion. Total development costs: 2007 program of record: $44.4 billion; JSF Program Office: $46.8 billion; Joint estimating team: $51.8 billion. Date to complete development: 2007 program of record: October 2013; JSF Program Office: October 2014; Joint estimating team: October 2016. Source: GAO analysis of DOD data. [End of table] The new defense budget just submitted requests for $3.6 billion for fiscal year 2010 JSF development costs. This is about $200 million more than the program office estimated for 2010 and about $700 million less than the joint team's estimate. [Footnote 3] The request does not include funding for the alternate engine program directed by the Congress. This issue is discussed in the next section. Although annual budgets and procurement quantities for fiscal year 2011 and out are still being reviewed by defense officials and are not available to us, we expect the JSF program to continue its rapid increase in annual procurement quantities and to buy some aircraft sooner than reported to the Congress in April 2008. At that time, DOD planned to ramp up procurement to reach a maximum of 130 aircraft per year by fiscal year 2015 (U.S. quantities only) and sustain this rate for 8 years. Procurement budget requirements for that plan were projected to be over $12 billion per year during peak production. The new fiscal year 2010 procurement budget requests funding of $6.8 billion for 30 JSF aircraft, a unit cost of $227 million. This budget is substantially lower than both the program office's and the joint team's estimates for 2010, in terms of unit costs and overall procurement funding. Last month, the Secretary of Defense announced plans to procure 513 JSF aircraft during the 6-year period, fiscal years 2010 through 2015. This total includes procuring 28 more aircraft during this period than previously planned. This plan does not increase the total aircraft to be procured through completion of the JSF program but would buy these 28 aircraft in earlier years than previously scheduled. By accelerating procurement, DOD hopes to recapitalize tactical air forces sooner and mitigate projected future fighter shortfalls. The additional aircraft represent a scaling back of the proposed JSF procurement plans that we reported on in March 2009. At that time, DOD was proposing to accelerate procurement by 169 aircraft during these same years. That proposal would have required from $22 billion to $33 billion more in total procurement funding over that period, according to the respective estimates of the program office and joint estimating team. We have not yet been provided budgets and annual procurement quantities for fiscal years 2011 and out under the Secretary's revised plan that would establish the increased funding requirements for the new accelerated plan compared to annual procurement funding requirements under the April 2008 program of record. Appendixes 1 and 2 provide an historical track of cost and schedule estimates. DOD's Proposal to Cancel the Alternate Engine Program May Bypass Long- term Merits: DOD and the Congress have had a continuing debate for several years on the merits of an alternate engine program to provide a second source and competition for engine procurement and life cycle support. The alternate engine program was part of the original JSF acquisition strategy. The department first proposed canceling the alternate engine program in the 2007 budget and has not asked for funding in the budgets since then. The administration does not believe an alternate engine is needed as a hedge against the failure of the main engine program and believes savings from competition would be small. The Congress has added funding each year since 2007 to sustain the alternate engine development, including $465 million for fiscal year 2009. To date, the two contractors have spent over $8 billion on engines development--over $6 billion with the main engine contractor and over $2 billion with the second source contractor. The way forward for the JSF engine acquisition strategy entails one of many critical choices facing DOD today, and underscores the importance of decisions facing the program. As we noted in past testimonies before this committee, the acquisition strategy for the JSF engine must weigh expected costs against potential rewards. In each of the past 2 years we have testified before this committee on the merits of a competitive engine program for the Joint Strike Fighter.[Footnote 4] While we did not update our analysis we believe it is still relevant and the same conclusions can be drawn. We reported in 2008 that to continue the JSF alternate engine program, an additional investment of about $3.5 billion to $4.5 billion in development and production-related costs, may be required to ensure competition.[Footnote 5] Our earlier cost analysis suggests that a savings of 9 to 11 percent would recoup that investment. As we reported last year, a competitive strategy has the potential for savings equal to or exceeding that amount across the life cycle of the engine. Prior experience indicates that it is reasonable to assume that competition on the JSF engine program could yield savings of at least that much. As a result, we remain confident that competitive pressures could yield enough savings to offset the costs of competition over the JSF program's life. However, we recognize that this ultimately will depend on the final approach for the competition, the number of aircraft actually purchased, and the ratio of engines awarded to each contractor. Results from past competitions provide evidence of potential financial and nonfinancial savings that can be derived from engine programs. One relevant case study to consider is the "Great Engine War" of the 1980s- -the competition between Pratt & Whitney and General Electric to supply military engines for the F-16 and other fighter aircraft programs. At that time, all engines for the F-14 and F-15 aircraft were being produced on a sole-source basis by Pratt & Whitney, which was criticized for increased procurement and maintenance costs, along with a general lack of responsiveness to government concerns about those programs. For example, safety issues with the single-engine F-16 aircraft were seen as having greater consequences than safety issues with the twin-engine F-14 or F-15 aircraft. To address concerns, the Air Force began to fund the development and testing of an alternate engine to be produced by General Electric; the Air Force also supported the advent of an improved derivative of the Pratt & Whitney engine. Beginning in 1983, the Air Force initiated a competition that Air Force documentation suggests resulted in significant cost savings in the program. In the first 4 years of the competition, when actual costs are compared to the program's baseline estimate, results included (1) nearly 30 percent cumulative savings for acquisition costs, (2) roughly 16 percent cumulative savings for operations and support costs; and (3) total savings of about 21 percent in overall life cycle costs. The Great Engine War was able to generate significant benefits because competition incentivized contractors to improve designs and reduce costs during production and sustainment. Competitive pressure continues today as the F-15 and F-16 aircraft are still being sold internationally. While other defense competitions resulted in some level of benefits, especially with regard to contractor responsiveness, they did not see the same levels of success absent continued competitive pressures. Similar competition for the JSF engines may also provide benefits that do not result in immediate financial savings, but could result in reduced costs or other positive outcomes over time. Our prior work, along with studies by DOD and others, indicate there are a number of nonfinancial benefits that may result from competition, including better performance, increased reliability, and improved contractor responsiveness. In addition, the long-term effects of the JSF engine program on the global industrial base go far beyond the two competing contractors. DOD and others have performed studies and have widespread concurrence as to these other benefits, including better engine performance, increased reliability, and improved contractor responsiveness. In fact, in 1998 and 2002, DOD program management advisory groups assessed the JSF alternate engine program and found the potential for significant benefits in these and other areas. Table 2 summarizes the benefits determined by those groups. Table 2: 1998 and 2002 Program Management Advisory Group Study Findings on the Benefits of an Alternate Engine Program: Factor assessed: Costs; Beneficial: 1998: [Empty]; Beneficial: 2002: [Empty]; Marginal: 1998: [Check]; Marginal: 2002: [Check]; No value: 1998: [Empty]; No value: 2002: [Empty]. Factor assessed: Development risk reduction; Beneficial: 1998: [Empty]; Beneficial: 2002: [Empty]; Marginal: 1998: [Empty]; Marginal: 2002: [Empty]; No value: 1998: [Check]; No value: 2002: [Check]. Factor assessed: Engine growth potential; Beneficial: 1998: [Empty]; Beneficial: 2002: [Empty]; Marginal: 1998: [Check]; Marginal: 2002: [Check]; No value: 1998: [Empty]; No value: 2002: [Empty]. Factor assessed: Fleet readiness; Beneficial: 1998: [Check]; Beneficial: 2002: [Check]; Marginal: 1998: [Empty]; Marginal: 2002: [Empty]; No value: 1998: [Empty]; No value: 2002: [Empty]. Factor assessed: Industrial base; Beneficial: 1998: [Check]; Beneficial: 2002: [Check]; Marginal: 1998: [Empty]; Marginal: 2002: [Empty]; No value: 1998: [Empty]; No value: 2002: [Empty]. Factor assessed: International implications; Beneficial: 1998: [Check]; Beneficial: 2002: [Check]; Marginal: 1998: [Empty]; Marginal: 2002: [Empty]; No value: 1998: [Empty]; No value: 2002: [Empty]. Factor assessed: Other considerations[A]; Beneficial: 1998: [Check]; Beneficial: 2002: [Check]; Marginal: 1998: [Empty]; Marginal: 2002: [Empty]; No value: 1998: [Empty]; No value: 2002: [Empty]. Factor assessed: Overall; Beneficial: 1998: [Check]; Beneficial: 2002: [Check]; Marginal: 1998: [Empty]; Marginal: 2002: [Empty]; No value: 1998: [Empty]; No value: 2002: [Empty]. Source: GAO analysis of DOD data. [A] Other considerations include contractor responsiveness, improved design solutions, and competition at the engine subsystem level. [End of table] While the benefits highlighted may be more difficult to quantify, they are no less important, and ultimately were strongly considered in recommending continuation of the alternate engine program. These studies concluded that the program would maintain the industrial base for fighter engine technology, enhance readiness, instill contractor incentives for better performance, ensure an operational alternative if the current engine developed problems, and enhance international participation. Another potential benefit of having an alternate engine program, and one also supported by the program advisory groups, is to reduce the risk that a single point systemic failure in the engine design could substantially affect the fighter aircraft fleet. This point is underscored by recent failures of the Pratt & Whitney test program. In August 2007, an engine running at a test facility experienced failures in the low pressure turbine blade and bearing, which resulted in a suspension of all engine test activity. In February 2008, during follow- on testing to prove the root cause of these failures, a blade failure occurred in another engine, resulting in delays to both the Air Force and Marine Corps variant flight test programs. Continued Manufacturing Inefficiencies Will Make it Difficult for the Program to Meet Its Production Schedule: Manufacturing of JSF development test aircraft is taking more time, money, and effort than planned. Officials believe that they can work through these problems and deliver the 9 remaining test aircraft by early 2010; however, by that time, DOD may have already ordered as many as 58 production aircraft. Manufacturing inefficiencies and parts shortages continue to delay the completion and delivery of development test aircraft needed for flight testing. The contractor has not yet demonstrated mature manufacturing processes, or an ability to produce aircraft consistently at currently planned annual rates. It has taken steps to improve manufacturing processes, the supplier base, and schedule management; however, given the manufacturing challenges, we believe that DOD's plan to accelerate procurement in the near term adds considerable risk and will be difficult to achieve. The prime contractor has restructured the JSF manufacturing schedule several times, each time lengthening the schedule to deliver aircraft to the test program. Delays and manufacturing inefficiencies are prime causes of contract cost overruns. The contractor has delivered four development flight test aircraft and projects delivering the remaining nine aircraft in 2009 and early 2010. Problems and delays are largely the residual effects from the late release of engineering drawings, design changes, delays in establishing a supplier base, and parts shortages, which continue to cause delays and force inefficient production line work-arounds where unfinished work is completed out of station.[Footnote 6] Data provided by the Defense Contract Management Agency and the JSF Program Office show continuing critical parts shortages, out-of-station work, and quality issues. The total projected labor hours to manufacture test aircraft increased by 40 percent just in the past year, as illustrated in figure 1. Figure 1: JSF Labor Hour Estimates for Development Test Aircraft (Budgeted labor hours in thousands): [Refer to PDF for image: vertical bar graph] Aircraft: BF-1; Budgeted hours, June 2007: 343; Budgeted hours, June 2008: 358. Aircraft: BF-2; Budgeted hours, June 2007: 233; Budgeted hours, June 2008: 294. Aircraft: BF-3; Budgeted hours, June 2007: 180; Budgeted hours, June 2008: 251. Aircraft: BF-4; Budgeted hours, June 2007: 155; Budgeted hours, June 2008: 229. Aircraft: AF-1; Budgeted hours, June 2007: 188; Budgeted hours, June 2008: 218. Aircraft: AF-2; Budgeted hours, June 2007: 146; Budgeted hours, June 2008: 218. Aircraft: AF-3; Budgeted hours, June 2007: 131; Budgeted hours, June 2008: 204. Aircraft: CF-1; Budgeted hours, June 2007: 239; Budgeted hours, June 2008: 255. Aircraft: CF-2; Budgeted hours, June 2007: 126; Budgeted hours, June 2008: 210. Aircraft: CF-3; Budgeted hours, June 2007: 118; Budgeted hours, June 2008: 196. Aircraft: BF-5; Budgeted hours, June 2007: 103; Budgeted hours, June 2008: 174. Aircraft: AF-4; Budgeted hours, June 2007: 91; Budgeted hours, June 2008: 165. Source: GAO analysis of DOD data. [End of figure] Performance data for two major cost areas--wing assembly and mate and delivery--indicate even more substantial growth. Figure 2 compares the increased budgeted hours in the 2008 schedule to 2007 estimates. The 2007 schedule assumed a steeper drop in labor hours as more units are produced and manufacturing and worker knowledge increases. The new schedule, based upon actual performance, projects a less steep decline in labor hours, indicating slower learning and lesser gains in worker efficiency. As of June 2008, the planned hours for these two major stations increased by about 90 percent over the June 2007 schedule, which itself had shown an increase from the 2006 schedule. The overlap in the work schedule between manufacturing the wing and mating (connecting) it to the aircraft fuselage has been a major concern for several years because it causes inefficient out-of-station work. The contractor continues to address this concern, but the new schedule indicates that this problem will continue at least through 2009. Figure 2: Budgeted Manufacturing Hours by Development Aircraft (Wing and Mate Delivery Stages): [Refer to PDF for image: two multiple line graphs] Wing manufacturing data: Aircraft: BF-1; Budgeted labor hours, June 2007: 70,612; Budgeted labor hours, July 2008: 76,205. Aircraft: BF-2; Budgeted labor hours, June 2007: 55,280; Budgeted labor hours, July 2008: 90,555. Aircraft: BF-3; Budgeted labor hours, June 2007: 42,892; Budgeted labor hours, July 2008: 75,345. Aircraft: BF-4; Budgeted labor hours, June 2007: 40,205; Budgeted labor hours, July 2008: 71,645. Aircraft: AF-1; Budgeted labor hours, June 2007: 48,925; Budgeted labor hours, July 2008: 76,577. Aircraft: AF-2; Budgeted labor hours, June 2007: 39,735; Budgeted labor hours, July 2008: 72,038. Aircraft: AF-3; Budgeted labor hours, June 2007: 36,711; Budgeted labor hours, July 2008: 66,727. Aircraft: CF-1; Budgeted labor hours, June 2007: 49,287; Budgeted labor hours, July 2008: 90,002. Aircraft: CF-2; Budgeted labor hours, June 2007: 28,605; Budgeted labor hours, July 2008: 80,611. Aircraft: CF-3; Budgeted labor hours, June 2007: 23,694; Budgeted labor hours, July 2008: 71,858. Aircraft: BF-5; Budgeted labor hours, June 2007: 16,617; Budgeted labor hours, July 2008: 63,734. Aircraft: AF-4; Budgeted labor hours, June 2007: 17,084; Budgeted labor hours, July 2008: 52,820. Mate and delivery manufacturing data: Aircraft: BF-1; Budgeted labor hours, June 2007: 69,683; Budgeted labor hours, July 2008: 71,113. Aircraft: BF-2; Budgeted labor hours, June 2007: 52,372; Budgeted labor hours, July 2008: 67,737. Aircraft: BF-3; Budgeted labor hours, June 2007: 35,245; Budgeted labor hours, July 2008: 55,642. Aircraft: BF-4; Budgeted labor hours, June 2007: 26,260; Budgeted labor hours, July 2008: 56,623. Aircraft: AF-1; Budgeted labor hours, June 2007: 24,493; Budgeted labor hours, July 2008: 51,046. Aircraft: AF-2; Budgeted labor hours, June 2007: 18,210; Budgeted labor hours, July 2008: 45,924. Aircraft: AF-3; Budgeted labor hours, June 2007: 16,972; Budgeted labor hours, July 2008: 51,728. Aircraft: CF-1; Budgeted labor hours, June 2007: 18,419; Budgeted labor hours, July 2008: 47,558. Aircraft: CF-2; Budgeted labor hours, June 2007: 16,275; Budgeted labor hours, July 2008: 43,657. Aircraft: CF-3; Budgeted labor hours, June 2007: 20,900; Budgeted labor hours, July 2008: 49,591. Aircraft: BF-5; Budgeted labor hours, June 2007: 14,214; Budgeted labor hours, July 2008: 39,296. Aircraft: AF-4; Budgeted labor hours, June 2007: 97,35; Budgeted labor hours, July 2008: 43,980. Source: GAO analysis of DOD data. [End of figure] The prime contractor has taken significant steps to improve schedule management, manufacturing efficiency, and supplier base. Our review found that the prime contractor has good schedule management tools and integrated processes in place. The one area not meeting commercial best practices was the absence of schedule risk analysis that would provide better insight into areas of risk and uncertainty in the schedule. DOD agreed with our March 2009 recommendation and will direct the contractor to perform periodic schedule risk analyses. The prime contractor is also implementing changes designed to address the manufacturing inefficiencies and parts shortages discussed earlier. These include (1) increasing oversight of key subcontractors that are having problems, (2) securing long-term raw material purchase price agreements for both the prime and key subcontractors, and (3) implementing better manufacturing line processes. On this latter point, according to program officials, the prime contractor has taken specific steps to improve wing manufacturing performance--noted above as one of the most troublesome workstations. Defense Contract Management Agency officials noted that the contractor produced the second short take off and landing aircraft variant with less work performed out of station than for the first such aircraft. Also, program office and contractor officials report some alleviation of parts shortages and improvements in quality, but also believe that the effects from previous design delays, parts shortages, and labor inefficiencies will continue to persist over the near term. Use of Cost Contracts for Production Aircraft Elevates the Government's Financial Risk: DOD is procuring a substantial number of JSF aircraft using cost reimbursement contracts. Cost reimbursement contracts place most of the program's financial risk on the buyer--DOD in this case--who is liable to pay more than budgeted should labor, material, or other incurred costs be more than expected when the contract was signed. Subsequent cost increases, such as the growth in manufacturing labor hours discussed above, are mostly passed on to the Government. Thus far, DOD has procured the first three production lots using cost reimbursement contracts--a total of 28 aircraft and an estimated $6.7 billion to date. JSF officials expect to also procure the fourth lot using cost reimbursement and to transition to fixed-price contracts when appropriate, possibly between lots 5 and 7 (fiscal years 2011 to 2013). It is unclear exactly how and when this will happen, but the expectation is to transition to fixed pricing once the air vehicle has a mature design, has been demonstrated in flight tests, and is producible at established cost targets. Under the April 2008 program of record, DOD was planning to procure as many as 275 aircraft costing an estimated $41.6 billion through fiscal year 2013 using cost reimbursement contracts. The plan to accelerate procurement of 28 aircraft would likely add to the quantities purchased on such contracts. Cost reimbursement contracts provide for payment of allowable incurred costs, to the extent prescribed in the contract. According to the Federal Acquisition Regulation, cost reimbursement contracts are suitable for use only when uncertainties involved in contract performance do not permit costs to be estimated with sufficient accuracy to use any type of fixed-price contract.[Footnote 7] Cost reimbursement contracts for weapon production are considered appropriate when the program lacks sufficient knowledge about system design, manufacturing processes, and testing results to establish firm prices and delivery dates. In contrast, a fixed-price contract provides for a pre-established price, places more of the risk and responsibility for costs on the contractor, and provides more incentive for efficient and economical performance. Procuring large numbers of production aircraft using cost reimbursement contracts reflects that the JSF design, production processes, and costs for labor and material is not yet sufficiently mature and that pricing information is not exact enough for the contractor to assume the risk under a fixed-price contract. We see it as a consequence of the substantial concurrency of development, test, and production built into the JSF schedule. Significant overlap of these activities means that DOD is procuring considerable quantities of operational aircraft while development test aircraft are still on the manufacturing line and where much testing remains to prove aircraft performance and suitability. Establishing a clear and accountable path to ensure that the contractor assumes more of the risk is prudent. Accordingly, we recommended in March 2009 that DOD report to the congressional defense committees by October 2009 explaining costs and risks associated with cost reimbursement contracts for production, the strategy for managing and mitigating risks, and plans for transitioning to fixed price contracts for production. DOD concurred. The former Assistant Secretary of the Air Force for Acquisition agreed with our concerns about significant concurrency and the need to transition to a fixed price environment. In an April 2009 memo, as the Assistant Secretary of the Air Force for Acquisition, she discussed her views on the concurrency of production and development testing as driving risks to the development program. She recommended that the JSF joint program office closely examine manufacturing processes and work to convert cost reimbursement contracts to fixed-price as soon as practical. JSF's Test Plan Is Improved but Flight Test Program Is Still in Its Infancy: After reducing test resources and activities to save money in 2007, the JSF Program Office developed a new test plan in the spring of 2008 that extended the development period by 1 year, better aligned test resources and availability dates, and lessened the overlap between development and operational testing. While improved, the new plan is still aggressive and has little room for error discovery, rework, and recovery from downtime should test assets be grounded or otherwise unavailable. The sheer complexity of the JSF program--with 22.9 million lines of software code[Footnote 8], three variants, and multi-mission development--suggests that the aircraft will encounter many unforeseen problems during flight testing requiring additional time in the schedule for rework. Given the complexity of the program, the joint estimating team noted that an additional 2 years beyond the recent 1 year extension may be needed to complete development. The test plan relies heavily on a series of advanced and robust simulation labs and a flying test bed to verify aircraft and subsystem performance. Figure 3 shows that 83 percent of the aircraft's capabilities are to be verified through labs, the flying test bed, and subject-matter analysis, while only 17 percent of test points are to be verified through flight testing. Program officials argue that their heavy investment in simulation labs will allow early risk reduction, thereby reducing the need for additional flight testing, controlling costs, and meeting the key milestones of the program's aggressive test plan. However, while the JSF program's simulation labs appear more prolific, integrated, and capable than the labs used in past aircraft programs, their ability to substitute for flight testing has not yet been demonstrated. Figure 3: Breakdown of Verification Venues for the JSF: [Refer to PDF for image: pie-chart] Flying test bed: 5%; Flight testing: 17%; Subject matter analysis: 19%; Labs: 59%. Source: GAO analysis of DOD data. [End of figure] Despite an improved test plan, JSF flight testing is still in its infancy. Only about 2 percent of its development flight testing had been completed as of November 2008. Figure 4 shows the expected ramp up in flight testing with most effort occurring in fiscal years 2010 through 2012. Past programs have shown that many problems are not discovered until flight testing. As such, the program is likely to experience considerable cost growth in the future as it steps up its flight testing, discovers new problems, and makes the necessary technical and design corrections. Figure 4: JSF Planned Development Test Flights: [Refer to PDF for image: vertical bar graph] Fiscal year: 2007; Planned test flights: 27. Fiscal year: 2008; Planned test flights: 97. Fiscal year: 2009; Planned test flights: 317. Fiscal year: 2010; Planned test flights: 1,243. Fiscal year: 2011; Planned test flights: 1,425. Fiscal year: 2012; Planned test flights: 1,289. Fiscal year: 2013; Planned test flights: 593. Source: GAO analysis of DOD data. [End of figure] While the program has been able to complete key ground tests and demonstrate basic aircraft flying capabilities, it continues to experience flight testing delays. Most notably, flight testing of full short takeoff and vertical landing capabilities has further been delayed. Flight testing of the carrier variant has also been delayed. Program officials do not believe either of the delays will affect planned initial operational capability dates. In 2009 and early fiscal year 2010, the program plans to begin flight testing 6 development test aircraft, including the first 2 aircraft dedicated to mission system testing. A fully integrated, mission-capable aircraft is not expected to enter flight testing until 2012. Despite the nascency of the flight test program and subsequent flight testing delays, DOD is investing heavily in procuring JSF aircraft. Procuring aircraft before testing successfully demonstrates that the design is mature and that the weapon system will work as intended increases the likelihood of expensive design changes becoming necessary when production is underway. Also, systems already built and fielded may later require substantial modifications, further adding to costs. The uncertain environment as testing progresses is one reason why the prime contractor and DOD are using cost-reimbursable contracts until rather late in procurement. Table 3 depicts planned investments--in both dollars and aircraft--prior to the completion of development flight testing. DOD may procure 273 aircraft at a total estimated cost of $41.9 billion before development flight testing is completed. Table 3 also shows the expected contract types. Table 3: Overlap of Procurement Investments and Flight Testing: Cumulative procurement (billions of then-year dollars): 2007: $0.9; 2008: $3.6; 2009: $6.9; 2010: $13.7; 2011: $20.6; 2012: $31.1; 2013: $41.9; 2014: $54.3. Cumulative aircraft procured: 2007: 2; 2008: 14; 2009: 28; 2010: 58; 2011: 101; 2012: 183; 2013: 273; 2014: 383. Contract type: 2007: Cost; 2008: Cost; 2009: Cost; 2010: Cost; 2011: Cost or fixed; 2012: Cost or fixed; 2013: Cost or fixed; 2014: Fixed. Percentage of flight test program completed: 2007: <1%; 2008: <1%; 2009: 2%; 2010: 9%; 2011: 34%; 2012: 62%; 2013: 88%; 2014: 100%. Continuum from 2007 through 2014: Limited Knowledge Gained From Flight Testing to More Knowledge Gained From Flight Testing. Source: GAO analysis of DOD data. Notes: This table contains updated information from similar data in our March 2009 report. It includes revised budget and quantity data for fiscal years 2009 and 2010. It does not reflect the additional 28 aircraft announced by the Secretary of Defense and the associated funding. That information is not available to us, but would be added to the above quantities in years after 2010. [End of table] Concluding Remarks: The JSF program is entering its most challenging phase, a crossroads of a sort. Looking forward, the contractor plans to complete work expeditiously to deliver the test assets, significantly step up flight testing, begin verifying mission system capabilities, mature manufacturing processes, and quickly ramp up production of operational aircraft. Challenges are many--continuing cost and schedule pressures; complex, extensive, and unproven software requirements; and a nascent, very aggressive test program with diminished flight test assets. While the program must move forward, we continue to believe that the program's concurrent development and production of the aircraft is extremely risky. By committing to procure large quantities of the aircraft before testing is complete and manufacturing processes are mature, DOD has significantly increased the risk of further compromising its return on investment--as well as delaying the delivery of critical capabilities to the warfighter. Furthermore, the program's plan to procure large quantities of the aircraft using cost- reimbursement contracts--where uncertainties in contract performance do not permit costs to be estimated with sufficient accuracy to use a fixed-price contract--places additional financial risk on the government. Until the contractor demonstrates that it can produce aircraft in a timely and efficient manner, DOD cannot fully understand future funding requirements. DOD needs to ensure that the prime contractor can meet expected development and production expectations. At a minimum, the contractor needs to develop a detailed plan demonstrating how it can successfully meet program development and production goals in the near future within cost and schedule parameters. As such, in our March 2009 report, we recommended that Secretary of Defense direct the Under Secretary of Defense for Acquisition, Technology and Logistics to report to congressional defense committees explaining the risks associated with using cost- reimbursable contracts as compared to fixed price contracts for JSF's production quantities, the program's strategy for managing those risks, and plans for transitioning to fixed-price contracts for production. DOD agreed with our recommendation. With an improved contracting framework and a more reasoned look to the future, the JSF program can more effectively meet DOD and warfighter needs in a constrained budget environment. Mr. Chairman, this concludes my prepared statement. I would be happy to answer any questions you may have at this time. For further information about this statement, please contact Michael J. Sullivan at (202) 512-4841 or sullivanm@gao.gov. Contact points for our Office of Congressional Relations and Public Affairs may be found on the last page of this statement. Individuals who made key contributions to this statement are Ridge Bowman, Bruce Fairbairn, Matt Lea, and Charlie Shivers. [End of section] Appendix I: Changes in JSF Cost, Quantity, and Delivery Estimates: Expected quantities: Development quantities: October 2001 (system development start): 14; December 2003 (2004 Replan): 14; December 2007: 13. Expected quantities: Procurement quantities (U.S. only): October 2001 (system development start): 2,852; December 2003 (2004 Replan): 2,443; December 2007: 2,443. Total quantities: October 2001 (system development start): 2,866; December 2003 (2004 Replan): 2,457; December 2007: 2,456. Cost Estimates (then-year dollars in billions): Development: October 2001 (system development start): $34.4; December 2003 (2004 Replan): $44.8; December 2007: $44.4. Cost Estimates (then-year dollars in billions): Procurement: October 2001 (system development start): $196.6; December 2003 (2004 Replan): $199.8; December 2007: $254.0. Cost Estimates (then-year dollars in billions): Military construction: October 2001 (system development start): $2.0; December 2003 (2004 Replan): $0.2; December 2007: $0.5. Total program acquisition: October 2001 (system development start): $233.0; December 2003 (2004 Replan): $244.8; December 2007: $298.9. Unit Cost Estimates (then-year dollars in millions): Program acquisition: October 2001 (system development start): $81; December 2003 (2004 Replan): $100; December 2007: $122. Unit Cost Estimates (then-year dollars in millions): Average procurement: October 2001 (system development start): $69; December 2003 (2004 Replan): $82; December 2007: $104. Estimated delivery dates: First operational aircraft delivery: October 2001 (system development start): 2008; December 2003 (2004 Replan): 2009; December 2007: 2010. Estimated delivery dates: Initial operational capability: October 2001 (system development start): 2010-2012; December 2003 (2004 Replan): 2012-2013; December 2007: 2012-2015. Source: GAO analysis of DOD data. Notes: Data are from the annual Selected Acquisition Reports that are dated in December but not officially released until March or April of the following year. The December 2003 data reflects the last major restructuring of the program. The December 2007 data represents the official program of record at the time of our review and was reported to the Congress in April 2008. Military construction costs have not been fully established and the reporting basis changed over time in these DOD reports. [End of table] [End of section] Appendix II: F-35 Joint Strike Fighter Schedule: Critical Design Review: Conventional Takeoff and Landing; Original Estimate: Apr-04; 2004 Replan: Oct-05; Current Estimate: Feb-06. Critical Design Review: Carrier Variant; Original Estimate: Jul-05; 2004 Replan: Jan-07; Current Estimate: Jun-07. Critical Design Review: Short Takeoff and Vertical Landing; Original Estimate: Oct-04; 2004 Replan: May-06; Current Estimate: Feb-06. First Flight: Conventional Takeoff and Landing; Original Estimate: Nov-05; 2004 Replan: Jul-06; Current Estimate: Dec-06. First Flight: Carrier Variant; Original Estimate: Jan-07; 2004 Replan: Aug-08; Current Estimate: Dec-09. First Flight: Short Takeoff and Vertical Landing; Original Estimate: Apr-06; 2004 Replan: May-07; Current Estimate: Jun-08[A]. Initial Operational Capability: Marine Corps; Original Estimate: Apr-10; 2004 Replan: Mar-12; Current Estimate: Mar-12. Initial Operational Capability: Air Force; Original Estimate: Jun-11; 2004 Replan: Mar-13; Current Estimate: Mar-13. Initial Operational Capability: Navy; Original Estimate: Apr-12; 2004 Replan: Mar-13; Current Estimate: Mar-15. 1st Production Aircraft Delivered: Original Estimate: Jun-08; 2004 Replan: Jun-09; Current Estimate: Jan-10. Operational Testing Completed: Original Estimate: Mar-12; 2004 Replan: Oct-13; Current Estimate: Oct-14. Full Rate Production: Original Estimate: Apr-12; 2004 Replan: Oct-13; Current Estimate: Oct-14. Source: GAO analysis of DOD data. Note: [A] Aircraft flown in conventional mode. The first test to demonstrated full short takeoff and vertical landing capabilities is scheduled for September 2009. [End of table] [End of section] Footnotes: [1] GAO, Joint Strike Fighter: Accelerating Procurement before Completing Development Increases the Government's Financial Risk, [hyperlink, http://www.gao.gov/products/GAO-09-303] (Washington, D.C.: Mar. 12, 2009). [2] GAO, Joint Strike Fighter: Impact of Recent Decisions on Program Risk, [hyperlink, http://www.gao.gov/products/GAO-08-569T] (Washington, D.C.: Mar. 11, 2008). This testimony updated information originally presented in GAO, Defense Acquisitions: Analysis of Costs for the Joint Strike Fighter Engine Program, [hyperlink, http://www.gao.gov/products/GAO-07-656T] (Washington, D.C.: Mar. 22, 2007). [3] The joint team's estimate included $420 million for the alternate engine program. DOD's 2010 budget request did not include this funding. [4] [hyperlink, http://www.gao.gov/products/GAO-08-569T] and [hyperlink, http://www.gao.gov/products/GAO-07-656T]. [5] Since that time, Congress appropriated $465 million in the fiscal year 2009 budget to continue the alternate engine program. [6] An efficient production line establishes an orderly flow of work as a product moves from workstation to workstation and on to final assembly. Out-of-station work, sometimes referred to as traveled work, refers to completing unfinished work on major components, for example, the wings, after they have left the wing workstation and moved down the production line to another station, such as mate and final assembly. [7] Federal Acquisition Regulation § 16.301-2. [8] Approximately 7.5 million lines of software code are on the aircraft itself while the remainder is associated with logistics, training and other supporting systems. [End of section] GAO's Mission: The Government Accountability Office, the audit, evaluation and investigative arm of Congress, exists to support Congress in meeting its constitutional responsibilities and to help improve the performance and accountability of the federal government for the American people. GAO examines the use of public funds; evaluates federal programs and policies; and provides analyses, recommendations, and other assistance to help Congress make informed oversight, policy, and funding decisions. GAO's commitment to good government is reflected in its core values of accountability, integrity, and reliability. Obtaining Copies of GAO Reports and Testimony: The fastest and easiest way to obtain copies of GAO documents at no cost is through GAO's Web site [hyperlink, http://www.gao.gov]. Each weekday, GAO posts newly released reports, testimony, and correspondence on its Web site. To have GAO e-mail you a list of newly posted products every afternoon, go to [hyperlink, http://www.gao.gov] and select "E-mail Updates." Order by Phone: The price of each GAO publication reflects GAO’s actual cost of production and distribution and depends on the number of pages in the publication and whether the publication is printed in color or black and white. Pricing and ordering information is posted on GAO’s Web site, [hyperlink, http://www.gao.gov/ordering.htm]. Place orders by calling (202) 512-6000, toll free (866) 801-7077, or TDD (202) 512-2537. Orders may be paid for using American Express, Discover Card, MasterCard, Visa, check, or money order. Call for additional information. To Report Fraud, Waste, and Abuse in Federal Programs: Contact: Web site: [hyperlink, http://www.gao.gov/fraudnet/fraudnet.htm]: E-mail: fraudnet@gao.gov: Automated answering system: (800) 424-5454 or (202) 512-7470: Congressional Relations: Ralph Dawn, Managing Director, dawnr@gao.gov: (202) 512-4400: U.S. Government Accountability Office: 441 G Street NW, Room 7125: Washington, D.C. 20548: Public Affairs: Chuck Young, Managing Director, youngc1@gao.gov: (202) 512-4800: U.S. Government Accountability Office: 441 G Street NW, Room 7149: Washington, D.C. 20548: