Quadrennial Defense Review:
Future Reviews Could Benefit from Improved Department of Defense Analyses and Changes to Legislative Requirements
GAO-07-709, Sep 14, 2007
The Department of Defense (DOD) is required by law to conduct a comprehensive examination of the national defense strategy, force structure, modernization plans, infrastructure, and budget every 4 years including an assessment of the force structure best suited to implement the defense strategy at low-to-moderate level of risk. The 2006 Quadrennial Defense Review (QDR), completed in February 2006, represents the first comprehensive review that DOD had undertaken since the military forces have been engaged in operations in Iraq and Afghanistan. GAO was asked to assess (1) the strengths and weaknesses of DOD's approach and methodology for the 2006 QDR and (2) what changes, if any, in the QDR legislation could improve the usefulness of the report, including any changes that would better reflect 21st century security conditions. To conduct its review, GAO analyzed DOD's methodology, QDR study guidance, and results from key analyses and also obtained views of defense analysts within and outside of DOD.
DOD's approach and methodology for the 2006 QDR had several strengths, but several weaknesses significantly limited the review's usefulness in addressing force structure, personnel requirements, and risk associated with executing the national defense strategy. Key strengths of the QDR included sustained involvement of senior DOD officials, extensive collaboration with interagency partners and allied countries, and a database to track implementation of initiatives. However, GAO found weaknesses in three key areas. First, DOD did not conduct a comprehensive, integrated assessment of different options for organizing and sizing its forces to provide needed capabilities. Without such an assessment, DOD is not well positioned to balance capability needs and risks within future budgets, given the nation's fiscal challenges. Second, DOD did not provide a clear analytical basis for its conclusion that it had the appropriate number of personnel to meet current and projected demands. During its review, DOD did not consider changing personnel levels and instead focused on altering the skill mix. However, a year after the QDR report was issued, DOD announced plans to increase Army and Marine Corps personnel by 92,000. Without performing a comprehensive analysis of the number of personnel it needs, DOD cannot provide an analytical basis that its military and civilian personnel levels reflect the number of personnel needed to execute the defense strategy. Third, the risk assessments conducted by the Secretary of Defense and the Chairman of the Joint Chiefs of Staff, which are required by the QDR legislation, did not fully apply DOD's risk management framework because DOD had not developed assessment tools to measure risk. Without a sound analytical approach to assessing risk, DOD may not be able to demonstrate how it will manage risk within current and expected resource levels. As a result, DOD is not in the best position to demonstrate that it has identified the force structure best suited to implement the defense strategy at low-to-moderate risk. Through discussions with DOD officials and defense analysts, GAO has identified several options for refining the QDR legislative language that Congress could consider to improve the usefulness of future QDRs, including changes to encourage DOD to focus on high priority strategic issues and better reflect security conditions of the 21st century. Congress could consider options to clarify its expectations regarding what budget information DOD should include in the QDR and eliminate reporting elements for issues that could be addressed in different reports. For example, the requirement to assess revisions to the unified command plan is also required and reported under other legislation. Further, some reporting elements such as how resources would be shifted between two conflicts could be eliminated in light of DOD's new planning approach that focuses on capabilities to meet a range of threats rather than on the allocation of forces for specific adversaries. GAO also presents an option to have an advisory group work with DOD prior to and during the QDR to provide DOD with alternative perspectives and analyses.
- Closed - implemented
- Closed - not implemented
Matter for Congressional Consideration
Matter: To improve the usefulness of future QDRs, Congress may wish to consider revisions to the QDR legislation, including (1) clarifying expectations on how the QDR should address the budget plan that supports the national defense strategy, (2) eliminating some detailed reporting elements that could be addressed in different reports and may no longer be relevant due to changes in the security environment, and (3) requiring an independent panel to provide advice and alternatives to the Secretary of Defense before and during the QDR process.
Status: Closed - Implemented
Comments: Congress made changes that clarified its expectations for Defense Department's reporting on the budget and directed DOD to create a panel of experts to assess the assumptions and outcomes of the review.
Recommendations for Executive Action
Recommendation: To enhance the usefulness of future Quadrennial Defense Reviews (QDRs) and assist congressional oversight, the Secretary of Defense should develop appropriate methods for the department to use in a comprehensive, data-driven capabilities-based assessments of alternative force structures and personnel requirements during future QDRs.
Agency Affected: Department of Defense
Status: Closed - Implemented
Comments: Congress may consider legislative changes to the language requiring the next Quadrennial Review which will be required by January 31, 2010. Congress considered our matter and made some changes to clarify its expectations that met the intent of the matter.
Recommendation: To enhance the usefulness of future Quadrennial Defense Reviews (QDRs) and assist congressional oversight, the Secretary of Defense should develop appropriate methods for the department to use in conducting a comprehensive, data-driven approach to assess the risks associated with capabilities of its proposed force structure during future QDRs.
Agency Affected: Department of Defense
Status: Closed - Not Implemented
Comments: DOD agreed with the recommendation. In the 2010 QDR report, DOD took a more data-based approach, but did not comprehensively assess risks associated with its proposed force structure. Instead, the QDR analysis included assessing the existing force structure using 3 scenarios, identifying gaps, and then using a revised force structure in the scenarios a second time. This revised force structure, according to DOD officials, is reflected in the QDR report.