Building Partner Capacity:
Actions Needed to Strengthen DOD Efforts to Assess the Performance of the Regional Centers for Security Studies
GAO-13-606: Published: Jun 28, 2013. Publicly Released: Jun 28, 2013.
What GAO Found
The Department of Defense's (DOD) five Regional Centers for Security Studies (Regional Centers) share similarities and differences with other DOD institutions that provide training and education, including professional military education, advanced degree-conferring, and professional development institutions, in terms of curriculum topics, targeted audience, and program format. GAO found that they all offer training and educational programs and activities to help participants understand security and military matters and to enhance their knowledge, skills, and experiences in these matters. However, there are notable differences in that the Regional Centers generally focus on helping foreign participants understand and respond to regional security issues; generally target a foreign civilian and military personnel audience; and offer shorter and typically less formal courses of study. The Regional Centers support DOD policy objectives with curricula designed to enhance security and foster partnerships through education and exchanges. By contrast, other DOD training and education organizations focus their curricula on military operations and leadership. While the Regional Centers' target audience is foreign civilian and military officials, the other DOD educational organizations typically aim their programs and activities at U.S. servicemembers at all career levels. Regional Center participants generally do not earn credit toward a degree, and the offered courses, conferences, and workshops are of shorter duration ranging from days to weeks. DOD's professional military education and advanced degree-conferring institutions are accredited and generally offer longer, more formal courses that provide participants the opportunity to earn advanced degrees.
DOD has taken some steps to enhance its oversight of the Regional Centers' plans and activities, but its ability to determine whether the Regional Centers are achieving departmental priorities remains limited because it has not developed an approach for assessing progress. DOD has defined roles and responsibilities, issued relevant guidance that reflects departmental objectives, and established a governance body and planning process to facilitate information sharing and to achieve more integrated decision making. However, DOD has not developed an approach that includes measurable goals and objectives, metrics for assessing performance, or a methodology to assess the Regional Centers' progress in achieving DOD priorities, to include clarifying how it will use performance data provided by the Regional Centers. GAO's prior work has found that achieving results in government requires a comprehensive oversight framework that includes clear goals, measurable objectives, and metrics for assessing progress, consistent with the framework established in the Government Performance and Results Act. The Regional Centers report various types of performance data, such as summaries of past activities. While DOD has established a governance body to assist in monitoring the Regional Centers' plans and activities, the body has not identified how it will use performance information to assess the Regional Centers' progress toward achieving department priorities. Conducting routine assessments using measurable goals and objectives, with metrics to evaluate progress, and a methodology for using performance information to include defining the role of the governance body would provide DOD a sounder basis for assessing the Regional Centers' progress in achieving results, and for better determining the allocation of resources.
Why GAO Did This Study
DOD has emphasized innovative and low-cost approaches to build the defense capacity of foreign partners, and it uses its five Regional Centers to administer programs to foster partnerships and deepen foreign officials' understanding of U.S. objectives. The conference report accompanying the fiscal year 2013 National Defense Authorization Act (H.R. Conf. Rep. No. 112-705) mandated GAO to conduct a study of the Regional Centers. GAO's report (1) describes how the Regional Centers' activities compare with those of other DOD training and education organizations, and (2) evaluates the extent to which DOD has developed and implemented an approach to oversee and assess the Regional Centers' progress in achieving DOD priorities. This report also provides information on the process used to approve Regional Center requests to waive reimbursement of the costs for nongovernmental and international organizations that participate in the Regional Centers' activities. GAO reviewed public law and departmental directives and conducted an analysis comparing aspects of the Regional Centers with other selected DOD training and education institutions.
What GAO Recommends
GAO recommends that DOD develop measurable goals linked to key programming priorities for the Regional Centers, metrics for assessing performance against these goals, and a methodology to assess the Regional Centers' progress in achieving DOD priorities. DOD generally agreed with the recommendations.
Recommendations for Executive Action
Status: Closed - Implemented
Comments: In June 2015, the Assistant Secretary of Defense for Strategy, Plans, and Capabilities released a memorandum to the five Regional Center Directors. The memorandum identifies priorities that are intended to guide the development of each Regional Center?s programs and describes the role of the centers in achieving the priorities. The memorandum additionally provides short-, medium-, and long-term indicators to measure progress for each Regional Center priority. Lastly, the memorandum states the progress on priorities will be iteratively monitored and evaluated by the Office of the Under Secretary of Defense for Policy?s Regional Offices and by the Regional Centers? governance board. By more clearly articulating the role of the Regional Centers in achieving DOD priorities and establishing short-, medium-, and long-term performance indicators, DOD is better positioned to evaluate and measure the Regional Centers? progress.
Recommendation: To enhance DOD's ability to determine whether the Regional Centers are achieving departmental priorities, the Secretary of Defense should direct the Under Secretary of Defense for Policy to develop an approach to assess the Regional Centers' progress in achieving DOD priorities, including identifying measurable goals and objectives, metrics, or other indicators of performance.
Agency Affected: Department of Defense
Status: Closed - Implemented
Comments: DOD concurred and has taken steps to implement this recommendation. In June 2015, DOD issued guidance and a memorandum that assigned the Under Secretary of Defense for Policy's Regional Offices with the responsibility for routine oversight, monitoring, and evaluation of Regional Center events within their respective areas of responsibility. The June 2015 memorandum also provided short-, medium-, and long-term indicators to measure progress for each Regional Center priority. The June 2015 memorandum stated the Principal Deputy Assistant Secretary of Defense Board (the Board) will annually assess the Regional Centers' progress toward achieving these indicators based on input from regional and relevant functional Deputy Assistant Secretaries of Defense. In June 2016, DOD officials stated that the Board plans to complete the first such annual performance assessment of the Regional Centers' fiscal year 2016 activities in the first quarter of fiscal year 2017. According to the officials, the Board will rely on a variety of assessment tools identified in the June 2015 memorandum to evaluate performance against the aforementioned priorities and indicators. Specifically, for this first assessment, the Board will focus on assessing direct causal linkages accredited to the Regional Centers' program and the short- and medium-term indicators. By establishing a methodology for using performance information, DOD is better positioned to assess the Regional Centers' progress in achieving DOD priorities.
Recommendation: To enhance DOD's ability to determine whether the Regional Centers are achieving departmental priorities, the Secretary of Defense should direct the Under Secretary of Defense for Policy to develop a methodology for using performance information, to include defining the role of the governance board in the process.
Agency Affected: Department of Defense