Organizational Transformation:

Enterprise Architecture Value Needs to Be Measured and Reported

GAO-12-791: Published: Sep 26, 2012. Publicly Released: Sep 26, 2012.

Additional Materials:

Contact:

Carol Cha
(202) 512-3000
melvinv@gao.gov

 

Office of Public Affairs
(202) 512-4800
youngc1@gao.gov

What GAO Found

Among the 27 agencies that GAO studied, all have fully or partially defined goals or purposes for their architectures, 11 have fully or partially established a method or metrics for measuring outcomes resulting from the use of their architectures, while 5 have fully or partially measured and reported outcomes and benefits.

Agencies cited a lack of guidance as a key reason why they have not established methods and metrics for measuring outcomes and benefits. Although the Office of Management and Budget (OMB) has issued recent enterprise architecture guidance to agencies, OMB has not yet provided sufficient details on the method and metrics that could be used to measure architecture program outcomes.

Why GAO Did This Study

According to OMB, the federal executive branch plans to spend at least $75 billion on information technology (IT) investments in fiscal year 2012. In response to a statute which mandates that GAO identify duplicative activities within federal agencies, GAO previously identified enterprise architecture as a mechanism for reducing duplication and overlap in investments. An architecture is a "blueprint" that describes how an organization operates in terms of business processes and technology, how it intends to operate in the future, and how it plans to transition to the future state. Knowing whether architecture outcomes are being achieved requires defining the architecture's goals, establishing a method and metrics to measure architecture outcomes, and periodically measuring and reporting these outcomes. To assess agencies' use of architecture as a mechanism for reducing duplication and overlap, GAO committed to determine the extent to which agencies are measuring and reporting architecture outcomes and benefits. To do this, GAO reviewed relevant documentation from 27 major federal agencies, reviewed the results of a GAO survey on the benefits of using architecture, and interviewed agency officials.

What GAO Recommends

GAO is making recommendations to the agencies and OMB to improve measurement and reporting of architecture outcomes. In commenting on a draft of this report, OMB and most of the agencies generally agreed with the findings and recommendations.

For more information, contact Valerie C. Melvin at (202) 512-6304 or melvinv@gao.gov.

Recommendations for Executive Action

  1. Status: Open

    Comments: The Department of Agriculture has begun to take steps to address our recommendation. In May 2013, the department submitted its draft Enterprise Roadmap to the Office of Management and Budget, which included metrics associated with potential outcomes related to its enterprise architecture efforts, such as the percentage of department investments using shared services. However, the department has yet to establish a documented method for measuring enterprise architecture outcomes. The Office of Management and Budget has requested that agencies provide an updated Enterprise Roadmap to the office no later than 2 weeks after the transmittal of the President's Budget for Fiscal Year 2015, and the Department of Agriculture Inspector General stated in April 2013 that the department intends to comply with guidance issued by the Office of Management and Budget associated with measuring enterprise architecture program outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Agriculture

  2. Status: Open

    Comments: The Department of the Air Force has not yet implemented this recommendation. According to an August 2013 draft plan, the department will complete development of a metrics program to assess the value of its architecture by June 2019.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Defense: Department of the Air Force

  3. Status: Open

    Comments: The Department of the Army has taken steps to address the recommendation We reported in September 2012 that of the department's three segment architectures, the Network segment had established metrics and a method to measure architecture-related outcomes, but the Generating and Operating Force segments had yet to establish metrics and methods. Since then, the Generating Force segment has developed a draft Army Business Management Strategy that includes metrics to measure the number of business systems retired over 5 years and costs savings and avoidance through use of the Army's business Enterprise architecture. However, the department has yet to finalize its strategy or to document the steps to measure the metrics. In addition, the Operating Force segment has yet to establish metrics to measure enterprise architecture outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Defense: Department of the Army

  4. Status: Open

    Comments: The Department of Commerce has yet to fully implement his recommendation. We reported in September 2012 that it had established metrics to measure and report outcomes associated with its enterprise architecture program, such as information technology cost savings. However, it has yet to establish a method (i.e. steps to be followed) for measuring. In November 2013, Commerce's Chief Enterprise Architect reported that the department is developing a new strategic plan and will develop meaningful architecture metrics after that plan is issued.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Commerce

  5. Status: Open

    Comments: The Department of Defense has yet to fully address our recommendation. The department reported in November 2013 that it plans to work on developing an Enterprise Architecture Management Plan in early 2014. According to the department, this plan will include a structured architecture value measurement approach. The department also developed a draft Enterprise Roadmap submission for the Office of Management and Budget, dated May 15, 2013, and stated that the February 2014 version of its roadmap will include metrics, baselines, targets, and measurement methods.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Defense

  6. Status: Open

    Comments: The Department of Education has yet to fully implement this recommendation. We reported in September 2012 that it had established a metric to measure the extent to which spending on development, modernization, and enhancement (DME) increased relative to steady-state spending, through use of its enterprise architecture activities, but had yet to establish a method to measure. In its May 2013, draft Enterprise Roadmap submission to the Office of Management and Budget, the department identified as a metric the extent to which its information technology investments achieve the department's DME spending target. However, it had yet to document the steps to be followed for measuring the metric. In its draft roadmap, the department stated that it intends to define the method for measuring its metrics in 2014. Specifically, according to agency officials, the department plans to document the method it uses to measure its DME metric.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Education

  7. Status: Open

    Comments: The Department of Energy has begun to take steps to address our recommendation. For example, in May 2013, it submitted its draft Enterprise Modernization Roadmap to the Office of Management and Budget, which included outcome metrics such as cost savings or avoidance associated with consolidating and sharing services. However, the department has yet to document the steps to be followed to measure the metrics.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Energy

  8. Status: Open

    Comments: The Department of Homeland Security has taken steps to address our recommendation. In May 2013, it submitted its draft Enterprise Roadmap to the Office of Management and Budget, which included outcome metrics. For example, the roadmap included metrics such as cost savings and avoidance gained from consolidating and sharing services. However, the department did not describe the steps to be followed to measure the metrics. The Department of Homeland Security's Chief Enterprise Architect stated that the department is re-evaluating its approach to measuring outcomes and may have a new approach by February 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Homeland Security

  9. Status: Open

    Comments: The Department of the Interior has taken steps to address our recommendation. In May 2013, the department submitted its draft Enterprise Roadmap to the Office of Management and Budget, which included metrics to measure outcomes associated with the department's enterprise architecture, such as cost savings and avoidance related to commodity information technology consolidation. The draft roadmap also identifies sources of data for measuring the outcomes; however, the department has yet to describe the steps to be followed for measuring the outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of the Interior

  10. Status: Open

    Comments: The Department of Labor has yet to fully implement this recommendation. The department's draft Enterprise Roadmap, dated May 15, 2013, includes architecture-related metrics, such as cost savings/avoidance gained by consolidating and sharing services. However, as of August 2013, the department has yet to finalize its metrics or document a method (i.e., steps to be followed) for measuring.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Labor

  11. Status: Open

    Comments: The Department of the Navy has not yet implemented this recommendation. An official with the Department of the Navy's Office of the Chief Information Officer stated that the department had recently established metrics to measure achievement of its objectives related to information management/information technology and cyberspace strategic objectives for fiscal years 2014 through 2018, and that enterprise architecture is part of a comprehensive approach to assessing progress in achieving cost saving goals. However, the department has yet to establish metrics and a method for measuring architecture outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Defense: Department of the Navy

  12. Status: Open

    Comments: The Department of State has yet to implement this recommendation. However, the department stated that it plans to incorporate the Office of Management and Budget's (OMB) Enterprise Architecture Outcomes and Measurements template as part of its February 2014 Enterprise Roadmap submission to OMB. The OMB template includes sample metrics such as cost savings/avoidance through system consolidation and cost savings/avoidance gained from sharing services.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of State

  13. Status: Open

    Comments: The Department of Transportation has begun to take steps to address our recommendation. For example, the department provided its April 2013 Enterprise Architecture Value Measurement Plan, which describes enterprise architecture metrics such as how the architecture program contributes to cost savings or avoidance. However, the plan does not describe a method for measuring enterprise architecture outcomes. The department's draft Enterprise Roadmap stated that the department plans to measure and report enterprise architecture performance by the end of fiscal year 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Transportation

  14. Status: Open

    Comments: The Department of the Treasury has yet to fully implement our recommendation. We reported in September 2012 that the department had established enterprise architecture metrics, but that it had yet to establish a methodology for measuring its architecture outcomes. In May 2013, the department submitted its draft Enterprise Roadmap to the Office of Management and Budget, which included new metrics associated with the department's enterprise architecture (e.g., cost savings/avoidance through consolidating systems and through sharing services). However, the department had not yet documented a method for measuring the metrics. Department officials stated that the department plans to finalize its approach in its next Enterprise Roadmap, which the Office of Management and Budget has asked agencies to submit no later than 2 weeks after the transmittal of the President's Budget for Fiscal Year 2015.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of the Treasury

  15. Status: Open

    Comments: The Department of Veterans Affairs has not implemented this recommendation. The department reported in June 2013 that it is focused on building out its core enterprise architecture and working with department stakeholders to help them understand and use the architecture. The department intends to implement the first phase of an enterprise architecture value measurement program during fiscal year 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Veterans Affairs

  16. Status: Open

    Comments: The Department of Justice has not yet demonstrated that it has established an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with its enterprise architecture's strategic goals and intended purpose.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Justice

  17. Status: Open

    Comments: The Environmental Protection Agency has taken steps to address our recommendation. Specifically, in May 2013, it submitted its Enterprise Roadmap to the Office of Management and Budget, which included a metric to measure the number of new shared services it implements every 2 years through use of its enterprise architecture. In addition, in September 2013, the agency developed an Enterprise Architecture Performance Measurement Methodology, which includes identifying metrics, establishing baselines, and planning targets. However, the agency has yet to establish the steps to be followed for measuring architecture metrics.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Environmental Protection Agency

  18. Status: Open

    Comments: The General Services Administration has yet to fully implement our recommendation. We reported in September 2012 that the agency had established metrics but not a method for measuring enterprise architecture outcomes and benefits. Since then, in May 2013, it submitted its draft Enterprise Roadmap, which included metrics to measure architecture outcomes such as costs savings and avoidance, to the Office of Management and Budget. However, the draft roadmap did not include the steps to be followed to measure the metrics. The agency stated that it expects to use its architecture-related metrics to measure its progress throughout fiscal year 2014 and plans to have results available at the end of fiscal year 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: General Services Administration

  19. Status: Open

    Comments: The National Aeronautics and Space Administration has begun to take steps to implement this recommendation. For example, the agency has drafted a Procedural Requirement that calls for measuring enterprise architecture effectiveness. However, as of June 2013, the document had not been approved. In addition, the agency's draft Enterprise Roadmap, which it submitted to the Office of Management and Budget in May 2013, stated that the agency is reviewing performance measures and intends to provide details in future documents.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: National Aeronautics and Space Administration

  20. Status: Open

    Comments: The Small Business Administration has begun to take steps to address our recommendation. In May 2013, the agency submitted its Enterprise Roadmap to the Office of Management and Budget. The roadmap included metrics to measure outcomes associated with the agency's enterprise architecture, such as cost savings through consolidating and sharing services. However, the agency has not yet described the steps to be followed for measuring enterprise architecture outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Small Business Administration

  21. Status: Open

    Comments: The Nuclear Regulatory Commission has yet to fully implement our recommendation. In September 2012, we reported that the agency had established a metric for measuring enterprise architecture outcomes, but had yet to establish a method. In June 2013, the agency reported that it had begun to assess how it measures and reports architecture outcomes. It further reported that its updated Enterprise Roadmap would include a plan to expand performance measures that include Office of Management and Budget-defined enterprise architecture outcomes and measurements. An updated Enterprise Roadmap is to be submitted to the Office of Management and Budget no later than 2 weeks after the President's fiscal year 2015 budget is transmitted to Congress.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Nuclear Regulatory Commission

  22. Status: Closed - Implemented

    Comments: The Social Security Administration has implemented this recommendation. In November 2012, the agency established an approach, including a documented method and metric to measure information technology procurement cost savings. Specifically, the agency documented its approach for measuring fiscal year 2012 architecture outcomes, which it used to measure fiscal year 2013 outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Social Security Administration

  23. Status: Open

    Comments: The National Science Foundation has yet to establish an approach for measuring enterprise architecture outcomes. In May 2013, the agency submitted its draft Enterprise Roadmap to the Office of Management and Budget, which included metrics associated with its enterprise architecture efforts, such as the number of investments that have been reviewed by the architecture team. However, the draft metrics do not measure enterprise architecture outcomes, such as cost savings or avoidance.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: National Science Foundation

  24. Status: Open

    Comments: The Office of Personnel Management (OPM) has yet to fully implement this recommendation. In September 2012, we reported that OPM had established a metric to measure enterprise architecture results and outcomes, but it had not established the steps needed to determine the results and outcomes. In May 2013, it submitted its Enterprise Roadmap to the Office of Management and Budget. The roadmap included an outcomes and measurement template, which documented metrics to measure architecture-related outcomes, such as how the enterprise architecture program contributes to cost savings through system consolidation and consolidating and sharing services. However, the agency has yet to establish a documented method (i.e., steps to be followed) to measure results. As of August 2013, agency officials were in the process of drafting steps to be followed.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Office of Personnel Management

  25. Status: Open

    Comments: The Department of Agriculture has yet to implement this recommendation. In May 2013, the department submitted its draft Enterprise Roadmap to the Office of Management and Budget, which included metrics associated with potential outcomes related to its enterprise architecture efforts. However, the department has yet to measure and report specific enterprise architecture outcomes and benefits. The Office of Management and Budget has requested that agencies provide an updated Enterprise Roadmap to the office no later than 2 weeks after the transmittal of the President's Budget for Fiscal Year 2015, and the Department of Agriculture Inspector General stated in April 2013 that the department intends to comply with guidance issued by the Office of Management and Budget associated with measuring enterprise architecture program outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Agriculture

  26. Status: Open

    Comments: The Department of the Air Force has not yet implemented this recommendation. According to an August 2013 draft plan, the department will complete the development of its architecture metrics program and report results to its Information Technology Governance Executive Board by June 2019.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Defense: Department of the Air Force

  27. Status: Open

    Comments: The Department of the Army has yet to fully implement the recommendation. With regard to the Generating Force segment, the department reported in its draft Army Business Management Strategy the number of systems retired in 2013 through use of its architecture. However, as of November 2013, the strategy had yet to be approved and final metrics had yet to be officially reported using this strategy. With regard to the Network and Operating Force segments, the Army has yet to report enterprise architecture outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Defense: Department of the Army

  28. Status: Open

    Comments: The Department of Commerce has taken steps to implement this recommendation. For example, the department reported enterprise architecture outcomes, such as information technology cost savings, to its executive leadership in November 2012. Specifically, it reported about $90,000 in cost savings in fiscal year 2012 related to moving an internal system to a shared service and to strategic sourcing. However, the department has yet to report architecture outcomes to the Office of Management and Budget. Furthermore, as of November 2013, it had yet to periodically report outcomes to top agency officials or the Office of Management and Budget.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Commerce

  29. Status: Open

    Comments: The Department of Defense has yet to implement this recommendation. As of November 2013, it had yet to establish an approach for measuring architecture value. It plans to work on developing an Enterprise Architecture Management Plan in early 2014, which is to include a structured architecture value measurement approach.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Defense

  30. Status: Closed - Implemented

    Comments: The Department of Education has implemented this recommendation. We reported in September 2012 that the department had reported an architecture outcome in its October 2011 Office of the Chief Information Officer Organization Performance report. Specifically, the department had reported that the ratio of development, modernization and enhancement (DME)spending to steady state spending had increased from 10 percent of total information technology (IT) spending in fiscal year 2011 to 13 percent of total IT spending in fiscal year 2012 as a result of its architecture activities. However, we also reported that the department had yet to periodically (i.e., repeatedly) measure and report the metric. Since then, the department reported to top agency officials at an August 2013 Investment Review Board meeting and in its May 2013 draft Enterprise Roadmap submission to the Office of Management and Budget that the department had achieved its DME spending target of 17 percent.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Education

  31. Status: Open

    Comments: The Department of Energy has yet to implement this recommendation. The department reported outcomes, such as cost savings associated with consolidating systems and sharing services, in its Enterprise Roadmap submission to the Office of Management and Budget in May, 2013. Department officials stated that the outcomes and benefits were also reported to its executive committee. However, the department did not reliably measure the outcomes. More specifically, it did not provide documentation supporting how its savings were calculated. In addition, the department has yet to periodically report outcomes and benefits.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Energy

  32. Status: Open

    Comments: The Department of Homeland Security has yet to fully implement this recommendation. In May 2013, it reported enterprise architecture outcomes and benefits to the Office of Management and Budget in its draft Enterprise Roadmap submission. Specifically, the draft included outcomes and benefits such as cost savings and avoidance gained from consolidating and sharing services. According to the department's Chief Enterprise Architect, this draft roadmap was also reviewed by the department Under Secretary for Management. However, the department has yet to finalize its roadmap or demonstrate that such metrics are periodically reported. According to the draft roadmap, outcomes will be reported again in fiscal year 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Homeland Security

  33. Status: Open

    Comments: The Department of the Interior has yet to implement this recommendation. In May 2013, the department submitted its draft enterprise roadmap to the Office of Management and Budget, which included examples of outcomes associated with its efforts, such as cost savings and avoidance related to commodity information technology consolidation. According to its draft Enterprise Roadmap, the first official measurements are to be for the first quarter of fiscal year 2014 and are to be reported in the second quarter of fiscal year 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of the Interior

  34. Status: Open

    Comments: The Department of Labor has yet to implement this recommendation. As of August 2013, it had yet to finalize its metrics or establish a method for measuring them.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Labor

  35. Status: Open

    Comments: The Department of the Navy has not yet implemented this recommendation. According to an official with the office of the Department of the Navy Chief Information Officer, the department's enterprise architecture is part of a comprehensive approach for assessing progress towards establishing goals and objectives. However, the department has yet to establish metrics for measuring and reporting outcomes attributed to architecture.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Defense: Department of the Navy

  36. Status: Open

    Comments: The Department of State has yet to implement this recommendation. More specifically, as of November 2013, the department has yet to establish metrics to measure architecture outcomes. The department stated that it plans to follow Office of Management and Budget (OMB) guidance and use OMB's Enterprise Architecture Outcomes and Measurements template for providing evidence of architecture outcomes and submit the template with its Enterprise Roadmap to OMB in early February 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of State

  37. Status: Open

    Comments: The Department of Transportation has yet to implement this recommendation. The department's May 2013 draft Enterprise Roadmap stated that the department plans to measure and report enterprise architecture performance by the end of fiscal year 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Transportation

  38. Status: Open

    Comments: The Department of the Treasury has yet to implement this recommendation. We reported in September 2012 that the department had reported architecture outcomes; however, the metrics had yet to be periodically measured and reported. In May 2013, the department submitted its draft Enterprise Roadmap to the Office of Management and Budget, which included outcomes associated with the department's enterprise architecture efforts that were different from previously reported metrics. Therefore, the department has yet to demonstrate that the outcomes are periodically reported.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of the Treasury

  39. Status: Open

    Comments: The Department of Veterans Affairs has not implemented this recommendation. The department reported in 2013 that it is focused on building out its core enterprise architecture and working with department stakeholders to help them understand and use the architecture. The department intends to implement the first phase of an enterprise architecture value measurement program during fiscal year 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Veterans Affairs

  40. Status: Open

    Comments: The Department of Justice has not yet demonstrated that it periodically measures and reports enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to the Office of Management and Budget.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Justice

  41. Status: Open

    Comments: The Environmental Protection Agency has yet to implement this recommendation. Agency officials submitted the agency's Enterprise Roadmap, including an Enterprise Architecture Outcomes and Measurement template, to the Office of Management and Budget in May 2013. The roadmap established the baseline number of shared services and a target number of new shared services to be implemented in fiscal years 2013 and 2014 through use of its enterprise architecture. The agency also reported that it plans to use the template for future performance management.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Environmental Protection Agency

  42. Status: Open

    Comments: The General Services Administration has yet to implement our recommendation. The agency submitted its draft Enterprise Roadmap, which included outcome metrics, to the Office of Management and Budget in May, 2013. However, the draft roadmap did not include measurements of these metrics and the agency has yet to demonstrate that outcomes and benefits are periodically reported. The agency stated that it expects to use its architecture-related metrics to measure its progress throughout fiscal year 2014 and plans to have results available at the end of fiscal year 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: General Services Administration

  43. Status: Open

    Comments: The National Aeronautics and Space Administration has not yet implemented this recommendation. The agency has yet to establish metrics and a method for measuring architecture outcomes. According to its draft Enterprise Roadmap and draft enterprise architecture procedural requirement, the agency plans to track results and review the outcomes with the agency Chief Information Officer at least annually to ensure results and feedback will be used to improve both the enterprise architecture program and investment performance.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: National Aeronautics and Space Administration

  44. Status: Open

    Comments: The Small Business Administration has yet to implement this recommendation. In May 2013, the agency submitted its Enterprise Roadmap to the Office of Management and Budget, which included metrics to measure how the enterprise architecture program contributes to cost savings through consolidating and sharing services. However, the department had yet to measure outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Small Business Administration

  45. Status: Open

    Comments: The Nuclear Regulatory Commission has yet to implement this recommendation. In June 2013, the agency reported that it was in the process of developing an enterprise architecture performance evaluation process, and that it planned to update its May 2013 draft Enterprise Roadmap to include a plan to expand performance measures that include Office of Management and Budget-defined enterprise architecture outcomes and measurements.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Nuclear Regulatory Commission

  46. Status: Open

    Comments: The Social Security Administration has taken steps to implement this recommendation. Specifically, in November 2012, the agency issued a report on fiscal year 2012 architecture outcomes and benefits and in November 2013 on fiscal year 2013 architecture outcomes and benefits, to its Chief Information Officer. The outcomes were associated with consolidating hardware requirements and bundling purchases. In addition, in May 2013, the agency submitted its draft Enterprise Roadmap to the Office of Management and Budget, which included examples of outcomes associated with its architecture efforts. However, the department has yet to finalize its roadmap and to periodically report its architecture outcomes and benefits to the Office of Management and Budget using established methods. The agency plans to finalize its Enterprise Roadmap in February 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Social Security Administration

  47. Status: Open

    Comments: The National Science Foundation has yet to implement the recommendation. The agency has yet to establish metrics to measure outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: National Science Foundation

  48. Status: Open

    Comments: The Office of Personnel Management has yet to implement this recommendation. We reported in September 2012 that agency officials reported that cost savings had been reported to the Chief Information Officer, but that officials had not provided documentation to support that the cost savings had been reliably measured. According to the agency's Office of Internal Oversight and Compliance, the agency plans to report, through the agency director, on architecture outcomes in its Enterprise Roadmap submission to the Office of Management and Budget in February 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Office of Personnel Management

  49. Status: Open

    Comments: The Department of Health and Human Services has yet to fully implement this recommendation. Specifically, since the department reported enterprise architecture results to its Chief Information Officer in November 2010, it has yet to report them to top agency officials again. A department enterprise architect stated that the department has drafted an Enterprise Architecture Outcomes and Measurements template as part of its draft Enterprise Roadmap, which it submitted to the Office of Management and Budget in May 2013, and the official added that the department plans to expand the template to include shared services-related measures. However, the department has yet to use the template to report enterprise architecture value to department executives. According to the department enterprise architect, the department plans to submit an updated Enterprise Roadmap to the Office of Management and Budget in February 2014.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Health and Human Services and Housing and Urban Development should ensure that enterprise architecture outcomes are periodically measured and reported to top agency officials.

    Agency Affected: Department of Health and Human Services

  50. Status: Closed - Implemented

    Comments: The Department of Housing and Urban Development has fully implemented our recommendation. Specifically, since it reported outcomes for 2011, the department has measured architecture outcomes and reported them again to an agency executive committee, as well as to the Office of Management and Budget. For example, it reported progress in reducing the number of technology products that duplicate existing capabilities through use of its architecture. According to agency officials, the department's Chief Information Officer reviewed and approved the report in April 2013 and an executive committee reviewed the architecture outcomes before they were submitted to the Office of Management and Budget in May 2013.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Health and Human Services and Housing and Urban Development should ensure that enterprise architecture outcomes are periodically measured and reported to top agency officials.

    Agency Affected: Department of Housing and Urban Development

  51. Status: Open

    Comments: The Office of Management and Budget (OMB) has taken steps to address our recommendation. For example, the office requested that agencies submit a draft Enterprise Roadmap in May 2013, which was to include an appendix on enterprise architecture outcomes. To prepare the appendix, agencies were to use a template to document architecture metrics and measurement methods. Among other things, this template included examples of outcome metrics and a field where agencies were to document measurement methods. However, OMB did not provide details on the methods that could be used or require that the steps to be followed for measuring are included in agencies' Enterprise Roadmap submissions. According to the OMB Federal Chief Architect, the office will consider whether to develop additional guidance after reviewing agencies' final Enterprise Roadmaps, which are to be submitted in early 2014, after the issuance of the President's budget request for fiscal year 2015.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, and to assist agencies in measuring and reporting outcomes achieved through enterprise architecture, the Director of OMB should ensure that the planned December 2012 guidance for enterprise architecture value measurement and reporting includes (1) sufficient details on the method and metrics that agencies could use to measure their architecture program's value and (2) a requirement for agencies to include in their April 2013 enterprise roadmap submissions a measurement method (i.e., steps to be followed) and metrics, and report on the outcomes and benefits achieved through enterprise architecture.

    Agency Affected: Executive Office of the President: Office of Management and Budget

 

Explore the full database of GAO's Open Recommendations »

Dec 10, 2014

Sep 25, 2014

Sep 23, 2014

Jun 10, 2014

May 22, 2014

May 12, 2014

May 8, 2014

Looking for more? Browse all our products here