Information Technology: Management Needs to Address Reporting of IRS Investments' Cost, Schedule, and Scope Information
Highlights
What GAO Found
The Internal Revenue Service (IRS) has made limited progress in improving the reliability and reporting of cost, schedule, and scope performance information–the agency has partially implemented two of GAO's five prior recommendations, but not yet addressed the remaining three (see table). IRS's implementation of these recommendations is critical in ensuring that Congress receives the reliable information it needs for effective oversight and decision making.
Status of IRS's Efforts to Address Prior GAO Recommendations
Recommendation |
Status |
Ensure projects consistently follow guidelines for updating performance information 60 days after completion of an activity. |
◐ |
Ensure that projected cost and schedule variances for in-process activities are updated monthly. |
◐ |
Develop and implement guidance for determining projected cost and schedule amounts. |
◌ |
Report cumulative cost and schedule information in the quarterly reports to Congress. |
◌ |
Qualitatively report on how delivered scope compares to what was planned in quarterly reports to Congress. |
◌ |
Key: ● Fully—the agency provided evidence that it fully addressed the recommendation. ◐ Partially—the agency provided evidence that it has addressed the recommendation to some extent. ◌ Not addressed—the agency did not provide any evidence that it addressed the recommendation.
Source: GAO analysis of IRS documentation and interviews with IRS officials.
Most of IRS's major information technology (IT) investments were reported as meeting cost and schedule goals. Specifically, 11 of 17 investments were reportedly within 10 percent of cost estimates, and 13 were within 10 percent of schedule estimates between October 2013 and September 2014. In addition, the agency reported “green” ratings for investments instead of their previous “yellow” ratings for Chief Technology Officer summary-level risk assessments. It is important to note that these ratings are not provided for 6 investments for which IRS provides detailed reporting to Congress. Providing summary-level risk ratings for all major investments would improve the visibility into changes in investment risk, and provide Congress with the information to more easily determine the investments requiring greater attention.
Selected investments experienced variances from initial cost, schedule, and scope plans that were not transparent in congressional reporting because IRS has yet to address GAO's prior recommendations. Specifically, the Return Review Program has so far exceeded planned costs by $86.5 million and has yet to deliver functionality that was scheduled for September 2012, and a key phase of Customer Account Data Engine 2 was developed 10 months late and at $183.6 million more than planned. However, none of these variances were clearly identified in congressional reporting. In addition, the consolidated reports on the status of testing for the Affordable Care Act Administration investment are not comprehensive, making it difficult to determine whether all required testing is being performed.
Why GAO Did This Study
IRS relies extensively on IT systems to annually collect more than $2 trillion in taxes, distribute more than $300 billion in refunds, and carry out its mission of providing service to America's taxpayers in meeting their tax obligations. For fiscal year 2014, IRS expected to spend about $2.4 billion on IT. Given the size and significance of IRS's IT investments and the challenges inherent in successfully delivering these complex IT systems, it is important that Congress be provided reliable cost, schedule, and scope information to assist with its oversight responsibilities.
Accordingly, GAO's objectives were to (1) evaluate IRS's efforts to address prior GAO recommendations for improving the reliability and reporting of cost, schedule, and scope information; (2) summarize the reported cost, schedule, and performance of IRS's major IT investments; and (3) assess the status and plans of selected investments.
To do so, GAO analyzed quarterly reports and reviewed information on cost and schedule from October 2013 to September 2014, interviewed program officials, and analyzed documentation for selected investments.
Recommendations
GAO is making three recommendations to improve the reliability and reporting of investment performance information and management of selected investments. IRS agreed with two recommendations but disagreed with the third related to the reporting of test results. GAO continues to believe it is still warranted.
Recommendations for Executive Action
Agency Affected | Recommendation | Status |
---|---|---|
Internal Revenue Service | To improve the reliability and reporting of investment performance information and management of selected major investments, the Commissioner of the IRS should direct the Chief Technology Officer to, for major investments included in congressional reporting, disclose instances where cost and schedule performance information reported to Congress is not updated. |
To address this recommendation, IRS included a table in its quarterly report to Congress which indicates whether the cost and schedule information on the investments for which IRS is required to report detailed information has been updated within the 60-day time frame established by Treasury. This table was first included in the April 2015 fiscal year 2015 2nd quarter report.
|
Internal Revenue Service | To improve the reliability and reporting of investment performance information and management of selected major investments, the Commissioner of the IRS should direct the Chief Technology Officer to provide summary-level Chief Technology Officer risk assessment ratings for all major investments in the quarterly reporting to Congress. |
To address this recommendation, IRS supplemented the summary-level Chief Technology Officer risk assessment ratings it was providing for 13 of its major investments with summary-level assessment ratings for its remaining major investments. IRS began providing this supplemental information in the April 2015 fiscal year 2015 2nd quarter report to Congress.
|
Internal Revenue Service | To improve the reliability and reporting of investment performance information and management of selected major investments, the Commissioner of the IRS should direct the Chief Technology Officer to modify reporting of the Affordable Care Act Administration testing status to senior management to include a comprehensive report on all impacted systems--including an explanation for why impacted systems were not tested at a particular level--and ensure this reporting is aligned with the manner in which testing is being performed. |
IRS disagreed with this recommendation at the time we made it stating that it followed a rigorous risk-based process for planning the tests of ACA-impacted systems, including the types and levels of testing, and that it had comprehensive reporting for the filing season 2015 release, which included ACA impacted systems. However, as noted in our report, our review of ACA Testing Review Checkpoint reports and filing season reports, which officials stated were used to provide comprehensive reports to senior managers, did not identify the status of testing for all systems impacted by ACA Releases 5.0 and 6.0. In September 2017, IRS finished developing ACA and the investment transitioned to the operations and maintenance phase. We followed up with the IRS on multiple occasions to determine the extent to which it might be implementing the recommendation in light of this transition. Most recently, in October 2020, IRS reiterated its disagreement with the recommendation, stating that the test reporting for ACA addresses the type of tests conducted and the systems that are impacted. Based on IRS's continued disagreement and the lack of any indication that this recommendation will be addressed, we are closing this recommendation as not implemented. As we initially reported in 2015, without status reports that account for all impacted systems and are aligned with the manner in which IRS performs testing, it will be difficult to determine whether all required testing is being performed to ensure ACA is ready for the filing season.
|