Adult Drug Courts: Studies Show Courts Reduce Recidivism, but DOJ Could Enhance Future Performance Measure Revision Efforts
Highlights
A drug court is a specialized court that targets criminal offenders who have drug addiction and dependency problems. These programs provide offenders with intensive court supervision, mandatory drug testing, substance-abuse treatment, and other social services as an alternative to adjudication or incarceration. As of June 2010, there were over 2,500 drug courts operating nationwide, of which about 1,400 target adult offenders. The Department of Justice's (DOJ) Bureau of Justice Assistance (BJA) administers the Adult Drug Court Discretionary Grant Program, which provides financial and technical assistance to develop and implement adult drug-court programs. DOJ requires grantees that receive funding to provide data that measure their performance. In response to the Fair Sentencing Act of 2010, this report assesses (1) data DOJ collected on the performance of federally funded adult drug courts and to what extent DOJ used these data in making grant- related decisions, and (2) what is known about the effectiveness of drug courts. GAO assessed performance data DOJ collected in fiscal year 2010 and reviewed evaluations of 32 drug- court programs and 11 cost-benefit studies issued from February 2004 through March 2011.
BJA collects an array of data on adult drug-court grantees, such as drug-court completion rates, and during the course of GAO's review, began expanding its use of this performance data to inform grant-related decisions, such as allocating resources and setting program priorities. For example, during September 2011, BJA assessed a sample of adult drug-court grantees' performance across a range of variables, using a new process it calls GrantStat. BJA developed recommendations following this assessment and is determining their feasibility. In addition, in October 2011, BJA finalized revisions to the performance measures on which grantees report. BJA's process of revising its performance measures generally adhered to key practices, such as obtaining stakeholder involvement; however, BJA could improve upon two practices as it continues to assess and revise measures in the future. First, while BJA plans to assess the reliability of the new measures after the first quarter of grantees' reporting, officials have not documented, as suggested by best practices, how it will determine if the measures were successful or whether changes would be needed. Second, should future changes to the measures be warranted, BJA could improve the way it documents its decisions and incorporates feedback from stakeholders, including grantees, by recording key methods and assumptions used to guide its revision efforts. By better adhering to best practices identified by GAO and academic literature, BJA could better ensure that its future revision efforts result in successful and reliable metrics--and that the revision steps it has taken are transparent. In the evaluations that GAO reviewed, drug-court program participation was generally associated with lower recidivism. GAO's analysis of evaluations reporting recidivism data for 32 programs showed that drug-court program participants were generally less likely to be re-arrested than comparison group members drawn from criminal court, with differences in likelihood reported to be statistically significant for 18 of the programs. Cost-benefit analyses showed mixed results. For example: (1) Across studies showing re-arrest differences, the percentages of drug- court program participants re-arrested were lower than for comparison group members by 6 to 26 percentage points. Drug court participants who completed their program had re-arrest rates 12 to 58 percentage points below those of the comparison group. (2) GAO's analysis of evaluations reporting relapse data for eight programs showed that drug-court program participants were less likely than comparison group members to use drugs, based on drug tests or self- reported drug use, although the difference was not always significant. (3) Of the studies assessing drug-court costs and benefits, the net benefit ranged from positive $47,852 to negative $7,108 per participant. GAO recommends that BJA document key methods used to guide future revisions of its performance measures for the adult drug-court program. DOJ concurred with GAO's recommendation.
Recommendations
Recommendations for Executive Action
| Agency Affected | Recommendation | Status |
|---|---|---|
| Bureau of Justice Assistance | Recognizing that BJA has recently revised the adult drug-court performance measures and has plans to assess their utility, and to ensure that its revision process is transparent and results in quality and successful metrics to inform management's key decisions on program operations, the BJA's Director should document key methods used to guide future revisions of its adult drug-court program performance measures. This documentation should include both a plan for how BJA will assess the measures after conclusion of the grantees' first reporting period and a rationale for why each measure was refined, including a discussion of the scope and nature of any relevant stakeholder comments. |
We found that the Bureau of Justice Assistance (BJA) could improve the way it documents its decisions and incorporates feedback from stakeholders, including grantees, by recording key methods and assumptions used to guide its revision of Adult Drug Court Discretionary Grant Program performance measures. Therefore, we recommended that BJA document key methods used to guide future performance measure revisions and that such documentation include both a plan for how BJA will assess the measures after conclusion of the grantees' first reporting period and a rationale for why each measure was refined. As part of our recommendation, we also noted that BJA should include in its records a discussion of the scope and nature of any relevant stakeholder comments that informed its decisions. In response, BJA developed a corrective action plan to specifically address our recommendation. The plan included creation of a timeline to record key revision related activities and a proposal to assess the data grantees submitted in response to the revised performance measures. In executing this corrective action plan, BJA completed its timeline, recording key steps in the performance measure revision process and noting when each occurred. BJA also completed a cross-walk, describing the actions it took to revise or remove certain performance measures and the rationale, such as specific stakeholder feedback, that supported its decisions. Additionally, as proposed in the corrective action plan, BJA analyzed the data grantees submitted using the revised performance measures and checked it for completeness, quality, and accuracy. To record its analysis, BJA produced a summary report in August 2012 and included recommendations for improving the performance measures that had the least reliable data. These actions are consistent with our recommendation.
|