Buting ,Williams & Stilling ,S.C. | A Criminal Defense Law Firm

Call Today for a FREE Consultation


Study: Risk-assessment algorithms are fraught with racial bias

by | Jul 26, 2019 | Criminal Defense

The Center for Court Innovation, a New York-based criminal justice reform agency, recently released a study on supposedly race-neutral risk assessment tools. These tools are widely used by courts to determine whether defendants should be granted bail or held in jail until trial.

The tools parse each defendant’s demographics and criminal history, the seriousness of the current charge, and any past interactions with the justice system, such as arrests without charges. They then spit out a number corresponding to the theoretical risk that the defendant will commit another crime if released on bail.

Risk-assessment tools are sold as objective, data-based decision-making algorithms that replace subjective human judgment with cold facts. The idea was to prevent racial bias in decisions about bail and pretrial release. But do they simply reinforce existing stereotypes?

There’s reason to believe they do. In 2016, the independent newsroom ProPublica published a study of Broward County, Florida’s COMPAS tool.

When COMPAS was used, African-American defendants were nearly twice as likely as whites to be labeled high-risk but not commit additional crimes — the “false positive” effect. White defendants were more likely to be labeled low-risk but commit new crimes.

The Center for Court Innovation created its own risk-assessment algorithm and used it to predict who would commit further crimes if let out on bail. No real-world bail decisions were made using the tool. They simply wanted to see how accurate its predictions would be.

The results were the same as ProPublica’s. African-Americans and Hispanics were falsely labeled high-risk much more often than whites.

Why? The thought is that some things considered by the tools, such as arrests that didn’t lead to charges, are the result of a history of unduly aggressive law enforcement in African-American neighborhoods. Moreover, African-Americans have historically been more likely to be arrested, charged and convicted than white peers. Considering past run-ins with law enforcement in the risk assessment may carry these past injustices forward.

Outcomes based on reason, not bias, may require a different approach

The Center for Court Innovation found that it could address the racial disparity by changing the scenario to reduce pre-trial detention overall. Pre-trial detention would only be ordered for those charged with violent felonies or domestic violence. People charged with nonviolent crimes would simply be released without bail.

After that, the risk-assessment tool would be used to predict who among those charged with violent crimes was likely to commit additional crimes if released.

This two-step process reduced pre-trial detention by over half and eliminated the racial disparities in false-positives.

It may indicate how racially biased the bail system is when an effective way to reduce the bias is to eliminate bail for the majority of defendants.

Practice Areas

“I just want to say thank you for the outstanding work you have done for him and let you know how much we appreciate the time and attention you gave to his case. We are obviously overjoyed by today’s dismissal!” (Child pornography case dismissed after motion to suppress was granted)”

“After having had time to exhale, we thank each one of you and all the others who contributed to the exemplary Supreme Court presentation. We are proud of your efforts on our behalf and, equally important, on behalf of the many present and future defendants statewide.” (Client’s comment after Supreme Court oral argument)

“Thank you. Thank you. I am so pleased to hear that we won. It doesn’t seem that it was even a close call. I appreciate your efforts.” (Oconto County defendant after Buting, Williams & Stilling got his prison sentence overturned in the court of appeals) ”

“Your time and advice was appreciated more than words can express at a time when we really needed someone to guide us.” (Client)

“The outcome was amazing, one unavailable even under identical circumstances in probably 98 percent of federal courtrooms around the country. Separate and apart from the outcome, though, I am supremely impressed by your efforts on your client’s behalf. Your comments in support of the requested sentence were perfect in tone and, having now reviewed the extensive sentencing memorandum you filed, your work in that regard was exemplary as well. Your client was certainly fortunate to have you as his attorney.” (Local federal court attorney present at a sentencing)

“I can’t thank you enough, not only for all of the tireless work that you and your staff put into my case, but for telling me what I needed to hear, at a time when I absolutely had to hear it. I consider myself blessed for everything turning out the way it did, especially since I blindly picked you out of a phone book! You helped me, my family and friends in many more ways than the money ever could.” (Child pornography client)

“I think you will find that in any circles where Kathy’s name is raised, people will always respond positively and identify her as an extremely hardworking, knowledgeable and ethical lawyer who is timely and effective with any endeavor she takes on. These circles would include colleagues, friends, prosecutors, judges, professors and others who have crossed paths with Kathy. They would also include the many lawyers like me who have referred numerous cases to Kathy, invariably with positive feedback from the clients regarding her knowledge of their case, empathy, professionalism and fair-mindedness in addressing their concerns.” (Fellow attorney)

“Thank you for giving [our son] back to us. Wonderful work!” (Family of client accused of armed robbery after charges were dismissed)

“Yes, His perfect time and perfect place, you were a part of this plan. I almost didn’t hire you, but I took a step of faith trusting Him and look what happened? Praise God. Our Lord put you in your vocation for a reason, continue to help those He brings your way. May He bless you in ALL you do!” (Client who was wrongfully convicted of sexual assault in a northwestern Wisconsin county. He was released from prison after attorneys got his conviction reversed.)

“I really cannot thank you enough for your past help. You really know your stuff. It is actually funny when I think about my other past attorney’s knowledge and then when I talk with you. It’s like night and day. You’re like a walking book of knowledge with a purpose-driven life. Thanks.” (Brown County client of attorney Buting)

“A year later and I still believe your defense is the single best example of lawyering I have ever seen.” (Television reporter commenting on attorney Buting’s defense of Steven Avery)

“You have a certain brilliance that makes me sure that when you talk, it is good information and I am in good hands. You tell it to me like it is even when the things you say are not always the things that I would like to hear. You keep it REAL!!!” (Brown County client)

“Thank you, thank you, thank you! I feel like this was one of the biggest blessings that happened in my life. I put this along with my children being born healthy and when I survived that horrific shooting. I appreciate everything you have done for me. I couldn’t ask for better lawyers. I want to say thank you to everybody at your firm. I owe you more than the fee you so rightfully deserve. … You gave me back hope. Thank you, man! Out of my 36 years … I have never seen such kindness before. I don’t know what I did to deserve this; I’m very thankful nonetheless. Thank you for giving me hope again. Thank you for your generosity. There are still some really good people around.” (Federal criminal appeal client)

“There is no other attorney I’ve ever even heard of I’d rather have as chief counsel and leader of my defense/appeals than Jerome Buting. You’re the best. Period.” (Dane County client)

“Your advice and counsel were greatly appreciated. We appreciate you taking the time on your Sunday and evenings to help us. We are SO happy about the results! Thanks again.” (Waukesha County client)

“Thank you again … for everything. Five and one-half years of commitment, so many ups and downs and an outcome like that. You did a GREAT job.” (Waukesha County felony drug offense client)