An algorithm that screens for child neglect raises concerns
Inside a cavernous stone fortress in downtown Pittsburgh, attorney Robin Frank defends parents at one of their lowest points when they are at risk of losing their children.
The job is never easy, but in the past she knew what she was up against when squaring off against child protective services in family court. Now, she worries shes fighting something she cant see: an opaque algorithm whose statistical calculations help social workers decide which families will have to endure the rigors of the child welfare system, and which will not.
A lot of people dont know that its even being used, Frank said. Families should have the right to have all of the information in their file.
From Los Angeles to Colorado and throughout Oregon, as child welfare agencies use or consider tools similar to the one in Allegheny County, Pennsylvania, an Associated Press review has identified a number of concerns about the technology, including questions about its reliability and its potential to harden racial disparities in the child welfare system. Related issues have already torpedoed some jurisdictions plans to use predictive models, such as the tool notably dropped by the state of Illinois.
According to new research from a Carnegie Mellon University team obtained exclusively by AP, Alleghenys algorithm in its first years of operation showed a pattern of flagging a disproportionate number of Black children for a mandatory neglect investigation, when compared with white children. The independent researchers, who received data from the county, also found that social workers disagreed with the risk scores the algorithm produced about one-third of the time.
https://apnews.com/article/child-welfare-algorithm-investigation-9497ee937e0053ad4144a86c68241ef1
____________________________________________________________________________________
PLEASE read the linked article. The whole thing. To paraphrase "Shane", an algorithm is a tool; it's as good or as bad as the person using it. It also should not be kept secret, nor should the "results".
no_hypocrisy
(46,067 posts)I had a client almost lose her children solely for being poor. Children were dazzled by the affluence of their foster parents and wanted their mother to let them be adopted. It was a CF but we got the kids back.
Phoenix61
(17,000 posts)Im reminded of the saying, If you cant dazzle them with brilliance baffle them with bullshit. Ive worked as a CPS investigator and theres a huge difference between a family that is struggling to feed their children and one that chooses not to. Theres no way to algorithm your way to knowing who is who. They say money cant solve everything but it sure can solve some things.