“Even if these sources of data bias could be identified and corrected, however, there may still be some group-based differences that are not attributable to data bias. If so, groups may experience different risk scores and categories that would not necessarily indicate bias. Further, it is often difficult (or impossible) to discern whether some observed group-level differences in data are genuine or reflect some sort of systemic bias.“

  • reallykindasorta@slrpnk.netOP
    link
    fedilink
    English
    arrow-up
    20
    ·
    edit-2
    22 days ago

    Hopefully it’s clear this is super problematic in the context of risk assessment tools. It means if you are categorized as part of a racial group that is convicted of more crimes, you might be categorized as a higher risk than you would otherwise.

    They argue models from education and psychology that address racial disparities could be adapted, but those institutions are designed to help people rather than to decide if they should be in jail.

    • snooggums@lemmy.world
      link
      fedilink
      English
      arrow-up
      27
      ·
      edit-2
      22 days ago

      It means if you are categorized as part of a racial group that commits more crimes, you might be categorized as a higher risk thank you would otherwise.

      Not commits more crimes. Disproportionately arrested and convicted of more crimes.