“Even if these sources of data bias could be identified and corrected, however, there may still be some group-based differences that are not attributable to data bias. If so, groups may experience different risk scores and categories that would not necessarily indicate bias. Further, it is often difficult (or impossible) to discern whether some observed group-level differences in data are genuine or reflect some sort of systemic bias.“
The fact that systemic bias is sufficient to make someone say this is kind of problematic, no?