This illustrates a serious problem with AI. We (Humans) are ceding our autonomy to AI without any evidence of the validity of the outcomes. The industry puts up a front saying they will be careful, but the reality is that they are faking it until they make it. Techies want to fix the problem by adding more data points or tweaking the algos, but the real fix will take actual structural societal changes which is time consuming and expensive. Technology alone will not fix this.