算法混淆

算法混淆是一种微妙但却影响深远的偏差来源。它的产生是因为机器学习模型非常擅长发现统计相关性，即使是虚假相关性也不例外。 While a developer might remove a sensitive feature like ‘race’ to prevent discrimination, the model can latch onto other features that act as proxies. A classic example is the use of ZIP codes in loan applications. Due to historical residential segregation, ZIP codes can be highly correlated with race. An algorithm might learn that applicants from certain ZIP codes are higher risk, not because of their location, but because the location is a proxy for a racial group that has historically been denied loans, creating a feedback loop of discrimination.

这与传统的统计混淆不同，因为算法并非仅仅被误导，而是主动从数据中学习歧视性策略。识别和缓解这种情况需要的不仅仅是特征移除。它通常需要运用因果推断技术来理解变量之间的真实关系，或者使用公平感知算法，这些算法可以被约束为忽略已知代理变量的影响。挑战在于，几乎任何变量都可能在某种程度上是代理变量，这使得完全消除代理变量变得困难。