THE SCIENCE ISN’T SETTLED: Psychology’s Favorite Tool for Measuring Racism Isn’t Up to the Job: Almost two decades after its introduction, the implicit association test has failed to deliver on its lofty promises.
Given all this excitement, it might feel safe to assume that the IAT really does measure people’s propensity to commit real-world acts of implicit bias against marginalized groups, and that it does so in a dependable, clearly understood way. After all, the test is hosted by Harvard, endorsed and frequently written about by some of the top social psychologists and science journalists in the country, and is currently seen by many as the most sophisticated way to talk about the complicated, fraught subject of race in America.
Unfortunately, none of that is true. A pile of scholarly work, some of it published in top psychology journals and most of it ignored by the media, suggests that the IAT falls far short of the quality-control standards normally expected of psychological instruments. The IAT, this research suggests, is a noisy, unreliable measure that correlates far too weakly with any real-world outcomes to be used to predict individuals’ behavior — even the test’s creators have now admitted as such. The history of the test suggests it was released to the public and excitedly publicized long before it had been fully validated in the rigorous, careful way normally demanded by the field of psychology. In fact, there’s a case to be made that Harvard shouldn’t be administering the test in its current form, in light of its shortcomings and its potential to mislead people about their own biases. There’s also a case to be made that the IAT went viral not for solid scientific reasons, but simply because it tells us such a simple, pat story about how racism works and can be fixed.
Is there anything in the field of social psychology that isn’t a fraud or a sham?