The real lesson, I think, from AI-machine learning is that AI-machine learning is a lot like "human judgment"—we have remarkably little insight into what features decisions of the situation are salient to the mind or to the whatever that is actually making the deciding. Thus this is not just a cautionry tale for AI-machine learning, it is also a cautionary tale for human "experts": Andrew Hill: Amazon Offers Cautionary Tale Of AI-Assisted Hiring: "Amazon, one of the most innovative and data-rich companies in the world, leapt on that possibility as early as 2014. It built a recruiting engine that analysed applications submitted to the group over the preceding decade and identified patterns. The idea was it would then spot candidates in the job market who would be worth recruiting...

..."Everyone wanted this holy grail,” one person familiar with the initiative told Reuters, which broke the story in October. Unfortunately, the data were dominated by applications from men, and the AI taught itself to prefer male candidates, discriminating against CVs that referred to “women’s” clubs, and setting aside graduates from certain all-women’s colleges. The initiative was downgraded and the research team scrapped. Amazon has claimed it never used the programme to evaluate applicants...


#noted

Comments