Unintuitive Features Study

Nowadays, AI systems have been applied widely in a variety of predictive tasks, from objective detection to text classification. These AI systems have greatly advanced automated decision-making. However, sometimes humans and AI systems think in very different ways, which means humans and AI systems might use different evidence to make predictions. In this study, we are using sentiment analysis of Amazon product reviews as a case study. Humans will judge sentiments of different words with different AI explanations. Human and AI judgments will be compared to find to which extend human and AI knowledge align.