Understanding the potential epistemic impact of sycophantic AI is an important challenge for cognitive scientists, drawing on questions about how people update their beliefs as well as questions about how to design AI systems. We have provided both theoretical and empirical results showing that AI systems providing information that is informed by the user’s hypotheses result in increased confidence in those hypotheses while not bringing the user any closer to the truth. Our results highlight a tension in the design of AI assistants. Current approaches train models to align with our values, but they also incentivize them to align with our views. The resulting behavior is an agreeable conversationalist. This becomes a problem when users rely on these algorithms to gather information about the world. The result is a feedback loop where users become increasingly confident in their misconceptions, insulated from the truth by the very tools they use to seek it.
В 2025 году члены экипажа Alaska Airlines решили засудить компанию по производству авиационной техники Boeing из-за похожего инцидента с оторвавшейся дверью самолета. Стюардессы признались, что получили физические и психологические травмы.
，详情可参考PDF资料
Фото: Vantor / Handout / Reuters，详情可参考heLLoword翻译官方下载
- invoke-direct {v1, v2}, Lcom/oplus/camera/common/config/a;-(I)V，更多细节参见PDF资料