Why Chatbots Are Bad

Researchers say natural-language processing by AI models will only contribute to more misinformation and polarization via MIT Technology Review:

Asking computers a question and getting an answer in natural language can hide complexity behind a veneer of authority that is not deserved…

The problem is that language models are mindless mimics. They can become strikingly accurate at predicting the words or phrases most likely to come next in a sentence or conversation. But despite Pichai’s casual claim that his AI “understands” many topics, language models do not know what they are saying and cannot reason about what their words convey…

There’s a dilemma here. Direct answers may be convenient, but they are also often incorrect, irrelevant, or offensive. They can hide the complexity of the real world…
March 30, 2022