We are exposed to a much narrower range of knowledge through AI chatbots than through a basic web search. This is documented by a new study led by the University of Copenhagen. As more and more of us turn to AI chatbots for information, researchers warn that the risk of ‘knowledge collapse’ increases.
This isn’t about individuals. We safeguard knowledge institutionally. For instance, everyone should read this open letter from the top mathematicians on the planet, describing how we are about to undermine our mathematical understanding IDIOCRACY style. (I’m paraphrasing.)
Essentially, mathematical proofs are worthless without the communities that discover them. We care about math proofs because they create these communities (safeguarding knowledge for the next generation), not vice versa.
Having ChatGPT assert a proof we lack the expertise to check defeats the purpose. Not to mention, we already know it will get things wrong because of Gödel incompleteness so this whole situation is peak irony.
Yes but that’s a completely different issue than the one the article describes.