Chatbot Epistemology

This piece considers the epistemological challenges that arise with the increasingly widespread use of AI chatbots. I articulate a problem that they present—the ‘boiling frog problem’. According to the metaphor, if you boil a frog by putting it in scalding water, it will try to save itself, but if you put the frog in a pot of tepid water, it will remain unaware of the rising water temperature and therefore, make no attempt to escape to save itself. In both cases, the outcome is the same—the frog dies. Likewise, I argue that the combination of factors I identify in this piece, over time, will give rise to detrimental engagements with chatbots and ultimately, to diminished human autonomy. The factors I consider include problems with digital privacy, misplaced epistemic trust in AI companions, LLM emergence, the use of personality profiling and adaptive language, misattributing sentience to LLMs, and more.