I REMAIN PUZZLED BY THIS: Why do LLMs make stuff up? New research peers under the hood.
The answer provided here doesn’t actually explain why the models make up fake articles with fake citations, for fake books with fake ISBN numbers. I’m also troubled that we didn’t completely understand this from the beginning.