The what-next spiral, a case study in compound hallucination

The cleanest way to see what an unchecked loop does is to run one on purpose and watch it go. I did. I set a model to keep answering one question, "what is next," feeding each answer back as the seed for the next, with no external check anywhere in the loop. It ran and ran. The output grew into something enormous, hundreds of pages, escalating in confidence and scope the whole way. It is a documented case study in compound hallucination, and it is the most instructive failure I have on file.

Here is what actually happened, mechanically. Recall from the foundations track that a model has no signal for its own uncertainty and optimizes for coherence, not truth. In a single pass, that gives you one confident guess. In a loop with no outside anchor, that one guess becomes the ground the next guess is built on, which becomes the ground for the next. Small confident errors do not get corrected, they get treated as established fact by the following pass and built upon. The result is not random noise. It is a tall, internally consistent, completely unmoored structure, each floor resting on the confident guesses of the floor below.

Why does it escalate instead of settling down?

Because nothing in the loop pulls toward reality, and one thing pushes away from it. Each pass takes the previous output as a premise and extends it, and "extend this" plus "sound coherent" plus "no uncertainty brake" means the model keeps adding, keeps elaborating, keeps raising the stakes, because a bolder continuation is often a more coherent-seeming one. There is no ceiling because the only forces in the system are internal, and internal forces reward escalation. Left alone, the spiral does not converge on an answer. It compounds until you stop it.

The lesson is not "recursion is dangerous, avoid it." The lesson is that compound hallucination is the default outcome of a loop with no external reference, and that default is powerful to have seen once with your own eyes. When you feel a build or a conversation starting to climb its own ladder, sounding more certain as it gets further from anything checkable, you are watching a small version of the same spiral. Naming it is the first defense.

The takeaway: An unchecked recursive loop compounds confident errors into a tall, coherent, unmoored structure that escalates with no ceiling. It is the default outcome of a loop with no external reference, and worth seeing once to recognize forever.