XIV · Anti-PatternsAnti-pattern✕

Premature Closure

also known as LLM Jump-to-Conclusion, Pre-Constraint-Check Commitment

The LLM commits to a confident answer before processing all constraints, characteristic of constraint-heavy tasks where it fills in plausible answers fast and gets cross-constraint interactions wrong.

Context

The agent receives a problem with interconnected constraints (crossword, scheduling, multi-objective design). Standard LLM behavior is to begin generating the answer as soon as the prompt is parsed, optimizing for fluent next-token prediction. The constraint web is acknowledged but not held.

Problem

The model commits early to per-clue / per-step answers that are individually plausible but jointly incoherent. By the time later constraints are processed the commitment is already made. Reviewing the trace shows the model knew the constraints but didn't gate generation on them. Result: confident wrong answers, not 'I don't know' wrong answers.

Forces

  • Next-token prediction architecture biases toward fluency over correctness.
  • Fast responses are rewarded by users and benchmarks.
  • Slowing down (e.g. LRM) costs latency and money.

Example

A standard LLM is given a 6x6 crossword with intersecting constraints (clues that share letters). Within seconds it fills the grid with plausible answers per individual clue. Five intersections are wrong because the model never held the intersection constraints while choosing per-clue answers. Bornet's crossword: LRM took 2 minutes and got nearly perfect; LLM took seconds and made 5 errors.

Diagram

Solution

Therefore:

Pair with: large-reasoning-model-paradigm (route to LRM), strategic-preparation-phase (force constraint enumeration before generation), generate-and-test-strategy (separate generate from verify). Detect premature-closure-prone tasks by load (constraint-heavy, multi-step, math).

What this pattern forbids. No useful constraint; the missing constraint is a structural gate between problem-reading and answer-generation for constraint-heavy tasks.

And the patterns that stand alongside it, or against it —

  • alternative-toLarge Reasoning Model (LRM) Paradigm★— Route reasoning-heavy tasks to a reasoning-tuned model that trades inference time for deliberation, rather than to a fast LLM that exhibits premature-closure.
  • alternative-toStrategic Preparation Phase★— Mandate an explicit problem-space representation step before the agent attempts solutions, mirroring how expert humans build a mental model of constraints and dependencies before solving.
  • alternative-toGenerate-and-Test Strategy★— Generate multiple candidate solutions in parallel, then systematically test each against declared constraints rather than committing to the first plausible one — adapted from Langley & Simon's cognitive-science research on human expert problem-solving.
  • complementsFalse Confidence Syndrome✕— Anti-pattern: the model produces incorrect answers with the same high confidence as correct ones, failing to vary its expressed certainty with its actual reliability — Oxford-documented for constraint-heavy prompts.
  • complementsContext Fragmentation✕— Anti-pattern: the LLM cannot hold multiple interconnected constraints in mind simultaneously the way human working memory can; it processes each constraint locally and loses the cross-constraint view.

Neighbourhood

Click any neighbour to follow the language. Scroll to zoom, drag to pan.

References

Provenance