Distribution Shift

Model trained on its own outputs degrades quality.

Model relies on irrelevant signals.

Small prompt changes cause large output changes.

Probabilities do not reflect true correctness.

Model-generated content that is fluent but unsupported by evidence or incorrect; mitigated by grounding and verificat...

Applying learned patterns incorrectly.

Differences between training and inference conditions.

Loss of old knowledge when learning new tasks.