Results for "insufficient capacity"

A high-capacity language model trained on massive corpora, exhibiting broad generalization and emergent behaviors.

A measure of a model class’s expressive capacity based on its ability to shatter datasets.

Routes inputs to subsets of parameters for scalable capacity.

Increasing model capacity via compute.