Large Language Model

Intermediate

A high-capacity language model trained on massive corpora, exhibiting broad generalization and emergent behaviors.

Full Definition

A high-capacity language model trained on massive corpora, exhibiting broad generalization and emergent behaviors.

Keywords

GPT-style scale

Domains

Large Language Models

Related Terms

Transformer narrower than

Architecture based on self-attention and feedforward layers; foundation of modern LLMs and many multimodal models.

 Language Model broader than

A model that assigns probabilities to sequences of tokens; often trained by next-token prediction.

 Prompt Engineering used in

Crafting prompts to elicit desired behavior, often using role, structure, constraints, and examples.

 Fine-Tuning used in

Updating a pretrained model’s weights on task-specific data to improve performance or adapt style/behavior.

 Tokenization prerequisite of

Converting text into discrete units (tokens) for modeling; subword tokenizers balance vocabulary size and coverage.

 Hallucination related to

Model-generated content that is fluent but unsupported by evidence or incorrect; mitigated by grounding and verificat...

 Vector Database related to

A datastore optimized for similarity search over embeddings, enabling semantic retrieval at scale.

 Fine-Tuning related to

Updating a pretrained model’s weights on task-specific data to improve performance or adapt style/behavior.

 Language Model related to

A model that assigns probabilities to sequences of tokens; often trained by next-token prediction.

Concept Map

See how Large Language Model connects to other concepts.

Open Knowledge Graph