Results for "layer norm"
Bottleneck Layer
Intermediate
A narrow hidden layer forcing compact representations.
Deep Learning
Intermediate
A branch of ML using multi-layer neural networks to learn hierarchical representations, often excelling in vision, speech, and language.
System Prompt
Intermediate
A high-priority instruction layer setting overarching behavior constraints for a chat model.
Depth vs Width
Intermediate
Tradeoffs between many layers vs many neurons per layer.
Norm
Advanced
Measure of vector magnitude; used in regularization and optimization.
Norm Formation
Advanced
Emergence of conventions among agents.