Results for "skip connection"

Allows gradients to bypass layers, enabling very deep networks.

Early architecture using learned gates for skip connections.

Gradients shrink through layers, slowing learning in early layers; mitigated by ReLU, residuals, normalization.