Underfitting
IntermediateWhen a model cannot capture underlying structure, performing poorly on both training and test data.
AdvertisementAd space — term-top
Why It Matters
Understanding underfitting is essential for building effective machine learning models. By ensuring that models are appropriately complex, practitioners can improve prediction accuracy and enhance performance across various applications, from image classification to natural language processing.
Underfitting occurs when a machine learning model is too simplistic to capture the underlying structure of the data, resulting in poor performance on both training and test datasets. This phenomenon is characterized by high bias, where the model fails to learn from the training data adequately. Mathematically, underfitting can be observed when the model's error is significantly higher than the optimal error achievable by more complex models. Common causes of underfitting include insufficient model capacity, inappropriate choice of model architecture, or inadequate feature representation. To address underfitting, practitioners may increase model complexity, enhance feature engineering, or employ more sophisticated algorithms.