Log Loss
IntermediatePenalizes confident wrong predictions heavily; standard for classification and language modeling.
AdvertisementAd space — term-top
Why It Matters
Log loss is crucial for evaluating classification models, especially in applications where accurate probability estimates are necessary, such as in medical diagnosis or financial forecasting. By penalizing confident incorrect predictions, it encourages the development of models that provide reliable and interpretable probability outputs.
Log loss, also known as logistic loss or cross-entropy loss, is a performance metric for evaluating the accuracy of probabilistic predictions in binary classification tasks. It quantifies the difference between the predicted probabilities and the actual binary outcomes, defined mathematically as Log Loss = - (1/N) * Σ [y_i * log(p_i) + (1 - y_i) * log(1 - p_i)], where y_i is the actual label (0 or 1) and p_i is the predicted probability of the positive class for instance i. Log loss penalizes incorrect predictions more heavily when the predicted probability is high, making it particularly sensitive to confident but wrong predictions. This characteristic makes log loss a widely used metric in machine learning, particularly in applications such as classification and language modeling, where accurate probability estimates are essential for decision-making.