Courage to Learn ML: An In-Depth Guide to the Most Common Loss Functions
towardsdatascience.com
MSE, Log Loss, Cross Entropy, RMSE, and the Foundational Principles of Popular Loss Functions

December 28, 2023 by Amy Ma

diving headfirst into the world of loss functions: the silent superheroes guiding our models to learn from mistakes. In this post, we’d cover the following topics:

  • What is a loss function?
  • Difference between loss functions and metrics
  • Explaining MSE and MAE from two perspectives
  • Three basic ideas when designing loss functions
  • Using those three basic ideas to interpret MSE, log loss, and cross-entropy loss
  • Connection between log loss and cross-entropy loss
  • How to handle multiple loss functions (objectives) in practice
  • Difference between MSE and RMSE

Read An In-Depth Guide to the Most Common Loss Functions