December 28, 2023 by Amy Ma

diving headfirst into the world of loss functions: the silent superheroes guiding our models to learn from mistakes. In this post, we'd cover the following topics:

• What is a loss function?
• Difference between loss functions and metrics
• Explaining MSE and MAE from two perspectives
• Three basic ideas when designing loss functions
• Using those three basic ideas to interpret MSE, log loss, and cross-entropy loss
• Connection between log loss and cross-entropy loss
• How to handle multiple loss functions (objectives) in practice
• Difference between MSE and RMSE

Read An In-Depth Guide to the Most Common Loss Functions