Mean Absolute Error (MAE)#
Mean Absolute Error (MAE) is a popular metric used in assessing regression model performance for its overall simplicity and interpretability. It measures the average magnitude of errors in predictions, without considering their direction.
MAE represents the mean of the absolute differences between predicted and actual values across a dataset, treating each discrepancy equally. A large value is indicative of poor performance, and communicates how much on average a prediction will deviate from the actual value in the units of the ground truth.
Example
To see and example of Mean Absolute Error, checkout the STS Benchmark on app.kolena.com/try.
Implementation Details#
MAE is calculated by taking the average of the absolute differences between the predicted values and the actual values. This can be mathematically represented as:
where \(x\) is the numerical value from the actual values, and \(y\) is the corresponding numerical value from the predicted values for a total of \(N\) number of predictions.
Examples#
Temperature Estimation:
| Ground Truth Temperature (°C) | Predicted Temperature (°C) |
|---|---|
| 25 | 27 |
| 35 | 30 |
Age Estimation:
| Ground Truth Age (Years) | Predicted Age (Years) |
|---|---|
| 60 | 70 |
| 40 | 20 |
Limitations and Biases#
While Mean Absolute Error (MAE) is straightforward to interpret, it treats all errors equally, which might not reflect the true impact of outliers or extreme errors on the model's performance.
In scenarios where the dataset contains outliers or extreme values, MAE might not accurately represent the model's overall predictive capability in a wholistic manner. It's important to complement MAE with other evaluation metrics, such as Root Mean Squared Error (RMSE), which penalizes larger errors more heavily.
Thus, while MAE provides valuable insights into prediction accuracy, it's advisable to consider it alongside other metrics for a comprehensive evaluation of regression models.