Chapter 8 - Measuring Performance of Prediction in Regression

(60%,40%)

A common practice in data partitioning is to partition some percent of the data into the training data set and some percent of the data into the validation data set. Which of the answer below is consistent with the percentage of data in training data set and percentage of data in validation data set? Multiple choice question. (30%,70%) (40%,60%) (60%,40%) (70%,30%)

Partitioning

Data '' is the process of dividing a data set into a training, a validation, and, in some situations, an optional test data set.

The mean error (ME) The mean absolute percentage error (MAPE) The root mean square error (RMSE)

Select all that apply Name 3 prediction model performance measures described in the chapter. Multiple select question. The mean error (ME) The mean absolute percentage error (MAPE) The root mean error (RME) The root mean square error (RMSE)

When large errors are particularly undesirable

When is the RMSE performance measure most desirable? Multiple choice question. When you care that there is an error but not whether it is + or - When you want to show the relative error When large errors are particularly undesirable When you want to measure the magnitude of the errors

Performance

it is important to develop '' measures that evaluate how well an estimated model will perform in an unseen sample, rather than making the evaluation solely on the basis of the sample data used to build the model.