AWS Certified AI Practitioner Practice Exam

If a model performs well on the training dataset but declines in production, what should be done?

1. Reduce the volume of the data that is used in training

2. Add hyperparameters to the model

3. Increase the volume of data that is used in training

4. Increase the model training time

The correct answer is: Increase the volume of data that is used in training

When a model performs well during training but shows a decline in production, it often indicates that the model is suffering from overfitting. Overfitting occurs when a model learns the noise and details in the training data to the point that it negatively impacts its performance on new, unseen data. In such cases, increasing the volume of training data can help the model generalize better. By incorporating more diverse and representative data into the training process, the model is exposed to various examples and patterns, which can enhance its ability to make predictions on unseen datasets. This additional data can help the model identify and learn the underlying trends rather than memorizing the training set, reducing the risk of overfitting and improving performance in production. Other choices, such as reducing the volume of data or adding hyperparameters, may not address the fundamental issue of the model's ability to generalize. Increasing training time alone may also lead to further overfitting rather than improving the model’s robustness. Therefore, the best action in this scenario is to increase the training data volume.