When do you stop training a Neural Network?

1. Early cut off looking at training_loss
2. Early cut off looking at validation_loss
3. Set Higher Regularization?

Increasing data is not an option, have used SMOTE related technqiues for interpolating more data for the imbalanced classes already.

Just trying to understand what do other folks do.