I would like to add one more thing here. The humongous models like Roberta, XLNet which are trained on an insane amount of data are built to address some of the problems that you mentioned.