Edit RoBERTa is an extension of BERT with changes to the pretraining procedure. The modifications include: training the model longer, with bigger batches, over more data RoBERTa has almost similar architecture as compare to BERT, but in order to improve the results on BERT architecture, the autho