Hi,

You’re retraining the embedding layer so the whole purpose of using pre-trained vector is being wasted.

You should set the embedding layer to trainable=False