EADST

Bert-Small Pytorch Model

from transformers import AutoModel
from transformers import AutoConfig

model_name = "google/bert_uncased_L-4_H-512_A-8"
config = AutoConfig.from_pretrained(model_name)
self.model = AutoModel.from_pretrained(model_name, add_pooling_layer=False, config=config)

Reference:

google/bert_uncased_L-4_H-512_A-8