# Does BERT freeze the entire model body when it does fine-tuning?

Recently, I came across the BERT model. I did some research and tried some implementations.

I wanted to tackle a NER task, so I chose the BertForSequenceClassifications provided by HuggingFace.

for epoch in range(1, args.epochs + 1):
total_loss = 0
model.train()
b_input_ids = batch[0].to(device)
b_labels = batch[2].to(device)

loss = outputs[0]

total_loss += loss.item()
loss.backward()