Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 40765

For questions related to transfer learning, a machine learning method that focuses on storing knowledge gained while solving one problem in order to apply this knowledge to a different but related problem.

0 votes
1 answer
67 views

BERT: After pretraining 880000 step, why fine-tune not work? [closed]

I am using pretraining code from https://github.com/NVIDIA/DeepLearningExamples Pretrain parameters: 15:47:02,534: INFO tensorflow 140678508230464 init_checkpoint: bertbase3layer-extract-from-googl …
CoderOnly's user avatar
  • 101
0 votes
Accepted

BERT: After pretraining 880000 step, why fine-tune not work?

change bert_output = bert_model.get_pooled_output() to bert_output = tf.reduce_mean(bert_model.get_sequence_output()[:,1:,:],1)
CoderOnly's user avatar
  • 101