Questions tagged [inference]
The inference tag has no usage guidance.
4
questions
1
vote
1answer
23 views
Is the Mask Needed for Masked Self-Attention During Inference with GPT-2
My understanding is that masked self-attention is necessary during training of GPT-2, as otherwise it would be able to directly see the correct next output at each iteration. My question is whether ...
1
vote
1answer
236 views
Why is exact inference in a Bayesian network both NP-hard and P-hard?
I should show that exact inference in a Bayesian network (BN) is NP-hard and P-hard by using a 3-SAT problem.
So, I did formulate a 3-SAT problem by defining 3-CNF:
$$(x_1 \lor x_2) \land (\neg x_3 \...
1
vote
0answers
13 views
How to use TPU for real-time low-latency inference?
I use Google's Cloud TPU hardware extensively using Tensorflow for training models and inference, however, when I run inference I do it in large batches. The TPU takes about 3 minutes to warm up ...
1
vote
0answers
12 views
Colour palettes for COCO dataset
Is there any link or explanation on how to create Color palettes for coco dataset for segmentation. I see there is a link for cityscapes dataset https://gluon-cv.mxnet.io/_modules/gluoncv/utils/viz/...
