Questions tagged [inference]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
9 views

How to productionize a YOLO model? [migrated]

I have successfully trained a YOLO v3 model using the AlexeyAB fork. Now I need to deploy the generated weight file into a service-oriented architecture production environment. For example, I need to ...
0
votes
0answers
25 views

What are state of the art backward chaining packages in Python?

What are state of the art backward chaining packages/tools/github algorithms in Python? It would be nice if you could also comment on the strengths and weaknesses of each solution !
1
vote
0answers
28 views

Why does the BatchNormalization layer produce different outputs during training and inference?

I modified resnet50 architecture to get a regression network. I just add batchnorm1d and ReLU layers just before the fully connected layer. During the training, the output of batchnorm1d layer is ...
4
votes
0answers
50 views

Training and inference for highly-context-sensitive information

What is the best way to train / do inference when the context matters highly as to what the inferred result should be? For example in the image below all people are standing upright, but because of ...
1
vote
1answer
63 views

Is the Mask Needed for Masked Self-Attention During Inference with GPT-2

My understanding is that masked self-attention is necessary during training of GPT-2, as otherwise it would be able to directly see the correct next output at each iteration. My question is whether ...
1
vote
0answers
37 views

How to use TPU for real-time low-latency inference?

I use Google's Cloud TPU hardware extensively using Tensorflow for training models and inference, however, when I run inference I do it in large batches. The TPU takes about 3 minutes to warm up ...
1
vote
0answers
21 views

Colour palettes for COCO dataset

Is there any link or explanation on how to create Color palettes for coco dataset for segmentation. I see there is a link for cityscapes dataset https://gluon-cv.mxnet.io/_modules/gluoncv/utils/viz/...
2
votes
1answer
279 views

Why is exact inference in a Bayesian network both NP-hard and P-hard?

I should show that exact inference in a Bayesian network (BN) is NP-hard and P-hard by using a 3-SAT problem. So, I did formulate a 3-SAT problem by defining 3-CNF: $$(x_1 \lor x_2) \land (\neg x_3 \...