Questions tagged [tensorflow]

For questions related to Google's open-source library for machine learning and machine intelligence. However, note that programming questions are off-topic here.

Filter by
Sorted by
Tagged with
0
votes
0answers
9 views

Any attempt for training results in worse segmentation

my question might be a kind of shot into dark, but currently I'm trying to optimize a training process of a neural net to improve final results. The problem I'm dealing with is multiclass segmentation ...
0
votes
0answers
14 views

In general, when are the normal, uniform and zero initializers used?

I came across a Conv2D layer in a fully convolutional network, which used a kernel_initializer='zero' for regression. Why is a ...
0
votes
0answers
30 views

Exception encountered when calling layer "attention_weight" (type Attention) [closed]

I am new to using attention. My input shape is per sample is of shape (6,128). I can't get my head around what the solution might be. ...
0
votes
0answers
23 views

Object detection: when there's only 1 object in each image

Good day. I have a custom dataset for object detection, which has imbalance that each image has only one object annotation. I trained the object detection model(Efficientdet-dx) on TensorFlow object ...
0
votes
0answers
60 views

Why is val accuracy 100% within 2 epochs and incorrectly predicting new images? (1,000 images per class when training)

My CNN tensorflow model reports 100% validation accuracy within 2 epochs. But it incorrectly predicts on single new images. (It is multiclass problem. I have 3 classes). How to resolve this? Can you ...
1
vote
1answer
350 views

Why is my validation/test accuracy higher than my training accuracy

Is this due to my dropout layers being disabled during evaluation? I'm classifying the CIFAR-10 dataset with a CNN using the Keras library. There are 50000 samples in the training set; I'm using a ...
0
votes
0answers
14 views

tfp.Distributions.Categorical.sample() is picking the same action everytime after certain iterations

I have written a code for an RL agent such that at each state the model calculates the probabilities of all possible actions and samples one action randomly to proceed further. To acheive this, I have ...
0
votes
0answers
27 views

Why am I getting a very small number as CNN prediction?

I created a CNN using Tensorflow to identify pneumonia and sometimes it returns a very small number as a prediction. why is this happening? I have attached the link for the dataset Here I how I ...
1
vote
1answer
132 views

Which model can I use for this problem with multiple inputs and outputs?

Which model is the most appropriate for this problem with multiple inputs and outputs? The data set is A1, A2, A3, A4, A5, A6, B1, B2, B3, B4 where ...
2
votes
0answers
48 views

What parameters or hyper-parameters of my model for time-series should I change to improve the MAE?

The following time series exercise is about writing the best possible model, minimizing the MAE. Helper functions normalize_series, ...
0
votes
0answers
28 views

What is it called when every entry of the output vector has a meaning?

I'm trying to implement Deep Q Learning using Tensorflow. The input is a vectorized representation of the state, and the output is a vector whose length is the number of possible actions. I've already ...
0
votes
0answers
38 views

How to fine-tune GPT-J with small dataset

I have followed this guide as closely as possible: https://github.com/kingoflolz/mesh-transformer-jax I'm trying to fine-tune GPT-J with a small dataset of ~500 lines: ...
0
votes
0answers
18 views

Training the Model properly

I am relatively new to Machine Learning. I want to build a good stock price prediction neural network model and I am using features that depend on the price as well as features that do not depend on ...
2
votes
1answer
274 views

Why isn't my implementation of DQN using TensorFlow on the FrozenWorld environment working?

I am trying to test DQN on FrozenWorld environment in gym using TensorFlow 2.x. The update rule is (off policy) $$Q(s,a) \leftarrow Q(s,a)+\alpha (r+\gamma~ max_{a'}Q(s',a')-Q(s,a))$$ I am using an ...
0
votes
1answer
51 views

Exploration for softmax should be binary or continuous softmax?

Maybe it's silly to ask but for random exploration in an RL for choosing discrete action, that in the neural network last layer softmax will be used, what random samples should we provide? binary like ...
0
votes
1answer
62 views

Validation accuracy very low with transfer learning

I am using MobileNetV3 from TF keras for doing transfer learning; I removed the last layer, added two dense layers, and trained for 20 epochs. How many dense layers should I add after the MobileNet ...
1
vote
0answers
53 views

Is the graph considered as overfit?

I have a training dataset of 2000 images and 500 images for validation. I have executed 50 epochs, however I realized that my graph seems to be different as my accuracy is smaller than my loss. I am ...
2
votes
3answers
74 views

How can I model any structure for a neural network?

Hello I am currently doing research on the effect of altering a neural network's structure. Particularly I am investigating what affect would putting a random DAG (directed acyclic graph) in the ...
1
vote
1answer
333 views

Artifacts After pruning Unet CNN

I'm trying to make a dark image brighter using CNN-UNet architecture. When I train the network, I get the following results: When I cut the features in half for pruning, and do full train again, I ...
2
votes
1answer
68 views

Why feeding the correct output as input during training of seq2seq models?

So, I've read about seq2seq for time-series and it seemed really promising, but when I went to implement it, all the tutorial I've found use the correct output as input to the decoder phase during ...
0
votes
1answer
100 views

Indoor positioning with variable number of distance measurements in tensorflow

Currently I have a setup where I'm determining the position of a transmitter using the RSSI of 4 receivers. Its a simple feed-forward network with some hidden layers, where the input is the RSSI ...
1
vote
1answer
47 views

Keras CNN: Multi Label Classification of Images - Model Evaluation

I am rather new to deep learning and got some questions on performing a multi-label image classification task with keras convolutional neural networks. Those are mainly referring to evaluating keras ...
1
vote
1answer
29 views

How to handle random order of inputs and get same output?

I am a beginner with DL. I did some tutorials and I know the basics of TensorFlow. But I have a problem understanding how to construct more advanced NNs. Let's say I have 6 inputs and a list of 500 ...
2
votes
0answers
39 views

Hand Landmark Detector Not Converging

I'm currently trying to train a custom model with TensorFlow to detect 17 landmarks/keypoints on each of 2 hands shown in an image (fingertips, first knuckles, bottom knuckles, wrist, and palm), for ...
1
vote
1answer
149 views

Why won't my model train with CTC loss?

I am trying to train an LSTM using CTC loss, but the loss does not decrease when I train it. I have created a minimal example of my issue by creating training data where the network simply has to copy ...
1
vote
1answer
63 views

How to construct input dependent convolutional filter?

I am constructing a convolutional variational autoencoder for images, starting out with mnist digits. Typically I would specify convolutional layers in the following way: ...
35
votes
6answers
10k views

Why do CNN's sometimes make highly confident mistakes, and how can one combat this problem?

I trained a simple CNN on the MNIST database of handwritten digits to 99% accuracy. I'm feeding in a bunch of handwritten digits, and non-digits from a document. I want the CNN to report errors, so I ...
0
votes
0answers
16 views

Which model should I use?

I want to create something like a recommendation system based on tensorflow/keras. Initially the system will have some arbitrary (random or user-chosen) inputs and generate some image based on those ...
5
votes
1answer
62 views

Validation accuracy higher than training accurarcy

I implemented the unet in tensorflow for the segmentation of MRI images of the thigh. I noticed I always get a higher validation accuracy by a small gap, independently of the initial split. One ...
0
votes
0answers
8 views

Categorical Location based Time Series data Prediction using LSTMs

I have some time series data with ActivityType as location shared below. Each CaseID has 6 unique values with different ...
1
vote
0answers
25 views

Training a neural network using several data sources with quality flags

I have been searching for a specific problem in training a NN and hope someone is able and willing to help as I cannot find a solution. The problems is that I have a spatial data set with 3 sources of ...
0
votes
0answers
25 views

Data Augmentation for Object Detection - Polygon Region Shape

I'm looking to run a Mask RCNN code on my dataset of about 2700 images. The images are too large and I would like to resize them, and I would also like to add some shear, scale and zoom augmentations. ...
7
votes
1answer
3k views

Can neural networks be evolved using NEAT in TensorFlow? [closed]

I am making a machine learning program for time series data analysis, and using NEAT could help the work. I started to learn TensorFlow not long ago, but it seems that the computational graphs in ...
1
vote
0answers
26 views

Multiple GRU layers to improve a text generation

I am using the model in this colab https://colab.research.google.com/github/tensorflow/text/blob/master/docs/tutorials/text_generation.ipynb#scrollTo=AM2Uma_-yVIq for Shakespeare like text generation. ...
1
vote
3answers
116 views

How to improve neural network training against a large data set of points with varying magnitude

I am currently using TensorFlow and have simply been trying to train a neural network directly against a large continuous data set, e.g. $y = [0.014, 1.545, 10.232, 0.948, ...]$ corresponding to ...
3
votes
0answers
207 views

How to use TPU for real-time low-latency inference?

I use Google's Cloud TPU hardware extensively using Tensorflow for training models and inference, however, when I run inference I do it in large batches. The TPU takes about 3 minutes to warm up ...
0
votes
1answer
85 views

What is better to use: early stopping, model checkpoint or both?

I want to get a model which works best, what should I go for while training the model, ModelCheckpoint, EarlyStopping, or both?
2
votes
1answer
286 views

Finding patterns in binary files using deep learning

I am a newbie in deep learning and wanted to know if the problem I have at hand is a suitable fit for deep learning algorithms. I have thousands of fragments each of about 1000 bytes size (i.e. ...
0
votes
1answer
585 views

Problem over DQN Algorithm not converging on snake

I'm using a DQN Algorithm to play Snake. The input of the neural network is a stack of 4 images taken from the games 80x80. The output is an array of 4 values, one for every direction. The problem ...
18
votes
3answers
22k views

What are "bottlenecks" in neural networks?

What are "bottlenecks" in the context of neural networks? This term is mentioned, for example, in this TensorFlow article, which also uses the term "bottleneck values". How does ...
1
vote
1answer
87 views

Tensorflow object detection model total loss starts out good, but suddenly explodes up to high loss numbers

I'm training a Tensorflow object detection model with approx. 7500 images of two classes, which contains approx. 10,000 classes per class. I'm using Tensorflow 2.6.0, in case that is relavent. I am ...
0
votes
1answer
37 views

How to handle an unbalanced dataset when training object detection algorithms?

I am training an object detection model, and I have some very highly unbalanced data annotations. I have almost 11,000 images, all with dimensions of 1024 $\times$ 1024. Within those images I have the ...
1
vote
1answer
107 views

Advantage Actor Critic model implementation with Tensorflowjs

I am trying to implement an Actor Critic method that controls an RC car. For this I have implemented a simulated environment and actor critic tensorflowjs models. My intention is to train a model to ...
0
votes
1answer
24 views

Do LSTM in tensorflow work sequentially or in parallel

I have a basic understanding how a cell and a layer of an LSTM works. However, I get confused by what "number of units" (as termed in tensorflow) exactly means. A unit is, as far as I ...
0
votes
1answer
103 views

How to handle extremely 'long' images?

After transforming timeseries into an image format, I get a width-height ratio of ~135. Typical image CNN applications involve either square or reasonably-rectangular proportions - whereas mine look ...
1
vote
1answer
177 views

How large should the corpus be to optimally retrain the GPT-2 model?

I just started working with the GPT-2 models and want to retrain one on a pretty narrow topic, so I have problems finding training material. How large should the corpus be to optimally retrain the GPT-...
0
votes
1answer
117 views

Transformer model is very slow and doesn't predict well

I created my first transformer model, after having worked so far with LSTMs. I created it for multivariate time series predictions - I have 10 different meteorological features (temperature, humidity, ...
0
votes
0answers
52 views

How to label images for image segmentation (with TensorFlow)?

I am following this tutorial on image segmentation on the TensorFlow website. The website uses its own labeled images for the tutorial, so the images have data that says which pixels are a part of the ...
0
votes
0answers
14 views

Tensorflow Probability Implementation of Automatic Differentiation Variational Inference with Mixtures

In this paper, the authors suggest using the following loss instead of the traditional ELBO in order to train what basically is a Variational Autoencoder with a Gaussian Mixture Model instead of a ...
1
vote
1answer
30 views

Are there any stats available on the usage of libraries by deep learning researchers?

I know three Python libraries that are popular in deep learning research community: Keras, PyTorch, Tensorflow. I don't know much about Theano. This question is not about the efficiency, flexibility ...

1
2 3 4 5
8