Questions tagged [tensorflow]
For questions related to Google's open-source library for machine learning and machine intelligence. However, note that programming questions are off-topic here.
161 questions with no upvoted or accepted answers
6
votes
1
answer
118
views
It is possible to use deep learning to give approximate solutions to NP-hard graph theory problems?
It is possible to use deep learning to give approximate solutions to NP-hard graph theory problems?
If we take, for example, the travelling salesman problem (or the dominating set problem). Let's say ...
- 181
4
votes
0
answers
71
views
Why does a neural network struggle to solve this simple problem?
Consider the following problem:
Given a vector x of size dim with values between 0 and 1 (exclusive), determine if ...
- 201
4
votes
0
answers
1k
views
Can we combine multiple different neural networks in one?
I want to make a kind of robotic brain, i.e. a big neural network, which includes an NLP model (for understanding human voice), real-time object recognition system (so that it can identify particular ...
- 41
4
votes
0
answers
186
views
Can AlexNet be changed to produce floating-point outputs in the range $[-1, 1]$, and, if not, which model should I use?
I'm developing a game AI, which tries to master racing simulation. I already trained a CNN (AlexNet) on in-game footage of me playing the game and the pressed keys as the target.
I had two main issues ...
- 103
3
votes
0
answers
138
views
Why shouldn't batch normalisation layers be learnable during fine-tuning?
I have been reading this TensorFlow tutorial on transfer learning, where they unfroze the whole model and then they say:
When you unfreeze a model that contains ...
- 882
3
votes
0
answers
258
views
Understanding the TensorFlow implementation of the policy gradient method
I was trying to understand the implementation of a basic policy gradient (REINFORCE) method using TensorFlow.
I think I got almost everything. The only thing that still bothers me is the loss function ...
- 31
3
votes
0
answers
480
views
How to use TPU for real-time low-latency inference?
I use Google's Cloud TPU hardware extensively using Tensorflow for training models and inference, however, when I run inference I do it in large batches. The TPU takes about 3 minutes to warm up ...
- 51
3
votes
0
answers
392
views
How do I create a chatbot using tensorflow or pytorch using like the one defined in dialogflow?
How do I create a chatbot using TensorFlow or PyTorch using like the one defined in DialogFlow? What are the best datasets that I can use so to create my own personal assistant like google assistant?
...
3
votes
0
answers
1k
views
Applying a 1D convolution for 4D input
i'm trying to implement this paper and I'm stuck for quite some time now. Here is the issue:
I have a 3D tensor and has (180,200,20) as dimension and I'm trying ...
- 61
3
votes
0
answers
30
views
How to voxelize multiple frames at the time and append them together?
I'm trying to implement this approach for object detection and tracking.
In this approach, the first step is voxelize each frame to construct a 3D tensor, the second step is to append multiple voxels ...
- 61
3
votes
0
answers
731
views
Getting worse performance when training a pre-trained model with the existing class
I am training pre-trained SSD-InceptionV2-Coco to detect the "car",
which is one of the classes in mscoco label.
I train the model with ~50k sample from KITTI, 500k iteration with batch size 2.
I ...
- 131
3
votes
1
answer
201
views
If neurons are only defined for values between 0 and 1, how does ReLU differ from the identity?
I'm struggling to understand the underlying mechanics of CNNs so any help is appreciated. I have a network with a ReLU activation function which does perform signifigantly better than one with sigmoid....
- 59
2
votes
0
answers
111
views
How to Create a Neural Network Model to Generate Dance Movements Based on Music in MMD Format
I am working on a project where I need to create a neural network model to generate dance movements based on music. My goal is to achieve results similar to this video: https://youtu.be/FrA7f5F9TsI
...
- 21
2
votes
0
answers
246
views
cGAN: Discriminator loss going to zero while Generator's going always up but the result is very good
I have a Conditional Generative Adversarial Network for Quantum State Tomography. The metrics I am monitoring during the training process are the losses and the Fidelity (the degree of similarity ...
- 23
2
votes
0
answers
32
views
Combining GANs and NLP for AI-Based Programming: Generating Input-Output Templates for Computer Functions
I would like to combine GANs and NLP to create a system that can take an input and generate an appropriate output. For example, ...
- 21
2
votes
2
answers
238
views
How to instruct Mask RCNN to identify objects too close to each other?
I have been trying to train a Mask RCNN model to identify individual poker chips in a stack. No matter what property I change, the end results look like the following image. I was guessing the issue ...
- 29
2
votes
0
answers
669
views
Positional Encoding in Transformer on multi-variate time series data hurts performance
I set up a transformer model that embeds positional encodings in the encoder. The data is multi-variate time series-based data.
As I just experiment with the positional encoding portion of the code I ...
- 121
2
votes
0
answers
109
views
What's new in LaBSE v2?
I can't find what's new in LaBSE v2 (https://tfhub.dev/google/LaBSE/2). What are the main highlights of v2 versus v1? And how did you find out?
- 121
2
votes
0
answers
53
views
If I want to predict two unrelated values given the same sequence of data points, should I have a model with two outputs or two models?
I want to predict two separate y-values (not really logically connected) based on an input sequence of data (values x). Using LSTM cells.
Should I train two models separately or should I just increase ...
- 181
2
votes
0
answers
43
views
CNN leaf segmentation throught classification of edges how to improve
I am trying to design a CNN that can do pixel wise segmentation of edges leaves in dense foliage agriculture images. Such as these:
On the basis of this article https://arxiv.org/pdf/1904.03124.pdf, ...
- 21
2
votes
0
answers
32
views
NN to find arbitrary transformation
Problem description
I'm creating a clock with 4 seven-segment LED displays. In an effort to get more familiar with tensorflow, I figured I should try to drive this clock with use of a Neural Network.
...
- 21
2
votes
0
answers
48
views
Single-value loss/training in a CNN with a tensor output
I am playing around with an idea of using using Q-learning with a DQN (Deep Q-Network), to determine the optimal position of a number of 'units' on a grid of allowed locations, according to some ...
- 21
2
votes
0
answers
91
views
Why do I get higher average dice accuracy for less data
I am working on image segmentation of MRI thigh images with deep learning (Unet). I noticed that I get a higher average dice accuracy over my predicted masks if I have less samples in the test data ...
- 139
2
votes
0
answers
46
views
Why does the loss stops reducing after a point in this Transformer Model?
Context
I was making a Transformer Model to convert English Sentences to German Sentences. But the loss stops reducing after some time.
Code
...
- 131
2
votes
0
answers
53
views
Loss function decays linearly in segmentation MRI fascia
I am working on a segmentation of MRI images of the thigh. I am trying to segment the fascia, there is a slight imbalance between the background and the mask. I have about 1400 images from 30 patients ...
- 139
2
votes
0
answers
1k
views
Why is DDPG not learning and it does not converge?
I have used a different setting, but DDPG is not learning and it does not converge. I have used these codes 1,2, and 3 and I used different optimizers, activation functions, and learning rate but ...
- 52
2
votes
0
answers
47
views
Incorporating domain knowledge into recurrent network
I am currently trying to solve a classification task with a recurrent artificial neural network (RNN).
Situation
There are up to 350 inputs (X) mapped on one categorical output (y)(13 differnt ...
- 31
2
votes
0
answers
193
views
How to use one-hot encoding for multiple columns (multi-class) with varying number of labels in each class?
I am a beginner in TensorFlow as well as in AI. I am basically from Pharma background and learning AI from scratch.
I have data with 5038 input (Float64) and 826 output (Categorical - Multi Labels in ...
2
votes
1
answer
477
views
Why isn't my implementation of DQN using TensorFlow on the FrozenWorld environment working?
I am trying to test DQN on FrozenWorld environment in gym using TensorFlow 2.x. The update rule is (off policy)
$$Q(s,a) \leftarrow Q(s,a)+\alpha (r+\gamma~ max_{a'}Q(s',a')-Q(s,a))$$
I am using an ...
- 121
2
votes
0
answers
170
views
How do I make my LSTM model more sensitive to changes in the sequence?
I have a many to one LSTM model for multiclass classification. For reference, this is the architecture of the model
...
- 21
2
votes
0
answers
25
views
How to handle set-like size agnostic input format
Let's set up some hypothetical simplified scenario: Each instance $i$ of my imaginary dataset $D=\{i_{1}, \ldots, i_{MAX}\}$ has different number $k_{i}$ of $n$-dimensional vectors as input into my ...
2
votes
0
answers
32
views
How are batch statistics computed in Recurrent Batch Normalization?
I'm implementing recurrent BN per this paper in Keras, but looking at it and those citing it, a detail remains unclear to me: how are batch statistics computed? Authors omit explicit clarification, ...
2
votes
0
answers
74
views
How should I make output layer of my neural network so that I can get outputs ranging from [-20,-1]
I am trying to make a neural network which takes in 0 and 1 as it's input and should give me output ranging from [-20,-1].I am using three layers with sigmoid as the activation function .How should I ...
- 63
2
votes
0
answers
57
views
How to implement loss function of H-GAN model
I was trying to implement the loss function of H-GAN. Here is my code . But it seem somethings wrong, maybe is recognition loss on z (EQ 9). I used the EQ 5 on MISO to calculate it. Here is my code:
...
- 21
2
votes
0
answers
307
views
Suggestions for Deep Learning for regression on huge 3D volumes
I have a dataset of 3D images (volumes) with dimensions 400x250x400. For each input image I have an output of the same dimensions. I would like to train a machine learning (or deep learning) model on ...
- 53
2
votes
0
answers
28
views
In addition to matrix algebra, can GPU's also handle the various Kernel functions for Neural Networks?
I've read a number of articles on how GPUs can speed up matrix algebra calculations, but I'm wondering how calculations are performed when one uses various kernel functions in a neural network.
If ...
- 131
2
votes
0
answers
59
views
RNN: Different test results on balanced and unbalanced data
I trained a recurrent neural network (if it matters - it contains three CuDNNLSTM cells and 3 Dense layers, Dropout = 0.2). The result of data preparation is one array of ~330.000 sequences. Each ...
- 68
2
votes
0
answers
627
views
How many episodes does it take for a vanilla one-step actor-critic agent to master the OpenAI BipedalWalker-v2 problem?
I'm trying to solve the OpenAI BipedalWalker-v2 by using a one-step actor-critic agent. I'm implementing the solution using python and tensorflow.
I'm following this pseudo-code taken from the book ...
- 373
2
votes
0
answers
39
views
Sequence to sequence machine learning / NMT - converting numbers into words
I want to do some sequence to sequence modelling on source data that looks like this:
/-0.013428/-0.124969/-0.13435/0.008087/-0.269241/-0.36849/
with target data ...
- 21
1
vote
0
answers
17
views
What Policy/Agent and Observation Spec To Use For TensorFlow Agents For Video Game Platformer?
I'm trying to create a model to beat a video game platformer I made a few months ago. In the game, the platforms scroll down from the sky and the player has to keep jumping to them to avoid touching ...
- 11
1
vote
0
answers
29
views
Any tutorials/courses to learn variational autoencoders on tabular data?
I aim to use variational autoencoders (VAE) to find interpretable latent spaces for genetic data. So, I need to understand how they work, what activation function to use, etc. But all tutorials and ...
- 111
1
vote
1
answer
38
views
Feature Crossing with ~200 features
I am working on a project to make a model using Keras to guess the difficulty of climbing routes on a standardised climbing wall (https://moonclimbing.com/moonboard). Each hold on the wall is either:
...
- 11
1
vote
0
answers
76
views
How to represent cards for uno game
I am currently trying to build a DQN agent that plays the game UNO
The observation it gets looks like this:
...
- 11
1
vote
1
answer
90
views
Transfer Learning for Solar Energy Production Forecasting with LSTM: Generalized vs. Specialized Models
I am working on a solar energy production forecasting problem using LSTM multi-step models to predict 1/4/8h ahead of solar energy production for different solar installations. Our goal is to help ...
1
vote
0
answers
380
views
what is tfrs.metrics.FactorizedTopK in tensorflow recommenders
from the official documentation link
In our training data we have positive (user, movie) pairs. To figure out how good our model is, we need to compare the affinity score that the model calculates ...
- 11
1
vote
0
answers
56
views
Replay Buffer taking long time to construct (Reinforcement Learning DQN with tf-agetns)
I'm new to Reinforcement Learning and I have some question. I am actually training some DQN using the tf-agents from tensorflow. And I recently learned that it's not possible to train a DQN using ...
- 11
1
vote
1
answer
166
views
How do you display a neural network
I'm new to tensorflow and ML but am progressing slowly. I know how to look at the weights and biases but am still trying to figure out if there is an easy way to display a neural network in the ...
- 151
1
vote
0
answers
26
views
Bayesian optimization with confidence bound not working
I have a simple MLP for which I want to optimize some hyperparameters. I have fixed the number of hidden layers (for unrelated reasons) to be 3. So the hyperparameters being optimized through Bayesian ...
- 121
1
vote
1
answer
101
views
Datasets input at model.fit produce unexpected results of training loss vs validation loss
Im trying to train a neural network (VAE) using tensorflow and Im getting different results based on the type of input in the model.fit.
When I input arrays I get normal difference between the ...
user56546
1
vote
0
answers
23
views
Convolutional network for multilabel classification in NLP
I am trying to label code snippets and I base on this article: https://arxiv.org/pdf/1906.01032.pdf
My dataset is just code snippets (tokenized as ascii characters) and 500 different labels from ...
- 11