Questions tagged [tensorflow]
For questions related to Google's open-source library for machine learning and machine intelligence. However, note that programming questions are off-topic here.
359
questions
0
votes
0
answers
69
views
Relating two small datasets with Poisson in a neural network or random network
I'm looking for a way to "relate" two small datasets, in Python, for predictive purposes. The two datasets are both independent and have no correlation (the numbers are randomly positioned). ...
- 101
0
votes
0
answers
10
views
NaN gradients while Training (but loss isn't NaN neither the computational graph is disconnected)
The reason I am asking this here is that I haven't found a bug in my code and maybe there isn't a bug at all (or maybe there is). I just want to validate the idea that I am trying to implement. Here ...
- 101
1
vote
0
answers
24
views
cGAN: Discriminator loss going to zero while Generator's going always up but the result is very good
I have a Conditional Generative Adversarial Network for Quantum State Tomography. The metrics I am monitoring during the training process are the losses and the Fidelity (the degree of similarity ...
- 11
1
vote
1
answer
18
views
Can I do incremental learning with different loss function in neural networks?
I have a saved tensorflow neural network model. I was wondering if it's possible to incrementally train the model but with different nt loss function.
- 111
1
vote
0
answers
22
views
How to represent cards for uno game
I am currently trying to build a DQN agent that plays the game UNO
The observation it gets looks like this:
...
- 11
0
votes
0
answers
16
views
kerascv retinanet for gender identification
I am using KerasCV Retinanet to detect people and their genders in images.
I would like to detect "man", "woman", "boy", "girl" and "baby" in images. ...
- 3
0
votes
0
answers
24
views
Neural Networks Model Predictions on Same Sample
I have built a tensorflow model to reconstruct the given input data sample by using an Autoencoder to predict the Missingness in the sample. However I do not have enough data sample where i don't have ...
1
vote
1
answer
52
views
RL agent for autonomous vehicle is able to follow the road but can't avoid crashing at all (Highway-Env / Racetrack Env.)
I coded some deep RL algorithms (DQN and SAC) with tf2/keras to solve an environment where a vehicle needs to follow the track and avoid crashing into one other vehicle (there is only one other ...
0
votes
1
answer
79
views
Transfer learning using pretrained tensorflow object detection model [closed]
I am new to AI/ML and wanted to seek guidance as I am totally lost. I will simplify my issue as follows:
Let's say I would like to detect apples and oranges in images.
I would like to leverage a pre-...
- 3
0
votes
2
answers
317
views
I'm trying to understand the use model for different Python libraries
I'm new to ML/AI field, and after completing several free university courses from MIT OpenCourseWare and Harvard CS50, I've gained some familiarity with the theoretical foundations of Artificial ...
- 109
0
votes
0
answers
30
views
MultiLayer Perceptron not working for regression problem, what could I try?
I am trying to learn the inverse kinematics of a robotic manipulator. To do that I have a simulator with which I acquired data.
My dataset is composed of positions in X, Y and Z and actuator variables ...
3
votes
1
answer
64
views
How can I improve this toy Graph Neural Network Generative Language model [closed]
Background
I'm an undergraduate student with research interests in a field of physics that has significant overlap with graph theory, and a functioning knowledge of how simple neural nets work and how ...
0
votes
0
answers
30
views
Interpreting TensorFlow playground simple neural network
The hidden layer neuron output images are meaningful to me. But I don't understand how the model can output any number except zero for the III quadrant when all hidden layer neurons output 0 for any ...
- 101
1
vote
1
answer
62
views
Dealing with noise in models with softmax output
I have a device with an accelerometer and gyroscope (6-axis). The device sends live raw telemetry data to the model 40 samples for each input, 6 values per sample (accelerometer xyz, gyroscope xyz). ...
- 113
0
votes
0
answers
81
views
Feature Importance for FT Transformer
I hope someone is able to shed light on this. I was reading through the codes on this link with regards to getting feature importance from attention scores.
https://github.com/aruberts/...
- 101
0
votes
0
answers
19
views
How do I find a similar RNN as a starting point?
I am new to machine learning and neural networks and I want to create a neural network for a study project.
I would like to create a RNN, that uses one (A) or several time series (with the same length,...
- 1
0
votes
0
answers
22
views
Binary classification using softmax and categorical crossentropy: monitoring validation
I run a binary classification using different CNN versions in Tensorflow.
When I label samples from each class using 0 and 1, I select a sigmoid output in the last layer of the CNN, like
...
- 101
1
vote
0
answers
18
views
good period prediction but bad magnitude using keras LSTM neural network
I want to predict the voltage of a battery along time using neural networks. This voltage is read using an ADC and generates a charge/discharge profile that ideally looks like this:
Which goes very ...
- 111
-1
votes
1
answer
130
views
Empty space detection [closed]
I'm looking for a TensorFlow model detecting empty spaces on the images. I need to add my company logo to this empty area so there shouldn't be any faces or objects in this area.
Also, I would be ...
- 99
0
votes
1
answer
36
views
Patterns binary classification - model doesn't overfit
I am working on a very basic binary classification problem. For each set of four float numbers $(x,y,z,w)$, I want to check if they fall or not into one category.
I have written a model with 3 dense ...
- 123
0
votes
0
answers
18
views
Difference in quantization regarding transpose_conv2d / conv2d
I'm trying to implement a transpose_conv2d function using padding/dilation of the input and calling a regular conv2d function. My approach is calculating the new input shape, padding and dilating the ...
0
votes
1
answer
65
views
What is actually being saved in the file when you save a model? For example a Tensorflow SavedModel file [closed]
I'm building a feature for my application that requires reading the properties of a saved ML model file (after it's trained). However, as I am pretty new to this field, I don't really understand the ...
- 113
1
vote
1
answer
100
views
Is it possible to write/build an AI model without using Frameworks? [closed]
I'm a relatively newbie in this world of Artificial Intelligence, although I am able to use frameworks such as Tensorflow and also understand the general concepts behind training weights and ...
- 113
0
votes
0
answers
20
views
How can I transform a signal into another using supervised learning?
I'm trying to transform a signal into another using supervised learning. My main goal is to create a model capable to transform a raw signal (Blue Line) into something similar to the "ideal" ...
0
votes
0
answers
17
views
Where can I find a model trained to detect patterns of an object like laboratory mice?
I am working on a real-time pose detection project using a model trained by DeepLabCut, which utilizes .pb and .yaml files for the model. My aim is to find a model or method that can help me detect ...
0
votes
0
answers
16
views
How to extract body of a base-model and fine tune with that body on different shape dataset like this situation
In BERT like transformer model (I am not talking about BERT in this thread), it has 2 training objectives Masked Language Modeling and Next sentence prediction right? and BERT model is also supports ...
- 158
0
votes
0
answers
17
views
Tips for getting LSTM to train for next word predcition
I am trying to train an LSTM network for next work prediction. I have scraped a rather large dataset from Wikipedia of country descriptions. I have done normal preprocessing (removing punctuation and ...
- 101
0
votes
1
answer
747
views
Keras Subclassing : TypeError: 'KerasTensor' object is not callable Call arguments received by layer [closed]
Implementing UNet but getting an error: type error 'KerasTensor' object is not callable
...
- 27
1
vote
1
answer
53
views
Transfer Learning for Solar Energy Production Forecasting with LSTM: Generalized vs. Specialized Models
I am working on a solar energy production forecasting problem using LSTM multi-step models to predict 1/4/8h ahead of solar energy production for different solar installations. Our goal is to help ...
0
votes
0
answers
36
views
Can I use this method to improve the VAE model?
My VAE model is not learning well.
The model's learning history shows that the reconstruction loss is as large as approximately 8000 or more, and the KL-Divergence loss is diverging, starting with an ...
- 17
0
votes
1
answer
31
views
How to convert my test data in the same dimensionality as my train data
I have trained a VAE with jpg images. My latent space dimension has 768 features and when plotting the latent space it looks like this:
However, when I use the scikit learn tool LDA (Linear ...
- 3
2
votes
0
answers
27
views
Combining GANs and NLP for AI-Based Programming: Generating Input-Output Templates for Computer Functions
I would like to combine GANs and NLP to create a system that can take an input and generate an appropriate output. For example, ...
- 21
0
votes
0
answers
134
views
Increasing "output_sequence_length" in TextVectorization layer worsens model's performance
When exploring the Twitter Sentiment Analysis dataset on Kaggle, I came up with a model that looks like this:
...
- 157
0
votes
0
answers
3k
views
How important is to fix this common Tensorflow warning?
I have seen some people with the same problem, this is the warning:
...
- 79
3
votes
2
answers
4k
views
Open-source vocal cloning (speech-to-speech neural style transfer)
I want to program and train a voice cloner, in part to learn about this area of AI, and in part to use as a prototype of audio for testing and getting feedback from early adopters before recording in ...
- 27
0
votes
0
answers
26
views
How to use a framework for NLP such as transformers with pytorch or tensorflow to generate statistics based on prompt messages about a dataset?
Is there a way to achieve this or do I have to go in other direction?
It should answer questions such as which order in the last year took the longest time to complete and why.
For instance, with a ...
- 101
0
votes
1
answer
90
views
Why final memory state equals to the last hidden state of entire hidden state sequence?
when return_sequences=True and return_state=True, a TensorFlow LSTM outputs the hidden states of the LSTM cell along with the ...
- 123
0
votes
1
answer
38
views
How to improve classification accuracy in TF deep neural network model?
I need help in increasing the accuracy of a classification model using Neural Networks on Tensorflow.
I am trying to train a model on sequential data ...
- 457
0
votes
1
answer
56
views
L2 regularization in BN layers, how to set gamma?
I have read tensorflow's documents about batch normzalization , but still don't get what is the gamma regulizer?
the link to document:
https://www.tensorflow.org/api_docs/python/tf/keras/layers/...
0
votes
0
answers
61
views
Best methods to square rectangular images for OR
I've read previous posts that assert using one of these solutions:
crop and or resize
nn input size independent
In my case, I am using some tensorflow models and afaik they report a fixed size like ...
- 79
1
vote
1
answer
111
views
How does the memory augmented neural network work, and how to make a simple implementation?
How does the memory augmented neural network (MANN) work? How can I make a simple MANN with a vanilla neural network especially without a recurrent network?
- 1,036
0
votes
2
answers
318
views
Please help me understand the role of loss function in neural networks
I've been studying NNs with tensorflow and decided to code a simple NN from scratch to get a better idea on hwo they work.
It my understanding that the cost is used in backpropagation, so basically ...
- 13
1
vote
0
answers
250
views
what is tfrs.metrics.FactorizedTopK in tensorflow recommenders
from the official documentation link
In our training data we have positive (user, movie) pairs. To figure out how good our model is, we need to compare the affinity score that the model calculates ...
- 11
0
votes
0
answers
71
views
Seq2seq with attention model only predicts index 0 in a text generation task
I am trying to build a model which summarizes some brief input text (X) and generates a headline (Y).
The problem is that the model always outputs 0 as the vocabulary index, which I think that might ...
- 1
3
votes
0
answers
50
views
Why does a neural network struggle to solve this simple problem?
Consider the following problem:
Given a vector x of size dim with values between 0 and 1 (exclusive), determine if ...
- 191
0
votes
2
answers
2k
views
How "exactly" are AI-accelerator chip ASICs built differently than GPUs as GPU seem to lead for many AI workloads on performance
There is a lot of discussion on google search about AI-custom-accelerators (like Intel's Gaudi) and GPUs.
Almost all of them say generic things like, a) AI Accelerator chip is for specialized AI ...
- 181
2
votes
2
answers
142
views
Why is a simple regression problem so hard for an MLP to learn?
Consider a very simple problem, which is to find the maximum value out of a list of 5 numbers between 0 and 1. This is obviously trivial, but serves as a good example for a real-world problem I'm ...
- 191
0
votes
0
answers
33
views
How to organize data for training a neural network to raytrace images
I am trying to train a neural network to go from a series of numbers(data about a 3D scene, such as camera position, sphere position, radius, and color, etc) to a raytraced image. I can generate as ...
- 1
0
votes
0
answers
237
views
How do transformers handle multidimensional input?
Transformers work with lists of vectors, i.e. sentence of length SEQ_LEN, with each word having size EMBEDDING_DIM. Now, since the model still makes use of Dense layers internally, i.e. as in https://...
0
votes
0
answers
14
views
How does the 'moment's matching trick' in GAN training improve the diversity of the generated samples?
I was investigating the TimeGAN code, when i stumbled across the 'moments loss' component. In one of the issues, the author states that this is a 'moment's matching trick' used 'to improve the ...
- 2,103