All Questions

Filter by
Sorted by
Tagged with
0
votes
0answers
3 views

How does DQN convergence work in reinforcement learning

In supervised learning we have an unbiased target value, but in reinforcement learning this isn’t the case The network predicts its own target value, now how exactly does it converge if the network ...
0
votes
0answers
3 views

Framework/language for automated design of physical objects

The idea of using AI to automatically propose new designs for physical objects seems very interesting. Looking at some proofs-of-concept, e.g. https://www.autodesk.com/solutions/generative-design, I ...
2
votes
0answers
9 views

How to run a Monte Carlo Tree Search MCTS for stochastic environment?

For MCTS there is an expansion phase where we make a move and list down all the next states. But this is complicated by the fact that for some games, after making the move, there is a stochastic ...
1
vote
0answers
4 views

Computational complexity of the forward pass of a CONVOLUTIONAL neural network?

How do I determine the computational complexity (big-O notation) of the forward pass of a CONVOLUTIONAL neural network? Let's assume for simplicity that we use zero-padding such that the input size ...
0
votes
0answers
16 views

How to combine two differently equally important signals into the reward function, that have different scales?

I have two signals that I want to use to model my reward. The first one is the CPU TIME: running mean from this diagram: The second one is the MAX RESIDUAL from this diagram: Since they are both ...
1
vote
1answer
21 views

Why does TD Learning require Markovian domains?

One of my friends and I were discussing the differences between Dynamic Programming, Monte-Carlo, and Temporal Difference (TD) Learning as policy evaluation methods - and we agreed on the fact that ...
1
vote
1answer
22 views

Why are state-values alone not sufficient in determining a policy (without a model)?

"If a model is not available, then it is particularly useful to estimate action values (the values of state-action pairs) rather than state values. With a model, state values alone are sufficient ...
0
votes
0answers
13 views

How to develop a model to detect a point crossed a line?

How to develop a system which detects if a object crosses a line. I am developing a system, basically which tells a object crossed a line. Do I need to get the camera calibration matrix ? Do I need to ...
0
votes
0answers
6 views

Can I train an object detection model with images with a white background?

To be more specific I have a dataset of 2400 images with unbalanced classes, 1 object per image and sometimes some objects are repeated along the dataset but in a different position and rotation of ...
0
votes
0answers
9 views

Which is the best RL algo for continuous states but discrete action spaces problem

I am trying to train an AI with an environment where the states are continuous but the actions are discrete, that means I can not apply DDPG or TD3. Can someone please help to let know what should be ...
3
votes
0answers
20 views

Why is the reward in reinforcement learning always a scalar?

I'm reading Reinforcement Learning by Sutton & Barto, and in section 3.2 they state that the reward in a Markov decision process is always a scalar real number. At the same time, I've heard about ...
1
vote
0answers
14 views

How to overfit GANs with a single image

When designing CNN for image recogition a commonly used sainty check to see if a model is working/designed fine is to see if we are able to overfit the model with a very small subset of images. I am ...
0
votes
0answers
8 views

Finding Cycles in a State Sequence

Suppose I observe a set of states $\mathbf{X} = \{X_{1}, X_{2}, \ldots, X_{K}\}$ over time. I assume that there exist $M$ cycles $\mathbf{C} = \{C_{1}, C_{2}, \ldots, C_{M} \}$ in the observed state ...
0
votes
0answers
15 views

What is the state-of-the-art algorithm for neural style transfer?

I've read the paper A Neural Algorithm of Artistic Style by Gatys et. al. and I find the application of neural style transfer very fun. I also read that Exploring the structure of a real-time, ...
0
votes
0answers
32 views

Is it a good idea to change the learning rate at each training step as a function of the loss?

Is it a good idea to change the learning rate at each training step as a function of the loss? i.e. for points with high loss value, put a high learning rate and for low loss value a low learning rate ...
2
votes
0answers
27 views

Would a different learning rate for every neuron and layer mitigate or solve the vanishing gradient problem?

I'm interested in using the sigmoid (or tanh) activation function instead of RELU. I'm aware of RELU advantages on faster computation and no vanishing gradient problem. But about vanishing gradient, ...
1
vote
0answers
13 views

Can I resize my images after labeling them?

Is it okay if I label my images with their original size and then resize them, or should I first resize them and then label them? I mean do I need to recalibrate my labels if I resized my images?
1
vote
1answer
25 views

Why is the optimal policy for an infinite horizon MDP deterministic?

Could someone please help me gain some intuition as to why the optimal policy for a Markov Decision Process in the infinite horizon case (agent acts forever), deterministic? Thank you!
0
votes
0answers
7 views

Automated Scoring (non-english language) Using BERT

i'm a student and i'm new to NLP. I want to build an Automated Scoring system which is in Indonesian Language using BERT. The system is expected to be able to measure the similarity of an answer(e.g: ...
0
votes
0answers
12 views

Limbs for PAFs in OpenPose

What limbs are used in openpose for the PAF? If you look at the skeletal reconstruction one would assume it is $ears - eyes$, $eyes - nose$, $nose-neck$, $neck - hips$, $shoulders - elbows$, $elbows- ...
0
votes
2answers
32 views

Is there a neural network that accepts both the current input and previous output?

I am quite new to neural networks. I am trying to implement in Python a neural network having only one hidden layer with $N$ neurons and $1$ output layer. The point is that I am analyzing time series ...
0
votes
0answers
17 views

Local Search vs K-means Clustering

I have found that the K-means algorithm with K=20, has been mentioned as a solution for the below question, A new mobile phone service chain store would like to open 20 service centers in your city. ...
1
vote
0answers
13 views

Keras model accuracy not improving beyond threshold

I am currently working on a public project for the National Weather Model. We are experimenting with using a recurrent neural network to replace the output of a quadratic formula that is in use. The ...
0
votes
1answer
38 views

How much computing power does it cost to run GPT-3?

I know it cost around $4.3 million dollars to train, but how much computing power does it cost to run the finished program? IBM Watson chatbot AI only costs a few cents per chat message to use, ...
-1
votes
0answers
11 views

Decoder.predict not working inside a training model

Hi I wanted to discuss a certain situation I have.. I have a LSTM code and I want to feed in an encoded sequence to it.. After that I want to run a decoder and classifier on the output it gives while ...
0
votes
0answers
13 views

How to add voice inflections to an existing SV2TTS voice cloning implementation?

I've been playing with the SV2TTS voice cloning implementation provided on Github: https://github.com/CorentinJ/Real-Time-Voice-Cloning It was straight forward to use as a TTS engine with clearly ...
0
votes
0answers
16 views

Image classification on SVG format

To best of my knowledge, images are usually fed in pixel format to ML models. Is there any work that does image classification where the image format is SVG?
-1
votes
0answers
13 views

How to enable transfer learning for Stylegan2 Tensorflow model training?

I am working in Google Colab with StyleGAN2 and need to transfer learning from a pre-trained model, for better quality with a small dataset and for reducing of training time. There is a file "...
0
votes
1answer
20 views

How do I classify whether a document is legal or not given a set of keywords that appear only in legal documents?

Let's say that I want to classify whether a document is a legal document or not. I have a list of keywords that will be presented only in legal documents. What is the proper way or algorithm to ...
0
votes
0answers
9 views

About synced and combined, 10 live human dancer's avatar in 3D environment

I have written this post in medium: Opensource Online group Dancing with Motion capture and … So I have was working on motion analysis and seen this GitHub page and this video (related paper could be ...
-1
votes
0answers
23 views

Training a Neural Network with Hexadecimal input

I currently started working in the field of Machine Learning and have been stuck on a problem where I have to train a Neural Network with a dataset containing hexadecimal inputs. I found that we can ...
0
votes
0answers
12 views

Does the selective search algorithm in object detection learn?

I am trying to get a better grasp of how object detection works. I (almost) completely understand the concept behind RPNs. However I am little bit confused with the selective search algorithm part. ...
1
vote
0answers
19 views

Can I use ML to discover via videos the best place to shoot in foosball?

I am a programmer, but just now attempting to enter the world of ML. I'm eyeballing a potential project/problem related to foosball. Pro foosball is a thing believe it or not and I'm wondering if I ...
0
votes
1answer
31 views

What ML algorithm should I use that suits this data?

What if I have some data, let's say I'm trying to answer if education level and IQ affect earnings, and I want to analyze this data and put in a regression model to predict earnings based on the IQ ...
1
vote
1answer
32 views

How to generate labels for self-supervised training?

I've been reading a lot lately about self-supervised learning and I didn't understand very well how to generate the desired label for a given image. Let's say that I have an image classification task, ...
3
votes
1answer
63 views

Comparing the derivation of the Deterministic Policy Gradient Theorem with the standard Policy Gradient Theorem

I would like to understand the difference between the standard policy gradient theorem and the deterministic policy gradient theorem. These two theorem are quite different, although the only ...
1
vote
0answers
20 views

When past states contain useful information, does A3C perform better than TD3, given that TD3 does not use an LSTM?

I am trying to build an AI that needs to have some information about the past states as well. Therefore, LSTMs are suitable for this. Now, I want to know that for a problem/game like Breakout, where ...
1
vote
0answers
35 views

How to deal with very, very small time-series?

I have an ensemble of 231 time series, the largest among them being 14 lines long. The task at hand is to try to predict these time-series. But I'm finding this difficult due to the very small size of ...
0
votes
1answer
35 views

Mixing CPU and GPU for distributed PyTorch training

For a job that a scheduled to be trained using PyTorch on CPU, is it possible to add additional GPU machine with to speed up training of certain layers? Does PyTorch allow such mixed setup? If not, ...
3
votes
2answers
90 views

What are some best practices when trying to design a reward function?

Generally speaking, is there a best-practice procedure to follow when trying to define a reward function for a reinforcement-learning agent? What common pitfalls are there when defining the reward ...
0
votes
0answers
12 views

Descent Training episodes for LSTM + TD3

I am building an AI with TD3 and lstm in both actor and critic. By LSTM size is 5,5 with 3 layers and hidden layers with 400 and 300 neurons respectively. I have states dimension of 5 with each value ...
1
vote
0answers
28 views

Why would the loss increase on a single fixed input?

I'm training a neural network on some input data. I know that loss increasing may be related to: overfitting, if the loss increases on test data (while still decreases on training data) oscillations ...
0
votes
0answers
13 views

Is RCNN resolution-independent, if keeping feature size constant?

From what I understand, (Faster/Mask-)RCNN is fully convolutional. The backbone is fully convolutional, and the region proposal network (RPN) creates anchors on the feature map with a fixed stride. ...
2
votes
0answers
55 views

How can I find a specific word in an audio file?

I'm trying to train and use a neural network to detect a specific word in an audio file. The input of the neural network is an audio of 2-3 seconds duration, and the neural network must determine ...
1
vote
0answers
46 views

How to make sense of label propagation formula in graph neural networks?

In the label propagation algorithm in section 3.2.3, we know the label of some nodes and we want to predict the label for the rest of the nodes whose labels we don't know. The update formula for this ...
0
votes
0answers
18 views

What are some solutions for dealing with time series data that are recorded at uneven intervals?

Let's say I have a time series data which is a bunch of observations that occur at different time stamps and intervals. For example, my observations come from a camera located at a traffic ...
0
votes
0answers
22 views

Is Bayesian NN vs adding random data more accurate?

I’m trying to train a classifier to recognize if people are wearing seatbelts. What if the person submitted a picture unrelated to a seatbelt classifier? Would I create an image label that is full of ...
2
votes
1answer
71 views

Why is tic-tac-toe considered a non-deterministic environment?

I have been reading about deterministic and stochastic environments, when I came up with an article that states that tic-tac-toe is a non-deterministic environment. But why is that? An action will ...
0
votes
0answers
19 views

TD3+lstm predicting the same output for varying states

I have a model with TD3 + lstm in both actor and critic. I am trying to make it learn to predict some specific actions based on the environment conditions. However i see that the AI predicts very ...
0
votes
0answers
29 views

Why do we use the Target Network for action evaluation in Double deep Q networks

Is there any specific reason as to why The target Network is used for evaluation and The online network Is used for selection, what would be the difference if both roles were switched, our online ...

15 30 50 per page
1
2 3 4 5
144