All Questions

0
votes
0answers
2 views

Pseudocode for CNN with Bounding Box and Classifier

I've been looking at various bounding box algorithms, like the three versions of RCNN, SSD and YOLO, and I have noticed that not even the original papers include pseudocode for their algorithms. I ...
2
votes
0answers
14 views

Expected SARSA vs SARSA in “RL: An Introduction”

Sutton and Barto state in the 2018-version of "Reinforcement Learning: An Introduction" in the context of Expected SARSA (p. 133) the following sentences: Expected SARSA is more complex ...
1
vote
1answer
13 views

How do I avoid an agent to tend to terminate in a negative state when time needs to be taken into account?

In an unknown environment, how do I avoid an agent to tend to terminate its trajectory in a negative state when time needs to be taken into account? Suppose the following example to make my question ...
1
vote
0answers
4 views

Judging a genetic algorithm's priority-based schedules by how far ahead the higher priority things are done

I'm creating a schedule for a summer camp. Because of the high risk of rain, the higher priority activities need to be attempted first, so there is more time for later attempts if need be (temporarily ...
2
votes
1answer
22 views

How is equation 8 derived in the paper “Self-critical sequence training for image captioning”?

In the paper "Self-critical sequence training for image captioning", on page 3, they define the loss function (of the parameters $\theta$) of an image captioning system as the negative expected reward ...
0
votes
0answers
9 views

How my LSTM is making association between the columns?

I have created LSTM model using the following Tensorflow code: ...
0
votes
1answer
14 views

Face liveness detection using face landmark points

How to detect liveness of face using face landmark points? I am getting face landmarks from android camera frames. And I want to detect liveness using these landmark points. How to tell if a human ...
2
votes
0answers
16 views

How to handle varying length of inputs that represent dependencies and recursivity in deep neural networks in case of regression?

I wanna solve a problem of regression to predict a factor. I decide to go with Deep Neural Networks as solution for my problem. The features in this problem represent loop characteristic such us loop ...
0
votes
1answer
19 views

Training a neural network to output the conditional probability of an event when the training data output is only binary

I have a dataset with hundreds of thousands of training examples. There are 27 input variables and one output variable which is always a 0 or a 1, based on whether an event happened or not. My ...
1
vote
1answer
19 views

Is the definition of machine learning by Mitchell in his book “Machine Learning” valid?

The definition machine learning is as follows: A computer program is said to learn from experience E with respect to some task T and performance measure P, if its performance at task T, as ...
1
vote
2answers
24 views

Relative Importance of Input Features

I am confused as to how neural networks consider the different features by that have access to at the input layer. Consider this example: I have three features: an image, a dollar amount, and a ...
1
vote
0answers
16 views

What is the difference between a non-stationary policy and a state that stores time?

This question is related to What does "stationary" mean in the context of reinforcement learning?, but I have a more specific question to clarify the difference between a non-stationary ...
0
votes
0answers
10 views

Will the transition from automation to robotics become a soft one or abrupt?

State of the art technology in the industry is equal to automation. Lots of machines are used which have increased the productivity. For example a crane, a truck, electric light, a food packaging ...
0
votes
1answer
18 views

Loss function spikes

For the UNSW-NB15 dataset i receive spikes in the loss function during training. The algorithms see part of this UNSW dataset a single time. Loss function is plotted after every batch. For other ...
0
votes
1answer
15 views

Loss/accuracy on Synthetic data

I am trying to understand if there is any difference in the the interpretation of accuracy and loss on synthetic data vs real data.
1
vote
0answers
18 views

Why is the learning rate is already very small (1e-05) while the model convergences too fast?

I am training a video prediction model. According to the loss plots, the model convergences very fast while the final loss is not small enough and the generation is not good. Actually, I have test ...
2
votes
1answer
24 views

Is 7. of the UK Gov Al healthcare code of conduct possible?

The NHS, Centre for Data Ethics, and Nuffield Council have put together a code of conduct for AI use in health care. My question is whether item 7 as follows is possible and in what ways might it be: ...
0
votes
0answers
7 views

How to use a function which compares AI players to create a fitness function of one weights set?

We are given a game between exactly two players, with end result either one of them wins or it is a draw. I have these things already done: A Player(List weights) ...
3
votes
0answers
19 views

Symbolic “math” using trained networks

Does anyone work out ways of relating trained networks by symbolic logic? For example: If I train a network on pictures of dogs, and I train a network on pictures of shirts. You could imagine that ...
1
vote
1answer
30 views

How do I apply the value iteration algorithm when there are two goal states?

I am working through the famous RL textbook by Sutton & Barto. Currently, I am on the value iteration chapter. To gain better understanding, I coded up a small example, inspired by this article. ...
0
votes
0answers
12 views

Using a combination of gradient boosting with LSTM for classification? [migrated]

I am presently using a LSTM model to classify high dimensional tabular data which is not text/images (dimensions 21392x1970). I also tried XGBoost (Gradient boosting) in Python separately for the same ...
0
votes
0answers
18 views

What are the prerequisites and skills for studying machine learning? [duplicate]

I just got interested in machine learning. For days, I searched many sites about the prerequisites and skills (including mathematical skills) needed to learn machine learning. I want to take my ...
2
votes
2answers
66 views

Is Windows a bad choice for DRL?

I'm looking into using PPO implementations like OpenAi's SpinningUp and Baselines. However, I fear that these implementations require packages which are not available for Windows. So I'm wondering if ...
1
vote
2answers
31 views

Modelling gut-feeling/subconscious knowledge of stock market traders

Some (stock market) traders have the ability to produce a high percentage of winning trades (80%+, positive return) over years. I had the chance to look into real money trades of two such traders and ...
0
votes
0answers
12 views

What is the right way to convolve over word embeddings?

I have two word embeddings w1 and w2 with dimension 100 as input into my convolutional neural network. It should learn the similarity between these two words. I am now concerned with the applied ...
2
votes
1answer
31 views

Why does Deep Q Network outputs multiple Q values?

I am learning Deep RL following this tutorial: https://medium.freecodecamp.org/an-introduction-to-deep-q-learning-lets-play-doom-54d02d8017d8 I understand everything but one detail: This image shows ...
1
vote
1answer
46 views

Is it possible to use a trained neural network to predict a feature, given other features and output?

I have a neural network that is already trained to predict two continuous outputs from a set of 7 continuous features. Is there any way to apply the network to predict one of the input features, ...
4
votes
1answer
46 views

Is fuzzy logic connected to neural networks?

Fuzzy logic is typically used in control theory and engineering applications, but is it connected fundamentally to classification systems? Once I have a trained neural network (multiple inputs, one ...
1
vote
0answers
15 views

Is policy learning and online system identification the same?

In some newer robotics literature, the term system identification is used in a certain meaning. The idea is not to use a fixed model, but to create the model on the fly. So it is equal to a model-free ...
1
vote
0answers
8 views

Azure ML studio pull directly from sharepoint

I am toying around with creating a probability of win calculator for proposals that we do. the information on each proposal is housed in our corporate SharePoint (which I am the admin) Is there a ...
1
vote
0answers
38 views

Why is gradient ascent necessary when training Actor Critic agents?

I have read a lot on Actor Critic and I'm not convinced that there is a qualitative difference doing direct gradient updates on the network and slightly adjusting a soft-max output in the direction of ...
1
vote
1answer
30 views

Robot Arm Deep Q Learning Actions

Hello I am new to reinforcement learning and robotics. So far I have an understanding of the concept on 2D world. You can make agent move one step in one direction. However, how do you define movement ...
1
vote
2answers
34 views

To what does the number of hidden layers in a neural network correspond?

In a neural network, the number of neurons in the hidden layer corresponds to the complexity of the model generated to map the inputs to output(s). More neurons creates a more complex function (and ...
1
vote
2answers
81 views

Is there more than one Q-matrix update formula?

I asked a question a while ago here and since then I've been solving the issues within my code but I have just one question... This is the formula for updating the Q-Matrix in Q-Learning: $$Q(s_t, ...
2
votes
0answers
18 views

Choosing more than one action in a parameterized policy

I would like to implement a variant of policy iteration that can choose one or more actions in each state. An example would be to heal and move in the game of Doom. Parameterizing the power set of ...
3
votes
0answers
18 views

What are the main benefits of using Bayesian networks?

I have some trouble understanding the benefits of Bayesian networks. Am I correct that the key benefit of the network is that one does not need to use chain rule of probability in order to calculate ...
1
vote
2answers
66 views

Find object location (x, y) in an image

I am generating images that consist of points where the object's location is where the most overlap of points occurs. In this example, the object location is (25, 51). I am trying to train a model to ...
2
votes
2answers
88 views

Can we define the AI singularity mathematically?

The "AI Singularity" or "Technological Singularity" is a vague term that roughly seems to refer to the idea of: Humans can design algorithms Humans can improve algorithms Eventually algorithms we ...
1
vote
0answers
27 views

Is a very powerful oracle sufficient to trigger the AI singularity?

Lets say we have a oracle $S$ that, given any function $F$ and desired output $y$, can find an input to $x$ that causes $F$ to output $y$ if it exists, or otherwise returns nil. I.e.: $$S(F, y) = x \...
0
votes
0answers
26 views

How do you implement NEAT by taking into account the loops?

I'm working on my own implementation of NEAT algorithm based on the original 2002 paper called "Efficient Reinforcement Learning through Evolving Neural Network Topologies" (by Kenneth O. Stanley and ...
1
vote
2answers
45 views

Difference between Graph Search and Tree Search

First of all, there is a lot of misunderstanding about the Graph search and Tree search. The difference between these two is not about Graph and Tree. They have two different algorithms. You can find ...
0
votes
0answers
10 views

Predicting global horizontal irradiance using satellite images [migrated]

I have the aim to build a model to predict global horizontal irradiance (ghi) using satellite images and other features namely the day of the year and time of the day. For extracting the satellite ...
3
votes
1answer
45 views

Should I model my problem as a semi-MDP?

I have a system (like a bank) that people (customers) are entered into the systems by a Poisson process, so the time between the arrival of people (two consecutive customers) will be a random variable....
0
votes
0answers
36 views

How to solve constraint satisfaction problem of two queen and two knights on a 4x4 grid

I have the following problem: Consider the problem of placing 2 knights and 2 queens on a 4 x 4 chessboard, each piece (knight or queen) per row (denoted by R1, R2, R3, and R4) as shown in the ...
2
votes
1answer
29 views

Mnist CNN Architecture

In this tutorial from Jeremy Howard: What is torch.nn really? he has an example towards the end where he creates a CNN for mnist. In nn.Conv2d he makes the ...
2
votes
2answers
75 views

What is self-supervision in machine learning?

What is self-supervision in machine learning? Is it related to supervised learning? How is it different from supervised learning?
1
vote
0answers
22 views

How the actor use the output from the critic to make action in actor-critic network?

I am reading about the actor-critic architecture. I am confused about how the actor determines the action using the value (or future reward) from the critic network. Below you have the most popular ...
1
vote
0answers
16 views

Complex systems constituting an entity unto itself

Introduction: The notion that various social complex systems (e.g. society, family, business company, state, etc) could be regarded as ones exhibiting consistent traits of behaviour of their own - ...
0
votes
0answers
9 views

How can we estimate the transition model and reward function?

In reinforcement learning (RL), there are model-based and model-free algorithms. In short, model-based algorithms use a transition model (e.g. a probability distribution) and the reward function, even ...
0
votes
2answers
28 views

Do I need an encoder-decoder architecture to predict the next item of a sequence?

I am trying to understand how RNNs are used for sequence modelling. On a tutorial here, it mentions that if you want to translate say a sentence from English to French you can use an encoder-decoder ...

15 30 50 per page