# All Questions

3,075 questions
0answers
2 views

### Pseudocode for CNN with Bounding Box and Classifier

I've been looking at various bounding box algorithms, like the three versions of RCNN, SSD and YOLO, and I have noticed that not even the original papers include pseudocode for their algorithms. I ...
0answers
14 views

### Expected SARSA vs SARSA in “RL: An Introduction”

Sutton and Barto state in the 2018-version of "Reinforcement Learning: An Introduction" in the context of Expected SARSA (p. 133) the following sentences: Expected SARSA is more complex ...
1answer
13 views

### How do I avoid an agent to tend to terminate in a negative state when time needs to be taken into account?

In an unknown environment, how do I avoid an agent to tend to terminate its trajectory in a negative state when time needs to be taken into account? Suppose the following example to make my question ...
0answers
4 views

### Judging a genetic algorithm's priority-based schedules by how far ahead the higher priority things are done

I'm creating a schedule for a summer camp. Because of the high risk of rain, the higher priority activities need to be attempted first, so there is more time for later attempts if need be (temporarily ...
1answer
22 views

### How is equation 8 derived in the paper “Self-critical sequence training for image captioning”?

In the paper "Self-critical sequence training for image captioning", on page 3, they define the loss function (of the parameters $\theta$) of an image captioning system as the negative expected reward ...
0answers
9 views

### How my LSTM is making association between the columns?

I have created LSTM model using the following Tensorflow code: ...
1answer
14 views

### Face liveness detection using face landmark points

How to detect liveness of face using face landmark points? I am getting face landmarks from android camera frames. And I want to detect liveness using these landmark points. How to tell if a human ...
0answers
16 views

### How to handle varying length of inputs that represent dependencies and recursivity in deep neural networks in case of regression?

I wanna solve a problem of regression to predict a factor. I decide to go with Deep Neural Networks as solution for my problem. The features in this problem represent loop characteristic such us loop ...
1answer
19 views

### Training a neural network to output the conditional probability of an event when the training data output is only binary

I have a dataset with hundreds of thousands of training examples. There are 27 input variables and one output variable which is always a 0 or a 1, based on whether an event happened or not. My ...
1answer
19 views

### Is the definition of machine learning by Mitchell in his book “Machine Learning” valid?

The definition machine learning is as follows: A computer program is said to learn from experience E with respect to some task T and performance measure P, if its performance at task T, as ...
2answers
24 views

### Relative Importance of Input Features

I am confused as to how neural networks consider the different features by that have access to at the input layer. Consider this example: I have three features: an image, a dollar amount, and a ...
0answers
16 views

### What is the difference between a non-stationary policy and a state that stores time?

This question is related to What does "stationary" mean in the context of reinforcement learning?, but I have a more specific question to clarify the difference between a non-stationary ...
0answers
10 views

### Will the transition from automation to robotics become a soft one or abrupt?

State of the art technology in the industry is equal to automation. Lots of machines are used which have increased the productivity. For example a crane, a truck, electric light, a food packaging ...
1answer
18 views

### Loss function spikes

For the UNSW-NB15 dataset i receive spikes in the loss function during training. The algorithms see part of this UNSW dataset a single time. Loss function is plotted after every batch. For other ...
1answer
15 views

### Loss/accuracy on Synthetic data

I am trying to understand if there is any difference in the the interpretation of accuracy and loss on synthetic data vs real data.
0answers
18 views

### Why is the learning rate is already very small (1e-05) while the model convergences too fast?

I am training a video prediction model. According to the loss plots, the model convergences very fast while the final loss is not small enough and the generation is not good. Actually, I have test ...
1answer
24 views

### Is 7. of the UK Gov Al healthcare code of conduct possible?

The NHS, Centre for Data Ethics, and Nuffield Council have put together a code of conduct for AI use in health care. My question is whether item 7 as follows is possible and in what ways might it be: ...
0answers
7 views

### How to use a function which compares AI players to create a fitness function of one weights set?

We are given a game between exactly two players, with end result either one of them wins or it is a draw. I have these things already done: A Player(List weights) ...
0answers
19 views

### Symbolic “math” using trained networks

Does anyone work out ways of relating trained networks by symbolic logic? For example: If I train a network on pictures of dogs, and I train a network on pictures of shirts. You could imagine that ...
1answer
30 views

### How do I apply the value iteration algorithm when there are two goal states?

I am working through the famous RL textbook by Sutton & Barto. Currently, I am on the value iteration chapter. To gain better understanding, I coded up a small example, inspired by this article. ...
0answers
12 views

### Using a combination of gradient boosting with LSTM for classification? [migrated]

I am presently using a LSTM model to classify high dimensional tabular data which is not text/images (dimensions 21392x1970). I also tried XGBoost (Gradient boosting) in Python separately for the same ...
0answers
18 views

### What are the prerequisites and skills for studying machine learning? [duplicate]

I just got interested in machine learning. For days, I searched many sites about the prerequisites and skills (including mathematical skills) needed to learn machine learning. I want to take my ...
2answers
66 views

### Is Windows a bad choice for DRL?

I'm looking into using PPO implementations like OpenAi's SpinningUp and Baselines. However, I fear that these implementations require packages which are not available for Windows. So I'm wondering if ...
2answers
31 views

### Modelling gut-feeling/subconscious knowledge of stock market traders

Some (stock market) traders have the ability to produce a high percentage of winning trades (80%+, positive return) over years. I had the chance to look into real money trades of two such traders and ...
0answers
12 views

### What is the right way to convolve over word embeddings?

I have two word embeddings w1 and w2 with dimension 100 as input into my convolutional neural network. It should learn the similarity between these two words. I am now concerned with the applied ...
1answer
31 views

### Why does Deep Q Network outputs multiple Q values?

I am learning Deep RL following this tutorial: https://medium.freecodecamp.org/an-introduction-to-deep-q-learning-lets-play-doom-54d02d8017d8 I understand everything but one detail: This image shows ...
1answer
46 views

### Is it possible to use a trained neural network to predict a feature, given other features and output?

I have a neural network that is already trained to predict two continuous outputs from a set of 7 continuous features. Is there any way to apply the network to predict one of the input features, ...
1answer
46 views

### Is fuzzy logic connected to neural networks?

Fuzzy logic is typically used in control theory and engineering applications, but is it connected fundamentally to classification systems? Once I have a trained neural network (multiple inputs, one ...
0answers
15 views

### Is policy learning and online system identification the same?

In some newer robotics literature, the term system identification is used in a certain meaning. The idea is not to use a fixed model, but to create the model on the fly. So it is equal to a model-free ...
0answers
8 views

### Azure ML studio pull directly from sharepoint

I am toying around with creating a probability of win calculator for proposals that we do. the information on each proposal is housed in our corporate SharePoint (which I am the admin) Is there a ...
0answers
38 views

### Why is gradient ascent necessary when training Actor Critic agents?

I have read a lot on Actor Critic and I'm not convinced that there is a qualitative difference doing direct gradient updates on the network and slightly adjusting a soft-max output in the direction of ...
1answer
30 views

### Robot Arm Deep Q Learning Actions

Hello I am new to reinforcement learning and robotics. So far I have an understanding of the concept on 2D world. You can make agent move one step in one direction. However, how do you define movement ...
2answers
34 views

### To what does the number of hidden layers in a neural network correspond?

In a neural network, the number of neurons in the hidden layer corresponds to the complexity of the model generated to map the inputs to output(s). More neurons creates a more complex function (and ...
2answers
81 views

0answers
26 views

### How do you implement NEAT by taking into account the loops?

I'm working on my own implementation of NEAT algorithm based on the original 2002 paper called "Efficient Reinforcement Learning through Evolving Neural Network Topologies" (by Kenneth O. Stanley and ...
2answers
45 views

### Difference between Graph Search and Tree Search

First of all, there is a lot of misunderstanding about the Graph search and Tree search. The difference between these two is not about Graph and Tree. They have two different algorithms. You can find ...
0answers
10 views

### Predicting global horizontal irradiance using satellite images [migrated]

I have the aim to build a model to predict global horizontal irradiance (ghi) using satellite images and other features namely the day of the year and time of the day. For extracting the satellite ...
1answer
45 views

### Should I model my problem as a semi-MDP?

I have a system (like a bank) that people (customers) are entered into the systems by a Poisson process, so the time between the arrival of people (two consecutive customers) will be a random variable....
0answers
36 views

### How to solve constraint satisfaction problem of two queen and two knights on a 4x4 grid

I have the following problem: Consider the problem of placing 2 knights and 2 queens on a 4 x 4 chessboard, each piece (knight or queen) per row (denoted by R1, R2, R3, and R4) as shown in the ...
1answer
29 views

### Mnist CNN Architecture

In this tutorial from Jeremy Howard: What is torch.nn really? he has an example towards the end where he creates a CNN for mnist. In nn.Conv2d he makes the ...
2answers
75 views

### What is self-supervision in machine learning?

What is self-supervision in machine learning? Is it related to supervised learning? How is it different from supervised learning?
0answers
22 views

### How the actor use the output from the critic to make action in actor-critic network?

I am reading about the actor-critic architecture. I am confused about how the actor determines the action using the value (or future reward) from the critic network. Below you have the most popular ...
0answers
16 views

### Complex systems constituting an entity unto itself

Introduction: The notion that various social complex systems (e.g. society, family, business company, state, etc) could be regarded as ones exhibiting consistent traits of behaviour of their own - ...
0answers
9 views

### How can we estimate the transition model and reward function?

In reinforcement learning (RL), there are model-based and model-free algorithms. In short, model-based algorithms use a transition model (e.g. a probability distribution) and the reward function, even ...
2answers
28 views

### Do I need an encoder-decoder architecture to predict the next item of a sequence?

I am trying to understand how RNNs are used for sequence modelling. On a tutorial here, it mentions that if you want to translate say a sentence from English to French you can use an encoder-decoder ...

15 30 50 per page