Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [machine-learning]

For questions about machine learning (ML) concepts, mathematics, research, general practice, and quality control. Machine learning is a sub-field of the broader field of artificial intelligence (AI).

0
votes
1answer
14 views

Face liveness detection using face landmark points

How to detect liveness of face using face landmark points? I am getting face landmarks from android camera frames. And I want to detect liveness using these landmark points. How to tell if a human ...
1
vote
1answer
19 views

Is the definition of machine learning by Mitchell in his book “Machine Learning” valid?

The definition machine learning is as follows: A computer program is said to learn from experience E with respect to some task T and performance measure P, if its performance at task T, as ...
1
vote
0answers
18 views

Why is the learning rate is already very small (1e-05) while the model convergences too fast?

I am training a video prediction model. According to the loss plots, the model convergences very fast while the final loss is not small enough and the generation is not good. Actually, I have test ...
0
votes
0answers
18 views

What are the prerequisites and skills for studying machine learning? [duplicate]

I just got interested in machine learning. For days, I searched many sites about the prerequisites and skills (including mathematical skills) needed to learn machine learning. I want to take my ...
1
vote
2answers
31 views

Modelling gut-feeling/subconscious knowledge of stock market traders

Some (stock market) traders have the ability to produce a high percentage of winning trades (80%+, positive return) over years. I had the chance to look into real money trades of two such traders and ...
1
vote
0answers
8 views

Azure ML studio pull directly from sharepoint

I am toying around with creating a probability of win calculator for proposals that we do. the information on each proposal is housed in our corporate SharePoint (which I am the admin) Is there a ...
1
vote
2answers
66 views

Find object location (x, y) in an image

I am generating images that consist of points where the object's location is where the most overlap of points occurs. In this example, the object location is (25, 51). I am trying to train a model to ...
2
votes
2answers
75 views

What is self-supervision in machine learning?

What is self-supervision in machine learning? Is it related to supervised learning? How is it different from supervised learning?
1
vote
2answers
61 views

RL vs Supervised Learning vs Planning

This is an excerpt taken from Sutton and Barto (pg. 3): Another key feature of reinforcement learning is that it explicitly considers the whole problem of a goal-directed agent interacting with ...
0
votes
0answers
50 views

Using AI to guess a mathematical pattern of certain polynomials in four variables: practical challenge

I'd like to use machine learning to guess a mathematical pattern: the input are certain polynomials in four variables $q_1,q_2,q_3,q_4$, the output can be zero or one. Allowed polynomials are such ...
0
votes
1answer
26 views

Are Random Boolean Networks useless?

The Turing-machine is well known in the literature. On the turing-machine it is possible to calculate the busy beaver problem. A more recent approach to implement a computer is a Random boolean ...
0
votes
0answers
23 views

How to make episode ending “good” in reinforcement learning?

TL;DR: read the bold. The rest are details I am trying to implement Reinforcement Learning:An Introduction, section 13.5 myself: on OpenAi's cartpole The algorithm seems to be learning something ...
2
votes
3answers
112 views

Are there profitable hedge funds using AI?

Is there any research in this area?
0
votes
0answers
18 views

How to correctly discount actor critic with experience replay?

In my related question, I asked about the one step actor critic from The Reinforcement Learning Book by Richard Sutton et al, section 13.5: The learning is becoming less significant as the episode ...
1
vote
1answer
25 views

In online one step actor critic, why does the weights update become less significant as the episode progresses?

The Reinforcement Learning Book by Richard Sutton et al, section 13.5 shows an online actor critic algorithm. Why do the weights updates depend on the discount factor via $I$? It seems that the more ...
1
vote
1answer
41 views

How to obtain a formula for loss, when given an iterative update rule in gradient descent?

From the reinforcement learning book section 13.3: Using pytorch, I need to calculate a loss, and then the gradient is calculated internally. How to obtain the loss from equations which are stated ...
0
votes
0answers
4 views

Mapping orb features to a different set of orb features

well I am trying to create a neural network with the purpose to map orb features (well they could be SURF or SIFT also but I would prefer SURF for dimensionality reasons) from 2 different modes. The ...
1
vote
1answer
29 views

Study path for artificial intelligence [duplicate]

I want to study artificial intelligence but I don't know how to begin. I want to know study path for artificial intelligence.
1
vote
1answer
30 views

Can we derive the distribution of a random variable based on a dependent random variable's distribution?

In the diagram below, there are three variables: X3 is a function of (depends on) X1 and X2, ...
0
votes
0answers
16 views

Is this exactly AC-3 algorithm works?

I am studying csp problems in artificial intelligence.I have so much efforts on written in N-Queens with csp. I confused with the output of my AC-3 algorithm with MAC-3 algorithm. Please check me with ...
0
votes
0answers
9 views

Understanding probabilistic inference graphs

I am having trouble understanding inference graphs. In the diagram below I understand the graph on the left (forward graph) where the arrows describe the direction that data flows when training for ...
1
vote
1answer
54 views

A neural network for digits recognition doesn't work (MNIST, Numpy) [closed]

I'm a beginner in machine learning and I was trying to make a test neural network for digits recognition from scratch using Numpy. I used MNIST dataset for training and testing. Input layer have 28*28 ...
1
vote
0answers
30 views

Experiment shows that LSTM does worse than Random Forest… Why?

LSTM is supposed to be the right tool to capture path-dependency in time-series data. I decided to run a simple experiment (simulation) to assess the extent to which LSTM is better able to understand ...
0
votes
0answers
6 views

How to perform structure learning for Bayes Net given already partially constructed net?

Let assume that we have dataset of variables (random events), I apriori would like to set dependency conditions between some of them and perform structure learning to figure out the rest of the net. ...
0
votes
0answers
33 views

What are the practical and theoretical properties that commonly used loss functions have?

What are the practical and theoretical properties that commonly used loss functions have (in particular, in the context of neural networks)?
3
votes
4answers
85 views

Choose model with the smallest loss or highest accuracy?

I have two Neural Network models (I use LSTM) that have different result on validation set (~100 samples data): Model A: Accuracy: ~91%, Loss: ~0.01 Model B: Accuracy: ~83%, Loss: ~0.003 The size ...
1
vote
1answer
44 views

Meaning of Actor Output in Actor Critic Reinforcement Learning

In actor critic, The equations for calculating the loss in actor critic are an actor loss (parameterized by $\theta$) $$log[\pi_\theta(s_t,a_t)]Q_w(s_t,a_t)$$ and a critic loss (parameterized by ...
1
vote
0answers
15 views

GPFlow: Gaussian Process Uncertainty Quantification

I trained some Gaussian process model with the Python library GPFlow on a dataset consisting of $(X, Y)$, inputs and outputs, in a regression setting. This model gives me pretty good predictions in ...
1
vote
0answers
20 views

How do PGMs factor in to modern ML?

I just finished the three-part series of Probabilistic Graphical Models courses from Stanford over on Coursera. I got in to them because I realized there is a certain class of problem for which the ...
0
votes
0answers
19 views

Models at RunTime and Artificial Intelligence

I'm looking for some help... Someone can refer me or recommend recent studies that relate to the models at runtime with the AI, that would really help me a lot. I also appreciate your comments on the ...
0
votes
1answer
42 views

Reduce receptive field size of CNN while keeping its capacity?

I have a convolutional encoder (a CNN) consisting of DenseBlocks and a total of 50 layers (cf. FC-DenseNet103). The receptive field of the encoder (after last layer) is 660 according to Tensorflow ...
0
votes
1answer
62 views

Difference between Machine learning and Deep learning? [duplicate]

What is machine learning and deep learning? I hope there are similar questions out there. But I couldn't able visualize. Can someone explain me the difference between Machine learning and Deep ...
0
votes
1answer
48 views

Which field to study to learn & create a.i generated simulations?

I wasn't sure how to title this question so pardon me please. You may have seen at least one video of those "INSANE A.I created simulation of {X} doing {Y & Z} like the following ones: A.I ...
2
votes
1answer
63 views

Can TD-Lambda be used with Deep Reinforcement Learning?

TD lambda is a way to interpolate between TD(0) - bootstraping over a single step, and, TD(max), bootstraping over the entire episode length, or, Monte carlo. Reading the link above, I see that an ...
1
vote
1answer
38 views

Which Openai Gym environment should I use to test a Temporal Difference RL Agent?

Up to now, I have been using (my version of) open AI's code, with the suggested CartPole. I have been using Monte Carlo methods, which, for cartpole, seemed to work fine. Trying to move to temporal ...
1
vote
2answers
42 views

When are Q values calculated in experince replay?

In experience replay, the update rule follows the loss: $$ L_i(\theta_i) = \mathbb{E}_{(s_t, a_t, r_t, s_{t+1}) \sim U(D)} \left[ \left(r_t + \gamma \max_{a_{t+1}} Q(s_{t+1}, a_{t+1}; \theta_i^-) - ...
0
votes
0answers
43 views

Is Iron Dome developer by Israel an AI?

Recently I watched a video of ISrael's Iron Dome. Which is mainly created to protect citizens from missile attacks by enimies. Though, it sounds so wierd but, actually it's not controlled by anyone. ...
0
votes
0answers
7 views

How to use SLAM on other sensor other than camera?

I have a sensor that reads electromagnetic field strength from each position. And the field is stable and unique for each position. So the reading is simply a function of the position like this: <...
0
votes
0answers
40 views

How does DeepMind's AlphaStar create new agents from existing agents?

I've watched this video of the recent contest of AlphaStar Vs Pro players of StarCraft2, and during the discussion David Silver of DeepMind explains the process of creating new agents (forked/branched)...
0
votes
1answer
46 views

How does DeepMind perform reinforcement learning on a TPU?

I've watched this video of the recent contest of AlphaStar Vs Pro players of StarCraft2, and during the discussion David Silver of DeepMind said that they train AlphaStar on TPUs. My question is, how ...
2
votes
1answer
51 views

What information should be cached in experience replay for actor-critic?

Experience replay is buffer (or a "memory") of transactions $e_t = (s_t, a_t, r_t, s_{t+1})$. The equations for calculating the loss in actor critic are an actor loss (parameterized by $\theta$) $$...
-1
votes
0answers
17 views

Driving behviour aggressivity

I have a project to make a classification ( scoring ) system to measure driving behaviour aggressivity using data like velocity, acceleration, weather and traffic code for speed limits according to ...
0
votes
1answer
45 views

inconsistent formulas for loss calculation in OpenAI's Actor Critic?

Open Ai's (working) actor critic code calculates the losses like so: ...
2
votes
1answer
43 views

How to define the final / terminal state for Q learning?

I'm training an agent using RL and the SARSA function to update a Q function, but I'm confused how you handle the final state. In this case when the game ends and there is no S'. For example, the ...
-1
votes
0answers
12 views

Logarithm of determinantal function in DPP is submodular

I am learning about Determinantal Point Processes, as described in the paper Determinantal point processes for machine learning In this setting, one of the key elements is the determinantal function $...
-1
votes
0answers
22 views

Can I pair Titan XP w/ RTX 2080 Ti?

I am looking to buy another GPU for my deep learning rig. I currently have a Titan XP but would like to be able to train models faster. I would add a second Titan XP but they have been out of stock ...
1
vote
2answers
62 views

Choosing the right neural network settings

I'm trying to train a neural network on evaluating chess positions if rather white (0.0) or black would win (1.0) Currently the input consists of 4 bits per chess field (piece id 0 - 12, equals 64*4)....
-1
votes
0answers
22 views

How many gradient descent iterations does it take for a neural network to over-fit, relative to network “complexity”

Following this question, I have a more refined, general, and probably more answerable question: Assuming: Infinite training data A learning problem whose loss function has no local minima (for ...
3
votes
2answers
70 views

Are neural networks statistical models?

By reading the abstract of Neural Networks and Statistical Models paper it would seem that ANNs are statistical models. In contrast Machine Learning is not just glorified Statistics. I am looking ...
-1
votes
0answers
20 views

Pre-trained regression models with high precission?

I'm trying to solve a regression problem with neural nets where my input is a set of 3 real numbers and my output is a set of 6 real numbers. I can generate as much sets as I want, so amount of data ...