Questions tagged [learning-algorithms]
For questions about different learning algorithms used by a Machine Learning program to achieve its end goal.
50
questions
1
vote
1answer
44 views
How do you know if an agent has learnt its environment in reinforcement learning?
I'm new to reinforcement learning and trying to understand it.
If you train an agent using a reinforcement learning algorithm (discrete or continuous) on an environment (real or simulated), then how ...
2
votes
0answers
25 views
Is there a theory that captures the following ideas?
A big class of problems that are relevant in today's society are full of uncertainty and are also sometimes computationally intractable. Along our lives we come to realize that we are solving the same ...
1
vote
1answer
40 views
Why does the machine learning algorithm need to learn a set of functions in the case of missing data?
I am currently studying the textbook Deep Learning by Goodfellow, Bengio, and Courville. Chapter 5.1 Learning Algorithms says the following:
Classification with missing inputs: Classification ...
2
votes
1answer
66 views
Which ANN can solve for y = x * x + b?
I am new to ANN. I am trying out several 'simple' algorithms to see what ANN can (or cannot) be used for and how. I played around with Conv2d once and had it recognize images succesfully. Now I am ...
1
vote
0answers
28 views
Intellectual property in the age of Industry 4.0
I am looking for specific references describing guidance principles around the interplay between IP (intellectual property) and Artificial Intelligence algorithms. For example, Company A has a large ...
0
votes
0answers
23 views
Backpropagation and PID
In backpropagation, the update rule for the weights is based on the derivative of some loss function. This is similar to the "proportional" aspect of a PID loop controller, where some control variable ...
0
votes
0answers
27 views
How can I write out the Real-TIme Recurrent Learning Gradient equations for a network?
This question is about Real-Time Recurrent Learning Gradient on a Recurrent neural network .
How can I write out the RTRL equations for a network ?
Before present an example give let's introduce ...
0
votes
0answers
24 views
How would an AI learn the concept of the words “repeat twice”?
In a hypothetical conversation:
Person A - "Repeat the word 'cat' twice".
Person B - "cat cat".
I'm thinking about how a human or AI can learn the concept of "...
5
votes
1answer
94 views
How can we prove that an autoassociator network will continue to perform if we zero the diagonal elements of a weight matrix?
How can we prove that an auto-associator network will continue to perform if we zero the diagonal elements of a weight matrix that has been determined by the Hebb rule? In other words, suppose that ...
2
votes
3answers
111 views
How do you interpret this learning curve?
Loss is MSE; orange is validation loss, blue training loss. The task is NN regression (18 inputs, 2 outputs), one layer 300 hidden units.
Tuning the lr, mom, l2 regularization parameters this is the ...
4
votes
0answers
57 views
Unable to train Coach for Banana-v0 Gym environment
I have just started playing with Reinforcement learning and starting from the basics I'm trying to figure out how to solve Banana Gym with coach.
Essentially ...
3
votes
1answer
48 views
Is it possible to do K-nearest-neighbours before training DNN
The following X-shape alternated pattern can be separated quite well and super fast by K-nearest Neighbour algorithm (go to http://ml-playground.com to test it):
However, DNN seems to face great ...
8
votes
1answer
100 views
How does Atlas from Boston Dynamics have human-like movement?
Discussing the video More Parkour Atlas a friend asked how the robot's movement where so similar to the one from a real human and wondering how this is achieve?
To my knowledge this is not something ...
2
votes
0answers
30 views
Algorithm to solve a fault independent of its type
I am looking to plan a solution for a workspace fault and not hardware faults.
Consider a task where a robot has to move balls from one place to another. In case it faces any condition which is ...
2
votes
1answer
73 views
Using ML to analyze Facebook posts
First of all, I should mention that I have a very basic knowledge of ML so I apologize if this question seems trivial or stupid.
I am working on a small personal project, basically an app that ...
0
votes
0answers
21 views
How to use FSICFR (or CFRM) trained result in real dice game playing
I trained a Liar Dice game (similar rule please refer to https://www.wikihow.com/Play-Liar%27s-Dice , and i am using 2 player + 1 dice vs 1 dice) with FSICFR algorithm and got an information set with ...
1
vote
1answer
19 views
Use AI to auto-correlate the words of human-translated texts?
There are many, many literary works in the public domain, along with human translations, many of which have entered the public domain as well. (Public domain = easily available)
In order for me to ...
2
votes
3answers
258 views
Can we define the AI singularity mathematically?
The "AI Singularity" or "Technological Singularity" is a vague term that roughly seems to refer to the idea of:
Humans can design algorithms
Humans can improve algorithms
Eventually algorithms we ...
1
vote
1answer
55 views
Artificial intelligence as a product of algorithms
Is this approach nonsense since reason produces algorithms as a method of solving problems. The algorithm is a sequence of events that perform a task till completion of the problem. Reason is ...
1
vote
1answer
97 views
how to predict the stock of food items using ai
Actually, I want to make an AI model which tells the seller about the maintaining stock of food items as a parameter of time and eventually learns by itself with the customer buying data
(problem - ...
1
vote
1answer
145 views
AI learning by demonstration for web navigation
I don't know what to search for, so I'll try to describe what I'm trying to do : I want an AI that learns by showing it how to navigate on the Internet.
Let's say I want to save 50 images from a ...
1
vote
1answer
1k views
Why we use LIFO(Last in First Out) queue in depth first search?
As, we use FIFO(First In First Out) queue in breadth search algorithm but in depth first search we use LIFO.Why we use LIFO instead of FIFO in depth first search?
1
vote
1answer
500 views
Does a solution for Wumpus World with neural networks exist?
The Wumpus World proposed in book of Stuart Russel and Peter Norvig, is a game which happens on a 4x4 board and the objective is to grab the gold and avoiding the threats that can kill you. The rules ...
1
vote
1answer
38 views
What is the approach to deduce formal rules based on data?
We have data in text format as sentences.
The goal is to detect rules which exist in this set of sentences.
I have a limited set of contextless sentences that fit a pattern and want to find the ...
4
votes
1answer
163 views
How do I train a bot to solve Katona style problems?
Cognitive psychology is researched since the 1940s. The idea was to understand human problem solving and the importants of heuristics in it. George Katona (an early psychologist) published in the ...
2
votes
1answer
144 views
What's an appropriate algorithm for classification with categorical features?
My input data consists of a series of 8 integers. Each integer is a discrete token, rather than a relative numeric value (i.e. '1' and '2' are as distinct as are '1' and '100'). The output is a ...
6
votes
1answer
356 views
Why not teach to a NN not only what is true, but also what is not true?
I'm not a person who studies neural networks, or does anything that is related with that area, but I have seen a couple of seminars, videos (such as 3Blue1Brown's Series), and what I am always told is ...
1
vote
0answers
58 views
How basically AI synthesize thinking?
In the instance like AlphaGo Zero.
How N' why AlphaGo Zero's training is so stable? Compared with traditional game theory applied in Deep RN technique!?
How "AlphaGo Zero" differs from "...
0
votes
1answer
59 views
Teaching a NN to manipulate pseudoRNG over a long time scale?
For speedrunning purposes, I am trying to train a neural network to identify human-executable ways to manipulate pseudo-RNG (in Pokemon Red, for the interested). The game runs at sixty frames per ...
2
votes
1answer
85 views
Which machine learning algorithm is suitable for detecting text w.r.t set of words
Considering the scenario where supervised training data-set in the form of sentence will be given to train the machine
The Bomb which had been planted by Terrorist on this morning was
defused by ...
1
vote
1answer
3k views
Where do 'random seeds' get used in deep neural networks?
I know that when creating neural networks it's standard practice to create a 'random seed' so that you can get producible results in your models. I have a couple of questions regarding this:
Is the ...
2
votes
1answer
934 views
Value iteration algorithm from pseudo-code to C++
I am having a difficult time translating this pseudocode into functional C++ code.
At line 10: The value function is represented as V[s], which has a bracket notation like arrays. Is this a separate ...
0
votes
1answer
57 views
Which is best: evaluation of states or probability of moves?
If you have a game and you are training an AI there seems to be two ways to do it.
First you take the game-state and a possible move and evaluate whether this move would be good or bad:
(1) ...
6
votes
0answers
317 views
Can we use the recursive least squares as a learning algorithm to an ADALINE?
I'm new to neural network, I study electrical engineering, and I just started working with ADALINEs.
I use Matlab, and in their Documentation they cite :
However, here the LMS (least mean squares) ...
1
vote
2answers
59 views
In the multi-linear regression, how is the value of weight $b_2$ calculated?
In multivariate linear regression (linear regression with more than one variable) the model is $yi = b_0 + b_1x_{1i} + b_2x_{2i} + ...$ , and so on. But how is the $b_n$ value calculated iteratively? ...
3
votes
2answers
141 views
Predict frequently purchased items under certain conditions with customer purchasing history data
I have purchasing history data for grocery shopping. I am trying to get abnormally frequently purchased items under certain conditions. For instance, I am trying to find frequently purchased items, ...
2
votes
2answers
36 views
Recommend item from set based on features
Forgive what might be a basic question. I'm just experimenting with ML / AL and I have a small problem set and I'd like to see if it can be solved with ML / AI. Basically, given a set of objects ...
0
votes
2answers
209 views
what is the proof behind the gradient of a curve being equal/proportional to the distance between the two co-ordinates in the x-axis [closed]
In the delta rule the equation to adjust the weight with respect to error is :-
where is the Learning Rate and E is the ...
-1
votes
1answer
85 views
Artificial Intelligence and Automatic Scheduling
I do not have background in Artificial Intelligence related algorithms etc. But I have a scheduling problem that needs to be resolved.
For example, employees need to be scheduled for on call. They ...
1
vote
0answers
51 views
How do stacked denoising autoencoders work
I've been studying a recommender system which uses a collaborative deep learning approach and Bayesian learning. It has the following NN representation :
I need to know the working of stacked ...
1
vote
0answers
165 views
Natural language processing with a continuous dependent variable
I have a large number of observations. Each observation contains:
dependent variable: a scores ranging from 0 - 100
independent variable: a large article
I want to know which words or phrases ...
1
vote
2answers
108 views
Trading off “Memory” vs “Optimization”
I've been researching the following topic. Or rather, I would like to but I can't find anything because I'm not sure what to look for.
I am interested weather there are some concepts or models that ...
3
votes
1answer
431 views
Machine learning algorithm for xml manipulation
Given a virtual game map (picture) and a racing car at the map's starting point, I'm trying to build an algorithm that would help me generate a route that would get the car from the beginning to the ...
5
votes
2answers
732 views
Approaches to an algorithm for crossing a road
I want to write an algorithm which indicates to a robot the first point in time when it is reasonably safe to cross a road. Assume that the robot's goal is to travel to a location that requires a ...
4
votes
1answer
612 views
Is a decision tree less suitable for incremental learning than e.g. a neural net?
I can recall that a professor once said that decision trees are not good for incremental learning, as they have to be rebuilt from the ground up if new training examples arrive.
Is this basically ...
5
votes
3answers
262 views
Why do Decision Tree Learning Algorithm preferably outputs the smallest Decision Tree?
I have been following the ML course by Tom Mitchel.
The inherent assumption while using Decision Tree Learning Algo is: The algo. preferably chooses a Decision Tree which is the smallest.
Why is ...
2
votes
1answer
112 views
Recognition of abbreviated text
I want to write a program that looks at abbreviated words, then figures out what the words are. For example, the abbreviation is "blk comp", and the translation is "black computer".
In order to give ...
3
votes
1answer
338 views
Perceptron learning
There is an example related to perceptron learning, but I couldn't get it, I don't exactly know how to solve it.
There is a snippet from lecture notes.
What is the transformation between epochs?
4
votes
1answer
89 views
How can artificial intelligence (including deep learning algorithms) find suspicious patterns in the bodyās biochemistry?
It has been suggested that machine learning algorithms (also Watson) can help with finding disease in patient images and optimize scans. Also that deep learning algorithms show promise for every type ...
3
votes
1answer
117 views
Which learning algorithms are suitable for data leakage detection and prevention?
I'm investigating applications of AI algorithms which can be used for data leakage detection and prevention within an intranet network (like Forcepoint). More specifically detecting traffic patterns. ...
