Questions tagged [learning-algorithms]
For questions about different learning algorithms used by a Machine Learning program to achieve its end goal.
43
questions
0
votes
0
answers
18
views
Can manual feature extraction be considered a part of a learning algorithm?
A learning algorithm is a tuple $(\mathcal{H}, \mathcal{O}, \mathcal{L})$ where $\mathcal{H}$, $\mathcal{O}$ and $\mathcal{L}$ are the hypothesis class, optimizer and loss function respectively.
We ...
- 150
0
votes
0
answers
31
views
agent based DNN with a loopback
I have a data problem with no direct reward mechanism,(test/train) good and fault solutions.
Though over a long time period good decisions might be made.
I've been searching for days now for an agent ...
- 101
1
vote
1
answer
269
views
Best algorithms/approaches for data sets of binary (1/0) features
I am working with a dataset with about 400 features, all binary (1 or 0). What approach would you recommend? Data set is about 500k records.
- 111
-1
votes
1
answer
41
views
What is the borderline between unsupervised learning and regular algorithms?
Unsupervised learning using neural networks is clearly machine learning since it is utilising neural nets.
However, some algorithms, k-means clustering, for example, are considered unsupervised ...
- 1,283
1
vote
0
answers
59
views
Can an ML model sort a random sequence of numbers from 1 to $ 2^{2^{512}} $ in our universe in infinite time?
I am pondering on the question in the title. As a human being, somehow I can sort a random sequence of numbers from 1 to $ 2^{2^{512}} $ in our universe in infinite time (But I am not sure.). Can an ...
- 688
2
votes
0
answers
41
views
Alternatives to Hierarchical RL for centralized control tasks?
Consider a problem where the agent must learn to control a hierarchy of agents acting against another such agent in a competitive environment. The agents on each team need to learn cooperate in order ...
- 121
0
votes
0
answers
90
views
Can Reinforcement Learning be used for UAV waypoint control?
I want to make a drone which can follow static and dynamic waypoints. I am a total beginner in the drone field so I can't figure out that should I use Reinforcement Learning or any other learning ...
1
vote
1
answer
448
views
How do you know if an agent has learnt its environment in reinforcement learning?
I'm new to reinforcement learning and trying to understand it.
If you train an agent using a reinforcement learning algorithm (discrete or continuous) on an environment (real or simulated), then how ...
- 249
1
vote
2
answers
260
views
Why does the machine learning algorithm need to learn a set of functions in the case of missing data?
I am currently studying the textbook Deep Learning by Goodfellow, Bengio, and Courville. Chapter 5.1 Learning Algorithms says the following:
Classification with missing inputs: Classification ...
- 547
1
vote
0
answers
38
views
Intellectual property in the age of Industry 4.0
I am looking for specific references describing guidance principles around the interplay between IP (intellectual property) and Artificial Intelligence algorithms. For example, Company A has a large ...
- 111
1
vote
0
answers
53
views
How can I write out the Real-TIme Recurrent Learning Gradient equations for a network?
This question is about Real-Time Recurrent Learning Gradient on a Recurrent neural network .
How can I write out the RTRL equations for a network ?
Before present an example give let's introduce ...
- 157
1
vote
0
answers
134
views
How would an AI learn the concept of the words "repeat twice"?
In a hypothetical conversation:
Person A - "Repeat the word 'cat' twice".
Person B - "cat cat".
I'm thinking about how a human or AI can learn the concept of "...
- 2,186
5
votes
1
answer
371
views
How can we prove that an autoassociator network will continue to perform if we zero the diagonal elements of a weight matrix?
How can we prove that an auto-associator network will continue to perform if we zero the diagonal elements of a weight matrix that has been determined by the Hebb rule? In other words, suppose that ...
- 157
2
votes
3
answers
242
views
How do you interpret this learning curve?
Loss is MSE; orange is validation loss, blue training loss. The task is NN regression (18 inputs, 2 outputs), one layer 300 hidden units.
Tuning the lr, mom, l2 regularization parameters this is the ...
4
votes
0
answers
79
views
Unable to train Coach for Banana-v0 Gym environment
I have just started playing with Reinforcement learning and starting from the basics I'm trying to figure out how to solve Banana Gym with coach.
Essentially ...
- 141
2
votes
2
answers
935
views
What is the difference between a learning algorithm and a hypothesis?
What's the distinction between a learning algorithm $A$ and a hypothesis $f$?
I'm looking for a few concrete examples, if possible.
For example, would the decision tree and random forest be considered ...
- 393
4
votes
1
answer
160
views
Is it possible to do K-nearest-neighbours before training DNN
The following X-shape alternated pattern can be separated quite well and super fast by K-nearest Neighbour algorithm (go to https://ml-playground.com to test it):
However, DNN seems to face great ...
- 1,283
2
votes
0
answers
37
views
Algorithm to solve a fault independent of its type
I am looking to plan a solution for a workspace fault and not hardware faults.
Consider a task where a robot has to move balls from one place to another. In case it faces any condition which is ...
- 21
2
votes
1
answer
198
views
Using ML to analyze Facebook posts
First of all, I should mention that I have a very basic knowledge of ML so I apologize if this question seems trivial or stupid.
I am working on a small personal project, basically an app that ...
user28054
1
vote
1
answer
36
views
Use AI to auto-correlate the words of human-translated texts?
There are many, many literary works in the public domain, along with human translations, many of which have entered the public domain as well. (Public domain = easily available)
In order for me to ...
2
votes
4
answers
498
views
Can we define the AI singularity mathematically?
The "AI Singularity" or "Technological Singularity" is a vague term that roughly seems to refer to the idea of:
Humans can design algorithms
Humans can improve algorithms
Eventually algorithms we ...
- 274
1
vote
1
answer
984
views
Does a solution for Wumpus World with neural networks exist?
The Wumpus World proposed in book of Stuart Russel and Peter Norvig, is a game which happens on a 4x4 board and the objective is to grab the gold and avoiding the threats that can kill you. The rules ...
user18391
1
vote
1
answer
56
views
What is the approach to deduce formal rules based on data?
We have data in text format as sentences.
The goal is to detect rules which exist in this set of sentences.
I have a limited set of contextless sentences that fit a pattern and want to find the ...
- 111
2
votes
1
answer
297
views
What's an appropriate algorithm for classification with categorical features?
My input data consists of a series of 8 integers. Each integer is a discrete token, rather than a relative numeric value (i.e. '1' and '2' are as distinct as are '1' and '100'). The output is a ...
- 21
6
votes
1
answer
438
views
Why not teach to a NN not only what is true, but also what is not true?
I'm not a person who studies neural networks, or does anything that is related with that area, but I have seen a couple of seminars, videos (such as 3Blue1Brown's Series), and what I am always told is ...
- 161
0
votes
1
answer
73
views
Teaching a NN to manipulate pseudoRNG over a long time scale?
For speedrunning purposes, I am trying to train a neural network to identify human-executable ways to manipulate pseudo-RNG (in Pokemon Red, for the interested). The game runs at sixty frames per ...
- 11
2
votes
1
answer
147
views
Which machine learning algorithm is suitable for detecting text w.r.t set of words
Considering the scenario where supervised training data-set in the form of sentence will be given to train the machine
The Bomb which had been planted by Terrorist on this morning was
defused by ...
- 121
2
votes
1
answer
4k
views
Where do 'random seeds' get used in deep neural networks?
I know that when creating neural networks it's standard practice to create a 'random seed' so that you can get producible results in your models. I have a couple of questions regarding this:
Is the ...
- 307
0
votes
1
answer
108
views
Which is best: evaluation of states or probability of moves?
If you have a game and you are training an AI there seems to be two ways to do it.
First you take the game-state and a possible move and evaluate whether this move would be good or bad:
(1) ...
- 2,186
5
votes
1
answer
503
views
Can we use the recursive least squares as a learning algorithm to an ADALINE?
I'm new to neural network, I study electrical engineering, and I just started working with ADALINEs.
I use Matlab, and in their Documentation they cite :
However, here the LMS (least mean squares) ...
- 151
1
vote
2
answers
162
views
In the multi-linear regression, how is the value of weight $b_2$ calculated?
In multivariate linear regression (linear regression with more than one variable) the model is $yi = b_0 + b_1x_{1i} + b_2x_{2i} + ...$ , and so on. But how is the $b_n$ value calculated iteratively? ...
- 21
2
votes
1
answer
154
views
Predict frequently purchased items under certain conditions with customer purchasing history data
I have purchasing history data for grocery shopping. I am trying to get abnormally frequently purchased items under certain conditions. For instance, I am trying to find frequently purchased items, ...
- 141
2
votes
2
answers
57
views
Recommend item from set based on features
Forgive what might be a basic question. I'm just experimenting with ML / AL and I have a small problem set and I'd like to see if it can be solved with ML / AI. Basically, given a set of objects ...
- 121
0
votes
2
answers
446
views
What is the proof behind the gradient of a curve being proportional to the distance between the two co-ordinates in the x-axis?
In the [delta rule][1] the equation to adjust the weight with respect to error is
$$w_{(n+1)}=w_{(n)}-\alpha \times \frac{\partial E}{\partial w}$$
*where $\alpha$ is the learning rate and $E$ is the ...
- 213
1
vote
0
answers
65
views
How do stacked denoising autoencoders work
I've been studying a recommender system which uses a collaborative deep learning approach and Bayesian learning. It has the following NN representation :
I need to know the working of stacked ...
- 333
1
vote
0
answers
386
views
Natural language processing with a continuous dependent variable
I have a large number of observations. Each observation contains:
dependent variable: a scores ranging from 0 - 100
independent variable: a large article
I want to know which words or phrases ...
- 119
2
votes
2
answers
118
views
Trading off "Memory" vs "Optimization"
I've been researching the following topic. Or rather, I would like to but I can't find anything because I'm not sure what to look for.
I am interested weather there are some concepts or models that ...
- 175
2
votes
1
answer
719
views
Machine learning algorithm for xml manipulation [closed]
Given a virtual game map (picture) and a racing car at the map's starting point, I'm trying to build an algorithm that would help me generate a route that would get the car from the beginning to the ...
user9890
5
votes
2
answers
2k
views
Approaches to an algorithm for crossing a road
I want to write an algorithm which indicates to a robot the first point in time when it is reasonably safe to cross a road. Assume that the robot's goal is to travel to a location that requires a ...
- 163
5
votes
1
answer
2k
views
Is a decision tree less suitable for incremental learning than e.g. a neural net?
I can recall that a professor once said that decision trees are not good for incremental learning, as they have to be rebuilt from the ground up if new training examples arrive.
Is this basically ...
- 153
5
votes
3
answers
590
views
Why do Decision Tree Learning Algorithm preferably outputs the smallest Decision Tree?
I have been following the ML course by Tom Mitchel.
The inherent assumption while using Decision Tree Learning Algo is: The algo. preferably chooses a Decision Tree which is the smallest.
Why is ...
- 499
5
votes
1
answer
101
views
How can artificial intelligence (including deep learning algorithms) find suspicious patterns in the body’s biochemistry?
It has been suggested that machine learning algorithms (also Watson) can help with finding disease in patient images and optimize scans. Also that deep learning algorithms show promise for every type ...
- 10.4k
3
votes
1
answer
134
views
Which learning algorithms are suitable for data leakage detection and prevention?
I'm investigating applications of AI algorithms which can be used for data leakage detection and prevention within an intranet network (like Forcepoint). More specifically detecting traffic patterns. ...
- 10.4k