Questions tagged [theory]

Use for questions on AI theory and other theoretical subjects related to AI.

20 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
0answers
32 views

Batch PTA stopping condition

I am reviewing my Neural Network lectures and I have a doubt: My book's (Haykin) batch PTA describes a cost function which is defined over the set of the misclassified inputs. I have always been ...
2
votes
0answers
55 views

Is there any application of topology to deep learning?

Is there any application of topology (as in math discipline) to deep learning? If so, what are some examples?
2
votes
0answers
34 views

Is there a theory that captures the following ideas?

A big class of problems that are relevant in today's society are full of uncertainty and are also sometimes computationally intractable. Along our lives we come to realize that we are solving the same ...
2
votes
0answers
20 views

Suitable kernels for Gaussian processes

Consider a stochastic process $\{X_t \colon t \in T\}$ indexed by a set $T$. We assume for simplicty that $T \in \mathbb{R}^n$. We assume that for any choice of indexes $t_1, \dots, t_n$, the random ...
2
votes
0answers
27 views

Did people analyze dynamics of very simple LSTMs?

I wonder if researchers tried to understand how LSTMs work by analyzing the dynamics of simple LSTM (e.g. with 2 units)? For example how the hidden state evolves depending on the properties of weight ...
2
votes
0answers
473 views

What does “episodic training” mean?

I'm reading the book Hands-On Meta Learning with Python, and in Prototypical networks said: So, we use episodic training—for each episode, we randomly sample a few data points from each class in ...
2
votes
0answers
80 views

Is this a problem well suited for machine learning?

The light-field of a certain scene is the set of all light rays that travel through the volume of that scene at a specific point of time. A light-field camera for example captures and stores a subset ...
2
votes
0answers
43 views

Why do neural networks have bias units?

Why do neural networks have bias units? Why is it sometimes okay to opt them out?
2
votes
0answers
72 views

An idea I had to create the first Humanoid using Deep Learning

I've come up with an idea on how we could use a combination of Deep Learning and body sensors to create a walking talking living humanoid. Here goes: First, we will recruit 1 billion people and have ...
1
vote
1answer
50 views

Flowchart for a simplified perceptron leaning algorithm [critique request]

I made a flowchart for a simplified perceptron leaning algorithm. Here is the process of the leaning algorithm. Step_1: Initialize the weights first. Step_2: Get a training example randomly and make ...
1
vote
0answers
29 views

What would happen if we set the evaluation function in the best-first search algorithm as the cost of paths taken to new nodes?

I am reading AI: A Modern Approach. In Chapter 3, Section 3.3.1, The best-first search algorithm is introduced. We learn that in each iteration, this algorithm chooses which node to expand based on ...
1
vote
1answer
41 views

What are the different types of goals for an AI system called?

I remember reading about two different types of goals for an intelligence. The gist was that the first type of goal is one that "just is" - it's an end goal for the system. There doesn't ...
1
vote
0answers
31 views

How would you differentiate between different on-policy reinforcement learning algorithms?

How would you differentiate between different on-policy reinforcement learning algorithms?
1
vote
0answers
17 views

Theoretical grounding for ease of training with a prior

If we have a neural network that learns the generative model for P(A, B, C) And now, we want to learn the generative model for P(A, B, C, D) Is there any theory that says learning P(A,B,C) and then ...
1
vote
0answers
272 views

Analogies and similarity

The more I think about machine learning the more I realize the importance of finding similarities by using analogies as a way of learning. If I want to categorize words into hierarchical tree this ...
0
votes
0answers
28 views

How to detect dynamic hand gestures?

I already know how to detect static hand gestures like fist, peace etc. I wonder however, how to detect dynamic hand gestures like swipe left/right or "draw" circle with hand. Is some kind ...
0
votes
0answers
82 views

What is the difference between learning agents and other kinds of agents, and more specifically, between performance standard and performance measure?

I am reading AI: A Modern Approach. In the 2nd chapter when introducing different agent types, i.e., reflex, utility-based, goal-based, and learning agents, I understood that all types of agents, ...
0
votes
0answers
21 views

The convolutional network architectures with enhanced invariance

It is well known, that CNN have advantage with respect to the Dense neural networks in the image classification and other pattern recognition tasks, because they have a translationall invariance built ...
0
votes
0answers
35 views

Is it a good idea to train a neural network to classify images without base-hypothesis?

I'm a relative beginner in deep-learning (understand by that, I'm doing my first kaggle competition right now, and I have loads to learn still) and I was just wondering something. Let's say you have ...
0
votes
0answers
29 views

Superhuman AI to disguise as human players

TL;DR below. You entered a online mini video game. It's a fast-paced hypercasual game. But it's a ranked one - top 10 get prizes. The leaderboard resets and prizes are handed out every couple of ...