Questions tagged [math]

For questions about mathematics related to artificial intelligence.

Filter by
Sorted by
Tagged with
5
votes
2answers
111 views

Are on-line backpropagation iterations perpendicular to the constraint?

Raul Rojas' Neural Networks A Systematic Introduction, section 8.1.2 relates off-line backpropagation and on-line backpropagation with Gauss-Jacobi and Gauss-Seidel methods for finding the ...
2
votes
1answer
109 views

Which matrix represents the similarity between words when using SVD?

Two words can be similar if they co-occur "a lot" together. They can also be similar if they have similar vectors. This similarity can be captured using cosine similarity. Let $A$ be a $n \times n$ ...
3
votes
2answers
70 views

Why is the max a non-expansive operator?

In certain reinforcement learning (RL) proofs, the operators involved are assumed to be non-expansive. For example, on page 6 of the paper Generalized Markov Decision Processes: Dynamic-programming ...
3
votes
0answers
88 views

What characteristics make it difficult for a Neural Network to approximate a function?

What are the characteristics which make a function difficult for the Neural Network to approximate? Intuitively, one might think uneven functions might be difficult to approximate, but uneven ...
13
votes
1answer
4k views

What is the Bellman operator in reinforcement learning?

In mathematics, the word operator can refer to several distinct but related concepts. An operator can be defined as a function between two vector spaces, it can be defined as a function where the ...
1
vote
0answers
21 views

Does a mechanical system repeats itself?

The inverted pendulum problem is a famous control task. It can be solved with a technique called system identification. System identification means to formalize the state-action space of a system in a ...
1
vote
3answers
1k views

What are examples of applications of the Fourier transform to AI?

The (discrete and continuous) Fourier transform (FT) is used in signal processing in order to convert a signal (or function) in a certain domain (e.g. the time domain) to another domain (e.g., ...
2
votes
2answers
204 views

Why is MSE used over other quadratic loss functions?

So I was wondering, why I have only encountered square loss function also known as MSE. The only nice property of MSE I am so far aware of is its convex nature. But then all equations of the form $x^{...
1
vote
3answers
90 views

Is it possible to compute $P( F \mid S )$ given $P(F \mid S,A)$, $P(F \mid S, \lnot A)$?

I have a bayesian network, which has the following data: $P(S) = 0.07$ $P(A) = 0.01$ $P(F \mid S,A) = 1.0$ $P(F \mid S, \lnot A) = 0.7$ $P(F \mid \lnot S, A) = 0.9$ $P(F \mid \lnot S, \lnot A) =...
2
votes
0answers
28 views

Calculating tangent vector of curve s(P,$\alpha$) at given point $\alpha$ = 0

I am reading the paper "Transformation Invariance in Pattern Recognition – Tangent Distance and Tangent Propagation", where the tangent vector is calculated for the given curve $s(P,\alpha)$ at $\...
4
votes
0answers
99 views

What are the main benefits of using Bayesian networks?

I have some trouble understanding the benefits of Bayesian networks. Am I correct that the key benefit of the network is that one does not need to use chain rule of probability in order to calculate ...
3
votes
4answers
336 views

Can we define the AI singularity mathematically?

The "AI Singularity" or "Technological Singularity" is a vague term that roughly seems to refer to the idea of: Humans can design algorithms Humans can improve algorithms Eventually algorithms we ...
1
vote
1answer
63 views

Is the next state drawn from the joint distribution of the previous state and action?

Suppose $G_t$, the discounted return at time $t$ is defined as: $$ G_t \triangleq R_t+\gamma R_{t+1}+\gamma^{2}R_{t+2} + \cdots = \sum_{j=1}^{\infty} \gamma^{k}R_{t+k}$$ where $R_t$ is the reward at ...
1
vote
1answer
162 views

How are vectors and matrices multiplied in supervised machine learning?

I've recently started reading a book about deep learning. The book is titled "Grokking Deep Learning" (by Andrew W Trask). In chapter 3 (pages 44 and 45), it talks about multiplying vectors using dot ...
1
vote
0answers
39 views

Where does the expectation term in the derivative of the soft-max policy come from?

At slide 17 of the David Silver's series, the soft-max policy is defined as follows $$ \pi_\theta(s, a) \propto e^{\phi(s, a)^T \theta} $$ that is, the probability of an action $a$ (in state $s$) is ...
1
vote
0answers
26 views

Since there are different types of neurons in adjacent positions in the brain's arrays, should heterogeneous layers be developed?

Below is a taxonomy of neurons. Some of these types occur in different locations in the brain, but there are adjacent neurons of varying types with clearly functional type diversity in many parts of ...
2
votes
1answer
153 views

Choice of fuzzification function

I'm a relative newbie to fuzzie logic systems but I have some knowledge in mathematics. I have the following problem: I want to fuzzify certain values. Some are in the range [-$\inf$,$\inf$] and some ...
4
votes
1answer
975 views

Why does the “reward to go” trick in policy gradient methods work?

In the policy gradient method, there's a trick to reduce the variance of policy gradient. We use causality, and remove part of the sum over rewards so that only actions happened after the reward are ...
1
vote
2answers
213 views

In the context of importance sampling ratio, how is the equation $\mathbb{E}\left[\rho_{t: T-1} G_{t} | S_{t}=s\right]=v_{\pi}(s)$ derived?

When reading the book by Sutton and Barto, I came across the importance sampling ratio. The first equation, I believe, describes the probability a particular sequence is obtained given the current ...
2
votes
1answer
99 views

Is there a mathematical example for Conditional Random Fields?

I am learning about probabilistic graphical models and I was wondering if there is an example explaining the math behind conditional random fields. Looking solely on the formula, I have no idea what ...
11
votes
2answers
1k views

How do we prove the n-step return error reduction property?

In section 7.1 (about the n-step bootstrapping) of the book Reinforcement Learning: An Introduction (2nd edition), by Andrew Barto and Richard S. Sutton, the authors write about what they call the "n-...
0
votes
1answer
43 views

When will we have computer programs that can compose mathematical proofs?

When will it be possible to give a computer program a bunch of assumptions and ask it if a certain statement is true or false, giving a proof or a counterexample respectively?
3
votes
3answers
430 views

Which neural network should I use to approximate a specific function?

We have convolutional neural networks and recurrent neural networks for analysing respectively images and sequential data. How do I determine which neural network architecture is more appropriate to ...
2
votes
0answers
299 views

Solving equations using reinforcement learning

I was lately curious about a reinforcement learning approach that would solve maths equations. For example, if I have the following equation: $$ f(g(h(w))) = 0 , with \ w = \begin{matrix} a_{11} &...
5
votes
1answer
94 views

Is there a limit of minimum error for a particular training dataset in artificial Neural Network?

In error-based learning using gradient descent, if I give you a training dataset, then can you find the minimum error after training? And the minimum error should be true for all architectures of a ...
2
votes
1answer
184 views

Is there a way of representing the minimax algorithm mathematically?

I have successfully figured out how the minimax algorithm works for a game like chess, where a game tree is used, and you assign a value to the terminal nodes and propagate that value up the tree. Is ...
2
votes
1answer
87 views

Reward-related formulation in reinforcement learning

I am referring to eq. 3.6 (p/g 49) based on Sutton's online book and can be found in an image below. I could not make sense of the final derivation of the equation $r(s, a, s')$. My question is ...
9
votes
2answers
2k views

Which areas of applied math are relevant to AI? [duplicate]

My background is in electrical engineering. I have a good grasp of CS foundations (e.g. data structures, algorithms, operating systems, discrete math and software engineering). I have option of ...
3
votes
1answer
672 views

Is known math really enough for AI

As an Electronics & Communication Engineering student I've heard some stories and theories about "The math we have is not enough to complete a thinker-learner AI." What is the truth? Is humankind ...
2
votes
1answer
127 views

Can you help me understand how weight normalization works?

I am trying to dissect the paper Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks. Unfortunately, because my math is a little bit rusty, I got a little ...
4
votes
2answers
518 views

Why is the derivative 0 if the policy is deterministic?

In the Berkeley RL class they mention the gradient would be 0 if the policy is deterministic. Why is that? https://www.youtube.com/watch?v=XGmd3wcyDg8&feature=youtu.be&t=1071
6
votes
1answer
78 views

What makes multi-layer neural networks able to perform nonlinear operations?

As I know, a single layer neural network can only do linear operations, but multilayered ones can. Also, I recently learned that finite matrices/tensors, which are used in many neural networks, can ...
3
votes
2answers
88 views

Are there any discount-factors based on branching factors?

I recently came across this function: $$\sum_{t = 0}^{\infty} \gamma^t R_t.$$ It's elegant and looks to be useful in the type of deterministic, perfect-information, finite models I'm working with. ...
1
vote
0answers
48 views

Optimization step in Apprenticeship Learning via Inverse Reinforcement Learning

Why the optimization step of the algorithm a quadratic program? [See: Apprenticeship Learning via Inverse Reinforcement Learning; page 3] Isn't the objective function linear? Why don't we treat ...
25
votes
4answers
4k views

Can neural networks be used to prove conjectures?

Imagine I have a list (in a computer-readable form) of all problems (or statements) and proofs that math relies on. Could I train a neural network in such a way that, for example, I enter a problem ...
15
votes
3answers
951 views

What are the mathematical prerequisites for an AI researcher?

What are the mathematical prerequisites for understanding the core part of the algorithms in artificial intelligence and developing own algorithm? Please, refer me the specific books.
3
votes
1answer
187 views

How does one even begin to mathematically model an AI algorithm?

How does one even begin to mathematically model an AI algorithm, like alpha-beta pruning or even its thousands of variations, to determine which variation is best?
15
votes
3answers
7k views

How to choose an activation function?

I choose the activation function for the output layer depending on the output that I need and the properties of the activation function that I know. For example, I choose the sigmoid function when I'm ...
1
vote
0answers
27 views

Simple question about HS algorithm's formul(Optical flow)

In the below pic, I can not understand what U vector is? It says flow field but I can not imagie what really is the flow field?
1
vote
0answers
76 views

How does this sigma work?(Harris algorithm) [closed]

May someone explains some first iterations of this sigma? Also, how did it convert the above expression to below expression? What it the meaning of I(x) and I(y)?
5
votes
1answer
156 views

How could an AI be used to improve the teaching and learning of mathematics?

I have been working with AI methods. I am thinking about how my daughter (and also other kids) could learn mathematics with the help of AI. For example, how could an AI be used to show the mistakes ...
13
votes
2answers
576 views

Is there any scientific/mathematical argument that prevents deep learning from ever producing strong AI?

I read Judea Pearl's The Book of Why, in which he mentions that deep learning is just a glorified curve fitting technology, and will not be able to produce human-like intelligence. From his book ...
3
votes
4answers
1k views

AI applications of the Fibonacci series

I have been looking at Fibonacci series, the golden ratio and its uses in nature, like how flowers and animals grow based on the series. I was wondering whether we could use the Fibonacci series and ...
4
votes
1answer
168 views

Which functions can be activation functions?

What are the required characteristics of an activation function (in a neural network)? Which functions can be activation functions? For example, which of the functions below can be used as an ...
4
votes
1answer
205 views

Defining formula for fuzzy equation

I'm learning fuzzy logic and more or less understand the basic concept, but i'm having a hard time understanding how to apply it to a method. I tried browsing online for explanation on how to use it, ...
0
votes
1answer
115 views

What is Bayes' theorem?

What is Bayes' theorem? How does it relate to conditional probabilities?
6
votes
3answers
4k views

What are the mathematical prerequisites to be able to study general artificial intelligence?

What are the mathematical prerequisites to be able to study general artificial intelligence (AI) or strong AI?
3
votes
0answers
649 views

How to calculate gradient of filter in convolution network

I have similar architecture like in image:CNN. I don't understand how to calculate gradient of filter F. I found these equations(source): Gradient and delta, where first equation calculate gradient ...
1
vote
2answers
4k views

What is the derivative of the Leaky ReLU activation function?

I am implementing a feed-forward neural network with leaky ReLU activation functions and back-propagation from scratch. Now, I need to compute the partial derivatives, but I don't know what the ...
3
votes
3answers
226 views

Understanding a few terms in Andrew Ng's definition of the cost function for linear regression

I have completed week 1 of Andrew Ng's course. I understand that the cost function for linear regression is defined as $J (\theta_0, \theta_1) = 1/2m*\sum (h(x)-y)^2$ and the $h$ is defined as $h(x) = ...