Questions tagged [math]

For questions about mathematics related to artificial intelligence.

73 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
0
votes
0answers
13 views

Predict a part of the input based of the output

I'm working on a fun project where I have a dataset of input and output data, both having a fixed size of characters. I would like to predict a part of the input based on a known output as follows: $$...
0
votes
1answer
22 views

Is the range of inception score flexible or bounded based on number of classes?

Inception score is used to evaluate the generative models. It is a score given based on quality and diversity of images generated. I have doubt about the range of inception score because of the reason ...
0
votes
0answers
31 views

Is there any geometrical interpretation on overcoming gradient related problems by adjusting/changing loss function?

There are instances in literature where we need to change loss function in order to escape from gradient problems. Let $L_f$ be a loss function for a model I need to train on. Some times $L_f$ leads ...
0
votes
0answers
14 views

A 2D distance measure that gives weightage to the angle between the two points?

n1 n8 n7 n2 c n6 n3 n4 n5 Assume that all neighbors ni are (Euclidean) ...
0
votes
1answer
31 views

What is meant by "well-behaved gradient" in this context?

Consider the following statement about the success of discriminative models So far, the most striking successes in deep learning have involved discriminative models, usually those that map a high-...
0
votes
0answers
22 views

Derivation of an probability expansion used in Word2Vec classifier model

We are using the following notations, for this question, to calculate the probability values \begin{array}{|c|c|} \hline \text{$w$} & \text{target word embedding vector} \\ \hline \text{$c$} &...
0
votes
0answers
20 views

Are there any good references that describe the equations of the forward pass of Graph Neural Networks?

I am trying to program Graph Neural Network from scratch. Can the community please suggest a good reference/s to read about the equations of the forward pass in Graph Neural Networks, especially in ...
0
votes
0answers
24 views

(Deep) feature engineering for lambda terms (mathematical expressions, higher order logic formulas) - is such thing?

Automated theorem proving with (deep) reinforcement learning (DRL) approach is hot topic in current AI research when domains of games are becoming saturated and completed research topics. For example, ...
0
votes
1answer
57 views

Why don't integrated gradients explain samples correctly?

I have a linear tabular dataset made of floats. The dataset follows a simple rule like: ...
0
votes
0answers
17 views

How do we get from entropy to KL divergence in this paper?

I'm reading through Regularizing Neural Networks By Penalizing Confident Output Distributions and I'm stuck on the equation in section 3.2. It's not clear to me at all that the self-entropy of the ...
0
votes
0answers
24 views

Do $V_\theta$ and $V_s$ represent partial or total derivatives in the paper "Learning Continuous Control Policies by Stochastic Value Gradients"?

I was reading up on the Stochastic Value Gradients paper by Heess et al. In the paper, they describe a recursive process to calculate path-wise derivatives via equations (3) and (4), at the bottom of ...
0
votes
0answers
45 views

What are the math theorems regarding the Multilayer Perceptron?

I've come across a theorem "Convergence theorem Simple Perceptron" for the first time, here-> https://zaguan.unizar.es/record/69205/files/TAZ-TFG-2018-148.pdf, page 27, (is in Spanish) ...
0
votes
1answer
77 views

Why can a neural network use more than one activation function?

From trying to understand neural networks better, I've come upon a tentative notion that an activation function aims to build a function it's approximating via linear combinations with biases and ...
0
votes
0answers
14 views

Is there an arrow missing in the derivation of front-door adjustment formula from do-calculus?

Here is Judea Pearl's derivation of the front-door adjustment formula: Is there an arrow from Genotype to Cancer missing in the second diagram at the right? just like this?
0
votes
0answers
71 views

Meaning of grad_outputs in torch.autograd.grad for complex input and output

Let's say we have a mathematical expression, $$ \mathbf{y} = \mathbf{Ax}, $$ where $\mathbf{y}$ and $\mathbf{x}$ are a vector, and $\mathbf{A}$ is a matrix. Let's say the vector $\mathbf{y}$ is used ...
0
votes
0answers
16 views

Is parameter sharing in AlBERT akin to repeated application of same function on input?

I read the AlBERT and saw that its architecture used "Parameter Sharing" among layers of the encoder. They mentioned that this was done to save model space, make fewer training parameters ...
0
votes
0answers
45 views

Can I solve the below functional equation using neural networks?

I recently watched this video, in which he solves the equation $$f(x)+f\left(\frac{1}{1-x}\right) = x$$ The answer is $$f(x) = \frac{x^3-x+1}{2x(x-1)}$$ I tried to solve this functional equation using ...
0
votes
1answer
69 views

Is it possible to know the distance objects are from camera based on only knowing one object's height?

I am doing a project where I have to know distance a particular object is from camera. In the photo I only know one of the object's height, but I don't know how far away that object is and I don't ...
0
votes
0answers
89 views

Derivation of regularized cost function w.r.t activation and bias

In regularzied cost function a L2 regularization cost has been added. Here we have already calculated cross entropy cost w.r.t $A, W$. As mentioned in the regularization notebook (see below) in ...
0
votes
0answers
57 views

How can the V and Q functions take the expectation over a sum where the number of summands is random?

Assume the existence of a Markov Decision Process consisting of: State space $S$ Action space $A$ Transition model $T: S \times A \times S \to [0,1]$ Reward function $R: S \times A \times S \to \...
-1
votes
0answers
14 views

About the proper method to make some mathematical model from AI trained Weights (Parameters)

If possible, I like to know about the available methods for creating the summarized mathematical models from the trained AI weights. For example, I need to make some summarized model from the trained ...
-1
votes
1answer
33 views

how to go from mathematical problem to neural network (and back)?

I am a little confused on how, you can find online papers that describe complex Machine Learning formulas in a mathematical/probabilistic way, and, in the other hands, easy tutorials that teach you ...
-2
votes
1answer
106 views

Why the optimal Bellman operator of a Q-function can be approximated by a single point

I am currently studying reinforcement learning, especially DQN. In DQN, learning proceeds in such a way as to minimize the norm (least-squares, Huber, etc.) of the optimal Bellman equation and the ...

1
2