# Questions tagged [math]

For questions about mathematics related to artificial intelligence.

226 questions
Filter by
Sorted by
Tagged with
330 views

### Which functions can be activation functions?

What are the required characteristics of an activation function (in a neural network)? Which functions can be activation functions? For example, which of the functions below can be used as an ...
229 views

### Defining formula for fuzzy equation

I'm learning fuzzy logic and more or less understand the basic concept, but i'm having a hard time understanding how to apply it to a method. I tried browsing online for explanation on how to use it, ...
121 views

### What is Bayes' theorem?

What is Bayes' theorem? How does it relate to conditional probabilities?
4k views

### What are the mathematical prerequisites to be able to study artificial general intelligence?

What are the mathematical prerequisites to be able to study artificial general intelligence (AGI) or strong AI?
727 views

### How to calculate gradient of filter in convolution network

I have similar architecture like in image:CNN. I don't understand how to calculate gradient of filter F. I found these equations(source): Gradient and delta, where first equation calculate gradient ...
4k views

### What is the derivative of the Leaky ReLU activation function?

I am implementing a feed-forward neural network with leaky ReLU activation functions and back-propagation from scratch. Now, I need to compute the partial derivatives, but I don't know what the ...
237 views

5k views

### Why do activation functions need to be differentiable in the context of neural networks?

Why should an activation function of a neural network be differentiable? Is it strictly necessary or is it just advantageous?
824 views

### Are FFNN (MLP) Lipschitz functions?

My question is regarding standard dense-connected feed forward neural networks with sigmoidal activation. I am studying Bayesian Optimization for hyper-parameter selection for neural networks. There ...
553 views

### Is recursion used in practice to improve performance of AI systems?

Is there any methods by which artificial intelligence use recursion(s) to solve a certain issue or to keep up working and calculating?