As of May 31, 2023, we have updated our Code of Conduct.

# Tag Info

Accepted

### How to express a fully connected neural network succintly using linear algebra?

The equation $$\hat{y} = \sigma(xW_\color{green}{1})W_\color{blue}{2} \tag{1}\label{1}$$ is the equation of the forward pass of a single-hidden layer fully connected and feedforward neural network, i....
Accepted

### How do you find the homography matrix given 4 points in both images?

To understand homographies and how to find them, you will need a good dose of projective geometry. I will briefly describe some preliminary concepts that you need to know before trying to find the ...

### Is there any difference between affine transformation and linear transformation?

In linear algebra, a linear transformation (aka linear map or linear transform) $f: \mathcal{V} \rightarrow \mathcal{W}$ is a function that satisfies the following two conditions $f(u + v)=f(u)+f(v)$ ...

### How can we find the value function by solving a system of linear equations?

Provided you have a finite number of states and actions, then there will not be an infinite number of terms. Therefore the state and action spaces need to be discrete and finite before the quote from ...
Accepted

### Why is the derivative of the softmax layer shaped differently than the derivative of other neurons?

When you use the softmax activation function is usually as a last layer of your network and to get an output that is a vector. Now your confusion is about shapes, so let's review a bit of calculus. If ...
Accepted

### Why MLP cannot approximate a closed shape function?

In neural networks, the family of functions and the shapes that they can make for decision surfaces is determined by the activation function you use (in your case, ...
Accepted

### Which linear algebra book should I read to understand vectorized operations?

If you already have two years of a bachelor's of mathematics, I recommend part I of the book that you're mentioning. That part of the book reviews the main mathematics used in the optimization of ...

### Does k consistency always imply (k - 1) consistency?

Define P as a CSP where X, Y are the variables, domain of both is {1,2,3,4} and conditions in normal form are: node-condition X<4 arc-condition X=Y P is 2-consistent (arc consistent) because for ...

### What does it mean to do multi-dimensional processing with tensors in tensor cores?

Both PR and Theoretically Valid Although Anima Anandkumar's presentation is a puff piece for NVidia, her representation is not contrary to theory. ... next level [above NVidia's GPU success] ... ...

### How does PCA work when we reduce the original space to 2 or higher-dimensional space?

You might want to have a look at the wikipedia article of PCA, where it says: "The $k$th component can be found by subtracting the first $k − 1$ principal components from $\mathbf{X}$:" \...

1 vote
Accepted

### What exactly is the eigenspace of a graph (in spectral clustering)?

In spectral clustering we not find the eigenvectors of a graph (a graph is not a matrix) but the eigenvalues/eigenvectors of the Laplacian matrix related to the adjacency matrix of the graph: graph =&...
1 vote

### What do we mean by 'principal angle between subspaces'?

Let's consider the case where you have two photos, one base photo and one other photo which is a scaled version of the base photo. Consider then that you could create a 'mapping' from the base photo ...
1 vote

### Is there any way to apply linear transformations on a vector other than matrix multiplication?

You can sometimes exploit the structure of your matrix to perform faster matrix multiplication. For example, if your matrix is sparse (or dense), there are algorithms that exploit this fact. In your ...
1 vote

### Which linear algebra book should I read to understand vectorized operations?

Linear Algebra Done Right by Axler seems to be the best book on linear algebra, with a brisk and modern approach.
1 vote

### Using reinforcement learning to find a preconditioner for linear systems of the form Ax = b

Reinforcement Learning is a method for learning to perform beneficial actions in an environment. One way this is accomplished is by learning to predict useful actions as a function of the observed ...
1 vote

### How does neural network classifier classify from just drawing a decision plane?

For other who were wondering the same questions as me, I'll answer it. My view above was inconsistent. Ultimately the last layer of simple feed-forward networks don't have any special properties ...

Only top scored, non community-wiki answers of a minimum length are eligible