We’re rewarding the question askers & reputations are being recalculated! Read more.

Questions tagged [linear-algebra]

For questions about the use/aspects/implementation/intuition/mathematical proofs of various Linear Algebra methods used in Machine Learning and AI algorithms.

Filter by
Sorted by
Tagged with
7
votes
1answer
186 views

Paradigm shift in Machine Learning

In some tweets about NeurIPS 2018, this video from NVIDIA appeared. At around 0.37, she says: ... If you think about the current computations in our deep learning systems, they are all based on ...
5
votes
3answers
263 views

How does neural network classifier classify from just drawing a decision plane?

I understand that a neural network basically distorts(non-linear transformation) and changes the perspective(linear transformations) of input space to draw a plane to classify data. How does the ...
5
votes
1answer
67 views

What makes multi-layer neural networks be able to perform nonlinear operations?

As I know, a single layer neural network can only do linear operations, but multilayered ones can. Alao I recently learned that finite matrices/tensors, which are used in many neural networks can ...
2
votes
0answers
111 views

AlexNet algorith complexity and operations count

I'm first year student in machine learning and I really recently started to immersing myself. I need to calculate number of: matrix additions matrix multiplications matrix divisions which are ...
1
vote
1answer
83 views

Using reinforcement learning to find a preconditioner for linear systems of the form Ax = b

Sparse linear system are normally solved by using solvers like MINRES, Conjugate gradient, GMRES. Efficient preconditioning, i.e., finding a matrix P such that PAx = Pb is easier to solve then the ...
1
vote
1answer
64 views

Weight Normalization paper

I am trying to dissect paper about weight normalization: https://papers.nips.cc/paper/6114-weight-normalization-a-simple-reparameterization-to-accelerate-training-of-deep-neural-networks.pdf ...
1
vote
1answer
155 views

Does k consistency always imply (k - 1) consistency?

From Russell-Norvig: A CSP is strongly k-consistent if it is k-consistent and is also (k − 1)-consistent, (k − 2)-consistent, . . . all the way down to 1-consistent. How can a CSP be k-consistent ...
1
vote
0answers
14 views

Estimating Baselines using ALS

I am trying to figure out how ALS works when minimizing the following formula: $\\ \\$ $\text{min}_{\lbrace b_u,b_i \rbrace} \sum_{(u,i)\in \mathcal{K}} (r_{ui} - \bar{r} - b_u - b_i )^2 + \lambda_{...