Questions tagged [linear-algebra]

For questions about the use/aspects/implementation/intuition/mathematical proofs of various Linear Algebra methods used in Machine Learning and AI algorithms.

Filter by
Sorted by
Tagged with
-2
votes
1answer
71 views

What does the cos (or sin) function actually do? [closed]

In the context of ML, using the example equation below, what is the cos function actually doing? It would be great if you could tell me the answer to this very simple example and how you came to the ...
1
vote
0answers
24 views

CSP Formulation of an algebraic problem

Is anyone able to explain how to do this? I'm not looking for the complete answer, I would settle for a "how to for dummies" explanation of how this is supposed to be solved. I understand ...
1
vote
0answers
14 views

Estimating Baselines using ALS

I am trying to figure out how ALS works when minimizing the following formula: $\\ \\$ $\text{min}_{\lbrace b_u,b_i \rbrace} \sum_{(u,i)\in \mathcal{K}} (r_{ui} - \bar{r} - b_u - b_i )^2 + \lambda_{...
7
votes
1answer
196 views

What does it mean to do multi-dimensional processing with tensors in tensor cores?

In some tweets about NeurIPS 2018, this video from NVIDIA appeared. At around 0.37, she says: If you think about the current computations in our deep learning systems, they are all based on Linear ...
1
vote
1answer
108 views

Using reinforcement learning to find a preconditioner for linear systems of the form Ax = b

Sparse linear system are normally solved by using solvers like MINRES, Conjugate gradient, GMRES. Efficient preconditioning, i.e., finding a matrix P such that PAx = Pb is easier to solve then the ...
2
votes
1answer
77 views

Weight Normalization paper

I am trying to dissect paper about weight normalization: https://papers.nips.cc/paper/6114-weight-normalization-a-simple-reparameterization-to-accelerate-training-of-deep-neural-networks.pdf ...
5
votes
1answer
67 views

What makes multi-layer neural networks be able to perform nonlinear operations?

As I know, a single layer neural network can only do linear operations, but multilayered ones can. Alao I recently learned that finite matrices/tensors, which are used in many neural networks can ...
1
vote
1answer
175 views

Does k consistency always imply (k - 1) consistency?

From Russell-Norvig: A CSP is strongly k-consistent if it is k-consistent and is also (k − 1)-consistent, (k − 2)-consistent, . . . all the way down to 1-consistent. How can a CSP be k-consistent ...
5
votes
3answers
292 views

How does neural network classifier classify from just drawing a decision plane?

I understand that a neural network basically distorts(non-linear transformation) and changes the perspective(linear transformations) of input space to draw a plane to classify data. How does the ...
2
votes
0answers
119 views

AlexNet algorith complexity and operations count

I'm first year student in machine learning and I really recently started to immersing myself. I need to calculate number of: matrix additions matrix multiplications matrix divisions which are ...