Podcast #128: We chat with Kent C Dodds about why he loves React and discuss what life was like in the dark days before Git. Listen now.

# Questions tagged [linear-algebra]

For questions about the use/aspects/implementation/intuition/mathematical proofs of various Linear Algebra methods used in Machine Learning and AI algorithms.

8 questions
Filter by
Sorted by
Tagged with
14 views

### Estimating Baselines using ALS

I am trying to figure out how ALS works when minimizing the following formula: $\\ \\$ \$\text{min}_{\lbrace b_u,b_i \rbrace} \sum_{(u,i)\in \mathcal{K}} (r_{ui} - \bar{r} - b_u - b_i )^2 + \lambda_{...
187 views

### Paradigm shift in Machine Learning

In some tweets about NeurIPS 2018, this video from NVIDIA appeared. At around 0.37, she says: ... If you think about the current computations in our deep learning systems, they are all based on ...
84 views

### Using reinforcement learning to find a preconditioner for linear systems of the form Ax = b

Sparse linear system are normally solved by using solvers like MINRES, Conjugate gradient, GMRES. Efficient preconditioning, i.e., finding a matrix P such that PAx = Pb is easier to solve then the ...
65 views

### Weight Normalization paper

I am trying to dissect paper about weight normalization: https://papers.nips.cc/paper/6114-weight-normalization-a-simple-reparameterization-to-accelerate-training-of-deep-neural-networks.pdf ...
67 views

### What makes multi-layer neural networks be able to perform nonlinear operations?

As I know, a single layer neural network can only do linear operations, but multilayered ones can. Alao I recently learned that finite matrices/tensors, which are used in many neural networks can ...
156 views

### Does k consistency always imply (k - 1) consistency?

From Russell-Norvig: A CSP is strongly k-consistent if it is k-consistent and is also (k − 1)-consistent, (k − 2)-consistent, . . . all the way down to 1-consistent. How can a CSP be k-consistent ...