# Questions tagged [tensor]

The tag has no usage guidance.

13 questions
Filter by
Sorted by
Tagged with
1 vote
501 views

### What operation is ggml_mul_mat performing? (K×Q in LLaMA)

I’m reading the source code of alpaca.cpp in an attempt to understand how a large language model works. (I have a strong programming background, but almost no math, ...
491 views

### How to calculate a meaningful distance between multidimensional tensors

TLDR: given two tensors $t_1$ and $t_2$, both with shape $(c,h,w),$ how shall the distance between them be measured? More Info: I'm working on a project in which I'm trying to distinguish between an ...
73 views

### What does it mean by "lazy mean" here?

Consider the following paragraph, taken from 3.4: Named Tensors of the textbook named Deep Learning with PyTorch by Eli Stevens et al., regarding the calculation of the mean for RGB channels of an RGB ...
1 vote
698 views

### Not able to understand Pytorch Tensor (Weight & Biases) Size for Linear Regression

Below are the two tensors ...
1k views

### What is the definition of a trace of a tensor?

Tensor is a multi-dimensional ordered collection of elements, which is used in deep learning to store and process data as well as intermediate steps. We are aware of the trace of a two-dimensional ...
19 views

### Do any practical deep learning algorithms deal with tensors containing non-real entries?

In deep learning, most of the applications are from text and images. Both text and images can be converted into a tensor of real numbers. Other than both mentioned above, there may be some other real-...
280 views

### Why using negative integers (as dimensions?) in tensor shapes rather than natural numbers?

Consider the following paragraph from A.1 MULTI-MNIST AND CLEVR of A IMPLEMENTATION DETAILS from the research paper titled ...
36 views

### Cost functions for reducing Tensors to 1-dimensional arrays?

I'm interested in the IT side, here, specifically how I most efficiently store a tensor in a one dimensional data structure. My assumption is that certain approaches will be more expensive than others,...
48 views

### How to visually or intuitively understand single element multi-dimensional tensors?

Consider the following code in PyTorch ...
1 vote
77 views

### Which product operation should be used in affine transformation?

Affine transformation as I am aware can be expressed as either dot product followed by addition or a matrix multiplication followed by addition $$a.x+b$$ $$a^{T}x + b$$ where the first one is based on ...
88 views

### What are the (key) purposes of unsqueezing operation on tensors?

The unsqeeze operation is used in several deep learning algorithms. However, I only found this operation in the code/implementation of the algorithms presented in the papers, which do not mention it. ...