Questions tagged [tensor]
The tensor tag has no usage guidance.
20 questions
0
votes
0
answers
23
views
Moving tensor to cuda reduces precision
I am trying to move a tensor to cuda, but unfortunately, I am loosing precision. The first entry is 5.02e-5 which is converted to 0. Is there a work around?
...
- 1
0
votes
0
answers
29
views
How to tell a model that there are another useful features?
Suppose there is problem of image detection in a CCTV. Look these tensor dimensions below:
...
0
votes
0
answers
18
views
Averaging classification result vs direct infer
Suppose I have tensor X_test with this shape:
(10,2,512) Where:
10 is num of ID
2 is num of Channel of every ID, let's say ...
0
votes
2
answers
112
views
Does 1-bit quantization (layers with boolean tensors) machine learning exist?
Does 1-bit quantization machine learning exist?
Pytorch's docs on "Quantization" define it as:
techniques for performing computations and storing tensors at lower bitwidths than floating ...
- 215
0
votes
0
answers
13
views
Help With Converting NumPy Function To TensorFlow Ops (graph execution issue)
I'm trying to export my command recognition model for deploymenet on embedded devices, however, I'm facing trouble when trying to encapsulate the preprocessing function into my model, that way, when I ...
0
votes
0
answers
23
views
Implement tensor operation with mini batches instead of Matrix multiplication in forward pass
The forward pass in neural network can be written as g(Wx+b). W is the weights Matrix, x is the input vector and b is bias, and g the non linearity, the activation function. However x can have more ...
- 301
3
votes
1
answer
110
views
Are the Dot Product and Tensor Product the same thing in Machine Learning?
I'm currently reading "Deep Learning with Python, Second Edition" by François Chollet, and I need help understanding one thing.
Below paragraph was copied from the page 41
2.2.3 Tensor ...
- 133
1
vote
1
answer
1k
views
What operation is ggml_mul_mat performing? (K×Q in LLaMA)
I’m reading the source code of alpaca.cpp in an attempt to understand how a large language model works. (I have a strong programming background, but almost no math, ...
- 111
2
votes
1
answer
693
views
How to calculate a meaningful distance between multidimensional tensors
TLDR: given two tensors $t_1$ and $t_2$, both with shape $(c,h,w),$ how shall the distance between them be measured?
More Info: I'm working on a project in which I'm trying to distinguish between an ...
- 371
0
votes
1
answer
97
views
What does it mean by "lazy mean" here?
Consider the following paragraph, taken from 3.4: Named Tensors of the textbook named Deep Learning with PyTorch by Eli Stevens et al., regarding the calculation of the mean for RGB channels of an RGB ...
- 3,990
1
vote
1
answer
865
views
Not able to understand Pytorch Tensor (Weight & Biases) Size for Linear Regression
Below are the two tensors
...
- 121
0
votes
1
answer
1k
views
What is the definition of a trace of a tensor?
Tensor is a multi-dimensional ordered collection of elements, which is used in deep learning to store and process data as well as intermediate steps.
We are aware of the trace of a two-dimensional ...
- 3,990
2
votes
0
answers
19
views
Do any practical deep learning algorithms deal with tensors containing non-real entries?
In deep learning, most of the applications are from text and images. Both text and images can be converted into a tensor of real numbers.
Other than both mentioned above, there may be some other real-...
- 3,990
0
votes
1
answer
345
views
Why using negative integers (as dimensions?) in tensor shapes rather than natural numbers?
Consider the following paragraph from A.1 MULTI-MNIST AND CLEVR of A IMPLEMENTATION DETAILS from the research paper titled ...
- 3,990
0
votes
0
answers
37
views
Cost functions for reducing Tensors to 1-dimensional arrays?
I'm interested in the IT side, here, specifically how I most efficiently store a tensor in a one dimensional data structure. My assumption is that certain approaches will be more expensive than others,...
- 6,233
0
votes
2
answers
57
views
How to visually or intuitively understand single element multi-dimensional tensors?
Consider the following code in PyTorch
...
- 3,990
1
vote
0
answers
105
views
Which product operation should be used in affine transformation?
Affine transformation as I am aware can be expressed as either dot product followed by addition or a matrix multiplication followed by addition
$$a.x+b$$
$$a^{T}x + b$$
where the first one is based on ...
- 3,990
0
votes
1
answer
126
views
What are the (key) purposes of unsqueezing operation on tensors?
The unsqeeze operation is used in several deep learning algorithms. However, I only found this operation in the code/implementation of the algorithms presented in the papers, which do not mention it.
...
- 3,990
2
votes
1
answer
126
views
Do researchers generally treat tensors just as mathematical objects with certain shape?
Most of the practical research in AI that includes neural networks deals with higher dimensional tensors. It is easy to imagine tensors up to three dimensions.
When I ask the question How do ...
- 3,990
0
votes
2
answers
2k
views
What is meant by an axis of a tensor?
Tensor is an ordered collection of elements. The elements are generally real numbers. Tensors are used in deep learning for storing data.
There is a wide usage of the word "axis" related to ...
- 3,990