Skip to main content
8 votes
Accepted

Do full-text translators such as DeepL or Google Translate fall under the term "Generative AI"?

Generative AI, as defined by IBM research, refers to deep-learning models capable of creating new content, be it text, images, or other media, based on their training data. This definition indeed ...
FledDev's user avatar
  • 204
7 votes

Do full-text translators such as DeepL or Google Translate fall under the term "Generative AI"?

The distinction between "generative" and "non-generative" AI isn't an especially useful one. A language model (to first approximation) takes a sentence as input and tells you how ...
Ray's user avatar
  • 346
5 votes
Accepted

Why there are only three machine learning paradigms: supervised, unsupervised, reinforcement?

You can formulate RL and unsupervised learning as "some sort of supervised learning"... in the case of UL you have that the target is an handcrafted task, it being similarity learning, next ...
Alberto's user avatar
  • 2,273
5 votes

Do full-text translators such as DeepL or Google Translate fall under the term "Generative AI"?

Actually it depends, generative models are specific kind of machine learning models. Generative often means a model that models the probability distribution of data $p(x)$, you cannot do translation ...
Dr. Snoopy's user avatar
  • 1,345
4 votes
Accepted

Are the Dot Product and Tensor Product the same thing in Machine Learning?

In machine learning, a tensor is a multidimensional array with some operations. In mathematics, the definition of a tensor is slightly different (see the Wikipedia article). However, the definitions ...
nbro's user avatar
  • 40.9k
4 votes

What is a pipeline in machine learning?

A data pipeline consists of 3 main steps data collection (e.g. you collect images of cats from different sources) data transformation (e.g. you make the images all have the same dimensions and maybe ...
nbro's user avatar
  • 40.9k
3 votes
Accepted

What is a beam?

Beam search The beam search is a algorithm to find probable output sequences for an input sequence, so it has been used for decoding in the context of sequence-to-sequence tasks, like machine ...
nbro's user avatar
  • 40.9k
3 votes

What is a pipeline in machine learning?

A "pipeline" typically refers to a chain of methods where the output of the one is used as the input of another method. This could be, e.g., a "preprocessing pipeline" where ...
BanDoP's user avatar
  • 193
3 votes

Would a pipeline of different models be considered Ensemble Learning?

No. Ensemble Learning (EL) is a way to improve the model performance, which usually means to reduce bias (i.e., get a better model class) or reduce variance (i.e., get better at generalizing across ...
Luca Anzalone's user avatar
2 votes

Would a pipeline of different models be considered Ensemble Learning?

Would a system like this, which takes the output of one model and uses it as the input for another, be considered Ensemble Learning? Not usually. The main criteria to consider something as an ...
Neil Slater's user avatar
  • 32.7k
2 votes
Accepted

Why is it called multi-headed attention?

The original paper "Attention is all you need" mentions the following. " Instead of performing a single attention function with $ d_{model} $-dimensional keys, values and queries, we ...
Sathishkumar Thirumalai's user avatar
2 votes

Exact definition of WRN-d-k (Wide ResNet)

I also found the WRN-$n$-$k$ notation confusing, but I think I can explain it: $n$ is the total number of convolutions in the model. So to understand the architecture associated with each $n$, we ...
Kale Kundert's user avatar
2 votes

Do full-text translators such as DeepL or Google Translate fall under the term "Generative AI"?

The original question has been updated so my answer is being updated to reflect this. The question being asked can be boiled down to just "What is it that makes something a generative AI?" I ...
Chthonic One's user avatar
2 votes
Accepted

What does it mean to "learn a distribution", and what does it contain?

Learning the distribution: When we talk about learning a distribution, we are essentially trying to capture the underlying statistical properties of the data. In other words, we try to capture the ...
Robin van Hoorn's user avatar
1 vote

What is an "inference kernel"?

Given the context and similar usage, they're probably referring to compute kernels in GPUs. This OpenAI blog post seems informative for more on this topic.
Alexander Wan's user avatar
1 vote

What constitutes a 'backdoor' attack in machine learning models?

As discussed in this tech blog: Machine learning backdoors are techniques that implant secret behaviors into trained ML models. The model works as usual until the backdoor is triggered by specially ...
cinch's user avatar
  • 2,277
1 vote

What does it mean if I trained my model with more steps per epoch than the total number of training images I have?

Welcome to AI.stackexchange! To answer your question more precisely, it would be helpful to provide a minimum working example of your code where we can see how you implemented your training loop. ...
tanasr's user avatar
  • 92
1 vote
Accepted

In the paper "LLM in a flash," what is meant by an up projection or down projection layer?

Up-project and down-project refer to the first and second feed forward layer respectively, found in each transformer block. They use this in the context of sparsity in the feedforward layers in each ...
Alexander Wan's user avatar
1 vote

What is a beam?

Here is Guillaume Klein's answer at the issue section of the Git repository:   "Beam Search" in Wikipedia:   Additionally, the beam size/beam width is controlling the number of paths that ...
Cloud Cho's user avatar
  • 181

Only top scored, non community-wiki answers of a minimum length are eligible