Questions tagged [terminology]

For questions related to the definition of and use of terminology in the context of Artificial Intelligence

Filter by
Sorted by
Tagged with
4 votes
3 answers
884 views

What is a pipeline in machine learning?

I have heard the term "pipeline" used in many different contexts. Now I'm trying to bring some clarity to the terminology: What exactly is a "pipeline" in machine learning?
user946822's user avatar
0 votes
1 answer
74 views

Why is it called multi-headed attention?

Why do we call the attention layer in transformers multi-headed attention when in practice all the attention matrices from different heads (W,K,V) for a single layer are concatenated to perform the ...
Tarique's user avatar
  • 103
0 votes
0 answers
23 views

In the context of lenet, does C1 refer to the conv layer or the output of the conv layer?

I'm studying lenet. C1 is the layer According to a tutorial, C1 is the first convolutional layer with 6 convolution kernels of size 5× 5. C1 is the feature map However, I believe that the part ...
JJJohn's user avatar
  • 221
3 votes
1 answer
738 views

Why there are only three machine learning paradigms: supervised, unsupervised, reinforcement?

I read in books, blogs, and articles that there are three learning paradigms: supervised, unsupervised, and reinforcement. However, I have never found a proof that this list is exhaustive. Can it be ...
Vladislav Gladkikh's user avatar
2 votes
2 answers
380 views

What is a beam?

For example, faster-whisper's transcribe function takes an argument beam_size: Beam size to use for decoding. What does "...
Geremia's user avatar
  • 163
5 votes
2 answers
2k views

What is curriculum learning in reinforcement learning?

I recently came across the term "curriculum learning" in the context of DRL and was intrigued by its potential to improve the learning process. As such, what is curriculum learning? And how ...
Robin van Hoorn's user avatar
1 vote
2 answers
73 views

Is manual binding output to input also an AI?

I know AI is primarly training a machine by samples of input-output in order it would learn itself about relations between the input and the output. What if I manually add the relations? Is that still ...
stkuser's user avatar
  • 13
7 votes
2 answers
461 views

Term for algorithms that are not trained

Before the advent of neural architectures, many AI domains (e.g. speech recognition and computer vision) used algorithms that consisted of a series of hand-crafted transformations for feature ...
Mew's user avatar
  • 181
5 votes
0 answers
556 views

Are "prompt engineering" and "prompt design" used as synonymous?

Are "prompt engineering" and "prompt design" used as synonymous / equivalent terms on the day to day communications (not research papers) in Artificial Intelligence community ? Do ...
Rubén's user avatar
  • 159
1 vote
1 answer
214 views

When is it necessary to explicitly define both the state and observation space in a custom environment?

I'm fairly new to reinforcement learning concepts, and I'm trying to implement a simple custom environment. In my custom environment, I have a scenario where I have multiple continuous state spaces, ...
AlphaBit95's user avatar
1 vote
1 answer
152 views

What is the difference between the term "generative" in classical machine learning and deep learning?

There are lots of explanations on DGM (Deep Generative Model) and generative classifier (most of the explanations on which are about generative classifier vs discriminative classifier) But, I can ...
Rhee's user avatar
  • 111
2 votes
1 answer
335 views

Do the terms 'sample complexity' and 'sample efficiency' mean the same thing in RL context

For example, the the paper Soft Actor-Critic:Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor, both terms are mentioned but without explaining. I have seen them in other ...
Sam's user avatar
  • 175
3 votes
1 answer
272 views

Sutton & Barto: what are parametrized functions?

From "Reinforcement Learning: An introduction (2nd ed.)" by Richard S. Sutton and Andrew G. Barto, on page 59 Instead, the agent would have to maintain $v_\pi$ and $q_\pi$ as parameterized ...
SomeoneUnknown's user avatar
-1 votes
1 answer
236 views

Is my understanding correct regarding the difference between policy and plan?

I am confused regarding the difference between policy and plan in reinforcement learning. According to my understanding, when we calculate the value of state using Bellman equation in deterministic ...
AAA's user avatar
  • 111
1 vote
1 answer
84 views

Does this property in product fuzzy logic have a name and any consequences?

In product fuzzy logic, the $AND$ operator of two variables $x_0$ and $x_1$ is the product $x_0x_1$. Using the $NOT(x)$ as $1-x$, expressions for the other three minterms are easily obtained. $$\...
Jaume Oliver Lafont's user avatar
3 votes
2 answers
1k views

What is the definition of a continuous state/action space?

This question is a result of a discussion with one of my more math-minded friends. When I accidentally mentioned the term continuous state space, he corrected me by saying that I am most probably ...
Saptam's user avatar
  • 67
1 vote
1 answer
45 views

Why could there be "information leak" if we do not use fixed horizons?

In this page Limitations on horizon length from the Imitation library, the authors recommend that the user sticks to fixed horizon experiments because there could be "information leak" ...
aletelecomm's user avatar
0 votes
1 answer
179 views

Confusion about bias in McCulloch-Pitts neurons

I just have a quick question, maybe I am too nit picky here. We recently had an introductory lecture to AI in university and the professor talked about McCulloch-Pitts neurons, e.g. activation as soon ...
DerOeko's user avatar
  • 13
1 vote
0 answers
179 views

Exact definition of WRN-d-k (Wide ResNet)

I am a little confused about the WRN-d-k notation from Wide Residual Networks. To quote the paper, In the rest of the paper we use the following notation: WRN-n-k denotes a residual network that has ...
nalzok's user avatar
  • 271
-1 votes
2 answers
209 views

What is the relationship between data science, artificial intelligence,machine learning and computer vision?

I am beginner to this field and i am trying to find big picture and i have tried to explore youtube and google images in this regard. According to my understanding ,machine learning is subset of ...
DSP_CS's user avatar
  • 171
4 votes
2 answers
2k views

What is the difference between representation and embedding?

As I searched about this two terms, I found they are somehow like each other, both try to create a vector from raw data as I understood. But, what is the difference of this two term?
aliiiiiiiiiiiiiiiiiiiii's user avatar
0 votes
1 answer
69 views

What should be taken as random variables in the distributions of datasets?

Consider the following two paragraphs taken from the paper titles Generative Adversarial Nets by Ian J. Goodfellow et.al #1: Abstract We propose a new framework for estimating generative models via ...
hanugm's user avatar
  • 3,622
0 votes
0 answers
69 views

What is single object localization?

Object detection is said to be combination of object localization and image classification. However, when reviewing localization, I often come across the term "single-object" localization, ...
akastack's user avatar
0 votes
1 answer
69 views

Where does the "rectified" in ReLU come from?

ReLU stands for Rectified Linear Unit. Linear Unit, I understand, since the function is piecewise linear. But what does rectified mean? I looked up the definition and it said: denoting an electric ...
a6623's user avatar
  • 123
1 vote
0 answers
42 views

Is there a name for this model?

I have an image autoencoder model trained as follows: Step 1) train a GAN to obtain a generator capable of drawing from the data manifold by sampling a normal distribution in latent space Step 2) ...
user11305730's user avatar
1 vote
0 answers
66 views

Is item-based collaborative filtering the same thing as content-based filtering?

According to this Google dev page content-based filtering Uses similarity between items to recommend items similar to what the user likes. collaborative filtering Uses similarities between queries ...
s1234567a's user avatar
0 votes
1 answer
141 views

What exactly is the AI explainability problem?

I am pretty new to AI and have recently been paying attention to AI explainability and the fact that it remains a hurdle within the path of commercializing certain AI systems in health for instance. I ...
rp2001's user avatar
  • 1
1 vote
0 answers
91 views

What are semantic word spaces in NLP?

In the abstract of this paper, it's written Semantic word spaces have been very useful but cannot express the meaning of longer phrases in a principled way. I would like to understand what semantic ...
Hermi's user avatar
  • 121
0 votes
1 answer
2k views

What is a "canonical space"?

I am reading the paper on 3D reconstruction, ViSER: Video-Specific Surface Embeddings for Articulated 3D Shape Reconstruction, and I encountered the term "canonical space". What is a "...
Trong-Thang Pham's user avatar
1 vote
2 answers
59 views

What are all the possible usages of 'multilayer perceptron'?

The term 'multilayer perceptron' has been used in literature in various ways in the literature. I am presenting some of them below As a feed-forward neural network [1]. As a fully connected feed-...
hanugm's user avatar
  • 3,622
0 votes
1 answer
189 views

Is the "Helvetica scenario" mentioned here related to Artificial Intelligence?

Consider the following sentence from the original GAN paper titled Generative Adversarial Nets in particular, $G$ must not be trained too much without updating $D$, in order to avoid "the ...
hanugm's user avatar
  • 3,622
2 votes
2 answers
3k views

What is the difference between features and inputs in machine learning?

I have seen many places that features and inputs have been used interchangeably when talking about machine learning especially deep neural networks. I want to know if they are indeed the same thing or ...
user0193's user avatar
  • 145
1 vote
0 answers
36 views

What do "large variables" and "small weights" mean in these sentences?

I'm trying to understand these two points from an article: Models with large variables i.e weight matrices. As a consequence such models have correspondingly large gradients and optimizer states. The ...
NRain's user avatar
  • 111
2 votes
1 answer
281 views

What is a 'degenerate run' in evaluating model performance?

I've recently come across a paper that uses the term "degenerate run", but I'm not sure if I understand what it means. The idea is that when they report the average performance of running ...
Pedram's user avatar
  • 121
1 vote
0 answers
118 views

What does "position" in "each position in the decoder" denote in the Transformer's original paper?

I am reading Attention is All You Need and I feel confused about the word "position" in this paper, by the way I'm not native English speaker which may cause my confusion which has confused ...
zenga's user avatar
  • 11
2 votes
1 answer
135 views

How to construct a reward function for a "wait and see" problem

I'm working on a problem that I think could probably be represented as a reinforcement learning task, but I'm uncertain about how to design the reward function. The core task is essentially a ...
user336650's user avatar
0 votes
0 answers
392 views

Which algorithm can find the best combination of players to maximize the chance of getting a high score?

I am looking for the right terminology for this problem, so I know what to learn about. Imagine a population of 100 people in a town. The town has a sport team with 10 positions that play in ...
vtscop's user avatar
  • 1
5 votes
1 answer
227 views

Does the term "data augmentation" imply increasing the training dataset?

I have a manuscript that has been reviewed and one of the reviewers commented on my use of the term " data augmentation", saying that it might not be the appropriate term in my case (...
Benjamin Cretois's user avatar
1 vote
1 answer
51 views

Should I need to interpret the word "metric" in "performance metric" rigorously?

Consider the following abstract from the research paper titled A Note on the Inception Score for instance Deep generative models are powerful tools that have produced impressive results in recent ...
hanugm's user avatar
  • 3,622
1 vote
1 answer
58 views

What is the name of a feature space which has consistant distance-related properties?

What is the word describing a feature space where distance between two elements has a decisive informational value, whatever the pair of elements is? For example if a model creates embeddings for ...
Sorenai de's user avatar
3 votes
2 answers
3k views

What does it mean by "gradient flow" in the context of neural networks?

Several research papers and textbooks (e.g. this) contain the phrase "gradient flow" in the context of neural networks. I am confused about whether it has any rigorous and formal way of ...
hanugm's user avatar
  • 3,622
0 votes
1 answer
44 views

What does it mean by "dynamics of a sequence" mathematically?

Consider the following paragraph from the topic named sequential models from the textbook titled Dive into Deep Learning Both cases raise the obvious question of how to generate training data. One ...
hanugm's user avatar
  • 3,622
1 vote
1 answer
121 views

Why is it called "area of union" when calculating the Intersection over Union?

When calculating the Intersection Over Union the following explanation is widely used. (Source: A Survey on Performance Metrics for Object-Detection Algorithms, by Padilla et al. 2020) The image and ...
Skid's user avatar
  • 13
0 votes
1 answer
65 views

Is there any subtle difference between kernel and filter in the context of neural netowrks?

Consider the following excerpt from a paragraph, taken from the topic Detecting features with convolutions of the textbook named Deep Learning with PyTorch by Eli Stevens et al., regarding ...
hanugm's user avatar
  • 3,622
0 votes
1 answer
78 views

Is there a standard term for the following flaw in the data?

I wonder if following characteristic of data has some standard "professional" or scientific term associated with it. Let's assume that I have a set of dog/cat images labeled 0 for a cat and ...
GKozinski's user avatar
  • 1,240
1 vote
0 answers
88 views

What do state features mean in the context of inverse RL?

I am reading Zeibart's Inverse RL paper, and it states - The agent is assumed to be attempting to optimize some function that linearly maps the features of each state, $f_{sj} \in \mathbb{R}^k$, to a ...
desert_ranger's user avatar
0 votes
1 answer
75 views

What does it mean by "lazy mean" here?

Consider the following paragraph, taken from 3.4: Named Tensors of the textbook named Deep Learning with PyTorch by Eli Stevens et al., regarding the calculation of the mean for RGB channels of an RGB ...
hanugm's user avatar
  • 3,622
1 vote
1 answer
1k views

What is meant by "lateral connection" in the context of neural networks?

A class of CNN is popular due to the implementation of residual connections. We can use both terms "residual connections" and "skip connections" interchangeably as they refer to ...
hanugm's user avatar
  • 3,622
1 vote
1 answer
566 views

Is the phrase "Feature Pyramid Network" refer to CNN only?

"Feature Pyramid Network" is a network that is used for feature extraction. Since it is pyramid in shape, it might be called so. Consider the following excerpts from two different sources #1 ...
hanugm's user avatar
  • 3,622
1 vote
0 answers
69 views

What does "statistical strength" mean in this context?

Consider the following excerpt from a paragraph taken from chapter 10: Sequence Modeling: Recurrent and Recursive Nets of the textbook named Deep Learning by Ian Goodfellow et al regarding the ...
hanugm's user avatar
  • 3,622

1
2 3 4 5
8