Skip to main content

All Questions

Tagged with
Filter by
Sorted by
Tagged with
3 votes
1 answer
588 views

Do the terms 'sample complexity' and 'sample efficiency' mean the same thing in RL context

For example, the the paper Soft Actor-Critic:Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor, both terms are mentioned but without explaining. I have seen them in other ...
Sam's user avatar
  • 195
-1 votes
1 answer
452 views

Is my understanding correct regarding the difference between policy and plan?

I am confused regarding the difference between policy and plan in reinforcement learning. According to my understanding, when we calculate the value of state using Bellman equation in deterministic ...
AAA's user avatar
  • 111
1 vote
0 answers
117 views

Is item-based collaborative filtering the same thing as content-based filtering?

According to this Google dev page content-based filtering Uses similarity between items to recommend items similar to what the user likes. collaborative filtering Uses similarities between queries ...
s1234567a's user avatar
1 vote
2 answers
68 views

What are all the possible usages of 'multilayer perceptron'?

The term 'multilayer perceptron' has been used in literature in various ways in the literature. I am presenting some of them below As a feed-forward neural network [1]. As a fully connected feed-...
hanugm's user avatar
  • 3,990
2 votes
2 answers
5k views

What is the difference between features and inputs in machine learning?

I have seen many places that features and inputs have been used interchangeably when talking about machine learning especially deep neural networks. I want to know if they are indeed the same thing or ...
user0193's user avatar
  • 145
1 vote
1 answer
660 views

How is the VAE related to the Autoencoding Variational Bayes (AEVB) algorithm?

I am familiar with the variational autoencoder, but not totally clear on what exactly the AEVB is. In the original VAE paper (by Kingma and Welling), he uses both the terms variational autoencoder and ...
a12345's user avatar
  • 243
1 vote
1 answer
1k views

Is there any difference between an objective function and a value function?

I found the usage of both objective function and value function in the same context. Context #1: In the paper titled Generative Adversarial Nets by Ian J. Goodfellow et al. We simultaneously train G ...
hanugm's user avatar
  • 3,990
0 votes
1 answer
311 views

Is "kernel" different from "filter" in convolutional neural networks?

Recently I asked a question on how a convolution 2d layer changes an RGB image into a grayscale image. Assume that our task is to convert an RGB image into a grayscale image. I use to believe that ...
hanugm's user avatar
  • 3,990
0 votes
1 answer
571 views

Is my understanding on "smooth approximation" correct?

Consider the following details regarding Softplus activation function $$\text{Softplus}(x) = \dfrac{\log(1+e^{\beta x})}{\beta}$$ SoftPlus is a smooth approximation to the ReLU function and can be ...
hanugm's user avatar
  • 3,990
2 votes
1 answer
860 views

Is there any difference between "image generation" and "image synthesis"?

Generative Adversarial networks (aka GANs) are used for image generation. The phrase image synthesis is also used in literature. I know that the phrase image generation stands for An act of ...
hanugm's user avatar
  • 3,990
2 votes
0 answers
94 views

Do the terms multi-task and multi-output refer to the same thing in the context of deep learning?

Do the terms multi-task and multi-output refer to the same thing in the context of deep learning (with neural networks)? For example, do neural networks for multi-task learning use multiple outputs? ...
user366312's user avatar
0 votes
2 answers
829 views

What is the exact difference between distributional semantics and distributed semantics?

While studying word embeddings in natural language processing, I encountered the following statement on page 327 of the textbook Natural Language Processing by Jacob Eisenstein Distributional ...
hanugm's user avatar
  • 3,990
3 votes
1 answer
5k views

What is the difference between terminal state, nonterminal states and normal states?

In Sutton & Barto's Reinforcement Learning: An Introduction, page 54, the authors define the terminal state as following: Each episode ends in a special state called the terminal state But the ...
Daviiid's user avatar
  • 573
1 vote
2 answers
7k views

What is the difference between "ground truth" and "ground-truth labels"?

I'm aware that the ground-truth of the example at the top left-hand corner of the image below is "zero" However, I am confused about the meaning of the terms ground truth and ground-truth ...
JJJohn's user avatar
  • 217
2 votes
1 answer
253 views

Is categorical encoding a type of word embedding?

Word embedding refers to the techniques in which a word is represented by a vector. There are also integer encoding and one-hot encoding, which I will collectively call categorical encoding. I can see ...
hanugm's user avatar
  • 3,990
4 votes
1 answer
2k views

Where do the feature extraction and representation learning differ?

Feature selection is a process of selecting a subset of features that contribute the most. Feature extraction allows getting new features that are not actually present in the given set of features. ...
hanugm's user avatar
  • 3,990
4 votes
1 answer
211 views

What is the relation between self-taught learning and transfer learning?

I am new to transfer learning and I start by reading A Survey on Transfer Learning, and it stated the following: according to different situations of labeled and unlabeled data in the source domain, ...
Kais Hasan's user avatar
5 votes
3 answers
1k views

What's the difference between architectures and backbones?

In the paper "ForestNet: Classifying Drivers of Deforestation in Indonesia using Deep Learning on Satellite Imagery", the authors talk about using: Feature Pyramid Networks (as the ...
codinggirl123's user avatar
1 vote
1 answer
652 views

What is the difference between sensitivity analysis and parameter tuning?

I tried different values of genetic algorithm operators: many crossover rates from 20% to 80% many crossover rates from 1% to 20% varying the population size The study of different parameter values ...
fathese's user avatar
  • 131
17 votes
2 answers
7k views

What is the difference between active learning and online learning?

The definitions for these two appear to be very similar, and frankly, I've been only using the term "active learning" the past couple of years. What is the actual difference between the two? ...
David's user avatar
  • 313
5 votes
3 answers
4k views

What are the differences between a knowledge base and a knowledge graph?

During my readings, I have seen many authors using the two terms interchangeably, i.e. as if they refer to the same thing. However, we all know about Google's first quotation of "knowledge graph&...
Betty's user avatar
  • 151
8 votes
2 answers
2k views

What is the difference between the prediction and control problems in the context of Reinforcement Learning?

What is the difference between the prediction (value estimation) and control problems in reinforcement learning? Are there scenarios in RL where the problem cannot be distinctly categorised into the ...
user avatar
6 votes
3 answers
1k views

What is the difference between artificial intelligence and swarm intelligence?

Artificial intelligence (AI) refers to the simulation of human intelligence in machines that are programmed to think like humans and mimic their actions. The term may also be applied to any machine ...
Pluviophile's user avatar
  • 1,283
5 votes
1 answer
2k views

Are model-free and off-policy algorithms the same?

In respect of RL, is model-free and off-policy the same thing, just different terminology? If not, what are the differences? I've read that the policy can be thought of as 'the brain', or decision ...
mason7663's user avatar
  • 633
3 votes
2 answers
626 views

Why are the terms classification and prediction used as synonyms in the context of deep learning?

Why are the terms classification and prediction used as synonyms especially when it comes to deep learning? For example, a CNN predicts the handwritten digit. To me, a prediction is telling the next ...
MScott's user avatar
  • 445
3 votes
1 answer
737 views

What is the difference between the concepts "known environment" and "deterministic environment"?

According to the book "Artificial Intelligence: A Modern Approach", "In a known environment, the outcomes (or outcome probabilities if the environment is stochastic) for all actions are given.", and ...
Miguel A.'s user avatar
2 votes
0 answers
99 views

What is the difference between tracking and mapping (TAM) and localization and mapping (LAM)?

In the paper Visual SLAM algorithms: a survey from 2010 to 2016 by Takafumi Taketomi, Hideaki Uchiyama and Sei Ikeda it is mentioned It should be noted that tracking and mapping (TAM) is used instead ...
Justaperson's user avatar
2 votes
2 answers
1k views

What is the difference between a learning algorithm and a hypothesis?

What's the distinction between a learning algorithm $A$ and a hypothesis $f$? I'm looking for a few concrete examples, if possible. For example, would the decision tree and random forest be considered ...
Shirish's user avatar
  • 403
3 votes
1 answer
3k views

What are the major differences between cost, loss, error, fitness, utility, objective, criterion functions?

I find the terms cost, loss, error, fitness, utility, objective, criterion functions to be interchangeable, but any kind of minor difference explained is appreciated.
Stephen Philip's user avatar
3 votes
1 answer
704 views

What is the difference between image processing and computer vision?

What is the difference between image processing and computer vision? They are apparently both used in artificial intelligence.
DSP_CS's user avatar
  • 181
4 votes
1 answer
776 views

Is there any difference between a control and an action in reinforcement learning?

There are reinforcement learning papers (e.g. Metacontrol for Adaptive Imagination-Based Optimization) that use (apparently, interchangeably) the term control or action to refer to the effect of the ...
nbro's user avatar
  • 41.4k
1 vote
0 answers
270 views

What is the difference between Knowledge Representation and Automated Reasoning?

Knowledge Representation and Automated Reasoning are two AI subfields which seem to have something to do with reasoning. However, I can't find any information online about their relationship. Are ...
olinarr's user avatar
  • 759
12 votes
3 answers
5k views

Is REINFORCE the same as 'vanilla policy gradient'?

I don't know what people mean by 'vanilla policy gradient', but what comes to mind is REINFORCE, which is the simplest policy gradient algorithm I can think of. Is this an accurate statement? By ...
yewang's user avatar
  • 361
23 votes
2 answers
15k views

What is the difference between reinforcement learning and optimal control?

Coming from a process (optimal) control background, I have begun studying the field of deep reinforcement learning. Sutton & Barto (2015) state that particularly important (to the writing of the ...
Bionic Buffulo's user avatar
4 votes
1 answer
144 views

What is the difference between a problem representation and problem modelling?

As far as I know, a problem representation is the formulation of the problem in a way that it can be programmed and therefore solved (for example, you can represent the $N$-queens problem by using an ...
Jay Critch's user avatar
5 votes
2 answers
6k views

What is "planning" in the context of reinforcement learning, and how is it different from RL and SL?

This is an excerpt taken from Sutton and Barto (pg. 3): Another key feature of reinforcement learning is that it explicitly considers the whole problem of a goal-directed agent interacting with an ...
user avatar
10 votes
1 answer
4k views

What is the difference between an episode, a trajectory and a rollout?

I often see the terms episode, trajectory, and rollout to refer to basically the same thing, a list of (state, action, rewards). Are there any concrete differences between the terms or can they be ...
Paula Vega's user avatar
12 votes
1 answer
20k views

What is the definition of "soft label" and "hard label"?

In semi-supervised learning, there are hard labels and soft labels. Could someone tell me the meaning and definition of the two things?
ellie's user avatar
  • 121
16 votes
1 answer
6k views

What is the difference between a receptive field and a feature map?

In a CNN, the receptive field is the portion of the image used to compute the filter's output. But one filter's output (which is also called a "feature map") is the next filter's input. What's the ...
Monica Heddneck's user avatar
5 votes
1 answer
137 views

What are the differences between an agent that thinks rationally and an agent that acts rationally?

Stuart Russell and Peter Norvig pointed out 4 four possible goals to pursue in artificial intelligence: systems that think/act humanly/rationally. What are the differences between an agent that ...
Bayequentist's user avatar
15 votes
2 answers
11k views

What is the difference between artificial intelligence and computational intelligence?

Having analyzed and reviewed a certain amount of articles and questions, apparently, the expression computational intelligence (CI) is not used consistently and it is still unclear the relationship ...
quintumnia's user avatar
  • 1,183
19 votes
4 answers
11k views

What is the difference between actor-critic and advantage actor-critic?

I'm struggling to understand the difference between actor-critic and advantage actor-critic. At least, I know they are different from asynchronous advantage actor-critic (A3C), as A3C adds an ...
Blaszard's user avatar
  • 1,077
5 votes
1 answer
2k views

What is the difference between policy and action in reinforcement learning?

I'm confused with the two terminology - action and policy - in Reinforcement Learning. As far as I know, the action is: It is what the agent makes in a given state. However, the book I'm reading ...
Blaszard's user avatar
  • 1,077
43 votes
5 answers
82k views

What is the difference between a convolutional neural network and a regular neural network?

I've seen these terms thrown around this site a lot, specifically in the tags convolutional-neural-networks and neural-networks. I know that a neural network is a system based loosely on the human ...
Mithical's user avatar
  • 2,925
4 votes
1 answer
2k views

What is the difference between pixel-based object recognition and feature-based object recognition?

From my understanding and text I found in research papers online : Pixel-based object recognition: neural networks are trained to locate individual objects based directly on pixel data. Feature-based ...
Umang Mathur's user avatar
10 votes
1 answer
4k views

What is the difference between memetic algorithms and genetic algorithms?

What is the difference between memetic algorithms and genetic algorithms? Is an individual's lifetime a learning part of memetic algorithms?
Nasser's user avatar
  • 211
7 votes
2 answers
700 views

What is the difference between artificial intelligence and cognitive science?

Sometimes I understand that people doing cognitive science try to avoid the term artificial intelligence. The feeling I get is that there is a need to put some distance to the GOFAI. Another ...
Luis's user avatar
  • 538
9 votes
2 answers
14k views

What is the difference between an agent function and an agent program?

In section 2.4 (p. 46) of the book Artificial Intelligence: A modern approach (3rd edition), Russell and Norvig write The job of AI is to design an agent program that implements the agent function — ...
Abhishek Bhatia's user avatar
5 votes
2 answers
646 views

What is the difference between abstract, autonomous and virtual intelligent agents?

On Wikipedia, we can read about different type of intelligent agents: abstract intelligent agents (AIA), autonomous intelligent agents, virtual intelligent agent (IVA), which I've found on other ...
kenorb's user avatar
  • 10.5k
8 votes
6 answers
13k views

What is the difference between artificial intelligence and robots?

What is the difference between artificial intelligence and robots?
Vishnu JK's user avatar
  • 1,082