Questions tagged [comparison]

For questions that involve the comparison of two AI concepts, terms or expressions. An example of such a question is: how does machine learning compare to deep learning?

Filter by
Sorted by
Tagged with
7
votes
3answers
1k views

Can the decoder in a transformer model be parallelized like the encoder?

Can the decoder in a transformer model be parallelized like the encoder? As far as I understand, the encoder has all the tokens in the sequence to compute the self-attention scores. But for a decoder,...
0
votes
0answers
13 views

Are the two do-calculus systems equivalent?

The version of the do-calculus system in The Book of Why by Judea Pearl is a little bit simpler than the original version. Are the two systems equivalent? The simple version is as follows: Rule1 ...
2
votes
1answer
138 views

Does GraphSage use hard attention?

I was reading the recent paper Graph Representation Learning via Hard and Channel-Wise Attention Networks, where the authors claim that there is no hard attention operator for graph data. From my ...
2
votes
2answers
753 views

What are the major differences between cost, loss, error, fitness, utility, objective, criterion functions?

I find the terms cost, loss, error, fitness, utility, objective, criterion functions to be interchangeable, but any kind of minor difference explained is appreciated.
90
votes
10answers
14k views

What is the difference between artificial intelligence and machine learning?

These two terms seem to be related, especially in their application in computer science and software engineering. Is one a subset of another? Is one a tool used to build a system for the other? ...
4
votes
2answers
498 views

What is the difference between abstract, autonomous and virtual intelligent agents?

On Wikipedia, we can read about different type of intelligent agents: abstract intelligent agents (AIA), autonomous intelligent agents, virtual intelligent agent (IVA), which I've found on other ...
13
votes
4answers
7k views

What does AI software look like, and how is it different from other software?

What does AI software look like? What is the major difference between AI software and other software?
1
vote
3answers
95 views

Is there a relationship between Computer Algebra and NLP?

My intuition is that there is some overlap between understanding language and symbolic mathematics (e.g. algebra). The rules of algebra are somewhat like grammar, and the step-by-step arguments get ...
2
votes
1answer
200 views

What's the intuition behind contrastive learning?

Recently, I have seen a surge of papers w.r.t contrastive learning (a subset of semi-supervised learning). Can anyone give a detailed explanation of this approach with its advantages/disadvantages ...
3
votes
1answer
77 views

What's the difference between estimation and approximation error?

I'm unable to find online, or understand from context - the difference between estimation error and approximation error in the context of machine learning (and, specifically, reinforcement learning). ...
6
votes
2answers
535 views

What is the intuition behind TD($\lambda$)?

I'd like to better understand temporal-difference learning. In particular, I'm wondering if it is prudent to think about TD($\lambda$) as a type of "truncated" Monte Carlo learning?
3
votes
3answers
2k views

In which cases is the categorical cross-entropy better than the mean squared error?

In my code, I usually use the mean squared error (MSE), but the TensorFlow tutorials always use the categorical cross-entropy (CCE). Is the CCE loss function better than MSE? Or is it better only in ...
1
vote
2answers
45 views

What is the difference between a language model and a word embedding?

I am self-studying applications of deep learning on the NLP and machine translation. I am confused about the concepts of "Language Model", "Word Embedding", "BLEU Score". ...
3
votes
1answer
85 views

Are Graph Neural Networks generalizations of Convolutional Neural Networks?

In lecture 4 of this course, the instructor argues that GNNs are generalizations of CNNs, and that one can recover CNNs from GNNs. He presents the following diagram (on the right) and mentions that it ...
0
votes
0answers
22 views

Which method is the most efficient for memory-bounded MCTS with a transposition table?

I am building an agent for a board game that can have a relatively lot of time to think. Therefore, memory management should be efficient. I am using a transposition table, where the nodes are stored ...
3
votes
4answers
489 views

What is the fundamental difference between an ML model and a function?

A model can be roughly defined as any design that is able to solve an ML task. Examples of models are the neural network, decision tree, Markov network, etc. A function can be defined as a set of ...
0
votes
1answer
87 views

What is the difference between exhaustive nearest neighbor search and k-nearest neighbour search?

I have two lists of feature vectors calculated from pre-trained CNN for image retrieval task: Query: FV_Q and Reference FV_R. <...
1
vote
2answers
62 views

Is there any situation in which breadth-first search is preferable over A*?

Is there any situation in which breadth-first search is preferable over A*?
2
votes
2answers
110 views

Should I use minimax or alpha-beta pruning?

Should I use minimax or alpha-beta pruning (or both)? Apparently, alpha-beta pruning prunes some parts of the search tree.
4
votes
1answer
2k views

What is the difference between a stationary and a non-stationary policy?

In reinforcement learning, there are deterministic and non-deterministic (or stochastic) policies, but there are also stationary and non-stationary policies. What is the difference between a ...
1
vote
1answer
75 views

What is the difference between Bayes-adaptive MDP and a Belief-MDP in Reinforcement Learning?

I have been reading a few papers in this area recently and I keep coming across these two terms. As far as I'm aware, Belief-MDPs are when you cast a POMDP as a regular MDP with a continuous state ...
4
votes
2answers
180 views

What is the difference between return and expected return?

At a time step $t$, for a state $S_{t}$, the return is defined as the discounted cumulative reward from that time step $t$. If an agent is following a policy (which in itself is a probability ...
2
votes
1answer
146 views

How can neural networks approximate any continuous function but have $\mathcal{VC}$ dimension only proportional to their number of parameters?

Neural networks typically have $\mathcal{VC}$ dimension that is proportional to their number of parameters and inputs. For example, see the papers Vapnik-Chervonenkis dimension of recurrent neural ...
9
votes
2answers
2k views

What are the main differences between a perceptron and a naive Bayes classifier?

What are the main differences between a perceptron and a naive Bayes classifier?
3
votes
3answers
111 views

What is the difference between neural networks and other ways of curve fitting?

For simplicity, let's assume we want to solve a regression problem, where we have one independent variable and one dependent variable, which we want to predict. Let's also assume that there is a ...
11
votes
2answers
6k views

What is the difference between reinforcement learning and optimal control?

Coming from a process (optimal) control background, I have begun studying the field of deep reinforcement learning. Sutton & Barto (2015) state that particularly important (to the writing of the ...
5
votes
1answer
82 views

What are the differences between an agent that thinks rationally and an agent that acts rationally?

Stuart Russell and Peter Norvig pointed out 4 four possible goals to pursue in artificial intelligence: systems that think/act humanly/rationally. What are the differences between an agent that ...
2
votes
1answer
132 views

What is the difference between a semantic network and an ontology?

What is the difference between a semantic network and an ontology? How are they related? I have not found any article that describes how these two concepts are related.
1
vote
1answer
209 views

What is the difference between the heuristic function and the evaluation function in A*?

I am reading college notes on state search space. The notes (which are not publicly available) say: To do state-search space, the strategy involves two parts: defining a heuristic function, and ...
2
votes
1answer
157 views

How to transform a PDDL to search?

I have a question about search and planning: I still haven't understood the difference from the two, but they seem very similar to me; here is a question I am struggling with: "Having formulated a ...
5
votes
1answer
475 views

How do we determine whether a heuristic function is better than another?

I am trying to solve a maze puzzle using the A* algorithm. I am trying to analyze the algorithm based on different applicable heuristic functions. Currently, I explored the Manhattan and Euclidean ...
5
votes
2answers
60 views

Do AlphaZero/MuZero learn faster in terms of number of games played than humans?

I don't know much about AI and am just curious. From what I read, AlphaZero/MuZero outperform any human chess player after a few hours of training. I have no idea how many chess games a very talented ...
3
votes
1answer
86 views

Which is a better form of regularization: lasso (L1) or ridge (L2)?

Given a ridge and a lasso regularizer, which one should be chosen for better performance? An intuitive graphical explanation (intersection of the elliptical contours of the loss function with the ...
4
votes
0answers
660 views

What are the differences between Yolo v1 and CenterNet?

I recently read a new paper (late 2019) about a one-shot object detector called CenterNet. Apart from this, I'm using Yolo (V3) one-shot detector, and what surprised me is the close similarity between ...
3
votes
1answer
65 views

What's the difference between architectures and backbones?

In the paper "ForestNet: Classifying Drivers of Deforestation in Indonesia using Deep Learning on Satellite Imagery", the authors talk about using: Feature Pyramid Networks (as the ...
3
votes
1answer
92 views

How can we derive a Convolution Neural Network from a more generic Graph Neural Network?

Convolution Neural Network (CNNs) operate over strict grid-like structures ($M \times N \times C$ images), whereas Graph Neural Networks (GNNs) can operate over all-flexible graphs, with an undefined ...
4
votes
3answers
277 views

What is the difference between artificial intelligence and swarm intelligence?

Artificial intelligence (AI) refers to the simulation of human intelligence in machines that are programmed to think like humans and mimic their actions. The term may also be applied to any machine ...
2
votes
1answer
97 views

What is the difference between out of distribution detection and anomaly detection?

I'm currently reading the paper Likelihood Ratios for Out-of-Distribution Detection, and it seems that their problem is very similar to the problem of anomaly detection. More precisely, given a neural ...
1
vote
1answer
900 views

Is my understanding of the differences between MDP, Semi MDP and POMDP correct?

I just wanted to confirm that my understanding of the different Markov Decision Processes are correct, because they are the fundamentals of reinforcement learning. Also, I read a few literature ...
8
votes
1answer
2k views

What is the difference between logic-based and rule-based AI?

I always thought rule-based was synonymous with logic-based AI. Logic has axioms and rules of inference, whereas rule-based AI has a knowledge base (essentially, axioms) and if-then rules to create ...
1
vote
0answers
185 views

What is the difference between derivation and entailment?

In section 7.3 of the book Artificial Intelligence: A Modern Approach (3rd edition), it's written An inference algorithm that derives only entailed sentences is called sound or truth-preserving. The ...
6
votes
1answer
10k views

What is the difference between an agent function and an agent program?

In section 2.4 (p. 46) of the book Artificial Intelligence: A modern approach (3rd edition), Russell and Norvig write The job of AI is to design an agent program that implements the agent function — ...
0
votes
0answers
11 views

AI generator for imaginary street maps?

Similar to This person does not exist or This artwork does not exist, how might I go about creating a This street map does not exist, including choosing an appropriate AI model and scoping features? ...
9
votes
2answers
987 views

What is the difference between Q-learning, Deep Q-learning and Deep Q-network?

Q-learning uses a table to store all state-action pairs. Q-learning is a model-free RL algorithm, so how could there be the one called Deep Q-learning, as deep means using DNN; or maybe the state-...
11
votes
1answer
5k views

Are humans superior to machines in chess?

A friend of mine, who is an International Master at chess, told me that humans were superior to machines provided you didn't impose the time constraints that exist in competitive chess (40 moves in 2 ...
6
votes
1answer
107 views

Why are neural networks preferred to other classification functions optimized by gradient decent

Consider a neural network, e.g. as presented by Nielsen here. Abstractly, we just construct some function $f: \mathbb{R}^n \to [0,1]^m$ for some $n,m \in \mathbb{N}$ (i.e. the dimensions of the input ...
10
votes
2answers
5k views

What is the difference between goal-based and utility-based agents?

What is the difference between goal-based and utility-based agents? Please, provide a real-world example.
3
votes
3answers
4k views

What is the difference between a stochastic and a deterministic policy?

In reinforcement learning, there are the concepts of stochastic (or probabilistic) and deterministic policies. What is the difference between them?
5
votes
1answer
425 views

What is the difference between reinforcement learning and evolutionary algorithms?

What is the difference between reinforcement learning (RL) and evolutionary algorithms (EA)? I am trying to understand the basics of RL, but I do not yet have practical experience with RL. I know ...
9
votes
1answer
3k views

What is the difference between expected return and value function?

I've seen numerous mathematical explanations of reward, value functions $V(s)$, and return functions. The reward provides an immediate return for being in a specific state. The better the reward, the ...

1
2 3 4 5
7