Questions tagged [comparison]

For questions that involve the comparison of two AI concepts, terms or expressions. An example of such a question is: how does machine learning compare to deep learning?

Filter by
Sorted by
Tagged with
1 vote
1 answer
41 views

Why are these two implementations of the $\epsilon$-greedy policy different?

According to the book Reinforcement Learning An Introduction, the epsilon greedy policy can generally implemented as: $$ \pi(a|s) = \begin{cases} \frac{\epsilon}{|A|} + 1 - \epsilon & \text{if } ...
kklaw's user avatar
  • 143
2 votes
1 answer
94 views

What are the similarities between Q-learning and Value Iteration?

This is the explanation of value iteration in our notes where you keep applying bellman optimality equation till it stops changing and then acting greedily wrt the value function gives the optimal ...
ace239's user avatar
  • 23
1 vote
1 answer
27 views

Is there validation data in K-fold cross-validation?

We know that in machine learning the dataset is divided into 3 parts: training data, validation data and test data. On the other hand, K-fold cross-validation is defined as follows: the dataset is ...
DSPinfinity's user avatar
0 votes
1 answer
55 views

What is the difference between Machine Learning model, algorithm and hypothesis?

I'm fairly new to Machine Learning field and still to grasp the basics, so this question may seem very stupid, but what is the difference between Machine Learning model, algorithm and hypothesis? Like ...
Niharika Patil's user avatar
0 votes
1 answer
50 views

Which search algorithm expands nodes closest to the goal?

I want to know which search algorithm among A* and Best-First Search and Greedy First Search expands nodes closest to the goal. I have three opinions about A* and Best-First Search and Greedy First ...
ndycuong's user avatar
0 votes
1 answer
68 views

What is the difference between A/B testing and Reinforcement Learning?

I was learning ML, and I learnt a new section called, Reinforcement Learning. After some research on web, I found that it is a trial and error technique by which ...
mainak mukherjee's user avatar
0 votes
0 answers
30 views

What are the advantages of using RL over classical approaches in problems such as collision avoidance and path planning?

What are the advantages of going for RL based approaches than classical approaches (geometric for example) in problems such as collision avoidance and path planning? Are RL based solutions better for ...
SathukaBootham's user avatar
0 votes
0 answers
27 views

Is there any available assessment of relative capabilities of Claude-2 and GPT-4?

My first experience with Claude-2 indicates that it has capabilities well comparable to GPT-4 and noticably above those of GPT-3.5. There is an AI models ladder but it currently does not include ...
Anixx's user avatar
  • 311
0 votes
1 answer
90 views

How are the intuitions and mathematics of attention mechanisms related to those of PageRank?

Excuse me if you find this question too vague and not fitting to this forum and feel free to close it. The overall goal of my question is to get a better intuition of the attention concept and ...
Hans-Peter Stricker's user avatar
3 votes
1 answer
98 views

How does Monte-Carlo Tree Search Compare to MCMC?

Monte-Carlo Tree Search was the method used for AlphaGo my understanding is: it would randomly search the state space of possible moves where the probability of choosing a move was proportional to the ...
profPlum's user avatar
  • 370
4 votes
1 answer
2k views

What's the difference between GPT3.5 and InstructGPT?

I read about the different model series in GPT3.5 here - https://platform.openai.com/docs/models/gpt-3-5 At the beginning of the page, it mentions to look at https://platform.openai.com/docs/model-...
Arya's user avatar
  • 41
1 vote
1 answer
52 views

Are on-policy algorithms always better than off-policy ones?

I am studying RL and I have a question: Are on-policy algorithms always better than off-policy ones?
Samvel Safaryan's user avatar
1 vote
1 answer
78 views

How are these two equations for the optimal state-value function equivalent?

By substituting the optimal policy $\pi_{\star}$ into the Bellman equation, we get the Bellman equation for $v_{\pi_{\star}}(s)=v_{\star}(s)$: $$ v_{\star}(s) = \sum\limits_a \pi_{\star}(a|s) \sum\...
DSPinfinity's user avatar
2 votes
1 answer
325 views

Do the terms 'sample complexity' and 'sample efficiency' mean the same thing in RL context

For example, the the paper Soft Actor-Critic:Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor, both terms are mentioned but without explaining. I have seen them in other ...
Sam's user avatar
  • 175
0 votes
1 answer
2k views

What's the difference between classification and segmentation in deep learning?

What's the difference between classification and segmentation in deep learning? In particular, can the classification loss function be used for segmentation problems?
lllittleX's user avatar
1 vote
0 answers
27 views

What is the precise relation between Swarm Intelligence and Ensemble Methods?

I come from the machine learning side of AI, and have recently become more interested in the bio-inspired side of AI. Specifically I started reading about swarm intelligence and immediately started ...
Jack Ding's user avatar
0 votes
0 answers
43 views

Are autoencoders computationally cheaper than MLPs with the same number of neurons?

Are autoencoders computationally cheaper than other neural networks such as MLP with the same number of neurons? I have read in some papers that autoencoders train the network faster, and I could ...
Jesus M.'s user avatar
0 votes
0 answers
1k views

What are the similarities and differences between ChatGPT and YouChat?

I have recently tried the both, and it looks to me that the both have similar capabilities. YouChat says ChatGPT is more advanced. YouChat has connection to the Internet, and according to it, ...
Anixx's user avatar
  • 311
1 vote
1 answer
530 views

For specific tasks, is it better to fine-tune models on examples or just use prompting with the context of the task?

These days large language models cover a vast amount of topics and information, but I wanted to understand: For specific tasks, is it better to fine-tune models on examples or just use prompting with ...
Imran Q's user avatar
  • 113
0 votes
2 answers
295 views

Should I use multi-armed-bandits or RL for a financial time-series problem?

If we take simple financial timeseries data(stock/commodity/currency prices), State(t+1) does not depend on the action that we choose to take at State(t) as in Maze or Chess problem. Simple example: ...
kobo's user avatar
  • 3
-1 votes
1 answer
227 views

Is my understanding correct regarding the difference between policy and plan?

I am confused regarding the difference between policy and plan in reinforcement learning. According to my understanding, when we calculate the value of state using Bellman equation in deterministic ...
AAA's user avatar
  • 111
1 vote
0 answers
66 views

How do transformers compare to CNNs in terms of compute budget (and computing time) during inference?

Transformers are data and GPU hungry during training. Is this also true at inference time? How do transformers compare to feedforward CNNs e.g., during bounding box generation at inference time? I ...
Mariusmarten's user avatar
1 vote
0 answers
23 views

Is there an AI technique (or general programming technique) suitable for seeing if two articles deal with the same event?

I'm looking for a way to work out if two or more articles deal with the same event or issue and I'm not sure where to start. For example, back in August 2022 there were a few articles on the latest ...
Mythic's user avatar
  • 11
2 votes
2 answers
2k views

What is the difference between A2C and Q-Learning, and when to use one over the other?

I'm trying to get an accurate answer about the difference between A2C and Q-Learning. And when can we use each of them?
Hani's user avatar
  • 23
2 votes
1 answer
178 views

Why and when do we use ReLU over tanh activation function?

I was reading LeCun Efficient Backprop and the author repeated stressed the importance of average the input patterns at 0 and thus justified the usage of tanh sigmoid. But if tanh is good then how ...
Struggling_In_Final's user avatar
0 votes
0 answers
41 views

As someone starting out in RL, could you help me understand the differences between actor-only, critic-only, and actor-critic methods?

I have been reading some medium articles and these three methods pop up a lot. I am wondering what the differences between these are, what are the advantages of one over the other, etc. Also from my ...
No-Time-To-Day's user avatar
3 votes
1 answer
5k views

Does SAC perform better than PPO in sample-expensive tasks with discrete action spaces?

I am currently using Proximal Policy Optimization (PPO) to solve my RL task. However, after reading about Soft Actor-Critic (SAC) now I am unsure whether I should stick to PPO or switch to SAC. ...
Aeryan's user avatar
  • 53
1 vote
1 answer
528 views

Why does mean episode reward during training differ dramatically from "manual" runs of the trained model on same data?

I am training an RL agent, using PPO, on a time-series environment that comes from a tabular dataset. The possible scores during an episode goes from -1 to positive infinity (though realistically, I ...
Vladimir Belik's user avatar
2 votes
0 answers
100 views

When are traditional image processing methods preferable to machine learning and why?

By traditional image processing I understand, e. g. using filters to improve the image, extracting edges and then classifying objects using template matching. My current decision criteria are: large ...
el123's user avatar
  • 21
8 votes
1 answer
6k views

What is the difference between the triplet loss and the contrastive loss?

What is the difference between the triplet loss and the contrastive loss? They look same to me. I don't understand the nuances between the two. I have the following queries: When to use what? What ...
Exploring's user avatar
  • 293
1 vote
0 answers
63 views

Is item-based collaborative filtering the same thing as content-based filtering?

According to this Google dev page content-based filtering Uses similarity between items to recommend items similar to what the user likes. collaborative filtering Uses similarities between queries ...
s1234567a's user avatar
0 votes
1 answer
66 views

Is there a way to improve the low-quality data?

I'm on a robotics team and we've been tasked to write a program to differentiate between a live and dead fish. We've been given ~15 minutes of training footage and it's absolutely terrible. It's low ...
user avatar
1 vote
2 answers
59 views

What are all the possible usages of 'multilayer perceptron'?

The term 'multilayer perceptron' has been used in literature in various ways in the literature. I am presenting some of them below As a feed-forward neural network [1]. As a fully connected feed-...
hanugm's user avatar
  • 3,612
2 votes
0 answers
49 views

What are the specific differences between vision transformers variants?

I have tried 4 different types of attacks on vision transformers (ViT small and tiny, DeiT small and tiny) but the attack successes on smaller versions are higher than the tiny versions. My ...
Craving_gold's user avatar
2 votes
2 answers
3k views

What is the difference between features and inputs in machine learning?

I have seen many places that features and inputs have been used interchangeably when talking about machine learning especially deep neural networks. I want to know if they are indeed the same thing or ...
user0193's user avatar
  • 145
2 votes
2 answers
2k views

What are the differences between BLEU and METEOR?

I am trying to understand the concept of evaluating the machine translation evaluation scores. I understand how what BLEU score is trying to achieve. It looks into different n-grams like BLEU-1,BLEU-2,...
Exploring's user avatar
  • 293
1 vote
2 answers
913 views

What is the difference between a policy and rewards?

I don't understand the difference between a policy and rewards. Sure, a policy tells us what to do, but isn't the output of a neural network trained on rewards basically a policy (i.e. choose the ...
Antonis Karvelas's user avatar
0 votes
1 answer
1k views

What is the difference between CNN-LSTM and RNN?

I'm starting to study RNN for a project of video prediction, but I encounter these CNN-LSTM models. Initially, I thought that is another name for RNN, but I think I get it wrong. Since I'm a beginner ...
mario corradetti's user avatar
3 votes
3 answers
767 views

Why are Siamese Neural Networks used instead of a single neural network?

Siamese Neural Networks are a type of neural network used to compare two instances and infer if they belong to the same object. They are composed by two parallel identical neural networks, whose ...
IgnacioGaBo's user avatar
2 votes
0 answers
27 views

What are the benefits of using spectral k-means over simple k-means?

I have understood why k-means can get stuck in local minima. Now, I am curious to know how the spectral k-means helps to avoid this local minima problem. According to this paper A tutorial on Spectral,...
Amartya's user avatar
  • 121
2 votes
0 answers
72 views

When to model decision-making problem as single agent vs multi-agent problem?

I understand the goals and purposes of RL in the case of a single agent and the underlying model, i.e. MDPs, for RL problems (or sequential decision making with uncertainty in general). My question is ...
David's user avatar
  • 121
7 votes
2 answers
7k views

What is the difference between a loss function and reward/penalty in Deep Reinforcement Learning?

In Deep Reinforcement Learning (DRL) I am having difficulties in understanding the difference between a Loss function, a reward/penalty and the integration of both in DRL. Loss function: Given an ...
Theo Deep's user avatar
  • 185
3 votes
1 answer
2k views

What is the difference between a greedy policy and an optimal policy?

I am struggling to understand what is the difference between an optimal policy and a greedy policy. Let $F(r_{t+1},s_{t+1}| s_t,a_t)$ be the probability distribution accorting to which, given action $...
fennel's user avatar
  • 33
3 votes
1 answer
1k views

What is multi-head attention doing mathematically, and how is it different from self-attention?

I'm trying to understand the difference between the concept of self-attention and multi-head attention. The latter is not actually too clear to me. I understand that, in the case of self-attention, we ...
James Arten's user avatar
1 vote
0 answers
55 views

How to compare RL algorithms with different NN sizes?

I wanted to run some tests with some RL algorithms in a continuous control task, namely PPO-clip and SAC. When comparing their NN structures described in their papers, SAC used 2 layers with 256 ...
kitaird's user avatar
  • 115
2 votes
1 answer
204 views

Is logic AI a complement to learning AI?

I want to know the relation between logic AI and learning AI. Logic AI here refers to the branch of AI that is based on mathematical logic. Learning AI refers to the branch of AI that is based on ...
hanugm's user avatar
  • 3,612
1 vote
1 answer
631 views

What is the difference between Mean Teacher and Knowledge Distillation?

I recently read two papers: BYOL Bootstrap your own latent: A new approach to self-supervised Learning DINO Emerging Properties in Self-Supervised Vision Transformers. I am confused about the terms ...
Đặng Huy Hoàng's user avatar
0 votes
1 answer
119 views

How many layers and neurons in a FFNN do I need to make it equivalent to a CNN?

I started to learn machine learning early, and I studied the convolutional neural network and its ability to understand images and how it helps to reduce the number of parameters that need to be tuned....
Mahmoud Kanbar's user avatar
13 votes
2 answers
2k views

Is there a fundamental difference between an environment being stochastic and being partially observable?

In AI literature, deterministic vs stochastic and being fully-observable vs partially observable are usually considered two distinct properties of the environment. I'm confused about this because what ...
martinkunev's user avatar
1 vote
0 answers
45 views

Can teacher forcing in RNN ensure Turing completeness?

RNN has the same capability as a universal Turing machine. But I am confused whether RNN holds the same capabilities if we use teacher forcing. Consider the following excerpts from paragraphs taken ...
hanugm's user avatar
  • 3,612

1
2 3 4 5
9