Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [comparison]

For questions that involve the comparison of two AI concepts, terms or expressions. An example of such a question is: how does machine learning compare to deep learning?

Filter by
Sorted by
Tagged with
2 votes
2 answers
439 views

Is it easier to use back-propagation or genetic algorithms to teach an artificial intelligence?

I am making a very simple neural network for a school project, and I would like to know what the best and easiest way to "teach" a neural network would be. From what I know, backpropagation ...
AlexanderB's user avatar
0 votes
0 answers
19 views

Are there leaderboards/tables/stats that compare inference times between close-sourced LLMs such as GPT 3.5/4 and Claude?

https://huggingface.co/spaces/optimum/llm-perf-leaderboard is great to compare inference times between LLMs but it misses close-sourced LLMs such as GPT 3.5/4 and Claude.
Franck Dernoncourt's user avatar
0 votes
2 answers
189 views

What is the difference between densenet and resnet?

Is the only difference between the two how the skip connection is combined? Resnet combines skip connections through addition and Densenet through concatenating. The Densenet paper appears to be ...
JobHunter69's user avatar
1 vote
1 answer
79 views

Is there any advantage of genetic algorithm (or programming) over Neural Networks? [closed]

I am planning to switch from neural networks to genetic algorithms (GA) and programming (GP). One of the main hassles of working with neural networks is that it requires a large amount of training ...
user366312's user avatar
0 votes
2 answers
37 views

Should I define my problem as image segmentation or detection?

I have a problem and have to decide wether it's an object detection or object segmentation problem. I want to use Yolov8 for training. We already have hundrets of images but they aren't labeled yet. ...
Ef Ge's user avatar
  • 113
1 vote
1 answer
232 views

When to use Pruning, Quantization , Distillation and others when optimizing speed

I want to understand how to optimize models for inference speed and am seeking some advice and best practices for the same. I am a little bit aware of the concepts of pruning, quantization, and ...
Hiren Namera's user avatar
4 votes
2 answers
2k views

What are the differences between seq2seq and encoder-decoder architectures?

I've read many tutorials online that use both words interchangeably. When I search and find that they are the same, why not just use one word since they have the same definition?
user avatar
1 vote
1 answer
82 views

Why are these two implementations of the $\epsilon$-greedy policy different?

According to the book Reinforcement Learning An Introduction, the epsilon greedy policy can generally implemented as: $$ \pi(a|s) = \begin{cases} \frac{\epsilon}{|A|} + 1 - \epsilon & \text{if } ...
kklaw's user avatar
  • 185
2 votes
1 answer
202 views

What are the similarities between Q-learning and Value Iteration?

This is the explanation of value iteration in our notes where you keep applying bellman optimality equation till it stops changing and then acting greedily wrt the value function gives the optimal ...
ace239's user avatar
  • 23
1 vote
1 answer
32 views

Is there validation data in K-fold cross-validation?

We know that in machine learning the dataset is divided into 3 parts: training data, validation data and test data. On the other hand, K-fold cross-validation is defined as follows: the dataset is ...
DSPinfinity's user avatar
0 votes
1 answer
112 views

What is the difference between Machine Learning model, algorithm and hypothesis?

I'm fairly new to Machine Learning field and still to grasp the basics, so this question may seem very stupid, but what is the difference between Machine Learning model, algorithm and hypothesis? Like ...
Niharika Patil's user avatar
0 votes
1 answer
76 views

Which search algorithm expands nodes closest to the goal?

I want to know which search algorithm among A* and Best-First Search and Greedy First Search expands nodes closest to the goal. I have three opinions about A* and Best-First Search and Greedy First ...
ndycuong's user avatar
0 votes
1 answer
111 views

What is the difference between A/B testing and Reinforcement Learning?

I was learning ML, and I learnt a new section called, Reinforcement Learning. After some research on web, I found that it is a trial and error technique by which ...
mainak mukherjee's user avatar
0 votes
0 answers
33 views

What are the advantages of using RL over classical approaches in problems such as collision avoidance and path planning?

What are the advantages of going for RL based approaches than classical approaches (geometric for example) in problems such as collision avoidance and path planning? Are RL based solutions better for ...
SathukaBootham's user avatar
0 votes
0 answers
38 views

Is there any available assessment of relative capabilities of Claude-2 and GPT-4?

My first experience with Claude-2 indicates that it has capabilities well comparable to GPT-4 and noticably above those of GPT-3.5. There is an AI models ladder but it currently does not include ...
Anixx's user avatar
  • 331
0 votes
1 answer
130 views

How are the intuitions and mathematics of attention mechanisms related to those of PageRank?

Excuse me if you find this question too vague and not fitting to this forum and feel free to close it. The overall goal of my question is to get a better intuition of the attention concept and ...
Hans-Peter Stricker's user avatar
3 votes
1 answer
179 views

How does Monte-Carlo Tree Search Compare to MCMC?

Monte-Carlo Tree Search was the method used for AlphaGo my understanding is: it would randomly search the state space of possible moves where the probability of choosing a move was proportional to the ...
profPlum's user avatar
  • 424
4 votes
1 answer
2k views

What's the difference between GPT3.5 and InstructGPT?

I read about the different model series in GPT3.5 here - https://platform.openai.com/docs/models/gpt-3-5 At the beginning of the page, it mentions to look at https://platform.openai.com/docs/model-...
Arya's user avatar
  • 41
1 vote
1 answer
68 views

Are on-policy algorithms always better than off-policy ones?

I am studying RL and I have a question: Are on-policy algorithms always better than off-policy ones?
Samvel Safaryan's user avatar
1 vote
1 answer
86 views

How are these two equations for the optimal state-value function equivalent?

By substituting the optimal policy $\pi_{\star}$ into the Bellman equation, we get the Bellman equation for $v_{\pi_{\star}}(s)=v_{\star}(s)$: $$ v_{\star}(s) = \sum\limits_a \pi_{\star}(a|s) \sum\...
DSPinfinity's user avatar
3 votes
1 answer
466 views

Do the terms 'sample complexity' and 'sample efficiency' mean the same thing in RL context

For example, the the paper Soft Actor-Critic:Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor, both terms are mentioned but without explaining. I have seen them in other ...
Sam's user avatar
  • 195
0 votes
1 answer
3k views

What's the difference between classification and segmentation in deep learning?

What's the difference between classification and segmentation in deep learning? In particular, can the classification loss function be used for segmentation problems?
lllittleX's user avatar
1 vote
0 answers
32 views

What is the precise relation between Swarm Intelligence and Ensemble Methods?

I come from the machine learning side of AI, and have recently become more interested in the bio-inspired side of AI. Specifically I started reading about swarm intelligence and immediately started ...
Jack Ding's user avatar
0 votes
0 answers
46 views

Are autoencoders computationally cheaper than MLPs with the same number of neurons?

Are autoencoders computationally cheaper than other neural networks such as MLP with the same number of neurons? I have read in some papers that autoencoders train the network faster, and I could ...
Jesus M.'s user avatar
0 votes
0 answers
1k views

What are the similarities and differences between ChatGPT and YouChat?

I have recently tried the both, and it looks to me that the both have similar capabilities. YouChat says ChatGPT is more advanced. YouChat has connection to the Internet, and according to it, ...
Anixx's user avatar
  • 331
1 vote
1 answer
623 views

For specific tasks, is it better to fine-tune models on examples or just use prompting with the context of the task?

These days large language models cover a vast amount of topics and information, but I wanted to understand: For specific tasks, is it better to fine-tune models on examples or just use prompting with ...
Imran Q's user avatar
  • 113
0 votes
2 answers
508 views

Should I use multi-armed-bandits or RL for a financial time-series problem?

If we take simple financial timeseries data(stock/commodity/currency prices), State(t+1) does not depend on the action that we choose to take at State(t) as in Maze or Chess problem. Simple example: ...
kobo's user avatar
  • 3
-1 votes
1 answer
354 views

Is my understanding correct regarding the difference between policy and plan?

I am confused regarding the difference between policy and plan in reinforcement learning. According to my understanding, when we calculate the value of state using Bellman equation in deterministic ...
AAA's user avatar
  • 111
1 vote
0 answers
79 views

How do transformers compare to CNNs in terms of compute budget (and computing time) during inference?

Transformers are data and GPU hungry during training. Is this also true at inference time? How do transformers compare to feedforward CNNs e.g., during bounding box generation at inference time? I ...
Mariusmarten's user avatar
1 vote
0 answers
24 views

Is there an AI technique (or general programming technique) suitable for seeing if two articles deal with the same event?

I'm looking for a way to work out if two or more articles deal with the same event or issue and I'm not sure where to start. For example, back in August 2022 there were a few articles on the latest ...
Mythic's user avatar
  • 11
3 votes
2 answers
3k views

What is the difference between A2C and Q-Learning, and when to use one over the other?

I'm trying to get an accurate answer about the difference between A2C and Q-Learning. And when can we use each of them?
Hani's user avatar
  • 33
2 votes
1 answer
237 views

Why and when do we use ReLU over tanh activation function?

I was reading LeCun Efficient Backprop and the author repeated stressed the importance of average the input patterns at 0 and thus justified the usage of tanh sigmoid. But if tanh is good then how ...
Struggling_In_Final's user avatar
0 votes
0 answers
44 views

As someone starting out in RL, could you help me understand the differences between actor-only, critic-only, and actor-critic methods?

I have been reading some medium articles and these three methods pop up a lot. I am wondering what the differences between these are, what are the advantages of one over the other, etc. Also from my ...
No-Time-To-Day's user avatar
3 votes
1 answer
7k views

Does SAC perform better than PPO in sample-expensive tasks with discrete action spaces?

I am currently using Proximal Policy Optimization (PPO) to solve my RL task. However, after reading about Soft Actor-Critic (SAC) now I am unsure whether I should stick to PPO or switch to SAC. ...
Aeryan's user avatar
  • 53
1 vote
1 answer
719 views

Why does mean episode reward during training differ dramatically from "manual" runs of the trained model on same data?

I am training an RL agent, using PPO, on a time-series environment that comes from a tabular dataset. The possible scores during an episode goes from -1 to positive infinity (though realistically, I ...
Vladimir Belik's user avatar
2 votes
0 answers
104 views

When are traditional image processing methods preferable to machine learning and why?

By traditional image processing I understand, e. g. using filters to improve the image, extracting edges and then classifying objects using template matching. My current decision criteria are: large ...
el123's user avatar
  • 21
9 votes
1 answer
7k views

What is the difference between the triplet loss and the contrastive loss?

What is the difference between the triplet loss and the contrastive loss? They look same to me. I don't understand the nuances between the two. I have the following queries: When to use what? What ...
Exploring's user avatar
  • 343
1 vote
0 answers
91 views

Is item-based collaborative filtering the same thing as content-based filtering?

According to this Google dev page content-based filtering Uses similarity between items to recommend items similar to what the user likes. collaborative filtering Uses similarities between queries ...
s1234567a's user avatar
0 votes
1 answer
73 views

Is there a way to improve the low-quality data?

I'm on a robotics team and we've been tasked to write a program to differentiate between a live and dead fish. We've been given ~15 minutes of training footage and it's absolutely terrible. It's low ...
user avatar
1 vote
2 answers
62 views

What are all the possible usages of 'multilayer perceptron'?

The term 'multilayer perceptron' has been used in literature in various ways in the literature. I am presenting some of them below As a feed-forward neural network [1]. As a fully connected feed-...
hanugm's user avatar
  • 3,890
2 votes
0 answers
54 views

What are the specific differences between vision transformers variants?

I have tried 4 different types of attacks on vision transformers (ViT small and tiny, DeiT small and tiny) but the attack successes on smaller versions are higher than the tiny versions. My ...
Craving_gold's user avatar
2 votes
2 answers
4k views

What is the difference between features and inputs in machine learning?

I have seen many places that features and inputs have been used interchangeably when talking about machine learning especially deep neural networks. I want to know if they are indeed the same thing or ...
user0193's user avatar
  • 145
2 votes
2 answers
3k views

What are the differences between BLEU and METEOR?

I am trying to understand the concept of evaluating the machine translation evaluation scores. I understand how what BLEU score is trying to achieve. It looks into different n-grams like BLEU-1,BLEU-2,...
Exploring's user avatar
  • 343
1 vote
2 answers
1k views

What is the difference between a policy and rewards?

I don't understand the difference between a policy and rewards. Sure, a policy tells us what to do, but isn't the output of a neural network trained on rewards basically a policy (i.e. choose the ...
Antonis Karvelas's user avatar
0 votes
1 answer
1k views

What is the difference between CNN-LSTM and RNN?

I'm starting to study RNN for a project of video prediction, but I encounter these CNN-LSTM models. Initially, I thought that is another name for RNN, but I think I get it wrong. Since I'm a beginner ...
mario corradetti's user avatar
3 votes
3 answers
919 views

Why are Siamese Neural Networks used instead of a single neural network?

Siamese Neural Networks are a type of neural network used to compare two instances and infer if they belong to the same object. They are composed by two parallel identical neural networks, whose ...
IgnacioGaBo's user avatar
2 votes
0 answers
27 views

What are the benefits of using spectral k-means over simple k-means?

I have understood why k-means can get stuck in local minima. Now, I am curious to know how the spectral k-means helps to avoid this local minima problem. According to this paper A tutorial on Spectral,...
Amartya's user avatar
  • 121
2 votes
0 answers
100 views

When to model decision-making problem as single agent vs multi-agent problem?

I understand the goals and purposes of RL in the case of a single agent and the underlying model, i.e. MDPs, for RL problems (or sequential decision making with uncertainty in general). My question is ...
David's user avatar
  • 121
7 votes
2 answers
9k views

What is the difference between a loss function and reward/penalty in Deep Reinforcement Learning?

In Deep Reinforcement Learning (DRL) I am having difficulties in understanding the difference between a Loss function, a reward/penalty and the integration of both in DRL. Loss function: Given an ...
Theo Deep's user avatar
  • 185
3 votes
1 answer
2k views

What is the difference between a greedy policy and an optimal policy?

I am struggling to understand what is the difference between an optimal policy and a greedy policy. Let $F(r_{t+1},s_{t+1}| s_t,a_t)$ be the probability distribution accorting to which, given action $...
fennel's user avatar
  • 33

1
2 3 4 5
10