95
votes
Accepted
What is self-supervised learning in machine learning?
Introduction
The term self-supervised learning (SSL) has been used (sometimes differently) in different contexts and fields, such as representation learning [1], neural networks, robotics [2], natural ...
- 39.6k
67
votes
Accepted
Is a switch from R to Python worth it?
I want to reframe your question.
Don't think about switching, think about adding.
In data science you'll be able to go very far with either python or r but you'll go farthest with both.
Python and ...
- 880
65
votes
What is the difference between artificial intelligence and machine learning?
Machine learning has been defined by many people in multiple (often similar) ways [1, 2]. One definition says that machine learning (ML) is the field of study that gives computers the ability to learn ...
- 860
51
votes
What's the difference between model-free and model-based reinforcement learning?
What's the difference between model-free and model-based reinforcement learning?
In Reinforcement Learning, the terms "model-based" and "model-free" do not refer to the use of a ...
- 30.4k
47
votes
Accepted
What is the relation between Q-learning and policy gradients methods?
However, both approaches appear identical to me i.e. predicting the maximum reward for an action (Q-learning) is equivalent to predicting the probability of taking the action directly (PG).
Both ...
- 30.4k
42
votes
What is the difference between a convolutional neural network and a regular neural network?
TLDR:
The convolutional-neural-network is a subclass of neural-networks which have at least one convolution layer. They are great for capturing local information (e.g. neighbor pixels in an image or ...
39
votes
Accepted
What is the difference between strong-AI and weak-AI?
The terms strong and weak don't actually refer to processing, or optimization power, or any interpretation leading to "strong AI" being stronger than "weak AI". It holds conveniently in practice, but ...
- 566
35
votes
What's the difference between model-free and model-based reinforcement learning?
Model-based reinforcement learning has an agent try to understand the world and create a model to represent it. Here the model is trying to capture 2 functions, the transition function from states $T$ ...
- 3,787
33
votes
Why does C++ seem less widely used than Python in AI?
You don't need a powerful language for programming AI. Most of the developers are using libraries like Keras, Torch, Caffe, Watson, TensorFlow, etc. Those low level libraries are highly optimized and ...
- 389
32
votes
Accepted
How is a deep neural network different from other neural networks?
The difference is mostly in the number of layers.
For a long time, it was believed that "1-2 hidden layers are enough for most tasks" and it was impractical to use more than that, because training ...
32
votes
Is a switch from R to Python worth it?
Of course, this type of questions will also lead to primarily opinion-based answers. Nonetheless, it is possible to enumerate the strengths and weakness of each language, with respect to machine ...
- 39.6k
28
votes
Accepted
How is BERT different from the original transformer architecture?
What is a transformer?
The original transformer, proposed in the paper Attention is all you need (2017), is an encoder-decoder-based neural network that is mainly characterized by the use of the so-...
- 39.6k
27
votes
What's the difference between model-free and model-based reinforcement learning?
In reinforcement learning (RL), there is an agent which interacts with an environment (in time steps). At each time step, the agent decides and executes an action, $a$, on an environment, and the ...
- 39.6k
25
votes
What is the difference between artificial intelligence and machine learning?
Machine learning is a subset of artificial intelligence. Roughly speaking, it corresponds to its learning side. There is no "official" definitions, boundaries are a bit fuzzy.
- 2,814
24
votes
Accepted
What is the difference between First-Visit Monte-Carlo and Every-Visit Monte-Carlo Policy Evaluation?
The first-visit and the every-visit Monte-Carlo (MC) algorithms are both used to solve the prediction problem (or, also called, "evaluation problem"), that is, the problem of estimating the value ...
- 39.6k
24
votes
What are the main differences between skip-gram and continuous bag of words?
So as you're probably already aware of, CBOW and Skip-gram are just mirrored versions of each other. CBOW is trained to predict a single word from a fixed window size of context words, whereas Skip-...
- 5,218
22
votes
Are humans superior to machines in chess?
Losing games to computers because of mistakes made under time pressure was probably a thing about 20 years ago, when Kasparov lost to DeepBlue after such a mistake(correction: it was Kramnik with the ...
- 890
19
votes
Accepted
What is the difference between machine learning and deep learning?
Deep learning is a specific variety of a specific type of machine learning. So it's possible to learn about deep learning without learning all of machine learning, but it requires learning some ...
- 4,262
19
votes
What is the difference between a convolutional neural network and a regular neural network?
Convolutional Neural Networks (CNNs) are neural networks with architectural constraints to reduce computational complexity and ensure translational invariance (the network interprets input patterns ...
- 353
19
votes
What is the difference between tree search and graph search?
There is always a lot of confusion about this concept, because the naming is misleading, given that both tree and graph searches produce a tree (from which you can derive a path) while exploring the ...
19
votes
What is self-supervised learning in machine learning?
Self-supervised learning is when you use some parts of the samples as labels for a task that requires a good degree of comprehension to be solved. I'll emphasize these two key points, before giving an ...
- 511
19
votes
Accepted
What does AI software look like, and how is it different from other software?
Code in AI is not in principle different from any other computer code. After all, you encode algorithms in a way that computers can process them. Having said that, there are a few points where your ...
- 5,362
18
votes
Accepted
What is the difference between actor-critic and advantage actor-critic?
Actor-Critic is not just a single algorithm, it should be viewed as a "family" of related techniques. They're all techniques based on the policy gradient theorem, which train some form of ...
- 10.1k
18
votes
Accepted
Can the decoder in a transformer model be parallelized like the encoder?
Can the decoder in a transformer model be parallelized like the
encoder?
Generally NO:
Your understanding is completely right. In the decoder, the output of each step is fed to the bottom decoder in ...
- 559
17
votes
What is the difference between artificial intelligence and machine learning?
Artificial intelligence
According to the book Artificial Intelligence: A Modern Approach (section 1.1), artificial intelligence (AI) has been defined in multiple ways, which can be organized into 4 ...
17
votes
Accepted
How does LSTM in deep reinforcement learning differ from experience replay?
How does this method differ from the experience replay, as they both use past information in the training? What's the typical application of both techniques?
Using a recurrent neural network is one ...
- 30.4k
16
votes
Why is Sanskrit the best language for AI?
Rick Briggs refers to the difficulty an artificial intelligence would have in detecting the true meaning of words spoken or written in one of our natural languages. Take for example an artificial ...
16
votes
Accepted
Why has the cross-entropy become the classification standard loss function and not Kullback-Leibler divergence?
When it comes to a classification problem in machine learning, the cross-entropy and the KL divergence are equal.
As already stated in the question, the general formula is this:
$$H(p, q) = H(p) + D_{...
- 1,947
16
votes
Why does C++ seem less widely used than Python in AI?
C++ is actually one of the most popular languages used in the AI/ML space. Python may be more popular in general, but as others have noted, it's actually quite common to have hybrid systems where the ...
- 3,757
16
votes
Accepted
What are the differences between Q-Learning and A*?
Q-learning and A* can both be viewed as search algorithms, but, apart from that, they are not very similar.
Q-learning is a reinforcement learning algorithm, i.e. an algorithm that attempts to find a ...
- 39.6k
Only top scored, non community-wiki answers of a minimum length are eligible