Questions tagged [inductive-bias]

For questions about the concept of inductive (learning) bias in machine learning and other AI sub-fields.

Filter by
Sorted by
Tagged with
2
votes
1answer
31 views

What can be an example for the prior knowledge used in Deep Learning systems?

It is known that machine learning algorithms expect feature engineering as an initial step. Now, consider the following paragraph, taken from 1.1 The deep learning revolution of the textbook named ...
1
vote
3answers
73 views

Is the inductive bias always a useful bias for generalisation?

Is it true that a bias is said to be inductive iff it is useful in generalising the data? Or does inductive bias can also refer to the assumptions that may cause a decrease in performance? Suppose I ...
2
votes
1answer
158 views

Is there a connection between the bias term in a linear regression model and the bias that can lead to under-fitting?

Here is a linear regression model $$y = mx + b,$$ where $b$ is known as $y$-intercept, but also known as the bias [1], $m$ is the slope, and $x$ is the feature vector. As I understood, in machine ...
8
votes
5answers
2k views

Can prior knowledge be encoded in deep neural networks?

I was reading Gary Marcus's a Critical Appraisal of Deep Learning. One of his criticisms is that neural networks don't incorporate prior knowledge in tackling a problem. My question is: have there ...