Questions tagged [inductive-bias]

For questions about the concept of inductive (learning) bias in machine learning and other AI sub-fields.

Filter by
Sorted by
Tagged with
2 votes
1 answer

What can be an example for the prior knowledge used in Deep Learning systems?

It is known that machine learning algorithms expect feature engineering as an initial step. Now, consider the following paragraph, taken from 1.1 The deep learning revolution of the textbook named ...
user avatar
  • 3,201
1 vote
3 answers

Is the inductive bias always a useful bias for generalisation?

Is it true that a bias is said to be inductive iff it is useful in generalising the data? Or does inductive bias can also refer to the assumptions that may cause a decrease in performance? Suppose I ...
user avatar
  • 3,201
5 votes
1 answer

Is there a connection between the bias term in a linear regression model and the bias that can lead to under-fitting?

Here is a linear regression model $$y = mx + b,$$ where $b$ is known as $y$-intercept, but also known as the bias [1], $m$ is the slope, and $x$ is the feature vector. As I understood, in machine ...
user avatar
  • 286
9 votes
5 answers

Can prior knowledge be encoded in deep neural networks?

I was reading Gary Marcus's a Critical Appraisal of Deep Learning. One of his criticisms is that neural networks don't incorporate prior knowledge in tackling a problem. My question is: have there ...
user avatar
  • 1,146