Questions tagged [inductive-bias]

For questions about the concept of inductive (learning) bias in machine learning and other AI sub-fields.

Filter by
Sorted by
Tagged with
8
votes
5answers
2k views

Can prior knowledge be encoded in deep neural networks?

I was reading Gary Marcus's a Critical Appraisal of Deep Learning. One of his criticisms is that neural networks don't incorporate prior knowledge in tackling a problem. My question is: have there ...
3
votes
1answer
219 views

Is there a connection between the bias term in a linear regression model and the bias that can lead to under-fitting?

Here is a linear regression model $$y = mx + b,$$ where $b$ is known as $y$-intercept, but also known as the bias [1], $m$ is the slope, and $x$ is the feature vector. As I understood, in machine ...