Questions tagged [generalization]

For questions related to the concept of generalization in computational learning theory and machine learning.

Filter by
Sorted by
Tagged with
2
votes
0answers
27 views

How can we prove this inequality, related to the generalization error, without using the Rademacher complexity?

This is an inequality on page 36 of the book Foundations of Machine Learning, but the author only states it without proof. $$ \mathbb{P}\left[\left|R(h)-\widehat{R}_{S}(h)\right|>\epsilon\right] \...
8
votes
3answers
158 views

Why can neural networks generalize at all?

Neural networks are incredibly good at learning functions. We know by the universal approximation theorem that, theoretically, they can take the form of almost any function - and in practice, they ...
4
votes
1answer
64 views

When exactly is a model considered over-parameterized?

When exactly is a model considered over-parameterized? There are some recent researches in Deep Learning about the role of over-parameterization toward generalization, so it would be nice if I can ...
1
vote
0answers
15 views

References on generalization theory and mathematical abstraction of ML concepts

I'd like to learn about generalization theory for machine learning algorithms. I'm looking for books and other references (in case books aren't available) that provide a gentle introduction to the ...
1
vote
0answers
16 views

Greedy Algorithm with State modelling

My Question Would it be viable to implement and also how would I go about implementing something like this, "AI Agent Rating State-machine"? Problem and constraints: An AI Agent is tasked with ...
11
votes
1answer
175 views

What are the state-of-the-art results on the generalization ability of deep learning methods?

I've read a few classic papers on different architectures of deep CNNs used to solve varied image-related problems. I'm aware there's some paradox in how deep networks generalize well despite ...
1
vote
0answers
47 views

Is it possible to extract the features of feature extraction?

Can the features of feature extraction be extracted by developing a feature extraction approach that can be pointed at a large number of feature extraction processes that have successfully extracted ...
1
vote
0answers
62 views

How do I determine the generalisation ability of a neural network?

I am trying to ascertain if my neural network is able to generalize or if it’s simply using memory/overfitting to solve a task. I would like my model to generalise. Currently, I train the neural ...
3
votes
1answer
244 views

How can generalization error be estimated?

How would you estimate the generalisation error? What are the methods of achieving this?
10
votes
3answers
525 views

How does noise affect generalization?

Does increasing the noise in data help to improve the learning ability of a network? Does it make any difference or does it depend on the problem being solved? How is it affect the generalization ...