Questions tagged [generalization]

For questions related to the concept of generalization in computational learning theory and machine learning.

6 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
1answer
66 views

When exactly is a model considered over-parameterized?

When exactly is a model considered over-parameterized? There are some recent researches in Deep Learning about the role of over-parameterization toward generalization, so it would be nice if I can ...
2
votes
0answers
29 views

How can we prove this inequality, related to the generalization error, without using the Rademacher complexity?

This is an inequality on page 36 of the book Foundations of Machine Learning, but the author only states it without proof. $$ \mathbb{P}\left[\left|R(h)-\widehat{R}_{S}(h)\right|>\epsilon\right] \...
1
vote
0answers
15 views

References on generalization theory and mathematical abstraction of ML concepts

I'd like to learn about generalization theory for machine learning algorithms. I'm looking for books and other references (in case books aren't available) that provide a gentle introduction to the ...
1
vote
0answers
16 views

Greedy Algorithm with State modelling

My Question Would it be viable to implement and also how would I go about implementing something like this, "AI Agent Rating State-machine"? Problem and constraints: An AI Agent is tasked with ...
1
vote
0answers
47 views

Is it possible to extract the features of feature extraction?

Can the features of feature extraction be extracted by developing a feature extraction approach that can be pointed at a large number of feature extraction processes that have successfully extracted ...
1
vote
0answers
63 views

How do I determine the generalisation ability of a neural network?

I am trying to ascertain if my neural network is able to generalize or if it’s simply using memory/overfitting to solve a task. I would like my model to generalise. Currently, I train the neural ...