3
$\begingroup$

The universal approximation theorem states that a feed-forward neural network with a single hidden layer containing a finite number of neurons can approximate any continuous function (provided some assumptions on the activation function are met).

Is there any other machine learning model (apart from any neural network model) that has been proved to be an universal function approximator (and that is potentially comparable to neural networks, in terms of usefulness and applicability)? If yes, can you provide a link to a research paper or book that shows the proof?

Similar questions have been asked in the past in other places (e.g. here, here and here), but they do not provide links to papers or books that show the proofs.

$\endgroup$
1
$\begingroup$

In the paper A Note on the Universal Approximation Capability of Support Vector Machines (2002) Barbara Hammer and Kai Gersmann investigate the universal function approximation capabilities of SVMs.

More specifically, the authors show that SVMs with standard kernels (including Gaussian, polynomial, and several dot product kernels) can approximate any measurable or continuous function up to any desired accuracy.

Therefore, SVMs can be considered universal function approximators.

| improve this answer | |
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.