0
$\begingroup$

This article talks about pruning in the context of convolutional neural networks:

One of the first methods of pruning is pruning entire convolutional filters. Using an L1 norm of the weight of all the filters in the network, they rank them. This is then followed by pruning the ‘n’ lowest ranking filters globally. The model is then retrained and this process is repeated.

There also exist methods for implementing structured pruning for a more light-touch approach of regulating the output of the method. This method utilizes a set of particle filters that are the same in number as the number of convolutional filters in the network.

Is pruning only applicable to CNNs?

Improve this question
$\endgroup$
1
  • $\begingroup$ No, you can apply the same concepts to any type of network. Also pruning is quite common when dealing with graphs. $\endgroup$
    – razvanc92
    Jun 29, 2021 at 6:52

2 Answers 2

Reset to default
1
$\begingroup$

No, it is not only applicable to CNNs, but to a wide range of other architectures, even the hype transformers.

For an extensive survey, I recommend that you have a look at this paper What is the State of Neural Network Pruning?.

Improve this answer
$\endgroup$
0
$\begingroup$

No, neural network pruning is applicable to any type of neural network, be it a feed-forward, convolutional or recurrent neural network.

Improve this answer
$\endgroup$
1
  • $\begingroup$ To support your claim, maybe you could provide a link to a research paper that applies pruning to e.g. a FFNN (that maybe also includes the implementation). $\endgroup$
    – nbro
    Jun 29, 2021 at 9:39

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .