# Is it useful to eliminate the less relevant filters from a trained CNN?

Imagine I have a tensorflow CNN model with good accuracy but maybe too many filters:

• Is there a way to determine which filters have more impact in output? I think it should be possible. At least, if a filter A has a 0, that only multiples the output of a filter B, then filter B is not related to filter A. In particular, I'm thinking in 2d data where 1 dimension is time-related and the other feature related (like one-hot char).

• Is there a way to eliminate the less relevant filters from a trained model, and leave the rest of the model intact?

• Is it useful or there are better methods?

NOTE: All the observations and results are from the paper The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks.

• Yes there are ways to determine which filters have more impact on the output. Its a very naive way but works very good in practice. Filters with small weights impact output less (according to empirical evidence), which basically means neurons whose weights lie in the switching region i.e ~$$0$$ in ReLu and ~$$-1$$ to $$1$$ (say) have less impact on final output.