I came across this line while reading the original paper on Spatial Transformers by Deepmind in the last paragraph of Sec 3.1:
The localisation network function floc() can take any form, such as a fully-connected network or a convolutional network, but should include a final regression layer to produce the transformation parameters θ.
I understand what regression is, but what is meant by a regression layer?