If you switch a neural network from real weights to complex weights, you're roughly doubling the size of the network, and increasing the computational load by a factor of 2 to 4. My question is, in general, roughly how does the benefit of using complex weights stack up to those extra costs? E.g. Will a complex neural network with half the weights achieve worse/comparable/better performance than a regular network with real weights?
In audio signal processing, complex numbers make the theory much more elegant, which is why I imagine using complex numbers might be disproportionately beneficial. Though I can also imagine the complexity they introduce might overly hinder things as well.
As far as I know, no one uses complex weights in the NNs (which must be for a reason), but I'd like a more definitive answer.