# Why does ReLU (and other non linearities) work?

Can someone please point me to where I can read up on why non linearities that can produce values larger than 1 or smaller than 0 work. My understanding is that neurons can only produce values between 0 and 1 and that this assumption can be used in things like cross entropy. Are my assumptions just completely wrong?