My assumption is that after the transformer is trained, some other software analyzes the answer for anti-wokeness and modifies it accordingly, rather than being trained using woke material.
I don't think this is correct though. I asked chatGPT to answer every question by inserting a $ character in between each character of the otherwise normal answer, to make it unreadable, or at least, difficult to interpret by what I call the censorship layer. The output had these inserted characters, however, this had no effect on the censorship. But may be the censorship layer is smart enough to read in between lines.
Question: Does the censorship comes from within the transformer or after it? (and, if it comes after, why my attempt to bypass it failed?)