# Total loss increasing, but loss components are decreasing?

I am writing a AlphaGo Zero clone, and sometimes in the training the policy head loss and value head loss would both be decreasing, but the total loss is increasing?

How is this possible? I am using Adam, and here's the code:

    input_tensor = Input((self.input_board_size, self.input_board_size, 2))
x = input_tensor
x = self.convolution_block(x)
for _ in range(self.number_of_residual_block):
x = self.residual_block(x)