How is he breathing? You really have to be careful with woodbased beddings and small rodents. They have really sensitive respiratory systems. He might have a URI and in that case he'll have to go to the vet.
And you're right, male mice are usually best kept alone.