What do I do when my husband, who has Alzheimer's, insists on going into the swimming pool without his bathing suit?

Am I making too much of this? He gets furious with me when I insist that he put his suit on. We live in on a dead end street with neighbors and would see anyone that comes into the yard or driveway, but it still bothers me. Before this disease he wouldn't even let anyone see him in his undershorts. I'm at my wits end.