Could my husband's paranoia after his stroke be the cause of why I can't go out and talk to our carpenter?

Can't talk to him about anything without him getting upset. I am a social person who tries to get along with most people. He thinks that because the carpenter is younger and can do what he can't I'm going to run off with him. I've told him that isn't the case because when we got married, I took my wedding vows seriously.