What to do about swimmer’s ear?

Hoping someone can help - really struggling with swimmer’s ear to the point where it’s putting me off going swimming. It’s even causing me to have other flu and cold symptoms. I’ve been told to stop water getting in through the nose and ears but the plugs I’m using are no good. Anyone have any good solutions?