What we know with some certainty is that nobody with symptoms
like yours ever later develops serious health
problems -- no infertility, cancer, or other difficulties. Similarly, men's sex partners don't develop any problems. So whatever is going on in such cases, it is not apparently due to any infection. And experience shows that once affected men come to understand that nothing serious is going on, the symptoms often fade away.
So my advice is to do your best to move on.