It all depends on how much discomfort this is causing you
but if your piece isn't getting any smaller, can
still get hard, isn't causing you
pain and you
don't have any bother urinating then, evne though what you describe isn't normal, it might not be anything to worry about.
That said, I'm not going to tell anyone how to feel about this or any other medical condition.