You are not alone in any of your fears and if you read some posts here, you will understand not only how many of us there are, but the unbelievable range of symptoms that anxiety
/panic and depression
I must agree with your doctor and
urge you to get into some therapy. I know it's not cheap, but if we don't get to the root cause of our anxiety and deal with it, it will be with us our entire lives , and can frequently get much worse.