all food groups are important for good health, therefore, if you aren't allergic to anything, there's usually no need to eliminate it, other than the obvious, which would be sugar/sweets, refined flour, white rice, etc.
Potatoes are starchy and can spike blood sugar
levels, but that doesn't mean they are bad for you either. A medium baked potato with the skin has more potassium than a banana.
You can check out this site: