If you have cancer risks in your family, your risk is obviously elevated. If you have a family history of
heart disease, your risk for stroke is also elevated,
and therefore your need to adjust for those risks accordingly. If you do not have additional risk concerns, I would say that you might want to seriously consider what might happen if you don't take the medications. In this case, does the risk out weigh the benefit or is it the other way around?