1.) constipation (prepare to stock up on Miralax)
2.) sedation (prepare to not want to get out of bed too much)
5.) pinpoint pupils
.... the list goes on.
AFTER an initial "getting used to" period of time (a few days, weeks, or months), MOST of these side effects will either disappear, or, become tolerable.
If it were me, in your shoes, I would NOT blanketly "refuse" to try your doctor's suggestion.