3mm and 2mm are relatively small
nodules from my understanding. Did he/she recommend any further watching of those
nodules or explanations as to your neck swelling? Any unexplained fevers?
Perhaps, going back to your family doc and asking for a referral to another endo for at least a second opinion is warranted here. Certainly, having unexplained weight loss is something (even if it has nothing to do with your thyroid) to be looked at.