I've done clomid, 50 mg, about six times now, and
I've had as many as 8 mature follicles, and
as little as 1, and
my doctor has never been concerned. I finally got pregnant on 50 mg clomid and IUI my second try five years ago, and I only had 2 follicles. One of them didn't look very mature, and surprise surprise, I got pregnant with twins!
If you're still concerned about it, you should ask your doctor about upping your dosage just a bit.