Hi,
I think when TTC it is important to have enough healthy fats in your diet. This means sticking to regular fat foods (regular dairy products are fine), and don't try to eat less fat.
Just stick to a healthy diet, with plenty of natural (fruits, veges, nuts, meats) minimally processed foods. Keep away from transfats - which are man made fats and present in many processed foods.
Go to Westonprice website if you are interested, it has a lot of info about fats in our diet.