Why do i get ill when dieting it's always a fever,sore throat or some kinda sickness?

well mind you i do not go too far and starve myself that my immunity crashes down i have a healthy diet with fruits and veggies or i'd say my normal diet in smaller amounts excludin the carbs like rice but i still don't get it everytime i diet to lose weight within a few weeks i fall sick why?????????????