He is well below the 3rd % for weight and height on the growth charts. Generally, though, because he is small for weight AND height, it's likely that his BMI (body mass index) is within normal limits. Doctors tend to look to bmi rather than one measurement of either growth or height. If he was a tall kid with low weight, they'd look a little closer.
Some kids are just small, and he started out small.