That can be caused by ESC miscalibration, motors not all exactly vertical, unequal weight distribution, motors or ESC's not matched, cracked frame that bends when power is applied, bad vibration issues ... I'm certain there are some I didn't think of.
Each of these can be fixed or compensated for.