Little crashes sometimes bend or chip the props. Bad props make vibration. Bad vibration can make it go crazy.
In addition to props being balanced, they must "track" properly. Look at the right edge of the prop disk while you slowly spin the prop by hand. First you see one blade then the other. If one is higher than the other, that must be corrected. A cresent of index card between prop and hub can help this. It helps to look from the side, through the center of the quad at one prop hub in front and one prop hub in back to give a reference for the prop disk of the spinning motor in the middle.