You didn't say, but it sounds like you went from 3s to 4s too. This is critical information to debug this.
Start by setting your PID, "D" terms to zero. Especially for the yaw.
Since it used to work and you haven't changed ESC/motor/prop but you it sounds like you have "invisible oscillation".
Personally, I would start with setting ESC calibration and neutral, then zero D terms and retune PIDs.
Edit: And when you start with the correct props with 3s, and go to 4s, you must reduce the prop size or burn up stuff like motor and ESC.