Baros can be a cross between a balancing act and a detective act.
To start with, put the altitude PIDs back to stock. Then set the thrust limits (found in the same area). The middle one is the amount of stick it takes to hover.
As mentioned, bouncing baro is usually a matter of not enough foam. The idea with the foam is that it slows the wind down and it takes more foam than you would think to do it. It's almost like you seal it with foam that leaks a little. Too much foam and you have gotten rid of your bouncy, but replaced it with a slow, large vertical oscillation.
Light has a large effect, mostly noticeable when you yaw around. Easy to test just after sundown to see if this is the case.
Even with enough foam, sometimes wind deflects along the arm and hits the FC sideways. I would wrap the FC in a 360 degree vertical cardboard fence for a test, especially to block the wind coming along the top of the tail boom from the rear motor. Maybe put a half a paper cup upside down over the FC with plenty of lip hanging down below the FC.
One of these things should help a lot. Then try tuning the altitude PIDs.