A video would help us guess what is wrong...
Upload it to youtube and post a link here. If the link is done correctly (youtube.com, not other sites) even the picture will show up here. Even if it is a link to another site, the link will still be visible and work even if the picture doesn't show up.
If you have proper mixers so that yaw comes from reducing one motor while increasing the other, and thrust comes from increasing both motors, and you have servos attached to the clear control surfaces for roll and pitch, then it should work. Center of gravity is one issue. If CG is below the props then it seems it shouldn't even require stabilization to fly.
If it doesn't oscillate when you try to take off, then increase PID until it does. Maybe start with I=D=0 and just make P high enough that it starts to act better but does not oscillate. With P a bit below oscillation, increase I till it oscillates again and then reduce somewhat.
You could suspend it from a single vertical string and get yaw tuned fairly well.