You should take off immediately after arming and starting the motors. If you sit there with motors spinning slowly, they will "wind up".
Race mount motors (tilted forward) cause issues like this. Consider sitting the front end on a piece of wood before takeoff to make the props level. Hover position is where the props are level.
Never change your transmitter trims from where they were when you did the transmitter wizard. Use Attitude -> Settings -> RotateVirtual to make it hover level in Attitude mode.
if it is drifting forward you subtract from pitch
if it is drifting left you subtract from roll
etc