Hi Zirrst,
I am currently in the process of getting comfortable with FPV. I remember my first flight, it was simply scary, as what I heard and what I saw were not in tune. At the moment I don't dare to fly any acro, and with the weather getting worse it may be a while until my first flips and rolls in FPV.
But as soon as you are a bit comfortable, flying in FPV is simple joy, and is definitely a lot easier than flying LOS. Also I found that I like rate very much in FPV, while in LOS I still prefer (r)attitude, as my brain still has a lot to work with the direction changes. The main challange is that the image is only 2D, it is difficult to have a precise estimation of distances.