Coincidentally, I have a similar problem! A challenging neighbour (on one side) who makes me feel uncomfortable, and another tree issue! On this occasion, a holly tree in my garden is growing, like wild-fire, across his right of way at the end of my garden! (it's a long garden) On the other side, my pleasant neighbours have an even crazier holly tree pushing over my fence. To make matters worse, I live in a conservation area where there are tree preservation orders on ALL trees, so I can't so much as trim a branch without risking a £20,000 fine, unless I submit an application to the council (including a plan of the garden), which takes 3-months to process. Since, it's winter I'm pretending it all doesn't exist, BUT I should be getting on with the application! That garden is hard work; the challenging neighbour is intimidating and unapproachable ...
I know it's a relatively small issue in the grand scheme of things, BUT very frustrating.