You seriously need to stop the growth into your garden. Bamboo is an invasive species and will otherwise take over your garden. Don’t feel sorry for your neighbours if they have planted it next to your fence as a barrier. Anything on your 50 % of the fence is fair game. Cut the shoots down to the roots and google a good weed killer to inject into the open shoots to kill the roots .