Sukkah Woes

we live in an apartment building in eretz yisrael . there are six apartments in the building.each apt has a private entrance from outside. there are 2 apartments downstairs ,two street level, and two upstairs. the two apartments downstairs and two apartment on street level have a patio outside their front door that can be made into a sukka but the two apts upstairs do not have that space so they need to make their sukkas on the street. we live on the top so we have two spaces on the street to make our sukka. in front of the left side or in front of the right side of the building and we chose the right side because on the left, there is a tree leaning over it and if we were to move the sukka a bit over past the tree , the pavement is uneven there so the sukka would be shaky. the problem is that the neighbors on the right downstairs are really angry with us for making the sukka on the street in front of their apt because they like to park their car there and also because they make their sukka in front of their apt on that patio and they feel that our sukkas too close and its an invasion of privacy.( even though theirs is downstairs and ours is upstairs on the street). the street by the way does not belong to anybody it is public property, but they feel that they have a chazaka on it because they park their car there. they want us to take our sukka down and redo it elsewhere or at least take it apart and rebuild it with the door facing away from the building, which obviously would be a big tircha. they are very angry with us and said we should have asked them first. are we mechuav to move it?