Goddamn, Sky just triggered some memories of a property I had in days of yore. Neighbors on two sides where the nicest folks you could imagine, but the guy on the third was a complete asshole. The funny thing was that they were all related (I had purchased their deceased Paw Paw's house), and when I mentioned to one of the nice ones that I was planning to put up a fence they *all* put in an appearance to tell me that cousin Billy was a total asshole, and to make sure I had *everything* legally squared away, because he *was* going to give me shit and there was nothing they could do about it.
So I did. Paid the money for an extra survey, got it in writing from the county commissioner how close I could put it to the line (right on it, but recommended eight inches back although you are assumed to have an automatic easement to care for the other side of your fence). And yes, he gave me shit and I shut him right the hell down.
He didn't talk to me for years either.