But now his Sherman Oaks neighbor is pointing to LaBeouf's fame as the reason for a new conflict.
LaBeouf's neighbor got so fed up with all the paparazzi, he built a towering wall in front of their home last year.
Los Angeles City Councilman Paul Koretz represents the neighborhood where the wall was built last year, a neighborhood filled with other fences and walls that fail to meet city regulations requiring them to stand no taller than 3 1/2 feet.
The wall LaBeouf's neighbor built, though, tops out at more than 7-feet tall.
Not only do city officials say the fence is too tall, they say it's too close to the road. In fact, it's built on city property.
"I think realistically if we want to go after this particular over-height fence, we should be looking at the whole neighborhood," Koretz said. "Virtually everybody has an over-height fence."
Koretz said some members of the neighborhood's homeowners association have complained to the city about the wall. The issue is now set to go before the City Council next week.
Calls for comment from LaBeouf's neighbors were not returned.
LaBeouf and the other neighbors who live near the wall in question said the wall should stay.
"They should give the guy a little breathing room, maybe make him fix a couple things, but I feel it's unnecessary to tear it down," said neighbor Richard Alicata.
City officials say disputes like this are fairly common in Los Angeles and compromises are reached most of the time.
Koretz said he's hoping some changes to this wall may be enough to keep it standing.