Officials said the 68 year old jumped from the Vincent Thomas Bridge that links San Pedro with Terminal Island. Several people called 911 around 12:35 p.m. reporting that someone had jumped from the bridge.
A dive team with Los Angeles Port Police pulled the body from the murky water several hours later, officials said. Scott's body was taken to a dock in Wilmington and turned over to the county coroner's office.
"I can confirm that Tony Scott has indeed passed away," said Simon Halls, the publicist for director Ridley Scott, Tony Scott's brother. "The family asks for privacy at this time."
Halls did not comment on the circumstances surrounding the death.
Scott's Toyota Prius was found parked on one of the eastbound lanes of the bridge. Authorities said a suicide note was found inside.
The British-born Scott also directed Hollywood blockbusters "Days of Thunder" and "Beverly Hills Cop II."
In a tweet Sunday, director Ron Howard said, "No more Tony Scott movies. Tragic day."
Scott leaves behind a wife and twin sons.
The Associated Press contributed to this report.