The discovery was made in the 900 block of Lincoln Avenue. Investigators said pipeline maintenance workers saw "unusual debris" that looked like human remains so they called police.
North Lincoln Avenue was shut down between San Gabriel Boulevard and Avenida De La Merced during the investigation.
No other details have been released. Anyone with information was asked to call the Los Angeles County Sheriff's Department's Homicide Bureau at (323) 890-5500.