The former assistant sheriff -- who stood up against corruption in the department under former Sheriff Lee Baca -- formally announced his candidacy on Monday.
He released a video online called "For Good,'' in which he vows to stand up to corruption and outlines other elements of his platform.
Rhambo has already obtained endorsements from five members of the California Legislative Black Caucus.
Rhambo has worked for 33 years in law enforcement and also served as city manager of Compton from 2017 through July 2019 and assistant city manager of Carson from 2014 to 2017.
MORE | Compton says LA County Sheriff's Dept. not living up to its contract
Compton says LA County Sheriff's Dept. not living up to its contract
In his campaign video, Rhambo said he wants to address issues in the department such as deputy gangs and the continued rise of murders and shootings in Los Angeles, where violent crime is increasing at a rate not seen in decades. As a Black and Asian man, he said he understands what it's like to walk down the street as a person of color.
He accused Villanueva of eroding public trust in the agency, saying he "used fear to consolidate power, and tried to rehire ex-deputies that committed domestic violence or excessive force and who make us good cops look bad.''
Villanueva has fiercely defended his record as sheriff, insisting he undertook sweeping action to eliminate deputy gangs and lashing out at the Board of Supervisors for what he has called dramatic budget cuts -- or "defunding'' -- in a time of spiking crime rates.
Rhambo, who was raised in Compton and South Los Angeles after being adopted from Korea, said his experience in law enforcement includes an assignment in the Internal Affairs Bureau, where he assisted in the formation of the Shooting and Force Response Team in the wake of the Rodney King beating.
ABC7 INVESTIGATIONS | Tattooed deputy gang rules Compton patrol station, deputy alleges
Deputy gang with matching tattoos rules Compton patrol station, LASD deputy alleges
He also headed the Asian Crime Task Force, commanding a group of investigators and multilingual deputies to investigate crimes committed against Asians or by Asians. And, he said he helped start the Sheriff's Community Oriented Policing Bureau, focused on suppressing violent crime, combating homelessness, offering quality of life programs and creating mental health response teams.
"And as sheriff, I'll stop the corruption, fight crime, address homelessness and make our criminal justice system more just and fair so that it works for all of us,'' Rhambo said in his campaign video.
Voters will elect a new LASD leader in June 2022. Also running in the election is Eliezer Vera, a chief in the department, who announced his campaign this spring. Vera has served in the department since 1988.
MORE | Villanueva escalates battle with LA over Venice homelessness
LA County Sheriff Alex Villanueva to Venice homeless: 'We're coming for you'
City News Service contributed to this report.