Investigators say Dennis Michael McKenzie, 55, brutally raped an 80-year-old woman in Lake Arrowhead in 2004. He was sentenced to seven years for the crime.
Over the last few weeks, he made more than 50 threatening and obscene phone calls to the family of the victim.
McKenzie was paroled to a halfway house in Long Beach, but he recently walked away and took off his GPS tracker. It was unclear exactly when he left the halfway house.
Police say a citizen in Palm Springs saw McKenzie and alerted authorities. He was taken into custody in the 500 block of South Palm Canyon Drive.