After getting a bottle, investigators say he drove the woman from the market to a remote area outside Castaic where he raped her.
He has been charged with numerous felonies, including kidnapping and assault with a deadly weapon.
Authorities said Upshaw may be responsible for similar crimes in other states. Anyone with information is urged to call /*Crime Stoppers*/ at (800) 222-TIPS.
The Associated Press contributed to this story.
