According to a tweet posted by the San Bernardino Police Department, officers received a call about a domestic violence issue early Saturday morning.
The mother of the child told officers her ex-boyfriend - 30-year-old Raymond Ornelas - broke her bedroom window and took the little girl, police said.
WATCH NOW ABC7 Los Angeles 24x7 Streaming channel
"[Ornelas] proceeded to drag her across the house by her hair, hit her multiple times, and produced a handgun while threatening to kill her," police said in a statement posted on Twitter. "He soon fled the scene with their 2-year-old daughter."
With the help of a SWAT team, police quickly found Ornelas and arrested him without incident.
The little girl wasn't injured and was returned to her mother, according to police.
Ornelas is now being held on multiple charges including burglary, domestic violence, assault with a deadly weapon and kidnapping.