According to a police report, 61-year-old Roger Stephens of Stone Mountain, became annoyed with the crying child and warned her mother to keep her daughter quiet.
The report says Stephens came up to the mother and said, "If you don't shut that baby up, I will shut her up for you."
Authorities say when the child continued to cry, Stephens grabbed the girl and hit her four to five times in the face. The toddler started to scream, and Stephens was later arrested.
Police say the girl's face was slightly red after the incident. A relative of the victim, identified as Sabrina Mathis, said the girl is doing fine, but the girl's mother was shaken up over the incident.
"She's as well as expected. Right now, she's just trying to calm down," says Mathis.
It's unclear if Stephens has an attorney. Calls to his home went unanswered.