The kids were identified as 9-year-old Meagan Roy and 5-year-old Jeremy Roy.
Authorities said they were taken Thursday by their mother, Theresa Roy, who does not have custody of the children.
Police said Theresa Roy has a history of neglect, and there was an argument with the grandmother before the children disappeared. According to the grandmother, Theresa Roy has been reportedly living in her car and was distraught over the fact that her brother was moving to Washington. Alexander also said her daughter suffers from paranoia and has been on medication.
"My daughter, she daydreams a lot, and she doesn't watch the kids very well," said grandmother Cynthia Alexander.
Deputies issued an Amber Alert for Roy's vehicle, and authorities were able to track down the mother and children on Friday morning.