Police were seeking a 22-year-old African-American man, standing about 6 feet 1 inch tall with a medium build, wearing white shorts. He was identified as Allen Lynn Thomas.
Three children were missing: a 7-year-old wearing black tights and a pink-and-white shirt; a 5-year-old wearing black tights; and a 5-month-old wearing all yellow.
Police say the suspect reportedly brandished a weapon at the woman, believed to be the suspect's wife or girlfriend, before taking the kids.
Officers reportedly gained access to the residence but found the suspect and the children gone. Several area streets were closed while police searched for the children and the suspect.
By 4:05 p.m., police said two of the three children were in custody, the 7-year-old and the 5-month-old.
The 5-year-old child, believed to be the daughter of the suspect, was reportedly safe at another location.
The suspect was still at large Tuesday at 6 p.m.