Fresno County authorities said they will not pursue charges against 30-year-old Kenneth Johnson.
Police said Johnson confessed to abusing the child at an apartment complex not far from Fresno State.
Johnson is the boyfriend of the child's babysitter. He reportedly told police he punched the child in the stomach because the baby would not stop crying.
Surveillance cameras caught Johnson leaving the complex around the time that the sitter called the police.