Chinese State Media reported the boy climbed out of a window and fell with his head getting stuck between the window's guardrail.
The boy's grandfather was asleep, heard him crying and called for help.
Firefighters tied a security rope around the boy's chest while working to free him.
Neighbors held a blanket under him in case he fell.
The boy's condition was unknown.