Riverside County sheriff's deputies said they were calling for the man to get out of his home, which was located in the 18000 block of Clark Street, when they saw a plume of black smoke coming from the house.
The man threatened family members and was possibly armed with an ax.
Jerry Avila, 32, eventually walked out and surrendered. He faces charges of arson and making criminal threats.