The blaze was about 65 percent contained as of Sunday morning.
The fire had forced hundreds to leave their homes Friday night, but most have returned. The blaze began Friday afternoon north of Highway 178 and grew quickly.
However, winds gusting over 40 mph are keeping water-dropping helicopters grounded and worries high.
The fire has blackened nearly 1,400 acres.
No injuries have been reported.
Lake Isabella is a recreational destination about 110 miles north of Los Angeles.