The country star was diagnosed with cancer in 2010 and underwent surgery. Despite his illness, he continued to schedule performances and even put out an album. He was one of several stars invited to a welcome home performance of the Grand Ole Opry last year after floods damaged the Opry house.
According to the Country Music Hall of Fame, the unique sound of Charlie and his brother, Ira, was highly influential in the history of the genre. The hall inducted them in 2001.
The brothers produced many hits including "I Don't Believe You've Met My Baby," "When I Stop Dreaming"; "Hoping That You're Hoping"; and "You're Running Wild."
Ira Louvin died in 1965, two years after the duo disbanded.
The Associated Press contributed to this report.