Bono was born a woman and made the decision to become a man. He will be dancing with a woman on the show.
"We will not be able to watch the show with Chaz on there," said Monica Cole of the American Family Association. "This is going to be very confusing for children and should not be included in their cast."
Bono talked about the controversy Tuesday on Good Morning America.
"I'm going to be dancing, I'm not up on there talking about anything other than dancing," Bono said. "People who don't have gender dysphoria aren't going to catch it by watching me dance on television."
One psychiatrist is urging parents not to let their children watch the show, saying children might be vulnerable as they try to establish their own identities.
Leaders of the Lesbian Gay Bisexual Transgender community have denounced the statement.
"I think what he wrote is hateful," said Robin Tyler, director of the Equality Campaign. "I think he was very insulting and demeaning toward Chaz Bono and toward gay and lesbian people hiding behind psychiatry."
Tyler is planning to hold viewing and dance parties in several cities across the country to support Bono.