Richardson told "Good Morning America" that he felt the facts of the case didn't support a pardon.
Billy the Kid was shot to death in 1881 at the age of 21, just a few months after escaping from jail.
According to legend, he killed 21 people, one for each year of his life, but officials put the total closer to nine.
The Associated Press contributed to this report