Judge John Cleland said no trial date is perfect but that "some dates are better than others." The trial is scheduled to begin on June 5.
The 68-year-old former Penn State assistant football coach is charged with 52 criminal counts involving 10 boys. Sandusky has denied the allegations.
Cleland said starting jury selection on Tuesday would, on balance, protect Sandusky's right to a fair trial, the alleged victims' rights to their day in court, the state's obligation to prosecute promptly and the public's expectation of a swift proceeding.
The charges against Sandusky concern his relationships with boys he met through his charity for at-risk kids, The Second Mile, between 1994 and 2008. Prosecutors say Sandusky sexually abused the kids and also gave them gifts.
Attorneys say some of the alleged abuse happened in the Penn State football team's facilities. The ensuing scandal led to the firing of coach Joe Paterno and the ouster of university President Graham Spanier.
The Associated Press contributed to this report.