Referee Ron Cherry left No. 12 Southern California's game against Notre Dame after getting accidentally hit by a player late in the third quarter.