The 31-year-old is being held in lieu of $50,000 bail. His arraignment is expected later in the day.
Officials say someone carrying two large knives banged on Hilton's window. She posted a photo of the Tuesday arrest on Twitter and described it as "scary."
If convicted he could face up to six years in prison.