The Department of Justice said in a statement that the incident occurred during Holder's regular morning meeting with senior staff. At one point, the 63-year-old Holder wasn't feeling well and excused himself, walking out on his own, according to a Justice Department official.
An ambulance was called as a precaution, and Holder was taken to MedStar Washington Hospital Center to be evaluated.
"He is currently resting comfortably and in good condition," the department said in a statement, which also noted that Holder was alert and conversing with doctors.
Holder was released from the hospital at 1:15 p.m. ET.