late 13c., "dwelling place of a hermit," from Old French hermitage, from Latin heremite (see hermit). Earlier in the same sense was hermitorie (c. 1200), from Medieval Latin hermitorium. Transferred sense of "solitary or secluded dwelling place" is from 1640s.