1610s, "unrefined, rough," from Latin impolitus "unpolished, rough, unrefined," from assimilated form of in- "not, opposite of" (see in- (1)) + politus "polished" (see polite). Sense of "discourteous, ill-mannered" is from 1739. Related: Impolitely; impoliteness.
