1660s, of birds, from white (adj.) + cap (n.). Attested from 1773 in reference to breaking waves, from 1818 of mushrooms, and from 1891 in reference to "one of a self-constituted band in U.S. who committed outrages under pretense of regulating public morals" [OED].
