Sen. David Vitter, whose number appeared in a D.C. madam's phone records, once called Bill Clinton morally unfit to govern.