Of course, we know what he said either way.
Political insults have always been with us. This is one of the canonical examples. As overall interactions go, this one lacks some of the creativity and flair of bygone days (“Mr. Wilkes, I don’t know whether you’ll die on the gallows or of the pox!” “That depends, my lord, on whether I embrace your principles or your mistress.”) But it still gets the job done.