On the eve of his trip to Charleston, S.C. for his “Rock Me Like a Herman Cain: South Cain-olina Primary Rally,” Stephen Colbert took to his Comedy Central late night show to express horror that his Super PAC — The Definitely Not Coordinating with Stephen Colbert Super PAC — was running ads against him.

Then he performed a “Carolina”-themed duet with James Taylor.

Here’s the video: