House Majority Leader Eric Cantor (R-Va.) confirmed Friday afternoon that the Republican-led House will investigate the IRS's inappropriate targeting of conservative groups.

"The IRS cannot target or intimidate any individual or organization based on their political beliefs," Cantor said in a statement. "The House will investigate this matter."

During his daily media briefing, White House press secretary Jay Carney agreed that the matter warranted investigation.

"The president would expect that it would be investigated" and appropriate action taken, Carney said.

Previously, Senate Minority Leader Mitch McConnell (R-Ky.) called for a government-wide review of whether administration agencies have been politicized.