Another top IRS official is leaving amid the growing scandal at the agency.

Joseph Grant, the commissioner of the agency's tax exempt and government entities division, will retire June 3, according to an IRS statement.