Another top IRS official is leaving amid the growing scandal at the agency.

Joseph Grant, the commissioner of the agency's tax exempt and government entities division, will retire June 3, according to an IRS statement.

Acting IRS commissioner Steven Miller resigned Wednesday. President Obama has appointed OMB official Daniel Werfel to replace him.

Grant heads the division of the agency responsible for tax-exempt organizations, where Lois Lerner works beneath him. Lerner was the official who initially disclosed the agency's wrongdoing last week and then struggled through a conference call with reporters.

Here's the IRS statement on Grant:

"Joseph Grant, Commissioner of Tax Exempt/Government Entities Division, has announced his plans to retire on June 3rd.  Before this position Joseph was the Deputy Commissioner, TE/GE. He joined the IRS in August 2005, as Director of the EP Rulings & Agreements division, became the Director of Employee Plans in 2006, and became TE/GE Deputy Commissioner in 2007.  Before that, he was the Chief Operating Officer and a Deputy Executive Director of the Pension Benefit Guaranty Corporation (PBGC). Joseph also served on the staff of the Oversight and Social Security subcommittees of the House Ways and Means Committee."