Any IRS employee that treats a taxpayer differently or improperly because of their political beliefs has breached the public trust. They have proven they can't be trusted to do their job and deserve to be fired.
The threat of losing their job may prevent IRS employees from carrying out legitimate audits on taxpayers who have political backgrounds. Plus holding threats of firing over the heads of IRS employees is bad for agency morale.