I think ultimately they did fire him because his show sucks, the ratings suck and they were probably losing their ass.
This was just the excuse they could use to finally do it. But with him I do think it was an accumulation of ridiculous BS he put out there, not just this alone.