After the show several people complained to Ofcom, which has rapped TalkSport over a similar case before.
In November last year it ruled of the broadcasting code on impartiality in politics when phone-in host and MP George Galloway criticised a rival for the constituency of Poplar and Limehouse, Jim Fitzpatrick.
A TalkSport spokesman said Whale, who had been with the station for 12 years, had been "guilty of a gross error of judgment which we found to be totally unacceptable".
"After serious consideration, the station reached the decision that there was a clear breach of the rules and that we had no choice but to terminate his contract."
Max Rushton is filling in on Whale's 10pm-1am Sunday to Thursday show while TalkSport seeks a replacement.